2024-09-05T12:41:18.014 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-05T12:41:18.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T12:41:18.129 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462 branch: wip-bharath6-testing-2024-09-05-1413-squid description: fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} email: hyelloji@redhat.com first_in_suite: false job_id: '7890462' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath6-testing-2024-09-05-1413-squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request - SLOW_OPS - slow request sha1: e856d6b2462509a377ef39149a05475ed006ebac subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: e856d6b2462509a377ef39149a05475ed006ebac kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath6-testing-2024-09-05-1413-squid sha1: e856d6b2462509a377ef39149a05475ed006ebac owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8220 sha1: e856d6b2462509a377ef39149a05475ed006ebac sleep_before_teardown: 0 subset: 990/1024 suite: fs:workload suite_branch: wip-bharath6-testing-2024-09-05-1413-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_e856d6b2462509a377ef39149a05475ed006ebac/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: e856d6b2462509a377ef39149a05475ed006ebac syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC4RrGuWlMRI42chVBugtKXTfd7Px++35OjQ5LvzSWQdE8iL1gfYC9pt1eLwhl00sUnhw2Af1otSW02xJOAn12g= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1woieW6IFs6Z0ob8R4RX2eukUF6T/5ppgM9Po7vGArJ6ZaPkQ5XLr0nzf0KvmFrqFh5I0ox6kabHEHCATK05Y= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMq2S17+Zh2DENB1kGN48vKXdkqKdubQBQgItLp9+OL6XiB1K9S1RpAFHp8nGAA0j2G2yptC35Ob0yLrSkViKQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-05_11:20:21 tube: smithi user: hyelloji verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-05T12:41:18.130 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_e856d6b2462509a377ef39149a05475ed006ebac/qa; will attempt to use it 2024-09-05T12:41:18.130 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_e856d6b2462509a377ef39149a05475ed006ebac/qa/tasks 2024-09-05T12:41:18.131 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-05T12:41:18.132 INFO:teuthology.task.internal:Checking packages... 2024-09-05T12:41:18.154 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e856d6b2462509a377ef39149a05475ed006ebac' 2024-09-05T12:41:18.154 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-05T12:41:18.154 INFO:teuthology.packaging:ref: None 2024-09-05T12:41:18.154 INFO:teuthology.packaging:tag: None 2024-09-05T12:41:18.154 INFO:teuthology.packaging:branch: wip-bharath6-testing-2024-09-05-1413-squid 2024-09-05T12:41:18.154 INFO:teuthology.packaging:sha1: e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:41:18.154 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath6-testing-2024-09-05-1413-squid 2024-09-05T12:41:18.302 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-261.ge856d6b2 2024-09-05T12:41:18.304 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-05T12:41:18.310 INFO:teuthology.task.internal:no buildpackages task found 2024-09-05T12:41:18.311 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-05T12:41:18.330 INFO:teuthology.task.internal:Saving configuration 2024-09-05T12:41:18.350 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-05T12:41:18.357 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-05T12:41:18.382 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 12:36:05.076473', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC4RrGuWlMRI42chVBugtKXTfd7Px++35OjQ5LvzSWQdE8iL1gfYC9pt1eLwhl00sUnhw2Af1otSW02xJOAn12g='} 2024-09-05T12:41:18.405 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 12:36:05.078143', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1woieW6IFs6Z0ob8R4RX2eukUF6T/5ppgM9Po7vGArJ6ZaPkQ5XLr0nzf0KvmFrqFh5I0ox6kabHEHCATK05Y='} 2024-09-05T12:41:18.426 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 12:36:05.074508', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMq2S17+Zh2DENB1kGN48vKXdkqKdubQBQgItLp9+OL6XiB1K9S1RpAFHp8nGAA0j2G2yptC35Ob0yLrSkViKQ='} 2024-09-05T12:41:18.426 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-05T12:41:18.432 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-05T12:41:18.432 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-05T12:41:18.432 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-05T12:41:18.433 INFO:teuthology.run_tasks:Running task console_log... 2024-09-05T12:41:18.519 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7625037130>, signals=[15]) 2024-09-05T12:41:18.520 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-05T12:41:18.527 INFO:teuthology.task.internal:Opening connections... 2024-09-05T12:41:18.527 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-05T12:41:18.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T12:41:18.615 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-05T12:41:18.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T12:41:18.691 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-09-05T12:41:18.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T12:41:18.767 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-05T12:41:18.774 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-05T12:41:18.792 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-05T12:41:18.793 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T12:41:18.851 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-09-05T12:41:18.852 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T12:41:18.852 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T12:41:18.852 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T12:41:18.852 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-05T12:41:18.874 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-05T12:41:18.893 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-05T12:41:18.893 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-05T12:41:18.952 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-05T12:41:18.952 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-05T12:41:18.952 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-05T12:41:18.952 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-05T12:41:18.952 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-05T12:41:18.952 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-05T12:41:18.953 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T12:41:18.953 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-05T12:41:18.953 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-05T12:41:18.953 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T12:41:18.953 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-05T12:41:18.953 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T12:41:18.953 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T12:41:18.953 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T12:41:18.953 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-05T12:41:18.974 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-09-05T12:41:18.993 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-09-05T12:41:18.993 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-09-05T12:41:19.051 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-09-05T12:41:19.051 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-09-05T12:41:19.051 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-09-05T12:41:19.051 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-09-05T12:41:19.051 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-09-05T12:41:19.051 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-09-05T12:41:19.052 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T12:41:19.052 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-09-05T12:41:19.052 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-09-05T12:41:19.052 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T12:41:19.052 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-09-05T12:41:19.052 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T12:41:19.052 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T12:41:19.052 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T12:41:19.052 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-09-05T12:41:19.082 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-05T12:41:19.093 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-05T12:41:19.101 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-05T12:41:19.101 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-05T12:41:19.104 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-05T12:41:19.106 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-09-05T12:41:19.123 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-05T12:41:19.130 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-05T12:41:19.130 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-05T12:41:19.161 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-05T12:41:19.164 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-09-05T12:41:19.269 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-05T12:41:19.339 INFO:teuthology.run_tasks:Running task kernel... 2024-09-05T12:41:19.354 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '8ad8b8b160987a14eb199bb67cc00e23a08d43f6'} 2024-09-05T12:41:19.354 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-05T12:41:19.354 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-05T12:41:19.355 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T12:41:19.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T12:41:19.372 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-05T12:41:19.430 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-503.el9.x86_64 2024-09-05T12:41:19.430 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-503.el9.x86_64 2024-09-05T12:41:19.431 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-09-05T12:41:23.383 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.2 MB 00:02 2024-09-05T12:41:25.309 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-05T12:41:29.793 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.5 MB 00:00 2024-09-05T12:41:31.311 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-05T12:41:32.115 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-05T12:41:37.587 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-05T12:41:39.560 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-05T12:41:39.560 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-05T12:41:39.643 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-05T12:41:39.645 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-05T12:41:39.645 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-05T12:41:39.763 DEBUG:teuthology.orchestra.run.smithi073:> echo no | sudo yum reinstall kernel || true 2024-09-05T12:41:40.302 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:03 ago on Thu 05 Sep 2024 12:41:37 PM UTC. 2024-09-05T12:41:40.447 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-05T12:41:40.458 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-05T12:41:40.458 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-05T12:41:40.458 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-05T12:41:40.458 INFO:teuthology.orchestra.run.smithi073.stdout:Reinstalling: 2024-09-05T12:41:40.458 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-05T12:41:40.458 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:41:40.458 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-05T12:41:40.459 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-05T12:41:40.459 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:41:40.459 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 1.9 M 2024-09-05T12:41:40.459 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 0 2024-09-05T12:41:40.459 INFO:teuthology.orchestra.run.smithi073.stderr:Operation aborted. 2024-09-05T12:41:40.522 INFO:teuthology.orchestra.run.smithi073.stdout:Is this ok [y/N]: 2024-09-05T12:41:40.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum reinstall -y kernel || true 2024-09-05T12:41:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:04 ago on Thu 05 Sep 2024 12:41:37 PM UTC. 2024-09-05T12:41:41.189 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-05T12:41:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-05T12:41:41.190 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-05T12:41:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-05T12:41:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:Reinstalling: 2024-09-05T12:41:41.190 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-05T12:41:41.190 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:41:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-05T12:41:41.190 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-05T12:41:41.190 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:41:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 1.9 M 2024-09-05T12:41:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 0 2024-09-05T12:41:41.191 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-05T12:41:41.914 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-503.el9.x86_64.rpm 2.8 MB/s | 1.9 MB 00:00 2024-09-05T12:41:41.914 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-05T12:41:41.914 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.6 MB/s | 1.9 MB 00:00 2024-09-05T12:41:41.943 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-05T12:41:42.184 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-05T12:41:42.184 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-05T12:41:42.214 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-05T12:41:42.215 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-05T12:41:42.390 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-05T12:41:42.491 INFO:teuthology.orchestra.run.smithi073.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-05T12:41:42.491 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-05T12:41:43.189 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-09-05T12:41:43.189 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-05T12:41:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-05T12:41:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:41:43.924 INFO:teuthology.orchestra.run.smithi073.stdout:Reinstalled: 2024-09-05T12:41:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-503.el9.x86_64 2024-09-05T12:41:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:41:43.924 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-05T12:41:44.104 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-05T12:41:44.162 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-503.el9.x86_64 2024-09-05T12:41:44.162 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-09-05T12:41:44.162 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-09-05T12:41:44.162 DEBUG:teuthology.parallel:result is None 2024-09-05T12:41:44.163 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-05T12:41:44.170 INFO:teuthology.task.internal:Creating test directory... 2024-09-05T12:41:44.170 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T12:41:44.172 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T12:41:44.175 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T12:41:44.193 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-05T12:41:44.199 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-05T12:41:44.206 INFO:teuthology.task.internal:Creating archive directory... 2024-09-05T12:41:44.206 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T12:41:44.228 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T12:41:44.233 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T12:41:44.332 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-05T12:41:44.339 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-05T12:41:44.339 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T12:41:44.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T12:41:44.357 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T12:41:44.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T12:41:44.374 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T12:41:44.376 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T12:41:44.400 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T12:41:44.427 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T12:41:44.439 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T12:41:44.444 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T12:41:44.449 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T12:41:44.463 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T12:41:44.479 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T12:41:44.480 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-05T12:41:44.488 INFO:teuthology.task.internal:Configuring sudo... 2024-09-05T12:41:44.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T12:41:44.490 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T12:41:44.523 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T12:41:44.550 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-05T12:41:44.607 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-05T12:41:44.607 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T12:41:44.610 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T12:41:44.612 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T12:41:44.629 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T12:41:44.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T12:41:44.752 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T12:41:44.829 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T12:41:44.874 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:41:44.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T12:41:44.939 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T12:41:44.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T12:41:45.033 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T12:41:45.118 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T12:41:45.161 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:41:45.161 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T12:41:45.228 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T12:41:45.274 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T12:41:45.322 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T12:41:45.409 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T12:41:45.452 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:41:45.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T12:41:45.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-05T12:41:45.524 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-05T12:41:45.526 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-09-05T12:41:45.557 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T12:41:45.565 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T12:41:45.601 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T12:41:46.047 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-05T12:41:46.054 INFO:teuthology.task.internal:Starting timer... 2024-09-05T12:41:46.054 INFO:teuthology.run_tasks:Running task pcp... 2024-09-05T12:41:46.064 INFO:teuthology.run_tasks:Running task selinux... 2024-09-05T12:41:46.072 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-05T12:41:46.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-09-05T12:41:46.142 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-09-05T12:41:46.144 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-05T12:41:46.208 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-05T12:41:46.210 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-09-05T12:41:46.274 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-09-05T12:41:46.276 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-05T12:41:46.276 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-09-05T12:41:46.295 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-09-05T12:41:46.295 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-05T12:41:46.318 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-05T12:41:46.319 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-09-05T12:41:46.348 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-09-05T12:41:46.348 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2024-09-05T12:41:46.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T12:41:46.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T12:41:46.374 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T12:41:46.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T12:41:46.404 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T12:41:46.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T12:41:46.432 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-05T12:41:46.433 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-09-05T12:41:46.462 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-05T12:41:46.499 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-09-05T12:41:46.538 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-05T12:41:46.547 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-05T12:41:46.550 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-05T12:41:46.664 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-05T12:41:46.675 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-05T12:41:46.676 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi162.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-05T12:45:45.794 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-09-05T12:45:45.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-05T12:45:45.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T12:45:45.873 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-05T12:45:45.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-05T12:45:45.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-05T12:45:45.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T12:45:46.026 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-05T12:45:46.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-05T12:45:46.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-05T12:45:46.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T12:45:46.182 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-05T12:45:46.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-05T12:45:46.257 INFO:teuthology.run_tasks:Running task clock... 2024-09-05T12:45:46.266 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-05T12:45:46.266 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T12:45:46.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T12:45:46.269 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T12:45:46.269 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T12:45:46.271 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T12:45:46.272 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T12:45:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T12:45:46.298 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T12:45:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T12:45:46.313 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T12:45:46.327 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T12:45:46.337 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-09-05T12:45:46.338 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-05T12:45:46.341 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T12:45:46.348 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-09-05T12:45:46.349 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-05T12:45:46.362 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T12:45:46.363 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T12:45:46.366 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-09-05T12:45:46.376 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T12:45:46.377 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T12:45:46.378 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-09-05T12:45:46.392 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T12:45:46.406 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T12:45:46.431 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-05T12:45:46.434 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T12:45:46.435 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-05T12:45:46.435 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.435 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.435 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.435 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.443 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-05T12:45:46.446 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T12:45:46.446 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-05T12:45:46.446 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.446 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.446 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.447 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.463 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-05T12:45:46.467 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T12:45:46.467 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-05T12:45:46.467 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.467 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.467 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.467 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T12:45:46.468 INFO:teuthology.run_tasks:Running task install... 2024-09-05T12:45:46.475 DEBUG:teuthology.task.install:project ceph 2024-09-05T12:45:46.475 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e856d6b2462509a377ef39149a05475ed006ebac'}} 2024-09-05T12:45:46.475 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e856d6b2462509a377ef39149a05475ed006ebac'} 2024-09-05T12:45:46.475 INFO:teuthology.task.install:Using flavor: default 2024-09-05T12:45:46.481 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-05T12:45:46.481 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-05T12:45:46.482 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e856d6b2462509a377ef39149a05475ed006ebac', 'tag': None, 'wait_for_package': False} 2024-09-05T12:45:46.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:45:46.484 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e856d6b2462509a377ef39149a05475ed006ebac', 'tag': None, 'wait_for_package': False} 2024-09-05T12:45:46.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:45:46.485 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e856d6b2462509a377ef39149a05475ed006ebac', 'tag': None, 'wait_for_package': False} 2024-09-05T12:45:46.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:45:46.634 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/ 2024-09-05T12:45:46.635 INFO:teuthology.task.install.rpm:Package version is 19.1.1-261.ge856d6b2 2024-09-05T12:45:46.640 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/ 2024-09-05T12:45:46.640 INFO:teuthology.task.install.rpm:Package version is 19.1.1-261.ge856d6b2 2024-09-05T12:45:46.645 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/ 2024-09-05T12:45:46.645 INFO:teuthology.task.install.rpm:Package version is 19.1.1-261.ge856d6b2 2024-09-05T12:45:46.747 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T12:45:46.747 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:45:46.747 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T12:45:46.760 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T12:45:46.760 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:45:46.760 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T12:45:46.763 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T12:45:46.763 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:45:46.763 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T12:45:46.774 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T12:45:46.774 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e856d6b2462509a377ef39149a05475ed006ebac/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T12:45:46.787 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T12:45:46.787 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e856d6b2462509a377ef39149a05475ed006ebac/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T12:45:46.791 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T12:45:46.791 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e856d6b2462509a377ef39149a05475ed006ebac/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T12:45:46.840 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T12:45:46.853 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T12:45:46.858 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T12:45:46.916 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T12:45:46.929 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T12:45:46.934 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T12:45:46.981 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-09-05T12:45:46.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-09-05T12:45:46.993 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-05T12:45:46.995 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-05T12:45:46.998 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-09-05T12:45:47.000 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-09-05T12:45:47.207 INFO:teuthology.orchestra.run.smithi073.stdout:45 files removed 2024-09-05T12:45:47.221 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-05T12:45:47.224 INFO:teuthology.orchestra.run.smithi169.stdout:45 files removed 2024-09-05T12:45:47.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T12:45:47.249 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T12:45:47.252 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T12:45:47.787 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-05T12:45:47.802 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-05T12:45:47.803 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-09-05T12:45:48.071 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-05T12:45:48.086 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-05T12:45:48.087 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-05T12:45:48.338 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-09-05T12:45:48.347 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-05T12:45:48.363 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-05T12:45:48.980 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-05T12:45:49.154 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-05T12:45:49.888 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.2 MB 00:01 2024-09-05T12:45:52.997 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 20 MB 00:02 2024-09-05T12:45:53.714 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 20 MB 00:03 2024-09-05T12:45:56.688 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 3.6 MB/s | 20 MB 00:05 2024-09-05T12:45:57.347 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-05T12:45:57.965 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-05T12:45:58.773 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-05T12:45:59.458 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-05T12:45:59.827 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-05T12:46:00.361 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-05T12:46:02.272 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-05T12:46:03.742 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-05T12:46:04.779 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-05T12:46:05.275 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-05T12:46:05.842 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-05T12:46:07.501 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T12:46:07.502 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T12:46:07.513 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T12:46:07.514 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T12:46:07.515 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T12:46:07.515 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T12:46:07.517 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T12:46:07.519 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T12:46:07.520 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T12:46:07.582 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-05T12:46:07.606 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-05T12:46:07.606 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-09-05T12:46:07.606 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-05T12:46:07.606 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-09-05T12:46:07.606 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T12:46:07.606 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 6.6 k 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 5.4 M 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 893 k 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 145 k 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 1.5 M 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 146 k 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 3.6 M 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 7.4 M 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 49 k 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 11 M 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 49 M 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 285 k 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 765 k 2024-09-05T12:46:07.607 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 222 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 27 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 18 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 32 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 749 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 127 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T12:46:07.608 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 162 k 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 320 k 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 300 k 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 99 k 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 85 k 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 3.1 M 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 170 k 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T12:46:07.609 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 3.4 M 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 3.2 M 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 21 M 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 32 k 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 2.4 M 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 249 k 2024-09-05T12:46:07.610 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 4.7 M 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 17 M 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 16 k 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 25 k 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 163 k 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T12:46:07.611 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 503 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 5.3 M 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T12:46:07.612 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 45 k 2024-09-05T12:46:07.613 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 136 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T12:46:07.614 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T12:46:07.615 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T12:46:07.616 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T12:46:07.617 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout:Install 148 Packages 2024-09-05T12:46:07.618 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 6 Packages 2024-09-05T12:46:07.619 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:07.619 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 222 M 2024-09-05T12:46:07.619 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-09-05T12:46:08.086 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T12:46:08.086 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T12:46:08.098 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T12:46:08.099 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T12:46:08.099 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T12:46:08.100 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T12:46:08.102 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T12:46:08.105 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T12:46:08.105 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T12:46:08.169 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-05T12:46:08.177 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-09-05T12:46:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-05T12:46:08.177 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 6.6 k 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 5.4 M 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 893 k 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 145 k 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 1.5 M 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 146 k 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 3.6 M 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 7.4 M 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 49 k 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 11 M 2024-09-05T12:46:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 49 M 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 285 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 765 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 222 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 27 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 18 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 32 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 749 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 127 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T12:46:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 162 k 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 320 k 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 300 k 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 99 k 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 85 k 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 3.1 M 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 170 k 2024-09-05T12:46:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 3.4 M 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 3.2 M 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 21 M 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 32 k 2024-09-05T12:46:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 2.4 M 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 249 k 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 4.7 M 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 17 M 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 16 k 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 25 k 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T12:46:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 163 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 503 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 5.3 M 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T12:46:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 45 k 2024-09-05T12:46:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 136 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T12:46:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T12:46:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T12:46:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T12:46:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-05T12:46:08.189 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-09-05T12:46:08.190 INFO:teuthology.orchestra.run.smithi073.stdout:Install 148 Packages 2024-09-05T12:46:08.190 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 6 Packages 2024-09-05T12:46:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:46:08.190 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 222 M 2024-09-05T12:46:08.190 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-05T12:46:08.584 INFO:teuthology.orchestra.run.smithi169.stdout:(1/154): ceph-19.1.1-261.ge856d6b2.el9.x86_64.r 51 kB/s | 6.6 kB 00:00 2024-09-05T12:46:08.835 INFO:teuthology.orchestra.run.smithi169.stdout:(2/154): ceph-fuse-19.1.1-261.ge856d6b2.el9.x86 3.5 MB/s | 893 kB 00:00 2024-09-05T12:46:08.927 INFO:teuthology.orchestra.run.smithi169.stdout:(3/154): ceph-base-19.1.1-261.ge856d6b2.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-05T12:46:08.952 INFO:teuthology.orchestra.run.smithi169.stdout:(4/154): ceph-immutable-object-cache-19.1.1-261 1.2 MB/s | 145 kB 00:00 2024-09-05T12:46:08.969 INFO:teuthology.orchestra.run.smithi073.stdout:(1/154): ceph-19.1.1-261.ge856d6b2.el9.x86_64.r 31 kB/s | 6.6 kB 00:00 2024-09-05T12:46:09.044 INFO:teuthology.orchestra.run.smithi169.stdout:(5/154): ceph-mds-19.1.1-261.ge856d6b2.el9.x86_ 20 MB/s | 2.4 MB 00:00 2024-09-05T12:46:09.194 INFO:teuthology.orchestra.run.smithi169.stdout:(6/154): ceph-mgr-19.1.1-261.ge856d6b2.el9.x86_ 6.3 MB/s | 1.5 MB 00:00 2024-09-05T12:46:09.320 INFO:teuthology.orchestra.run.smithi169.stdout:(7/154): ceph-mon-19.1.1-261.ge856d6b2.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-05T12:46:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:(2/154): ceph-fuse-19.1.1-261.ge856d6b2.el9.x86 1.3 MB/s | 893 kB 00:00 2024-09-05T12:46:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:(3/154): ceph-immutable-object-cache-19.1.1-261 1.9 MB/s | 145 kB 00:00 2024-09-05T12:46:09.753 INFO:teuthology.orchestra.run.smithi169.stdout:(8/154): ceph-common-19.1.1-261.ge856d6b2.el9.x 16 MB/s | 21 MB 00:01 2024-09-05T12:46:09.903 INFO:teuthology.orchestra.run.smithi169.stdout:(9/154): ceph-radosgw-19.1.1-261.ge856d6b2.el9. 18 MB/s | 11 MB 00:00 2024-09-05T12:46:09.928 INFO:teuthology.orchestra.run.smithi169.stdout:(10/154): ceph-selinux-19.1.1-261.ge856d6b2.el9 144 kB/s | 25 kB 00:00 2024-09-05T12:46:10.104 INFO:teuthology.orchestra.run.smithi169.stdout:(11/154): cephfs-mirror-19.1.1-261.ge856d6b2.el 1.2 MB/s | 222 kB 00:00 2024-09-05T12:46:10.171 INFO:teuthology.orchestra.run.smithi169.stdout:(12/154): cephfs-shell-19.1.1-261.ge856d6b2.el9 406 kB/s | 27 kB 00:00 2024-09-05T12:46:10.201 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-05T12:46:10.254 INFO:teuthology.orchestra.run.smithi169.stdout:(13/154): libcephfs-devel-19.1.1-261.ge856d6b2. 382 kB/s | 32 kB 00:00 2024-09-05T12:46:10.396 INFO:teuthology.orchestra.run.smithi169.stdout:(14/154): libcephfs2-19.1.1-261.ge856d6b2.el9.x 5.2 MB/s | 749 kB 00:00 2024-09-05T12:46:10.403 INFO:teuthology.orchestra.run.smithi073.stdout:(4/154): ceph-mds-19.1.1-261.ge856d6b2.el9.x86_ 3.4 MB/s | 2.4 MB 00:00 2024-09-05T12:46:10.471 INFO:teuthology.orchestra.run.smithi169.stdout:(15/154): libcephsqlite-19.1.1-261.ge856d6b2.el 2.1 MB/s | 163 kB 00:00 2024-09-05T12:46:10.486 INFO:teuthology.orchestra.run.smithi073.stdout:(5/154): ceph-base-19.1.1-261.ge856d6b2.el9.x86 3.1 MB/s | 5.4 MB 00:01 2024-09-05T12:46:10.538 INFO:teuthology.orchestra.run.smithi169.stdout:(16/154): librados-devel-19.1.1-261.ge856d6b2.e 1.9 MB/s | 127 kB 00:00 2024-09-05T12:46:10.631 INFO:teuthology.orchestra.run.smithi169.stdout:(17/154): libradosstriper1-19.1.1-261.ge856d6b2 5.4 MB/s | 503 kB 00:00 2024-09-05T12:46:10.797 INFO:teuthology.orchestra.run.smithi169.stdout:(18/154): ceph-osd-19.1.1-261.ge856d6b2.el9.x86 11 MB/s | 17 MB 00:01 2024-09-05T12:46:10.873 INFO:teuthology.orchestra.run.smithi169.stdout:(19/154): python3-ceph-argparse-19.1.1-261.ge85 605 kB/s | 45 kB 00:00 2024-09-05T12:46:10.964 INFO:teuthology.orchestra.run.smithi169.stdout:(20/154): python3-ceph-common-19.1.1-261.ge856d 1.4 MB/s | 136 kB 00:00 2024-09-05T12:46:11.040 INFO:teuthology.orchestra.run.smithi169.stdout:(21/154): python3-cephfs-19.1.1-261.ge856d6b2.e 2.1 MB/s | 162 kB 00:00 2024-09-05T12:46:11.132 INFO:teuthology.orchestra.run.smithi169.stdout:(22/154): librgw2-19.1.1-261.ge856d6b2.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-05T12:46:11.157 INFO:teuthology.orchestra.run.smithi169.stdout:(23/154): python3-rados-19.1.1-261.ge856d6b2.el 2.7 MB/s | 320 kB 00:00 2024-09-05T12:46:11.170 INFO:teuthology.orchestra.run.smithi073.stdout:(6/154): ceph-common-19.1.1-261.ge856d6b2.el9.x 8.8 MB/s | 21 MB 00:02 2024-09-05T12:46:11.182 INFO:teuthology.orchestra.run.smithi169.stdout:(24/154): python3-rbd-19.1.1-261.ge856d6b2.el9. 5.9 MB/s | 300 kB 00:00 2024-09-05T12:46:11.208 INFO:teuthology.orchestra.run.smithi169.stdout:(25/154): python3-rgw-19.1.1-261.ge856d6b2.el9. 1.9 MB/s | 99 kB 00:00 2024-09-05T12:46:11.227 INFO:teuthology.orchestra.run.smithi073.stdout:(7/154): ceph-mgr-19.1.1-261.ge856d6b2.el9.x86_ 1.8 MB/s | 1.5 MB 00:00 2024-09-05T12:46:11.233 INFO:teuthology.orchestra.run.smithi169.stdout:(26/154): rbd-fuse-19.1.1-261.ge856d6b2.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-05T12:46:11.292 INFO:teuthology.orchestra.run.smithi169.stdout:(27/154): rbd-nbd-19.1.1-261.ge856d6b2.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-05T12:46:11.304 INFO:teuthology.orchestra.run.smithi073.stdout:(8/154): ceph-mon-19.1.1-261.ge856d6b2.el9.x86_ 5.8 MB/s | 4.7 MB 00:00 2024-09-05T12:46:11.367 INFO:teuthology.orchestra.run.smithi169.stdout:(28/154): ceph-grafana-dashboards-19.1.1-261.ge 425 kB/s | 32 kB 00:00 2024-09-05T12:46:11.387 INFO:teuthology.orchestra.run.smithi073.stdout:(9/154): ceph-selinux-19.1.1-261.ge856d6b2.el9. 303 kB/s | 25 kB 00:00 2024-09-05T12:46:11.475 INFO:teuthology.orchestra.run.smithi169.stdout:(29/154): rbd-mirror-19.1.1-261.ge856d6b2.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-05T12:46:11.501 INFO:teuthology.orchestra.run.smithi169.stdout:(30/154): ceph-mgr-cephadm-19.1.1-261.ge856d6b2 1.1 MB/s | 146 kB 00:00 2024-09-05T12:46:11.884 INFO:teuthology.orchestra.run.smithi169.stdout:(31/154): ceph-mgr-dashboard-19.1.1-261.ge856d6 8.7 MB/s | 3.6 MB 00:00 2024-09-05T12:46:12.351 INFO:teuthology.orchestra.run.smithi169.stdout:(32/154): ceph-test-19.1.1-261.ge856d6b2.el9.x8 20 MB/s | 49 MB 00:02 2024-09-05T12:46:12.376 INFO:teuthology.orchestra.run.smithi169.stdout:(33/154): ceph-mgr-modules-core-19.1.1-261.ge85 507 kB/s | 249 kB 00:00 2024-09-05T12:46:12.402 INFO:teuthology.orchestra.run.smithi169.stdout:(34/154): ceph-mgr-rook-19.1.1-261.ge856d6b2.el 991 kB/s | 49 kB 00:00 2024-09-05T12:46:12.435 INFO:teuthology.orchestra.run.smithi169.stdout:(35/154): ceph-prometheus-alerts-19.1.1-261.ge8 281 kB/s | 16 kB 00:00 2024-09-05T12:46:12.438 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T12:46:12.440 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T12:46:12.453 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T12:46:12.454 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T12:46:12.455 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T12:46:12.456 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T12:46:12.458 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T12:46:12.461 INFO:teuthology.orchestra.run.smithi169.stdout:(36/154): ceph-volume-19.1.1-261.ge856d6b2.el9. 4.7 MB/s | 285 kB 00:00 2024-09-05T12:46:12.461 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T12:46:12.462 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T12:46:12.526 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-05T12:46:12.537 INFO:teuthology.orchestra.run.smithi073.stdout:(10/154): ceph-osd-19.1.1-261.ge856d6b2.el9.x86 12 MB/s | 17 MB 00:01 2024-09-05T12:46:12.544 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-05T12:46:12.544 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-05T12:46:12.544 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-05T12:46:12.544 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-05T12:46:12.544 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T12:46:12.544 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 6.6 k 2024-09-05T12:46:12.544 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 5.4 M 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 893 k 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 145 k 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 1.5 M 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 146 k 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 3.6 M 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 7.4 M 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 49 k 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 11 M 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 49 M 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 285 k 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 765 k 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 222 k 2024-09-05T12:46:12.545 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 27 k 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 18 k 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 32 k 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 749 k 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 127 k 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T12:46:12.546 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 162 k 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 320 k 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 300 k 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 99 k 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 85 k 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 3.1 M 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 170 k 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T12:46:12.547 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 3.4 M 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 3.2 M 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 21 M 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 32 k 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 2.4 M 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 249 k 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 4.7 M 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 17 M 2024-09-05T12:46:12.548 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.1.1-261.ge856d6b2.el9 ceph-noarch 16 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 25 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 163 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T12:46:12.549 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 503 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 5.3 M 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T12:46:12.550 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 45 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.1.1-261.ge856d6b2.el9 ceph 136 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T12:46:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T12:46:12.552 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T12:46:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T12:46:12.554 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T12:46:12.555 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout:Install 148 Packages 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 6 Packages 2024-09-05T12:46:12.556 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:46:12.557 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 222 M 2024-09-05T12:46:12.557 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-05T12:46:12.570 INFO:teuthology.orchestra.run.smithi169.stdout:(37/154): ceph-mgr-diskprediction-local-19.1.1- 6.9 MB/s | 7.4 MB 00:01 2024-09-05T12:46:12.587 INFO:teuthology.orchestra.run.smithi073.stdout:(11/154): cephfs-mirror-19.1.1-261.ge856d6b2.el 4.4 MB/s | 222 kB 00:00 2024-09-05T12:46:12.595 INFO:teuthology.orchestra.run.smithi169.stdout:(38/154): cephfs-top-19.1.1-261.ge856d6b2.el9.n 137 kB/s | 18 kB 00:00 2024-09-05T12:46:12.620 INFO:teuthology.orchestra.run.smithi169.stdout:(39/154): cephadm-19.1.1-261.ge856d6b2.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-05T12:46:12.638 INFO:teuthology.orchestra.run.smithi073.stdout:(12/154): cephfs-shell-19.1.1-261.ge856d6b2.el9 541 kB/s | 27 kB 00:00 2024-09-05T12:46:12.688 INFO:teuthology.orchestra.run.smithi073.stdout:(13/154): libcephfs-devel-19.1.1-261.ge856d6b2. 635 kB/s | 32 kB 00:00 2024-09-05T12:46:12.745 INFO:teuthology.orchestra.run.smithi169.stdout:(40/154): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-05T12:46:12.764 INFO:teuthology.orchestra.run.smithi073.stdout:(14/154): libcephfs2-19.1.1-261.ge856d6b2.el9.x 9.8 MB/s | 749 kB 00:00 2024-09-05T12:46:12.779 INFO:teuthology.orchestra.run.smithi169.stdout:(41/154): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-05T12:46:12.814 INFO:teuthology.orchestra.run.smithi073.stdout:(15/154): libcephsqlite-19.1.1-261.ge856d6b2.el 3.2 MB/s | 163 kB 00:00 2024-09-05T12:46:12.837 INFO:teuthology.orchestra.run.smithi169.stdout:(42/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-05T12:46:12.856 INFO:teuthology.orchestra.run.smithi073.stdout:(16/154): librados-devel-19.1.1-261.ge856d6b2.e 3.0 MB/s | 127 kB 00:00 2024-09-05T12:46:12.863 INFO:teuthology.orchestra.run.smithi169.stdout:(43/154): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-05T12:46:12.888 INFO:teuthology.orchestra.run.smithi169.stdout:(44/154): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-05T12:46:12.913 INFO:teuthology.orchestra.run.smithi169.stdout:(45/154): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-05T12:46:12.923 INFO:teuthology.orchestra.run.smithi073.stdout:(17/154): libradosstriper1-19.1.1-261.ge856d6b2 7.4 MB/s | 503 kB 00:00 2024-09-05T12:46:12.938 INFO:teuthology.orchestra.run.smithi169.stdout:(46/154): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-05T12:46:12.964 INFO:teuthology.orchestra.run.smithi169.stdout:(47/154): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-05T12:46:12.997 INFO:teuthology.orchestra.run.smithi169.stdout:(48/154): python3-cryptography-36.0.1-4.el9.x86 5.6 MB/s | 1.2 MB 00:00 2024-09-05T12:46:13.040 INFO:teuthology.orchestra.run.smithi169.stdout:(49/154): automake-1.16.2-8.el9.noarch.rpm 6.7 MB/s | 689 kB 00:00 2024-09-05T12:46:13.065 INFO:teuthology.orchestra.run.smithi169.stdout:(50/154): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-05T12:46:13.090 INFO:teuthology.orchestra.run.smithi169.stdout:(51/154): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-05T12:46:13.119 INFO:teuthology.orchestra.run.smithi162.stdout:(1/154): ceph-19.1.1-261.ge856d6b2.el9.x86_64.r 36 kB/s | 6.6 kB 00:00 2024-09-05T12:46:13.149 INFO:teuthology.orchestra.run.smithi169.stdout:(52/154): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-05T12:46:13.174 INFO:teuthology.orchestra.run.smithi169.stdout:(53/154): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-05T12:46:13.200 INFO:teuthology.orchestra.run.smithi169.stdout:(54/154): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-05T12:46:13.224 INFO:teuthology.orchestra.run.smithi169.stdout:(55/154): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-05T12:46:13.240 INFO:teuthology.orchestra.run.smithi073.stdout:(18/154): librgw2-19.1.1-261.ge856d6b2.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-05T12:46:13.241 INFO:teuthology.orchestra.run.smithi169.stdout:(56/154): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-05T12:46:13.275 INFO:teuthology.orchestra.run.smithi169.stdout:(57/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-05T12:46:13.300 INFO:teuthology.orchestra.run.smithi169.stdout:(58/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-05T12:46:13.324 INFO:teuthology.orchestra.run.smithi073.stdout:(19/154): python3-ceph-argparse-19.1.1-261.ge85 542 kB/s | 45 kB 00:00 2024-09-05T12:46:13.359 INFO:teuthology.orchestra.run.smithi169.stdout:(59/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-05T12:46:13.369 INFO:teuthology.orchestra.run.smithi162.stdout:(2/154): ceph-fuse-19.1.1-261.ge856d6b2.el9.x86 3.5 MB/s | 893 kB 00:00 2024-09-05T12:46:13.384 INFO:teuthology.orchestra.run.smithi169.stdout:(60/154): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-05T12:46:13.409 INFO:teuthology.orchestra.run.smithi169.stdout:(61/154): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-05T12:46:13.423 INFO:teuthology.orchestra.run.smithi073.stdout:(20/154): python3-ceph-common-19.1.1-261.ge856d 1.3 MB/s | 136 kB 00:00 2024-09-05T12:46:13.426 INFO:teuthology.orchestra.run.smithi169.stdout:(62/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-05T12:46:13.460 INFO:teuthology.orchestra.run.smithi169.stdout:(63/154): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-05T12:46:13.461 INFO:teuthology.orchestra.run.smithi162.stdout:(3/154): ceph-immutable-object-cache-19.1.1-261 1.6 MB/s | 145 kB 00:00 2024-09-05T12:46:13.485 INFO:teuthology.orchestra.run.smithi169.stdout:(64/154): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-05T12:46:13.511 INFO:teuthology.orchestra.run.smithi169.stdout:(65/154): openblas-0.3.26-2.el9.x86_64.rpm 764 kB/s | 38 kB 00:00 2024-09-05T12:46:13.515 INFO:teuthology.orchestra.run.smithi073.stdout:(21/154): python3-cephfs-19.1.1-261.ge856d6b2.e 1.7 MB/s | 162 kB 00:00 2024-09-05T12:46:13.536 INFO:teuthology.orchestra.run.smithi169.stdout:(66/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-05T12:46:13.536 INFO:teuthology.orchestra.run.smithi162.stdout:(4/154): ceph-base-19.1.1-261.ge856d6b2.el9.x86 9.0 MB/s | 5.4 MB 00:00 2024-09-05T12:46:13.591 INFO:teuthology.orchestra.run.smithi073.stdout:(22/154): python3-rados-19.1.1-261.ge856d6b2.el 4.2 MB/s | 320 kB 00:00 2024-09-05T12:46:13.603 INFO:teuthology.orchestra.run.smithi169.stdout:(67/154): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-05T12:46:13.653 INFO:teuthology.orchestra.run.smithi162.stdout:(5/154): ceph-mgr-19.1.1-261.ge856d6b2.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-05T12:46:13.678 INFO:teuthology.orchestra.run.smithi169.stdout:(68/154): openblas-openmp-0.3.26-2.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-09-05T12:46:13.691 INFO:teuthology.orchestra.run.smithi073.stdout:(23/154): python3-rbd-19.1.1-261.ge856d6b2.el9. 2.9 MB/s | 300 kB 00:00 2024-09-05T12:46:13.737 INFO:teuthology.orchestra.run.smithi169.stdout:(69/154): openssl-devel-3.2.2-4.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-05T12:46:13.753 INFO:teuthology.orchestra.run.smithi169.stdout:(70/154): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-05T12:46:13.766 INFO:teuthology.orchestra.run.smithi073.stdout:(24/154): python3-rgw-19.1.1-261.ge856d6b2.el9. 1.3 MB/s | 99 kB 00:00 2024-09-05T12:46:13.795 INFO:teuthology.orchestra.run.smithi169.stdout:(71/154): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-05T12:46:13.829 INFO:teuthology.orchestra.run.smithi169.stdout:(72/154): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-05T12:46:13.846 INFO:teuthology.orchestra.run.smithi169.stdout:(73/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-05T12:46:13.858 INFO:teuthology.orchestra.run.smithi073.stdout:(25/154): rbd-fuse-19.1.1-261.ge856d6b2.el9.x86 931 kB/s | 85 kB 00:00 2024-09-05T12:46:13.870 INFO:teuthology.orchestra.run.smithi162.stdout:(6/154): ceph-mds-19.1.1-261.ge856d6b2.el9.x86_ 5.8 MB/s | 2.4 MB 00:00 2024-09-05T12:46:13.888 INFO:teuthology.orchestra.run.smithi169.stdout:(74/154): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-05T12:46:13.946 INFO:teuthology.orchestra.run.smithi162.stdout:(7/154): ceph-mon-19.1.1-261.ge856d6b2.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-09-05T12:46:13.963 INFO:teuthology.orchestra.run.smithi169.stdout:(75/154): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-05T12:46:13.988 INFO:teuthology.orchestra.run.smithi169.stdout:(76/154): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-05T12:46:14.014 INFO:teuthology.orchestra.run.smithi169.stdout:(77/154): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-05T12:46:14.039 INFO:teuthology.orchestra.run.smithi169.stdout:(78/154): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-05T12:46:14.064 INFO:teuthology.orchestra.run.smithi169.stdout:(79/154): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-05T12:46:14.089 INFO:teuthology.orchestra.run.smithi169.stdout:(80/154): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-05T12:46:14.115 INFO:teuthology.orchestra.run.smithi169.stdout:(81/154): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-05T12:46:14.184 INFO:teuthology.orchestra.run.smithi073.stdout:(26/154): ceph-radosgw-19.1.1-261.ge856d6b2.el9 3.6 MB/s | 11 MB 00:02 2024-09-05T12:46:14.198 INFO:teuthology.orchestra.run.smithi169.stdout:(82/154): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-05T12:46:14.224 INFO:teuthology.orchestra.run.smithi169.stdout:(83/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-05T12:46:14.249 INFO:teuthology.orchestra.run.smithi169.stdout:(84/154): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-05T12:46:14.274 INFO:teuthology.orchestra.run.smithi169.stdout:(85/154): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-05T12:46:14.276 INFO:teuthology.orchestra.run.smithi073.stdout:(27/154): rbd-mirror-19.1.1-261.ge856d6b2.el9.x 7.4 MB/s | 3.1 MB 00:00 2024-09-05T12:46:14.300 INFO:teuthology.orchestra.run.smithi169.stdout:(86/154): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-05T12:46:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:(28/154): rbd-nbd-19.1.1-261.ge856d6b2.el9.x86_ 1.4 MB/s | 170 kB 00:00 2024-09-05T12:46:14.325 INFO:teuthology.orchestra.run.smithi169.stdout:(87/154): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-05T12:46:14.326 INFO:teuthology.orchestra.run.smithi073.stdout:(29/154): ceph-grafana-dashboards-19.1.1-261.ge 635 kB/s | 32 kB 00:00 2024-09-05T12:46:14.338 INFO:teuthology.orchestra.run.smithi162.stdout:(8/154): ceph-common-19.1.1-261.ge856d6b2.el9.x 15 MB/s | 21 MB 00:01 2024-09-05T12:46:14.350 INFO:teuthology.orchestra.run.smithi169.stdout:(88/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-05T12:46:14.375 INFO:teuthology.orchestra.run.smithi169.stdout:(89/154): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-05T12:46:14.376 INFO:teuthology.orchestra.run.smithi073.stdout:(30/154): ceph-mgr-cephadm-19.1.1-261.ge856d6b2 1.9 MB/s | 146 kB 00:00 2024-09-05T12:46:14.388 INFO:teuthology.orchestra.run.smithi162.stdout:(9/154): ceph-selinux-19.1.1-261.ge856d6b2.el9. 505 kB/s | 25 kB 00:00 2024-09-05T12:46:14.392 INFO:teuthology.orchestra.run.smithi169.stdout:(90/154): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-05T12:46:14.409 INFO:teuthology.orchestra.run.smithi169.stdout:(91/154): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-05T12:46:14.485 INFO:teuthology.orchestra.run.smithi169.stdout:(92/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-05T12:46:14.501 INFO:teuthology.orchestra.run.smithi169.stdout:(93/154): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-05T12:46:14.518 INFO:teuthology.orchestra.run.smithi169.stdout:(94/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-05T12:46:14.552 INFO:teuthology.orchestra.run.smithi169.stdout:(95/154): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-05T12:46:14.577 INFO:teuthology.orchestra.run.smithi169.stdout:(96/154): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-09-05T12:46:14.603 INFO:teuthology.orchestra.run.smithi169.stdout:(97/154): qatzip-libs-1.2.0-1.el9.x86_64.rpm 939 kB/s | 47 kB 00:00 2024-09-05T12:46:14.628 INFO:teuthology.orchestra.run.smithi169.stdout:(98/154): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-05T12:46:14.653 INFO:teuthology.orchestra.run.smithi169.stdout:(99/154): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-05T12:46:14.670 INFO:teuthology.orchestra.run.smithi169.stdout:(100/154): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-05T12:46:14.695 INFO:teuthology.orchestra.run.smithi169.stdout:(101/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-05T12:46:14.713 INFO:teuthology.orchestra.run.smithi162.stdout:(10/154): ceph-radosgw-19.1.1-261.ge856d6b2.el9 14 MB/s | 11 MB 00:00 2024-09-05T12:46:14.721 INFO:teuthology.orchestra.run.smithi169.stdout:(102/154): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-05T12:46:14.735 INFO:teuthology.orchestra.run.smithi073.stdout:(31/154): ceph-mgr-dashboard-19.1.1-261.ge856d6 8.7 MB/s | 3.6 MB 00:00 2024-09-05T12:46:14.772 INFO:teuthology.orchestra.run.smithi162.stdout:(11/154): cephfs-mirror-19.1.1-261.ge856d6b2.el 3.7 MB/s | 222 kB 00:00 2024-09-05T12:46:14.813 INFO:teuthology.orchestra.run.smithi169.stdout:(103/154): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-05T12:46:14.831 INFO:teuthology.orchestra.run.smithi162.stdout:(12/154): cephfs-shell-19.1.1-261.ge856d6b2.el9 464 kB/s | 27 kB 00:00 2024-09-05T12:46:14.864 INFO:teuthology.orchestra.run.smithi169.stdout:(104/154): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-05T12:46:14.889 INFO:teuthology.orchestra.run.smithi162.stdout:(13/154): libcephfs-devel-19.1.1-261.ge856d6b2. 544 kB/s | 32 kB 00:00 2024-09-05T12:46:14.973 INFO:teuthology.orchestra.run.smithi162.stdout:(14/154): libcephfs2-19.1.1-261.ge856d6b2.el9.x 8.8 MB/s | 749 kB 00:00 2024-09-05T12:46:15.031 INFO:teuthology.orchestra.run.smithi169.stdout:(105/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-05T12:46:15.040 INFO:teuthology.orchestra.run.smithi162.stdout:(15/154): libcephsqlite-19.1.1-261.ge856d6b2.el 2.4 MB/s | 163 kB 00:00 2024-09-05T12:46:15.064 INFO:teuthology.orchestra.run.smithi169.stdout:(106/154): gperftools-libs-2.9.1-2.el9.x86_64.r 1.5 MB/s | 309 kB 00:00 2024-09-05T12:46:15.098 INFO:teuthology.orchestra.run.smithi169.stdout:(107/154): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-05T12:46:15.099 INFO:teuthology.orchestra.run.smithi162.stdout:(16/154): librados-devel-19.1.1-261.ge856d6b2.e 2.1 MB/s | 127 kB 00:00 2024-09-05T12:46:15.124 INFO:teuthology.orchestra.run.smithi169.stdout:(108/154): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-09-05T12:46:15.157 INFO:teuthology.orchestra.run.smithi169.stdout:(109/154): liboath-2.6.7-2.el9.x86_64.rpm 1.8 MB/s | 49 kB 00:00 2024-09-05T12:46:15.166 INFO:teuthology.orchestra.run.smithi162.stdout:(17/154): libradosstriper1-19.1.1-261.ge856d6b2 7.4 MB/s | 503 kB 00:00 2024-09-05T12:46:15.168 INFO:teuthology.orchestra.run.smithi073.stdout:(32/154): ceph-test-19.1.1-261.ge856d6b2.el9.x8 13 MB/s | 49 MB 00:03 2024-09-05T12:46:15.182 INFO:teuthology.orchestra.run.smithi169.stdout:(110/154): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-09-05T12:46:15.194 INFO:teuthology.orchestra.run.smithi073.stdout:(33/154): ceph-mgr-modules-core-19.1.1-261.ge85 544 kB/s | 249 kB 00:00 2024-09-05T12:46:15.207 INFO:teuthology.orchestra.run.smithi169.stdout:(111/154): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-05T12:46:15.233 INFO:teuthology.orchestra.run.smithi169.stdout:(112/154): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-05T12:46:15.244 INFO:teuthology.orchestra.run.smithi073.stdout:(34/154): ceph-mgr-rook-19.1.1-261.ge856d6b2.el 659 kB/s | 49 kB 00:00 2024-09-05T12:46:15.261 INFO:teuthology.orchestra.run.smithi073.stdout:(35/154): ceph-prometheus-alerts-19.1.1-261.ge8 246 kB/s | 16 kB 00:00 2024-09-05T12:46:15.300 INFO:teuthology.orchestra.run.smithi169.stdout:(113/154): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-05T12:46:15.325 INFO:teuthology.orchestra.run.smithi169.stdout:(114/154): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-05T12:46:15.350 INFO:teuthology.orchestra.run.smithi169.stdout:(115/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-09-05T12:46:15.375 INFO:teuthology.orchestra.run.smithi169.stdout:(116/154): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-05T12:46:15.386 INFO:teuthology.orchestra.run.smithi073.stdout:(36/154): ceph-volume-19.1.1-261.ge856d6b2.el9. 2.0 MB/s | 285 kB 00:00 2024-09-05T12:46:15.401 INFO:teuthology.orchestra.run.smithi169.stdout:(117/154): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-05T12:46:15.426 INFO:teuthology.orchestra.run.smithi169.stdout:(118/154): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-05T12:46:15.453 INFO:teuthology.orchestra.run.smithi073.stdout:(37/154): cephadm-19.1.1-261.ge856d6b2.el9.noar 3.9 MB/s | 765 kB 00:00 2024-09-05T12:46:15.459 INFO:teuthology.orchestra.run.smithi169.stdout:(119/154): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-05T12:46:15.478 INFO:teuthology.orchestra.run.smithi073.stdout:(38/154): cephfs-top-19.1.1-261.ge856d6b2.el9.n 199 kB/s | 18 kB 00:00 2024-09-05T12:46:15.490 INFO:teuthology.orchestra.run.smithi162.stdout:(18/154): librgw2-19.1.1-261.ge856d6b2.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-05T12:46:15.526 INFO:teuthology.orchestra.run.smithi169.stdout:(120/154): libarrow-9.0.0-11.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-09-05T12:46:15.550 INFO:teuthology.orchestra.run.smithi162.stdout:(19/154): python3-ceph-argparse-19.1.1-261.ge85 774 kB/s | 45 kB 00:00 2024-09-05T12:46:15.551 INFO:teuthology.orchestra.run.smithi169.stdout:(121/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-05T12:46:15.577 INFO:teuthology.orchestra.run.smithi169.stdout:(122/154): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-05T12:46:15.602 INFO:teuthology.orchestra.run.smithi169.stdout:(123/154): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-05T12:46:15.608 INFO:teuthology.orchestra.run.smithi162.stdout:(20/154): python3-ceph-common-19.1.1-261.ge856d 2.3 MB/s | 136 kB 00:00 2024-09-05T12:46:15.627 INFO:teuthology.orchestra.run.smithi169.stdout:(124/154): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-05T12:46:15.637 INFO:teuthology.orchestra.run.smithi073.stdout:(39/154): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-09-05T12:46:15.653 INFO:teuthology.orchestra.run.smithi169.stdout:(125/154): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-05T12:46:15.675 INFO:teuthology.orchestra.run.smithi162.stdout:(21/154): python3-cephfs-19.1.1-261.ge856d6b2.e 2.4 MB/s | 162 kB 00:00 2024-09-05T12:46:15.678 INFO:teuthology.orchestra.run.smithi169.stdout:(126/154): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-05T12:46:15.695 INFO:teuthology.orchestra.run.smithi169.stdout:(127/154): python3-jaraco-functools-3.5.0-2.el9 464 kB/s | 19 kB 00:00 2024-09-05T12:46:15.721 INFO:teuthology.orchestra.run.smithi169.stdout:(128/154): python3-jaraco-text-3.2.0-6.el9.noar 467 kB/s | 20 kB 00:00 2024-09-05T12:46:15.721 INFO:teuthology.orchestra.run.smithi073.stdout:(40/154): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-05T12:46:15.742 INFO:teuthology.orchestra.run.smithi162.stdout:(22/154): python3-rados-19.1.1-261.ge856d6b2.el 4.7 MB/s | 320 kB 00:00 2024-09-05T12:46:15.746 INFO:teuthology.orchestra.run.smithi169.stdout:(129/154): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-05T12:46:15.771 INFO:teuthology.orchestra.run.smithi073.stdout:(41/154): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-05T12:46:15.771 INFO:teuthology.orchestra.run.smithi169.stdout:(130/154): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-05T12:46:15.788 INFO:teuthology.orchestra.run.smithi169.stdout:(131/154): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-05T12:46:15.805 INFO:teuthology.orchestra.run.smithi073.stdout:(42/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-05T12:46:15.830 INFO:teuthology.orchestra.run.smithi169.stdout:(132/154): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-05T12:46:15.863 INFO:teuthology.orchestra.run.smithi073.stdout:(43/154): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-05T12:46:15.872 INFO:teuthology.orchestra.run.smithi169.stdout:(133/154): python3-portend-3.1.0-2.el9.noarch.r 397 kB/s | 16 kB 00:00 2024-09-05T12:46:15.897 INFO:teuthology.orchestra.run.smithi169.stdout:(134/154): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-05T12:46:15.922 INFO:teuthology.orchestra.run.smithi073.stdout:(44/154): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-05T12:46:15.922 INFO:teuthology.orchestra.run.smithi169.stdout:(135/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-05T12:46:15.934 INFO:teuthology.orchestra.run.smithi162.stdout:(23/154): ceph-osd-19.1.1-261.ge856d6b2.el9.x86 8.2 MB/s | 17 MB 00:02 2024-09-05T12:46:15.948 INFO:teuthology.orchestra.run.smithi169.stdout:(136/154): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-05T12:46:15.959 INFO:teuthology.orchestra.run.smithi162.stdout:(24/154): python3-rbd-19.1.1-261.ge856d6b2.el9. 1.4 MB/s | 300 kB 00:00 2024-09-05T12:46:15.964 INFO:teuthology.orchestra.run.smithi073.stdout:(45/154): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-05T12:46:15.973 INFO:teuthology.orchestra.run.smithi169.stdout:(137/154): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-05T12:46:15.984 INFO:teuthology.orchestra.run.smithi162.stdout:(25/154): python3-rgw-19.1.1-261.ge856d6b2.el9. 1.9 MB/s | 99 kB 00:00 2024-09-05T12:46:15.989 INFO:teuthology.orchestra.run.smithi073.stdout:(46/154): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-05T12:46:15.998 INFO:teuthology.orchestra.run.smithi169.stdout:(138/154): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-05T12:46:16.010 INFO:teuthology.orchestra.run.smithi162.stdout:(26/154): rbd-fuse-19.1.1-261.ge856d6b2.el9.x86 1.6 MB/s | 85 kB 00:00 2024-09-05T12:46:16.023 INFO:teuthology.orchestra.run.smithi073.stdout:(47/154): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-05T12:46:16.023 INFO:teuthology.orchestra.run.smithi169.stdout:(139/154): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-05T12:46:16.049 INFO:teuthology.orchestra.run.smithi169.stdout:(140/154): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-05T12:46:16.060 INFO:teuthology.orchestra.run.smithi162.stdout:(27/154): rbd-nbd-19.1.1-261.ge856d6b2.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-05T12:46:16.091 INFO:teuthology.orchestra.run.smithi169.stdout:(141/154): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-05T12:46:16.116 INFO:teuthology.orchestra.run.smithi169.stdout:(142/154): python3-typing-extensions-4.12.2-2.e 808 kB/s | 74 kB 00:00 2024-09-05T12:46:16.118 INFO:teuthology.orchestra.run.smithi162.stdout:(28/154): ceph-grafana-dashboards-19.1.1-261.ge 549 kB/s | 32 kB 00:00 2024-09-05T12:46:16.141 INFO:teuthology.orchestra.run.smithi169.stdout:(143/154): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-05T12:46:16.167 INFO:teuthology.orchestra.run.smithi169.stdout:(144/154): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-05T12:46:16.169 INFO:teuthology.orchestra.run.smithi162.stdout:(29/154): ceph-mgr-cephadm-19.1.1-261.ge856d6b2 2.9 MB/s | 146 kB 00:00 2024-09-05T12:46:16.192 INFO:teuthology.orchestra.run.smithi169.stdout:(145/154): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-05T12:46:16.198 INFO:teuthology.orchestra.run.smithi073.stdout:(48/154): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-05T12:46:16.217 INFO:teuthology.orchestra.run.smithi169.stdout:(146/154): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-05T12:46:16.240 INFO:teuthology.orchestra.run.smithi073.stdout:(49/154): bison-3.7.4-5.el9.x86_64.rpm 4.3 MB/s | 943 kB 00:00 2024-09-05T12:46:16.242 INFO:teuthology.orchestra.run.smithi169.stdout:(147/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-05T12:46:16.265 INFO:teuthology.orchestra.run.smithi073.stdout:(50/154): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-05T12:46:16.291 INFO:teuthology.orchestra.run.smithi073.stdout:(51/154): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-05T12:46:16.292 INFO:teuthology.orchestra.run.smithi169.stdout:(148/154): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-05T12:46:16.294 INFO:teuthology.orchestra.run.smithi162.stdout:(30/154): rbd-mirror-19.1.1-261.ge856d6b2.el9.x 10 MB/s | 3.1 MB 00:00 2024-09-05T12:46:16.316 INFO:teuthology.orchestra.run.smithi073.stdout:(52/154): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-05T12:46:16.341 INFO:teuthology.orchestra.run.smithi073.stdout:(53/154): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-05T12:46:16.375 INFO:teuthology.orchestra.run.smithi073.stdout:(54/154): flexiblas-openblas-openmp-3.0.4-8.el9 549 kB/s | 18 kB 00:00 2024-09-05T12:46:16.378 INFO:teuthology.orchestra.run.smithi162.stdout:(31/154): ceph-mgr-dashboard-19.1.1-261.ge856d6 17 MB/s | 3.6 MB 00:00 2024-09-05T12:46:16.384 INFO:teuthology.orchestra.run.smithi169.stdout:(149/154): NetworkManager-1.48.10-1.el9.x86_64. 25 MB/s | 2.3 MB 00:00 2024-09-05T12:46:16.408 INFO:teuthology.orchestra.run.smithi073.stdout:(55/154): libaio-devel-0.3.111-13.el9.x86_64.rp 336 kB/s | 11 kB 00:00 2024-09-05T12:46:16.459 INFO:teuthology.orchestra.run.smithi073.stdout:(56/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-09-05T12:46:16.460 INFO:teuthology.orchestra.run.smithi169.stdout:(150/154): NetworkManager-libnm-1.48.10-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-09-05T12:46:16.476 INFO:teuthology.orchestra.run.smithi073.stdout:(57/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-05T12:46:16.501 INFO:teuthology.orchestra.run.smithi073.stdout:(58/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-05T12:46:16.502 INFO:teuthology.orchestra.run.smithi169.stdout:(151/154): NetworkManager-team-1.48.10-1.el9.x8 975 kB/s | 40 kB 00:00 2024-09-05T12:46:16.535 INFO:teuthology.orchestra.run.smithi073.stdout:(59/154): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-05T12:46:16.552 INFO:teuthology.orchestra.run.smithi169.stdout:(152/154): NetworkManager-tui-1.48.10-1.el9.x86 4.9 MB/s | 248 kB 00:00 2024-09-05T12:46:16.627 INFO:teuthology.orchestra.run.smithi073.stdout:(60/154): ceph-mgr-diskprediction-local-19.1.1- 3.3 MB/s | 7.4 MB 00:02 2024-09-05T12:46:16.627 INFO:teuthology.orchestra.run.smithi169.stdout:(153/154): librados2-19.1.1-261.ge856d6b2.el9.x 8.3 MB/s | 3.4 MB 00:00 2024-09-05T12:46:16.677 INFO:teuthology.orchestra.run.smithi169.stdout:(154/154): librbd1-19.1.1-261.ge856d6b2.el9.x86 7.3 MB/s | 3.2 MB 00:00 2024-09-05T12:46:16.683 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-09-05T12:46:16.684 INFO:teuthology.orchestra.run.smithi169.stdout:Total 25 MB/s | 222 MB 00:09 2024-09-05T12:46:16.685 INFO:teuthology.orchestra.run.smithi073.stdout:(61/154): libuuid-devel-2.37.4-20.el9.x86_64.rp 163 kB/s | 24 kB 00:00 2024-09-05T12:46:16.711 INFO:teuthology.orchestra.run.smithi073.stdout:(62/154): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-05T12:46:16.744 INFO:teuthology.orchestra.run.smithi073.stdout:(63/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-05T12:46:16.769 INFO:teuthology.orchestra.run.smithi073.stdout:(64/154): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-05T12:46:16.794 INFO:teuthology.orchestra.run.smithi073.stdout:(65/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 283 kB/s | 47 kB 00:00 2024-09-05T12:46:16.803 INFO:teuthology.orchestra.run.smithi162.stdout:(32/154): ceph-test-19.1.1-261.ge856d6b2.el9.x8 20 MB/s | 49 MB 00:02 2024-09-05T12:46:16.820 INFO:teuthology.orchestra.run.smithi073.stdout:(66/154): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-05T12:46:16.829 INFO:teuthology.orchestra.run.smithi162.stdout:(33/154): ceph-mgr-modules-core-19.1.1-261.ge85 554 kB/s | 249 kB 00:00 2024-09-05T12:46:16.854 INFO:teuthology.orchestra.run.smithi162.stdout:(34/154): ceph-mgr-rook-19.1.1-261.ge856d6b2.el 988 kB/s | 49 kB 00:00 2024-09-05T12:46:16.879 INFO:teuthology.orchestra.run.smithi162.stdout:(35/154): ceph-prometheus-alerts-19.1.1-261.ge8 329 kB/s | 16 kB 00:00 2024-09-05T12:46:16.905 INFO:teuthology.orchestra.run.smithi162.stdout:(36/154): ceph-volume-19.1.1-261.ge856d6b2.el9. 5.5 MB/s | 285 kB 00:00 2024-09-05T12:46:16.911 INFO:teuthology.orchestra.run.smithi073.stdout:(67/154): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-05T12:46:16.945 INFO:teuthology.orchestra.run.smithi073.stdout:(68/154): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-05T12:46:16.963 INFO:teuthology.orchestra.run.smithi162.stdout:(37/154): cephfs-top-19.1.1-261.ge856d6b2.el9.n 312 kB/s | 18 kB 00:00 2024-09-05T12:46:16.997 INFO:teuthology.orchestra.run.smithi162.stdout:(38/154): cephadm-19.1.1-261.ge856d6b2.el9.noar 6.4 MB/s | 765 kB 00:00 2024-09-05T12:46:17.004 INFO:teuthology.orchestra.run.smithi073.stdout:(69/154): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-05T12:46:17.029 INFO:teuthology.orchestra.run.smithi073.stdout:(70/154): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-05T12:46:17.113 INFO:teuthology.orchestra.run.smithi073.stdout:(71/154): openssl-devel-3.2.2-4.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-05T12:46:17.139 INFO:teuthology.orchestra.run.smithi162.stdout:(39/154): ceph-mgr-diskprediction-local-19.1.1- 8.8 MB/s | 7.4 MB 00:00 2024-09-05T12:46:17.146 INFO:teuthology.orchestra.run.smithi073.stdout:(72/154): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-05T12:46:17.156 INFO:teuthology.orchestra.run.smithi162.stdout:(40/154): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-05T12:46:17.171 INFO:teuthology.orchestra.run.smithi073.stdout:(73/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-05T12:46:17.255 INFO:teuthology.orchestra.run.smithi073.stdout:(74/154): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-05T12:46:17.273 INFO:teuthology.orchestra.run.smithi162.stdout:(41/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-05T12:46:17.289 INFO:teuthology.orchestra.run.smithi073.stdout:(75/154): python3-colorama-0.4.6-3.el9.noarch.r 522 kB/s | 61 kB 00:00 2024-09-05T12:46:17.298 INFO:teuthology.orchestra.run.smithi162.stdout:(42/154): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-05T12:46:17.314 INFO:teuthology.orchestra.run.smithi073.stdout:(76/154): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-05T12:46:17.341 INFO:teuthology.orchestra.run.smithi073.stdout:(77/154): python3-jinja2-2.11.3-6.el9.noarch.rp 4.7 MB/s | 248 kB 00:00 2024-09-05T12:46:17.357 INFO:teuthology.orchestra.run.smithi162.stdout:(43/154): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-05T12:46:17.453 INFO:teuthology.orchestra.run.smithi162.stdout:(44/154): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-05T12:46:17.453 INFO:teuthology.orchestra.run.smithi162.stdout:(45/154): libgfortran-11.5.0-2.el9.x86_64.rpm 1.8 MB/s | 801 kB 00:00 2024-09-05T12:46:17.453 INFO:teuthology.orchestra.run.smithi162.stdout:(46/154): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-05T12:46:17.453 INFO:teuthology.orchestra.run.smithi073.stdout:(78/154): python3-jsonpatch-1.21-16.el9.noarch. 593 kB/s | 26 kB 00:00 2024-09-05T12:46:17.453 INFO:teuthology.orchestra.run.smithi073.stdout:(79/154): python3-jsonpointer-2.0-4.el9.noarch. 572 kB/s | 19 kB 00:00 2024-09-05T12:46:17.453 INFO:teuthology.orchestra.run.smithi073.stdout:(80/154): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-05T12:46:17.453 INFO:teuthology.orchestra.run.smithi073.stdout:(81/154): python3-markupsafe-1.1.1-12.el9.x86_6 690 kB/s | 35 kB 00:00 2024-09-05T12:46:17.467 INFO:teuthology.orchestra.run.smithi162.stdout:(47/154): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-05T12:46:17.510 INFO:teuthology.orchestra.run.smithi073.stdout:(82/154): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-05T12:46:17.533 INFO:teuthology.orchestra.run.smithi162.stdout:(48/154): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-05T12:46:17.534 INFO:teuthology.orchestra.run.smithi073.stdout:(83/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-05T12:46:17.560 INFO:teuthology.orchestra.run.smithi073.stdout:(84/154): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-05T12:46:17.585 INFO:teuthology.orchestra.run.smithi073.stdout:(85/154): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-05T12:46:17.611 INFO:teuthology.orchestra.run.smithi073.stdout:(86/154): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-05T12:46:17.636 INFO:teuthology.orchestra.run.smithi073.stdout:(87/154): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-05T12:46:17.661 INFO:teuthology.orchestra.run.smithi073.stdout:(88/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-05T12:46:17.695 INFO:teuthology.orchestra.run.smithi073.stdout:(89/154): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-05T12:46:17.720 INFO:teuthology.orchestra.run.smithi073.stdout:(90/154): python3-pytz-2021.1-5.el9.noarch.rpm 870 kB/s | 51 kB 00:00 2024-09-05T12:46:17.725 INFO:teuthology.orchestra.run.smithi162.stdout:(49/154): boost-program-options-1.75.0-8.el9.x8 558 kB/s | 107 kB 00:00 2024-09-05T12:46:17.745 INFO:teuthology.orchestra.run.smithi073.stdout:(91/154): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-05T12:46:17.759 INFO:teuthology.orchestra.run.smithi162.stdout:(50/154): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-05T12:46:17.801 INFO:teuthology.orchestra.run.smithi162.stdout:(51/154): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-05T12:46:17.820 INFO:teuthology.orchestra.run.smithi073.stdout:(92/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-05T12:46:17.826 INFO:teuthology.orchestra.run.smithi162.stdout:(52/154): elfutils-libelf-devel-0.191-4.el9.x86 216 kB/s | 22 kB 00:00 2024-09-05T12:46:17.845 INFO:teuthology.orchestra.run.smithi073.stdout:(93/154): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-05T12:46:17.856 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-09-05T12:46:17.859 INFO:teuthology.orchestra.run.smithi162.stdout:(53/154): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-05T12:46:17.871 INFO:teuthology.orchestra.run.smithi073.stdout:(94/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-05T12:46:17.885 INFO:teuthology.orchestra.run.smithi162.stdout:(54/154): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-05T12:46:17.896 INFO:teuthology.orchestra.run.smithi073.stdout:(95/154): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-05T12:46:17.918 INFO:teuthology.orchestra.run.smithi162.stdout:(55/154): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-05T12:46:17.921 INFO:teuthology.orchestra.run.smithi073.stdout:(96/154): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-05T12:46:17.944 INFO:teuthology.orchestra.run.smithi162.stdout:(56/154): libaio-devel-0.3.111-13.el9.x86_64.rp 189 kB/s | 11 kB 00:00 2024-09-05T12:46:17.946 INFO:teuthology.orchestra.run.smithi073.stdout:(97/154): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-05T12:46:17.972 INFO:teuthology.orchestra.run.smithi073.stdout:(98/154): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-05T12:46:17.977 INFO:teuthology.orchestra.run.smithi162.stdout:(57/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-05T12:46:17.990 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-09-05T12:46:17.991 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-09-05T12:46:17.997 INFO:teuthology.orchestra.run.smithi073.stdout:(99/154): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-05T12:46:18.002 INFO:teuthology.orchestra.run.smithi162.stdout:(58/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-05T12:46:18.022 INFO:teuthology.orchestra.run.smithi073.stdout:(100/154): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-05T12:46:18.048 INFO:teuthology.orchestra.run.smithi073.stdout:(101/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-05T12:46:18.070 INFO:teuthology.orchestra.run.smithi162.stdout:(59/154): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-05T12:46:18.073 INFO:teuthology.orchestra.run.smithi073.stdout:(102/154): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-05T12:46:18.103 INFO:teuthology.orchestra.run.smithi162.stdout:(60/154): libtool-2.4.6-46.el9.x86_64.rpm 5.7 MB/s | 581 kB 00:00 2024-09-05T12:46:18.120 INFO:teuthology.orchestra.run.smithi162.stdout:(61/154): libuuid-devel-2.37.4-20.el9.x86_64.rp 488 kB/s | 24 kB 00:00 2024-09-05T12:46:18.156 INFO:teuthology.orchestra.run.smithi073.stdout:(103/154): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-05T12:46:18.170 INFO:teuthology.orchestra.run.smithi162.stdout:(62/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.7 MB/s | 3.0 MB 00:00 2024-09-05T12:46:18.187 INFO:teuthology.orchestra.run.smithi162.stdout:(63/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-05T12:46:18.207 INFO:teuthology.orchestra.run.smithi073.stdout:(104/154): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-05T12:46:18.212 INFO:teuthology.orchestra.run.smithi162.stdout:(64/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-05T12:46:18.241 INFO:teuthology.orchestra.run.smithi073.stdout:(105/154): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-05T12:46:18.246 INFO:teuthology.orchestra.run.smithi162.stdout:(65/154): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-05T12:46:18.272 INFO:teuthology.orchestra.run.smithi162.stdout:(66/154): openblas-0.3.26-2.el9.x86_64.rpm 458 kB/s | 38 kB 00:00 2024-09-05T12:46:18.282 INFO:teuthology.orchestra.run.smithi073.stdout:(106/154): grpc-data-1.46.7-10.el9.noarch.rpm 469 kB/s | 19 kB 00:00 2024-09-05T12:46:18.406 INFO:teuthology.orchestra.run.smithi162.stdout:(67/154): openblas-openmp-0.3.26-2.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-09-05T12:46:18.458 INFO:teuthology.orchestra.run.smithi073.stdout:(107/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-05T12:46:18.464 INFO:teuthology.orchestra.run.smithi162.stdout:(68/154): openssl-devel-3.2.2-4.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-05T12:46:18.500 INFO:teuthology.orchestra.run.smithi073.stdout:(108/154): libarrow-doc-9.0.0-11.el9.noarch.rpm 628 kB/s | 26 kB 00:00 2024-09-05T12:46:18.506 INFO:teuthology.orchestra.run.smithi162.stdout:(69/154): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-05T12:46:18.533 INFO:teuthology.orchestra.run.smithi073.stdout:(109/154): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-05T12:46:18.548 INFO:teuthology.orchestra.run.smithi162.stdout:(70/154): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-05T12:46:18.567 INFO:teuthology.orchestra.run.smithi073.stdout:(110/154): liboath-2.6.7-2.el9.x86_64.rpm 727 kB/s | 49 kB 00:00 2024-09-05T12:46:18.573 INFO:teuthology.orchestra.run.smithi162.stdout:(71/154): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-05T12:46:18.600 INFO:teuthology.orchestra.run.smithi073.stdout:(111/154): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-05T12:46:18.624 INFO:teuthology.orchestra.run.smithi162.stdout:(72/154): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-05T12:46:18.626 INFO:teuthology.orchestra.run.smithi073.stdout:(112/154): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-09-05T12:46:18.649 INFO:teuthology.orchestra.run.smithi162.stdout:(73/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-05T12:46:18.677 INFO:teuthology.orchestra.run.smithi073.stdout:(113/154): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-05T12:46:18.701 INFO:teuthology.orchestra.run.smithi073.stdout:(114/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-05T12:46:18.733 INFO:teuthology.orchestra.run.smithi162.stdout:(74/154): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-05T12:46:18.735 INFO:teuthology.orchestra.run.smithi073.stdout:(115/154): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-05T12:46:18.752 INFO:teuthology.orchestra.run.smithi073.stdout:(116/154): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-05T12:46:18.757 INFO:teuthology.orchestra.run.smithi162.stdout:(75/154): python3-colorama-0.4.6-3.el9.noarch.r 563 kB/s | 61 kB 00:00 2024-09-05T12:46:18.769 INFO:teuthology.orchestra.run.smithi073.stdout:(117/154): python3-certifi-2023.05.07-4.el9.noa 422 kB/s | 14 kB 00:00 2024-09-05T12:46:18.791 INFO:teuthology.orchestra.run.smithi162.stdout:(76/154): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-05T12:46:18.794 INFO:teuthology.orchestra.run.smithi073.stdout:(118/154): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-05T12:46:18.817 INFO:teuthology.orchestra.run.smithi162.stdout:(77/154): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-05T12:46:18.827 INFO:teuthology.orchestra.run.smithi073.stdout:(119/154): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-05T12:46:18.850 INFO:teuthology.orchestra.run.smithi162.stdout:(78/154): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-05T12:46:18.853 INFO:teuthology.orchestra.run.smithi073.stdout:(120/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-05T12:46:18.876 INFO:teuthology.orchestra.run.smithi162.stdout:(79/154): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-05T12:46:18.878 INFO:teuthology.orchestra.run.smithi073.stdout:(121/154): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-05T12:46:18.945 INFO:teuthology.orchestra.run.smithi073.stdout:(122/154): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-05T12:46:18.951 INFO:teuthology.orchestra.run.smithi162.stdout:(80/154): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-05T12:46:18.962 INFO:teuthology.orchestra.run.smithi073.stdout:(123/154): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-09-05T12:46:18.976 INFO:teuthology.orchestra.run.smithi162.stdout:(81/154): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-09-05T12:46:18.987 INFO:teuthology.orchestra.run.smithi073.stdout:(124/154): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-09-05T12:46:19.001 INFO:teuthology.orchestra.run.smithi162.stdout:(82/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-05T12:46:19.004 INFO:teuthology.orchestra.run.smithi073.stdout:(125/154): python3-jaraco-classes-3.2.1-5.el9.n 423 kB/s | 18 kB 00:00 2024-09-05T12:46:19.021 INFO:teuthology.orchestra.run.smithi073.stdout:(126/154): python3-jaraco-collections-3.0.0-8.e 690 kB/s | 23 kB 00:00 2024-09-05T12:46:19.038 INFO:teuthology.orchestra.run.smithi073.stdout:(127/154): python3-jaraco-functools-3.5.0-2.el9 579 kB/s | 19 kB 00:00 2024-09-05T12:46:19.055 INFO:teuthology.orchestra.run.smithi073.stdout:(128/154): python3-jaraco-text-3.2.0-6.el9.noar 589 kB/s | 20 kB 00:00 2024-09-05T12:46:19.072 INFO:teuthology.orchestra.run.smithi073.stdout:(129/154): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-05T12:46:19.097 INFO:teuthology.orchestra.run.smithi073.stdout:(130/154): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-05T12:46:19.114 INFO:teuthology.orchestra.run.smithi073.stdout:(131/154): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-05T12:46:19.143 INFO:teuthology.orchestra.run.smithi162.stdout:(83/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-05T12:46:19.148 INFO:teuthology.orchestra.run.smithi073.stdout:(132/154): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-05T12:46:19.165 INFO:teuthology.orchestra.run.smithi073.stdout:(133/154): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-09-05T12:46:19.169 INFO:teuthology.orchestra.run.smithi162.stdout:(84/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-09-05T12:46:19.190 INFO:teuthology.orchestra.run.smithi073.stdout:(134/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-05T12:46:19.202 INFO:teuthology.orchestra.run.smithi162.stdout:(85/154): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-05T12:46:19.224 INFO:teuthology.orchestra.run.smithi073.stdout:(135/154): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-05T12:46:19.228 INFO:teuthology.orchestra.run.smithi162.stdout:(86/154): python3-prettytable-0.7.2-27.el9.noar 720 kB/s | 42 kB 00:00 2024-09-05T12:46:19.249 INFO:teuthology.orchestra.run.smithi073.stdout:(136/154): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-05T12:46:19.275 INFO:teuthology.orchestra.run.smithi073.stdout:(137/154): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-05T12:46:19.300 INFO:teuthology.orchestra.run.smithi073.stdout:(138/154): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-05T12:46:19.303 INFO:teuthology.orchestra.run.smithi162.stdout:(87/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-05T12:46:19.325 INFO:teuthology.orchestra.run.smithi073.stdout:(139/154): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-05T12:46:19.328 INFO:teuthology.orchestra.run.smithi162.stdout:(88/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-05T12:46:19.350 INFO:teuthology.orchestra.run.smithi073.stdout:(140/154): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-05T12:46:19.353 INFO:teuthology.orchestra.run.smithi162.stdout:(89/154): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-09-05T12:46:19.376 INFO:teuthology.orchestra.run.smithi073.stdout:(141/154): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-05T12:46:19.379 INFO:teuthology.orchestra.run.smithi162.stdout:(90/154): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-05T12:46:19.401 INFO:teuthology.orchestra.run.smithi073.stdout:(142/154): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-05T12:46:19.404 INFO:teuthology.orchestra.run.smithi162.stdout:(91/154): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-05T12:46:19.426 INFO:teuthology.orchestra.run.smithi073.stdout:(143/154): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-05T12:46:19.429 INFO:teuthology.orchestra.run.smithi162.stdout:(92/154): python3-requests-oauthlib-1.3.0-12.el 706 kB/s | 54 kB 00:00 2024-09-05T12:46:19.452 INFO:teuthology.orchestra.run.smithi073.stdout:(144/154): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-05T12:46:19.463 INFO:teuthology.orchestra.run.smithi162.stdout:(93/154): python3-toml-0.10.2-6.el9.noarch.rpm 706 kB/s | 42 kB 00:00 2024-09-05T12:46:19.489 INFO:teuthology.orchestra.run.smithi162.stdout:(94/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-09-05T12:46:19.493 INFO:teuthology.orchestra.run.smithi073.stdout:(145/154): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-05T12:46:19.519 INFO:teuthology.orchestra.run.smithi073.stdout:(146/154): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-05T12:46:19.522 INFO:teuthology.orchestra.run.smithi162.stdout:(95/154): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-05T12:46:19.545 INFO:teuthology.orchestra.run.smithi073.stdout:(147/154): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-05T12:46:19.547 INFO:teuthology.orchestra.run.smithi162.stdout:(96/154): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-05T12:46:19.581 INFO:teuthology.orchestra.run.smithi162.stdout:(97/154): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-05T12:46:19.594 INFO:teuthology.orchestra.run.smithi073.stdout:(148/154): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-05T12:46:19.606 INFO:teuthology.orchestra.run.smithi162.stdout:(98/154): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-05T12:46:19.640 INFO:teuthology.orchestra.run.smithi162.stdout:(99/154): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-09-05T12:46:19.665 INFO:teuthology.orchestra.run.smithi162.stdout:(100/154): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-05T12:46:19.699 INFO:teuthology.orchestra.run.smithi162.stdout:(101/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-05T12:46:19.724 INFO:teuthology.orchestra.run.smithi162.stdout:(102/154): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-09-05T12:46:19.752 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-09-05T12:46:19.752 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-09-05T12:46:19.828 INFO:teuthology.orchestra.run.smithi073.stdout:(149/154): librbd1-19.1.1-261.ge856d6b2.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-05T12:46:19.933 INFO:teuthology.orchestra.run.smithi162.stdout:(103/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-05T12:46:19.958 INFO:teuthology.orchestra.run.smithi162.stdout:(104/154): lua-devel-5.4.4-4.el9.x86_64.rpm 86 kB/s | 22 kB 00:00 2024-09-05T12:46:20.017 INFO:teuthology.orchestra.run.smithi162.stdout:(105/154): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-05T12:46:20.053 INFO:teuthology.orchestra.run.smithi073.stdout:(150/154): NetworkManager-1.48.10-1.el9.x86_64. 5.1 MB/s | 2.3 MB 00:00 2024-09-05T12:46:20.057 INFO:teuthology.orchestra.run.smithi162.stdout:(106/154): grpc-data-1.46.7-10.el9.noarch.rpm 482 kB/s | 19 kB 00:00 2024-09-05T12:46:20.092 INFO:teuthology.orchestra.run.smithi162.stdout:(107/154): gperftools-libs-2.9.1-2.el9.x86_64.r 2.3 MB/s | 309 kB 00:00 2024-09-05T12:46:20.112 INFO:teuthology.orchestra.run.smithi073.stdout:(151/154): NetworkManager-team-1.48.10-1.el9.x8 696 kB/s | 40 kB 00:00 2024-09-05T12:46:20.117 INFO:teuthology.orchestra.run.smithi162.stdout:(108/154): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-05T12:46:20.143 INFO:teuthology.orchestra.run.smithi162.stdout:(109/154): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-05T12:46:20.162 INFO:teuthology.orchestra.run.smithi073.stdout:(152/154): librados2-19.1.1-261.ge856d6b2.el9.x 5.3 MB/s | 3.4 MB 00:00 2024-09-05T12:46:20.168 INFO:teuthology.orchestra.run.smithi162.stdout:(110/154): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-05T12:46:20.187 INFO:teuthology.orchestra.run.smithi073.stdout:(153/154): NetworkManager-tui-1.48.10-1.el9.x86 3.2 MB/s | 248 kB 00:00 2024-09-05T12:46:20.202 INFO:teuthology.orchestra.run.smithi162.stdout:(111/154): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-05T12:46:20.235 INFO:teuthology.orchestra.run.smithi162.stdout:(112/154): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-05T12:46:20.262 INFO:teuthology.orchestra.run.smithi073.stdout:(154/154): NetworkManager-libnm-1.48.10-1.el9.x 4.1 MB/s | 1.8 MB 00:00 2024-09-05T12:46:20.269 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-05T12:46:20.269 INFO:teuthology.orchestra.run.smithi073.stdout:Total 18 MB/s | 222 MB 00:12 2024-09-05T12:46:20.269 INFO:teuthology.orchestra.run.smithi162.stdout:(113/154): parquet-libs-9.0.0-11.el9.x86_64.rpm 13 MB/s | 839 kB 00:00 2024-09-05T12:46:20.286 INFO:teuthology.orchestra.run.smithi162.stdout:(114/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-05T12:46:20.303 INFO:teuthology.orchestra.run.smithi162.stdout:(115/154): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-05T12:46:20.328 INFO:teuthology.orchestra.run.smithi162.stdout:(116/154): python3-certifi-2023.05.07-4.el9.noa 572 kB/s | 14 kB 00:00 2024-09-05T12:46:20.353 INFO:teuthology.orchestra.run.smithi162.stdout:(117/154): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-05T12:46:20.376 INFO:teuthology.orchestra.run.smithi162.stdout:(118/154): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-05T12:46:20.409 INFO:teuthology.orchestra.run.smithi162.stdout:(119/154): python3-cherrypy-18.6.1-2.el9.noarch 6.3 MB/s | 358 kB 00:00 2024-09-05T12:46:20.435 INFO:teuthology.orchestra.run.smithi162.stdout:(120/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-05T12:46:20.460 INFO:teuthology.orchestra.run.smithi162.stdout:(121/154): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-05T12:46:20.485 INFO:teuthology.orchestra.run.smithi162.stdout:(122/154): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-05T12:46:20.502 INFO:teuthology.orchestra.run.smithi162.stdout:(123/154): python3-jaraco-8.2.1-3.el9.noarch.rp 642 kB/s | 11 kB 00:00 2024-09-05T12:46:20.519 INFO:teuthology.orchestra.run.smithi162.stdout:(124/154): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-05T12:46:20.536 INFO:teuthology.orchestra.run.smithi162.stdout:(125/154): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-05T12:46:20.553 INFO:teuthology.orchestra.run.smithi162.stdout:(126/154): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-05T12:46:20.620 INFO:teuthology.orchestra.run.smithi162.stdout:(127/154): libarrow-9.0.0-11.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2024-09-05T12:46:20.646 INFO:teuthology.orchestra.run.smithi162.stdout:(128/154): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-09-05T12:46:20.671 INFO:teuthology.orchestra.run.smithi162.stdout:(129/154): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-05T12:46:20.696 INFO:teuthology.orchestra.run.smithi162.stdout:(130/154): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-05T12:46:20.721 INFO:teuthology.orchestra.run.smithi162.stdout:(131/154): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-05T12:46:20.755 INFO:teuthology.orchestra.run.smithi162.stdout:(132/154): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-05T12:46:20.781 INFO:teuthology.orchestra.run.smithi162.stdout:(133/154): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-05T12:46:20.814 INFO:teuthology.orchestra.run.smithi162.stdout:(134/154): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-05T12:46:20.856 INFO:teuthology.orchestra.run.smithi162.stdout:(135/154): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-09-05T12:46:20.882 INFO:teuthology.orchestra.run.smithi162.stdout:(136/154): python3-pyperclip-1.8.2-2.el9.noarch 420 kB/s | 28 kB 00:00 2024-09-05T12:46:20.907 INFO:teuthology.orchestra.run.smithi162.stdout:(137/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 713 kB/s | 90 kB 00:00 2024-09-05T12:46:20.932 INFO:teuthology.orchestra.run.smithi162.stdout:(138/154): python3-repoze-lru-0.7-16.el9.noarch 406 kB/s | 31 kB 00:00 2024-09-05T12:46:20.958 INFO:teuthology.orchestra.run.smithi162.stdout:(139/154): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-05T12:46:20.983 INFO:teuthology.orchestra.run.smithi162.stdout:(140/154): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-05T12:46:21.008 INFO:teuthology.orchestra.run.smithi162.stdout:(141/154): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-05T12:46:21.033 INFO:teuthology.orchestra.run.smithi162.stdout:(142/154): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-05T12:46:21.059 INFO:teuthology.orchestra.run.smithi162.stdout:(143/154): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-05T12:46:21.084 INFO:teuthology.orchestra.run.smithi162.stdout:(144/154): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-05T12:46:21.109 INFO:teuthology.orchestra.run.smithi162.stdout:(145/154): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-05T12:46:21.126 INFO:teuthology.orchestra.run.smithi162.stdout:(146/154): re2-20211101-20.el9.x86_64.rpm 12 MB/s | 191 kB 00:00 2024-09-05T12:46:21.151 INFO:teuthology.orchestra.run.smithi162.stdout:(147/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-05T12:46:21.202 INFO:teuthology.orchestra.run.smithi162.stdout:(148/154): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-05T12:46:21.302 INFO:teuthology.orchestra.run.smithi162.stdout:(149/154): NetworkManager-1.48.10-1.el9.x86_64. 25 MB/s | 2.3 MB 00:00 2024-09-05T12:46:21.369 INFO:teuthology.orchestra.run.smithi162.stdout:(150/154): NetworkManager-libnm-1.48.10-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-05T12:46:21.428 INFO:teuthology.orchestra.run.smithi162.stdout:(151/154): NetworkManager-team-1.48.10-1.el9.x8 694 kB/s | 40 kB 00:00 2024-09-05T12:46:21.456 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-05T12:46:21.478 INFO:teuthology.orchestra.run.smithi162.stdout:(152/154): NetworkManager-tui-1.48.10-1.el9.x86 4.9 MB/s | 248 kB 00:00 2024-09-05T12:46:21.528 INFO:teuthology.orchestra.run.smithi162.stdout:(153/154): librados2-19.1.1-261.ge856d6b2.el9.x 8.5 MB/s | 3.4 MB 00:00 2024-09-05T12:46:21.589 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-05T12:46:21.589 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-05T12:46:21.628 INFO:teuthology.orchestra.run.smithi162.stdout:(154/154): librbd1-19.1.1-261.ge856d6b2.el9.x86 6.6 MB/s | 3.2 MB 00:00 2024-09-05T12:46:21.634 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-05T12:46:21.634 INFO:teuthology.orchestra.run.smithi162.stdout:Total 24 MB/s | 222 MB 00:09 2024-09-05T12:46:22.802 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-05T12:46:22.941 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-05T12:46:22.941 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-05T12:46:23.349 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-05T12:46:23.349 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-05T12:46:24.729 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-05T12:46:24.729 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-05T12:46:25.845 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-09-05T12:46:25.921 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/160 2024-09-05T12:46:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/160 2024-09-05T12:46:25.989 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/160 2024-09-05T12:46:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2024-09-05T12:46:26.431 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 5/160 2024-09-05T12:46:26.536 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 5/160 2024-09-05T12:46:26.573 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 6/160 2024-09-05T12:46:26.832 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 6/160 2024-09-05T12:46:26.874 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:19.1.1-261.ge856d6b2.el9.x86_64 7/160 2024-09-05T12:46:26.992 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/160 2024-09-05T12:46:27.137 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/160 2024-09-05T12:46:27.299 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/160 2024-09-05T12:46:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/160 2024-09-05T12:46:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 12/160 2024-09-05T12:46:27.491 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 12/160 2024-09-05T12:46:27.513 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_ 13/160 2024-09-05T12:46:27.576 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_ 13/160 2024-09-05T12:46:27.606 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T12:46:27.631 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T12:46:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T12:46:27.973 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T12:46:28.095 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T12:46:28.155 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T12:46:28.265 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T12:46:28.339 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T12:46:28.576 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T12:46:28.690 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/160 2024-09-05T12:46:28.786 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/160 2024-09-05T12:46:28.828 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/160 2024-09-05T12:46:28.863 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/160 2024-09-05T12:46:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/160 2024-09-05T12:46:29.011 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/160 2024-09-05T12:46:29.046 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/160 2024-09-05T12:46:29.089 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/160 2024-09-05T12:46:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/160 2024-09-05T12:46:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2024-09-05T12:46:29.221 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/160 2024-09-05T12:46:29.273 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/160 2024-09-05T12:46:29.302 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/160 2024-09-05T12:46:29.338 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/160 2024-09-05T12:46:29.415 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/160 2024-09-05T12:46:29.432 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-05T12:46:29.448 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:19.1.1-261.ge856d6b2.el9.x 33/160 2024-09-05T12:46:29.491 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:19.1.1-261.ge856d6b2.el9 34/160 2024-09-05T12:46:29.515 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/160 2024-09-05T12:46:29.520 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:19.1.1-261.ge856d6b2.el9.x86_64 35/160 2024-09-05T12:46:29.593 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/160 2024-09-05T12:46:29.607 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/160 2024-09-05T12:46:29.635 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/160 2024-09-05T12:46:29.712 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/160 2024-09-05T12:46:29.827 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/160 2024-09-05T12:46:29.848 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/160 2024-09-05T12:46:29.914 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/160 2024-09-05T12:46:30.165 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2024-09-05T12:46:30.292 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 5/160 2024-09-05T12:46:30.397 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 5/160 2024-09-05T12:46:30.418 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 6/160 2024-09-05T12:46:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/160 2024-09-05T12:46:30.501 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 6/160 2024-09-05T12:46:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/160 2024-09-05T12:46:30.535 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.1.1-261.ge856d6b2.el9.x86_64 7/160 2024-09-05T12:46:30.563 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/160 2024-09-05T12:46:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/160 2024-09-05T12:46:30.589 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/160 2024-09-05T12:46:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/160 2024-09-05T12:46:30.660 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 45/160 2024-09-05T12:46:30.693 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/160 2024-09-05T12:46:30.742 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/160 2024-09-05T12:46:30.748 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/160 2024-09-05T12:46:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/160 2024-09-05T12:46:30.822 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/160 2024-09-05T12:46:30.823 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 12/160 2024-09-05T12:46:30.861 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 49/160 2024-09-05T12:46:30.894 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-05T12:46:30.897 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 50/160 2024-09-05T12:46:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 12/160 2024-09-05T12:46:30.944 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/160 2024-09-05T12:46:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_ 13/160 2024-09-05T12:46:30.972 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/160 2024-09-05T12:46:30.980 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/160 2024-09-05T12:46:30.997 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/160 2024-09-05T12:46:31.012 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_ 13/160 2024-09-05T12:46:31.023 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/160 2024-09-05T12:46:31.033 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T12:46:31.048 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/160 2024-09-05T12:46:31.058 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T12:46:31.073 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/160 2024-09-05T12:46:31.213 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/160 2024-09-05T12:46:31.253 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/160 2024-09-05T12:46:31.269 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T12:46:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 57/160 2024-09-05T12:46:31.381 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2024-09-05T12:46:31.401 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/160 2024-09-05T12:46:31.442 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T12:46:31.444 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 59/160 2024-09-05T12:46:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 5/160 2024-09-05T12:46:31.484 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/160 2024-09-05T12:46:31.510 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/160 2024-09-05T12:46:31.534 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 62/160 2024-09-05T12:46:31.555 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T12:46:31.587 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 5/160 2024-09-05T12:46:31.599 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T12:46:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 63/160 2024-09-05T12:46:31.633 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 6/160 2024-09-05T12:46:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T12:46:31.708 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 6/160 2024-09-05T12:46:31.731 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 64/160 2024-09-05T12:46:31.750 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.1.1-261.ge856d6b2.el9.x86_64 7/160 2024-09-05T12:46:31.767 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 65/160 2024-09-05T12:46:31.779 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/160 2024-09-05T12:46:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T12:46:31.795 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 66/160 2024-09-05T12:46:31.805 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/160 2024-09-05T12:46:31.829 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/160 2024-09-05T12:46:31.873 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/160 2024-09-05T12:46:31.911 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 69/160 2024-09-05T12:46:31.942 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/160 2024-09-05T12:46:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/160 2024-09-05T12:46:31.972 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/160 2024-09-05T12:46:32.006 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T12:46:32.007 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/160 2024-09-05T12:46:32.011 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/160 2024-09-05T12:46:32.040 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 12/160 2024-09-05T12:46:32.048 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/160 2024-09-05T12:46:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/160 2024-09-05T12:46:32.114 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/160 2024-09-05T12:46:32.125 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/160 2024-09-05T12:46:32.143 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 12/160 2024-09-05T12:46:32.165 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_ 13/160 2024-09-05T12:46:32.210 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/160 2024-09-05T12:46:32.211 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_ 13/160 2024-09-05T12:46:32.213 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/160 2024-09-05T12:46:32.232 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T12:46:32.247 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/160 2024-09-05T12:46:32.259 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T12:46:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/160 2024-09-05T12:46:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/160 2024-09-05T12:46:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/160 2024-09-05T12:46:32.395 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/160 2024-09-05T12:46:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/160 2024-09-05T12:46:32.439 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/160 2024-09-05T12:46:32.452 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T12:46:32.483 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/160 2024-09-05T12:46:32.510 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/160 2024-09-05T12:46:32.524 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/160 2024-09-05T12:46:32.552 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2024-09-05T12:46:32.564 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/160 2024-09-05T12:46:32.609 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T12:46:32.622 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/160 2024-09-05T12:46:32.676 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/160 2024-09-05T12:46:32.705 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/160 2024-09-05T12:46:32.730 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T12:46:32.740 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/160 2024-09-05T12:46:32.782 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T12:46:32.816 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/160 2024-09-05T12:46:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.1.1-261.ge856d6b2.el9.x 33/160 2024-09-05T12:46:32.872 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T12:46:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.1.1-261.ge856d6b2.el9 34/160 2024-09-05T12:46:32.923 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.1.1-261.ge856d6b2.el9.x86_64 35/160 2024-09-05T12:46:32.983 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T12:46:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/160 2024-09-05T12:46:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/160 2024-09-05T12:46:33.113 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/160 2024-09-05T12:46:33.209 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T12:46:33.248 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/160 2024-09-05T12:46:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/160 2024-09-05T12:46:33.316 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/160 2024-09-05T12:46:33.317 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/160 2024-09-05T12:46:33.360 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/160 2024-09-05T12:46:33.394 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/160 2024-09-05T12:46:33.411 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/160 2024-09-05T12:46:33.447 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/160 2024-09-05T12:46:33.481 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/160 2024-09-05T12:46:33.497 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/160 2024-09-05T12:46:33.548 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/160 2024-09-05T12:46:33.549 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 85/160 2024-09-05T12:46:33.595 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 86/160 2024-09-05T12:46:33.599 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/160 2024-09-05T12:46:33.632 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/160 2024-09-05T12:46:33.676 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/160 2024-09-05T12:46:33.684 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/160 2024-09-05T12:46:33.708 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/160 2024-09-05T12:46:33.730 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/160 2024-09-05T12:46:33.735 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2024-09-05T12:46:33.805 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/160 2024-09-05T12:46:33.849 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/160 2024-09-05T12:46:33.859 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/160 2024-09-05T12:46:33.914 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/160 2024-09-05T12:46:33.915 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.26-2.el9.x86_64 89/160 2024-09-05T12:46:33.928 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/160 2024-09-05T12:46:33.944 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 90/160 2024-09-05T12:46:33.949 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/160 2024-09-05T12:46:33.960 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/160 2024-09-05T12:46:34.002 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/160 2024-09-05T12:46:34.022 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/160 2024-09-05T12:46:34.027 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/160 2024-09-05T12:46:34.041 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 45/160 2024-09-05T12:46:34.060 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.1.1-261.ge856d6b2.el9.x 33/160 2024-09-05T12:46:34.074 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/160 2024-09-05T12:46:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.1.1-261.ge856d6b2.el9 34/160 2024-09-05T12:46:34.129 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/160 2024-09-05T12:46:34.132 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.1.1-261.ge856d6b2.el9.x86_64 35/160 2024-09-05T12:46:34.202 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/160 2024-09-05T12:46:34.203 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/160 2024-09-05T12:46:34.233 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 49/160 2024-09-05T12:46:34.247 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/160 2024-09-05T12:46:34.295 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 50/160 2024-09-05T12:46:34.323 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/160 2024-09-05T12:46:34.341 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/160 2024-09-05T12:46:34.377 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/160 2024-09-05T12:46:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/160 2024-09-05T12:46:34.462 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/160 2024-09-05T12:46:34.465 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/160 2024-09-05T12:46:34.518 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/160 2024-09-05T12:46:34.601 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/160 2024-09-05T12:46:34.639 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/160 2024-09-05T12:46:34.681 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 57/160 2024-09-05T12:46:34.698 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/160 2024-09-05T12:46:34.784 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/160 2024-09-05T12:46:34.814 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/160 2024-09-05T12:46:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 59/160 2024-09-05T12:46:34.870 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/160 2024-09-05T12:46:34.896 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/160 2024-09-05T12:46:34.921 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 62/160 2024-09-05T12:46:34.996 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 63/160 2024-09-05T12:46:35.052 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/160 2024-09-05T12:46:35.123 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 64/160 2024-09-05T12:46:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/160 2024-09-05T12:46:35.174 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/160 2024-09-05T12:46:35.217 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/160 2024-09-05T12:46:35.255 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 45/160 2024-09-05T12:46:35.287 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 65/160 2024-09-05T12:46:35.288 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/160 2024-09-05T12:46:35.325 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 66/160 2024-09-05T12:46:35.345 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/160 2024-09-05T12:46:35.359 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/160 2024-09-05T12:46:35.403 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/160 2024-09-05T12:46:35.417 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/160 2024-09-05T12:46:35.441 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 69/160 2024-09-05T12:46:35.448 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 49/160 2024-09-05T12:46:35.472 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/160 2024-09-05T12:46:35.484 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 50/160 2024-09-05T12:46:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/160 2024-09-05T12:46:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/160 2024-09-05T12:46:35.536 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/160 2024-09-05T12:46:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/160 2024-09-05T12:46:35.570 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/160 2024-09-05T12:46:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/160 2024-09-05T12:46:35.611 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/160 2024-09-05T12:46:35.645 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/160 2024-09-05T12:46:35.652 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/160 2024-09-05T12:46:35.733 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/160 2024-09-05T12:46:35.777 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/160 2024-09-05T12:46:35.791 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/160 2024-09-05T12:46:35.807 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/160 2024-09-05T12:46:35.830 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/160 2024-09-05T12:46:35.871 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 57/160 2024-09-05T12:46:35.912 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/160 2024-09-05T12:46:35.967 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/160 2024-09-05T12:46:35.977 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/160 2024-09-05T12:46:36.021 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 59/160 2024-09-05T12:46:36.056 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/160 2024-09-05T12:46:36.082 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/160 2024-09-05T12:46:36.098 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/160 2024-09-05T12:46:36.107 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 62/160 2024-09-05T12:46:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/160 2024-09-05T12:46:36.183 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 63/160 2024-09-05T12:46:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/160 2024-09-05T12:46:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 97/160 2024-09-05T12:46:36.310 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 64/160 2024-09-05T12:46:36.348 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 65/160 2024-09-05T12:46:36.376 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 66/160 2024-09-05T12:46:36.410 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/160 2024-09-05T12:46:36.554 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/160 2024-09-05T12:46:36.590 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 99/160 2024-09-05T12:46:36.623 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/160 2024-09-05T12:46:36.665 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 99/160 2024-09-05T12:46:36.695 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:19.1.1-261.ge856d6b2.el9.x86_64 100/160 2024-09-05T12:46:36.703 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/160 2024-09-05T12:46:36.711 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 69/160 2024-09-05T12:46:36.731 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/160 2024-09-05T12:46:36.750 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/160 2024-09-05T12:46:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/160 2024-09-05T12:46:36.779 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/160 2024-09-05T12:46:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/160 2024-09-05T12:46:36.814 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/160 2024-09-05T12:46:36.847 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/160 2024-09-05T12:46:36.890 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/160 2024-09-05T12:46:36.898 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/160 2024-09-05T12:46:36.923 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/160 2024-09-05T12:46:36.952 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 85/160 2024-09-05T12:46:36.998 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 86/160 2024-09-05T12:46:37.014 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/160 2024-09-05T12:46:37.062 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/160 2024-09-05T12:46:37.084 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/160 2024-09-05T12:46:37.093 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/160 2024-09-05T12:46:37.117 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/160 2024-09-05T12:46:37.199 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/160 2024-09-05T12:46:37.211 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/160 2024-09-05T12:46:37.243 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 103/160 2024-09-05T12:46:37.269 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/160 2024-09-05T12:46:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 103/160 2024-09-05T12:46:37.315 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.26-2.el9.x86_64 89/160 2024-09-05T12:46:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:19.1.1-261.ge856d6b2.el9.x86_64 104/160 2024-09-05T12:46:37.339 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 90/160 2024-09-05T12:46:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/160 2024-09-05T12:46:38.008 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/160 2024-09-05T12:46:38.067 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/160 2024-09-05T12:46:38.072 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/160 2024-09-05T12:46:38.105 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/160 2024-09-05T12:46:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/160 2024-09-05T12:46:38.207 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/160 2024-09-05T12:46:38.262 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 85/160 2024-09-05T12:46:38.307 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 86/160 2024-09-05T12:46:38.404 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/160 2024-09-05T12:46:38.450 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/160 2024-09-05T12:46:38.653 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 89/160 2024-09-05T12:46:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 90/160 2024-09-05T12:46:38.767 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/160 2024-09-05T12:46:39.426 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/160 2024-09-05T12:46:39.454 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/160 2024-09-05T12:46:39.501 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/160 2024-09-05T12:46:39.529 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/160 2024-09-05T12:46:39.562 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 97/160 2024-09-05T12:46:39.564 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/160 2024-09-05T12:46:39.670 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 105/160 2024-09-05T12:46:39.708 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 105/160 2024-09-05T12:46:39.878 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/160 2024-09-05T12:46:39.909 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 99/160 2024-09-05T12:46:40.001 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 99/160 2024-09-05T12:46:40.047 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.1.1-261.ge856d6b2.el9.x86_64 100/160 2024-09-05T12:46:40.083 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/160 2024-09-05T12:46:40.259 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 105/160 2024-09-05T12:46:40.303 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 106/160 2024-09-05T12:46:40.376 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 106/160 2024-09-05T12:46:40.376 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T12:46:40.376 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T12:46:40.376 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:40.412 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 107/160 2024-09-05T12:46:40.562 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/160 2024-09-05T12:46:40.604 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 103/160 2024-09-05T12:46:40.675 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 103/160 2024-09-05T12:46:40.705 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.1.1-261.ge856d6b2.el9.x86_64 104/160 2024-09-05T12:46:40.811 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/160 2024-09-05T12:46:40.903 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/160 2024-09-05T12:46:40.923 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/160 2024-09-05T12:46:40.948 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 97/160 2024-09-05T12:46:41.256 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/160 2024-09-05T12:46:41.294 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 99/160 2024-09-05T12:46:41.384 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 99/160 2024-09-05T12:46:41.415 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.1.1-261.ge856d6b2.el9.x86_64 100/160 2024-09-05T12:46:41.452 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/160 2024-09-05T12:46:41.931 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/160 2024-09-05T12:46:41.963 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 103/160 2024-09-05T12:46:42.026 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 103/160 2024-09-05T12:46:42.048 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.1.1-261.ge856d6b2.el9.x86_64 104/160 2024-09-05T12:46:43.093 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 105/160 2024-09-05T12:46:43.127 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 105/160 2024-09-05T12:46:43.669 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 105/160 2024-09-05T12:46:43.714 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 106/160 2024-09-05T12:46:43.790 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 106/160 2024-09-05T12:46:43.790 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T12:46:43.790 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T12:46:43.790 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:46:43.823 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 107/160 2024-09-05T12:46:44.831 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 105/160 2024-09-05T12:46:44.862 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 105/160 2024-09-05T12:46:45.404 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 105/160 2024-09-05T12:46:45.449 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 106/160 2024-09-05T12:46:45.541 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 106/160 2024-09-05T12:46:45.541 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T12:46:45.541 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T12:46:45.541 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:46:45.576 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 107/160 2024-09-05T12:46:52.436 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 107/160 2024-09-05T12:46:52.436 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-09-05T12:46:52.436 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-09-05T12:46:52.436 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-09-05T12:46:52.436 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-09-05T12:46:52.436 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-09-05T12:46:52.436 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-09-05T12:46:52.436 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-09-05T12:46:52.436 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:52.606 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 108/160 2024-09-05T12:46:52.622 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 108/160 2024-09-05T12:46:52.623 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:52.623 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T12:46:52.623 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:54.109 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 109/160 2024-09-05T12:46:54.136 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 109/160 2024-09-05T12:46:54.137 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:54.137 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T12:46:54.137 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T12:46:54.137 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T12:46:54.137 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 110/160 2024-09-05T12:46:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 110/160 2024-09-05T12:46:54.402 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:54.402 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T12:46:54.402 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T12:46:54.402 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T12:46:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 111/160 2024-09-05T12:46:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 111/160 2024-09-05T12:46:54.861 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:54.861 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T12:46:54.861 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T12:46:54.861 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T12:46:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:54.967 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.2-8.el9.noarch 112/160 2024-09-05T12:46:55.024 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/160 2024-09-05T12:46:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/160 2024-09-05T12:46:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/160 2024-09-05T12:46:55.321 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/160 2024-09-05T12:46:55.401 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/160 2024-09-05T12:46:55.489 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/160 2024-09-05T12:46:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/160 2024-09-05T12:46:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/160 2024-09-05T12:46:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/160 2024-09-05T12:46:55.726 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 107/160 2024-09-05T12:46:55.726 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-09-05T12:46:55.726 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-09-05T12:46:55.726 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-09-05T12:46:55.726 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-09-05T12:46:55.726 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-09-05T12:46:55.726 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-09-05T12:46:55.726 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-09-05T12:46:55.727 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:46:55.739 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-16.el9.x86_64 122/160 2024-09-05T12:46:55.921 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 108/160 2024-09-05T12:46:55.938 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 108/160 2024-09-05T12:46:55.938 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:55.938 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T12:46:55.938 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:46:56.143 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 123/160 2024-09-05T12:46:56.171 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 123/160 2024-09-05T12:46:56.202 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-261.ge856d6b2.el 124/160 2024-09-05T12:46:56.265 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-261.ge856d6b2.e 125/160 2024-09-05T12:46:56.293 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noar 126/160 2024-09-05T12:46:57.239 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 107/160 2024-09-05T12:46:57.239 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-05T12:46:57.239 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-05T12:46:57.239 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-05T12:46:57.239 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-05T12:46:57.239 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-05T12:46:57.239 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-05T12:46:57.240 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-05T12:46:57.240 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:46:57.347 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noar 126/160 2024-09-05T12:46:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.no 127/160 2024-09-05T12:46:57.382 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 109/160 2024-09-05T12:46:57.408 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 109/160 2024-09-05T12:46:57.408 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:57.408 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T12:46:57.409 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T12:46:57.409 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T12:46:57.409 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:46:57.409 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 108/160 2024-09-05T12:46:57.433 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 108/160 2024-09-05T12:46:57.433 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:57.433 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T12:46:57.433 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:46:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 110/160 2024-09-05T12:46:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 110/160 2024-09-05T12:46:57.664 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:57.664 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T12:46:57.664 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T12:46:57.664 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T12:46:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:46:58.108 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 111/160 2024-09-05T12:46:58.131 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 111/160 2024-09-05T12:46:58.131 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:58.131 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T12:46:58.132 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T12:46:58.132 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T12:46:58.132 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:46:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.2-8.el9.noarch 112/160 2024-09-05T12:46:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/160 2024-09-05T12:46:58.333 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/160 2024-09-05T12:46:58.348 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.no 127/160 2024-09-05T12:46:58.370 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-261.ge856 128/160 2024-09-05T12:46:58.475 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-261.ge856 128/160 2024-09-05T12:46:58.516 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/160 2024-09-05T12:46:58.566 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/160 2024-09-05T12:46:58.635 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/160 2024-09-05T12:46:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-261.ge856d6b2.el9 129/160 2024-09-05T12:46:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 130/160 2024-09-05T12:46:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 130/160 2024-09-05T12:46:58.691 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:58.691 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T12:46:58.691 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T12:46:58.691 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T12:46:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:58.725 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/160 2024-09-05T12:46:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 131/160 2024-09-05T12:46:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 131/160 2024-09-05T12:46:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:19.1.1-261.ge856d6b2.el9.x86_64 132/160 2024-09-05T12:46:58.855 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/160 2024-09-05T12:46:58.891 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/160 2024-09-05T12:46:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 133/160 2024-09-05T12:46:58.904 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 109/160 2024-09-05T12:46:58.924 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/160 2024-09-05T12:46:58.930 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 109/160 2024-09-05T12:46:58.930 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:58.930 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T12:46:58.930 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T12:46:58.931 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T12:46:58.931 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:46:58.968 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-16.el9.x86_64 122/160 2024-09-05T12:46:59.154 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 110/160 2024-09-05T12:46:59.178 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 110/160 2024-09-05T12:46:59.178 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:59.178 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T12:46:59.178 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T12:46:59.178 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T12:46:59.178 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:46:59.432 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 123/160 2024-09-05T12:46:59.459 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 123/160 2024-09-05T12:46:59.490 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-261.ge856d6b2.el 124/160 2024-09-05T12:46:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-261.ge856d6b2.e 125/160 2024-09-05T12:46:59.582 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noar 126/160 2024-09-05T12:46:59.613 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 111/160 2024-09-05T12:46:59.637 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 111/160 2024-09-05T12:46:59.637 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:59.637 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T12:46:59.637 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T12:46:59.637 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T12:46:59.637 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:46:59.743 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 112/160 2024-09-05T12:46:59.792 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/160 2024-09-05T12:46:59.822 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-46.el9.x86_64 134/160 2024-09-05T12:46:59.856 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/160 2024-09-05T12:46:59.859 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 135/160 2024-09-05T12:46:59.883 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 135/160 2024-09-05T12:46:59.883 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:59.883 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T12:46:59.883 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T12:46:59.884 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T12:46:59.884 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:59.926 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-261.ge856d6 136/160 2024-09-05T12:46:59.950 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-261.ge856d6 136/160 2024-09-05T12:46:59.950 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:46:59.950 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T12:46:59.950 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:46:59.994 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 137/160 2024-09-05T12:47:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 137/160 2024-09-05T12:47:00.017 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:00.018 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T12:47:00.018 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T12:47:00.018 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T12:47:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:47:00.040 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/160 2024-09-05T12:47:00.089 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/160 2024-09-05T12:47:00.166 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/160 2024-09-05T12:47:00.263 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/160 2024-09-05T12:47:00.328 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 138/160 2024-09-05T12:47:00.351 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 138/160 2024-09-05T12:47:00.351 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:00.351 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T12:47:00.351 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T12:47:00.351 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T12:47:00.352 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:47:00.395 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/160 2024-09-05T12:47:00.431 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/160 2024-09-05T12:47:00.463 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/160 2024-09-05T12:47:00.499 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 122/160 2024-09-05T12:47:00.617 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noar 126/160 2024-09-05T12:47:00.650 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.no 127/160 2024-09-05T12:47:00.862 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 123/160 2024-09-05T12:47:00.890 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 123/160 2024-09-05T12:47:00.921 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-261.ge856d6b2.el 124/160 2024-09-05T12:47:00.984 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-261.ge856d6b2.e 125/160 2024-09-05T12:47:01.013 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noar 126/160 2024-09-05T12:47:01.613 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.no 127/160 2024-09-05T12:47:01.634 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-261.ge856 128/160 2024-09-05T12:47:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-261.ge856 128/160 2024-09-05T12:47:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-261.ge856d6b2.el9 129/160 2024-09-05T12:47:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 130/160 2024-09-05T12:47:01.960 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 130/160 2024-09-05T12:47:01.960 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:01.960 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T12:47:01.960 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T12:47:01.961 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T12:47:01.961 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:47:02.012 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 131/160 2024-09-05T12:47:02.024 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 131/160 2024-09-05T12:47:02.049 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noar 126/160 2024-09-05T12:47:02.082 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.no 127/160 2024-09-05T12:47:02.121 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.1.1-261.ge856d6b2.el9.x86_64 132/160 2024-09-05T12:47:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 133/160 2024-09-05T12:47:03.045 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.no 127/160 2024-09-05T12:47:03.074 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-261.ge856 128/160 2024-09-05T12:47:03.087 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-46.el9.x86_64 134/160 2024-09-05T12:47:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 135/160 2024-09-05T12:47:03.146 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 135/160 2024-09-05T12:47:03.146 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:03.146 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T12:47:03.147 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T12:47:03.147 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T12:47:03.147 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:47:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-261.ge856 128/160 2024-09-05T12:47:03.190 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-261.ge856d6 136/160 2024-09-05T12:47:03.213 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-261.ge856d6 136/160 2024-09-05T12:47:03.213 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:03.213 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T12:47:03.213 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:47:03.257 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 137/160 2024-09-05T12:47:03.280 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 137/160 2024-09-05T12:47:03.281 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:03.281 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T12:47:03.281 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T12:47:03.281 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T12:47:03.281 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:47:03.343 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-261.ge856d6b2.el9 129/160 2024-09-05T12:47:03.376 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 130/160 2024-09-05T12:47:03.400 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 130/160 2024-09-05T12:47:03.400 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:03.400 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T12:47:03.401 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T12:47:03.401 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T12:47:03.401 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:47:03.452 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 131/160 2024-09-05T12:47:03.463 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 131/160 2024-09-05T12:47:03.560 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.1.1-261.ge856d6b2.el9.x86_64 132/160 2024-09-05T12:47:03.591 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 138/160 2024-09-05T12:47:03.608 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 133/160 2024-09-05T12:47:03.614 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 138/160 2024-09-05T12:47:03.615 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:03.615 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T12:47:03.615 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T12:47:03.615 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T12:47:03.615 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:47:04.529 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 134/160 2024-09-05T12:47:04.563 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 135/160 2024-09-05T12:47:04.586 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 135/160 2024-09-05T12:47:04.586 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:04.586 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T12:47:04.586 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T12:47:04.587 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T12:47:04.587 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:47:04.630 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-261.ge856d6 136/160 2024-09-05T12:47:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-261.ge856d6 136/160 2024-09-05T12:47:04.653 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:04.653 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T12:47:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:47:04.698 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 137/160 2024-09-05T12:47:04.721 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 137/160 2024-09-05T12:47:04.721 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:04.721 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T12:47:04.722 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T12:47:04.722 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T12:47:04.722 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:47:04.873 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:19.1.1-261.ge856d6b2.el9.x86_64 139/160 2024-09-05T12:47:04.914 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 140/160 2024-09-05T12:47:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:19.1.1-261.ge856d6b2.el9.x86_64 141/160 2024-09-05T12:47:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 142/160 2024-09-05T12:47:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 143/160 2024-09-05T12:47:05.023 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 138/160 2024-09-05T12:47:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 138/160 2024-09-05T12:47:05.047 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T12:47:05.047 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T12:47:05.047 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T12:47:05.047 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T12:47:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:47:05.204 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-shell-2:19.1.1-261.ge856d6b2.el9.x86_64 144/160 2024-09-05T12:47:05.253 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 145/160 2024-09-05T12:47:05.283 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:19.1.1-261.ge856d6b2.el9.x86_6 146/160 2024-09-05T12:47:05.313 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 147/160 2024-09-05T12:47:05.368 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 148/160 2024-09-05T12:47:05.966 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T12:47:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T12:47:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T12:47:06.888 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:19.1.1-261.ge856d6b2.el9.noarch 150/160 2024-09-05T12:47:06.978 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 151/160 2024-09-05T12:47:07.011 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/160 2024-09-05T12:47:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/160 2024-09-05T12:47:07.139 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/160 2024-09-05T12:47:07.165 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 155/160 2024-09-05T12:47:07.165 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T12:47:07.250 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T12:47:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 157/160 2024-09-05T12:47:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T12:47:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T12:47:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T12:47:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.1.1-261.ge856d6b2.el9.x86_64 139/160 2024-09-05T12:47:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 140/160 2024-09-05T12:47:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.1.1-261.ge856d6b2.el9.x86_64 141/160 2024-09-05T12:47:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 142/160 2024-09-05T12:47:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 143/160 2024-09-05T12:47:08.473 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-shell-2:19.1.1-261.ge856d6b2.el9.x86_64 144/160 2024-09-05T12:47:08.525 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 145/160 2024-09-05T12:47:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.1.1-261.ge856d6b2.el9.x86_6 146/160 2024-09-05T12:47:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 147/160 2024-09-05T12:47:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 148/160 2024-09-05T12:47:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T12:47:09.229 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T12:47:09.249 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T12:47:09.610 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.1.1-261.ge856d6b2.el9.x86_64 139/160 2024-09-05T12:47:09.651 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 140/160 2024-09-05T12:47:09.693 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.1.1-261.ge856d6b2.el9.x86_64 141/160 2024-09-05T12:47:09.724 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 142/160 2024-09-05T12:47:09.760 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 143/160 2024-09-05T12:47:09.940 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.1.1-261.ge856d6b2.el9.x86_64 144/160 2024-09-05T12:47:09.982 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 145/160 2024-09-05T12:47:10.013 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.1.1-261.ge856d6b2.el9.x86_6 146/160 2024-09-05T12:47:10.042 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 147/160 2024-09-05T12:47:10.080 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 148/160 2024-09-05T12:47:10.081 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:19.1.1-261.ge856d6b2.el9.noarch 150/160 2024-09-05T12:47:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 151/160 2024-09-05T12:47:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/160 2024-09-05T12:47:10.282 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/160 2024-09-05T12:47:10.329 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/160 2024-09-05T12:47:10.355 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 155/160 2024-09-05T12:47:10.355 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T12:47:10.447 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T12:47:10.471 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 157/160 2024-09-05T12:47:10.477 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:10.477 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:10.657 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:10.657 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T12:47:10.702 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T12:47:10.741 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T12:47:10.741 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T12:47:10.757 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T12:47:10.777 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T12:47:11.616 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.1.1-261.ge856d6b2.el9.noarch 150/160 2024-09-05T12:47:11.710 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 151/160 2024-09-05T12:47:11.751 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/160 2024-09-05T12:47:11.831 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/160 2024-09-05T12:47:11.863 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/160 2024-09-05T12:47:11.889 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 155/160 2024-09-05T12:47:11.889 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T12:47:11.973 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T12:47:11.998 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 157/160 2024-09-05T12:47:12.004 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:12.004 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:12.184 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:12.184 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T12:47:12.276 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T12:47:12.276 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T12:47:13.216 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T12:47:13.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:19.1.1-261.ge856d6b2.el9.x86_64 1/160 2024-09-05T12:47:13.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 2/160 2024-09-05T12:47:13.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 3/160 2024-09-05T12:47:13.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 4/160 2024-09-05T12:47:13.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-261.ge856d6 5/160 2024-09-05T12:47:13.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 6/160 2024-09-05T12:47:13.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 7/160 2024-09-05T12:47:13.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 8/160 2024-09-05T12:47:13.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 9/160 2024-09-05T12:47:13.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 10/160 2024-09-05T12:47:13.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 11/160 2024-09-05T12:47:13.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:19.1.1-261.ge856d6b2.el9.x86_64 12/160 2024-09-05T12:47:13.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 13/160 2024-09-05T12:47:13.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-shell-2:19.1.1-261.ge856d6b2.el9.x86_64 14/160 2024-09-05T12:47:13.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:19.1.1-261.ge856d6b2.el9.x86_6 15/160 2024-09-05T12:47:13.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 16/160 2024-09-05T12:47:13.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 17/160 2024-09-05T12:47:13.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 18/160 2024-09-05T12:47:13.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_ 19/160 2024-09-05T12:47:13.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 20/160 2024-09-05T12:47:13.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:19.1.1-261.ge856d6b2.el9 21/160 2024-09-05T12:47:13.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:19.1.1-261.ge856d6b2.el9.x 22/160 2024-09-05T12:47:13.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:19.1.1-261.ge856d6b2.el9.x86_64 23/160 2024-09-05T12:47:13.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:19.1.1-261.ge856d6b2.el9.x86_64 24/160 2024-09-05T12:47:13.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:19.1.1-261.ge856d6b2.el9.x86_64 25/160 2024-09-05T12:47:13.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:19.1.1-261.ge856d6b2.el9.x86_64 26/160 2024-09-05T12:47:13.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 27/160 2024-09-05T12:47:13.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 28/160 2024-09-05T12:47:13.229 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:19.1.1-261.ge856d6b2.el9.x86_64 29/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-261.ge856d6b2.e 30/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noar 31/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.no 32/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-261.ge856 33/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-261.ge856d6b2.el9 34/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 35/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-261.ge856d6b2.el 36/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 37/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 38/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:19.1.1-261.ge856d6b2.el9.noarch 39/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/160 2024-09-05T12:47:13.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-09-05T12:47:13.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/160 2024-09-05T12:47:13.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-09-05T12:47:13.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/160 2024-09-05T12:47:13.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/160 2024-09-05T12:47:13.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/160 2024-09-05T12:47:13.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/160 2024-09-05T12:47:13.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 149/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 151/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/160 2024-09-05T12:47:13.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 153/160 2024-09-05T12:47:13.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/160 2024-09-05T12:47:13.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 155/160 2024-09-05T12:47:13.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/160 2024-09-05T12:47:13.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 157/160 2024-09-05T12:47:13.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:13.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 159/160 2024-09-05T12:47:16.068 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/160 2024-09-05T12:47:16.068 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:47:16.068 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-09-05T12:47:16.068 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:16.068 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:16.068 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:16.068 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:16.068 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.070 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T12:47:16.071 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.072 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T12:47:16.073 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T12:47:16.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T12:47:16.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T12:47:16.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T12:47:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T12:47:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.079 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:16.080 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T12:47:16.080 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T12:47:16.080 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T12:47:16.080 INFO:teuthology.orchestra.run.smithi169.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T12:47:16.080 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T12:47:16.080 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T12:47:16.080 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T12:47:16.080 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:47:16.080 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-05T12:47:16.415 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T12:47:16.415 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.1.1-261.ge856d6b2.el9.x86_64 1/160 2024-09-05T12:47:16.415 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 2/160 2024-09-05T12:47:16.415 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 3/160 2024-09-05T12:47:16.415 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 4/160 2024-09-05T12:47:16.415 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-261.ge856d6 5/160 2024-09-05T12:47:16.415 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 6/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 7/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 8/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 9/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 10/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 11/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.1.1-261.ge856d6b2.el9.x86_64 12/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 13/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-shell-2:19.1.1-261.ge856d6b2.el9.x86_64 14/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.1.1-261.ge856d6b2.el9.x86_6 15/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 16/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 17/160 2024-09-05T12:47:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 18/160 2024-09-05T12:47:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_ 19/160 2024-09-05T12:47:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 20/160 2024-09-05T12:47:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.1.1-261.ge856d6b2.el9 21/160 2024-09-05T12:47:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.1.1-261.ge856d6b2.el9.x 22/160 2024-09-05T12:47:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.1.1-261.ge856d6b2.el9.x86_64 23/160 2024-09-05T12:47:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.1.1-261.ge856d6b2.el9.x86_64 24/160 2024-09-05T12:47:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.1.1-261.ge856d6b2.el9.x86_64 25/160 2024-09-05T12:47:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.1.1-261.ge856d6b2.el9.x86_64 26/160 2024-09-05T12:47:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 27/160 2024-09-05T12:47:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 28/160 2024-09-05T12:47:16.434 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.1.1-261.ge856d6b2.el9.x86_64 29/160 2024-09-05T12:47:16.434 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-261.ge856d6b2.e 30/160 2024-09-05T12:47:16.434 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noar 31/160 2024-09-05T12:47:16.434 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.no 32/160 2024-09-05T12:47:16.434 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-261.ge856 33/160 2024-09-05T12:47:16.434 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-261.ge856d6b2.el9 34/160 2024-09-05T12:47:16.434 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 35/160 2024-09-05T12:47:16.434 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-261.ge856d6b2.el 36/160 2024-09-05T12:47:16.434 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 37/160 2024-09-05T12:47:16.434 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 38/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:19.1.1-261.ge856d6b2.el9.noarch 39/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-09-05T12:47:16.435 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-09-05T12:47:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-09-05T12:47:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/160 2024-09-05T12:47:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-09-05T12:47:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-09-05T12:47:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-09-05T12:47:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-09-05T12:47:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-09-05T12:47:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-09-05T12:47:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-09-05T12:47:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/160 2024-09-05T12:47:16.437 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-09-05T12:47:16.438 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/160 2024-09-05T12:47:16.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/160 2024-09-05T12:47:16.440 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/160 2024-09-05T12:47:16.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/160 2024-09-05T12:47:16.442 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 149/160 2024-09-05T12:47:16.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/160 2024-09-05T12:47:16.444 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 151/160 2024-09-05T12:47:16.444 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/160 2024-09-05T12:47:16.444 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 153/160 2024-09-05T12:47:16.444 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/160 2024-09-05T12:47:16.444 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 155/160 2024-09-05T12:47:16.444 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/160 2024-09-05T12:47:16.444 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 157/160 2024-09-05T12:47:16.444 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:16.444 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 159/160 2024-09-05T12:47:16.469 DEBUG:teuthology.parallel:result is None 2024-09-05T12:47:17.932 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T12:47:17.932 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.1.1-261.ge856d6b2.el9.x86_64 1/160 2024-09-05T12:47:17.932 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 2/160 2024-09-05T12:47:17.932 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 3/160 2024-09-05T12:47:17.932 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 4/160 2024-09-05T12:47:17.932 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-261.ge856d6 5/160 2024-09-05T12:47:17.932 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 6/160 2024-09-05T12:47:17.932 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 7/160 2024-09-05T12:47:17.933 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 8/160 2024-09-05T12:47:17.933 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 9/160 2024-09-05T12:47:17.933 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 10/160 2024-09-05T12:47:17.933 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 11/160 2024-09-05T12:47:17.933 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.1.1-261.ge856d6b2.el9.x86_64 12/160 2024-09-05T12:47:17.933 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 13/160 2024-09-05T12:47:17.933 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.1.1-261.ge856d6b2.el9.x86_64 14/160 2024-09-05T12:47:17.933 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.1.1-261.ge856d6b2.el9.x86_6 15/160 2024-09-05T12:47:17.933 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 16/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 17/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 18/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_ 19/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 20/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.1.1-261.ge856d6b2.el9 21/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.1.1-261.ge856d6b2.el9.x 22/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.1.1-261.ge856d6b2.el9.x86_64 23/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.1.1-261.ge856d6b2.el9.x86_64 24/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.1.1-261.ge856d6b2.el9.x86_64 25/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.1.1-261.ge856d6b2.el9.x86_64 26/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 27/160 2024-09-05T12:47:17.934 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 28/160 2024-09-05T12:47:17.935 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.1.1-261.ge856d6b2.el9.x86_64 29/160 2024-09-05T12:47:17.935 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-261.ge856d6b2.e 30/160 2024-09-05T12:47:17.935 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noar 31/160 2024-09-05T12:47:17.935 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.no 32/160 2024-09-05T12:47:17.935 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-261.ge856 33/160 2024-09-05T12:47:17.935 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-261.ge856d6b2.el9 34/160 2024-09-05T12:47:17.935 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 35/160 2024-09-05T12:47:17.935 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-261.ge856d6b2.el 36/160 2024-09-05T12:47:17.935 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 37/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 38/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.1.1-261.ge856d6b2.el9.noarch 39/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-09-05T12:47:17.936 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/160 2024-09-05T12:47:17.937 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/160 2024-09-05T12:47:17.938 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/160 2024-09-05T12:47:17.939 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/160 2024-09-05T12:47:17.940 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/160 2024-09-05T12:47:17.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/160 2024-09-05T12:47:17.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/160 2024-09-05T12:47:17.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/160 2024-09-05T12:47:17.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/160 2024-09-05T12:47:17.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/160 2024-09-05T12:47:17.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/160 2024-09-05T12:47:17.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/160 2024-09-05T12:47:17.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/160 2024-09-05T12:47:17.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/160 2024-09-05T12:47:17.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/160 2024-09-05T12:47:17.942 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/160 2024-09-05T12:47:17.943 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 149/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 151/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 153/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 155/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 157/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T12:47:17.944 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 159/160 2024-09-05T12:47:19.236 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/160 2024-09-05T12:47:19.236 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:47:19.236 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T12:47:19.237 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:19.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T12:47:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T12:47:19.240 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T12:47:19.241 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T12:47:19.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T12:47:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T12:47:19.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T12:47:19.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T12:47:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T12:47:19.248 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T12:47:19.249 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T12:47:19.249 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T12:47:19.249 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:47:19.249 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-05T12:47:19.658 DEBUG:teuthology.parallel:result is None 2024-09-05T12:47:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/160 2024-09-05T12:47:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:47:20.582 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-05T12:47:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.1.1-261.ge856d6b2.el9.noarch 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T12:47:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T12:47:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T12:47:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T12:47:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T12:47:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T12:47:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T12:47:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T12:47:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T12:47:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T12:47:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T12:47:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T12:47:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T12:47:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T12:47:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T12:47:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T12:47:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T12:47:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T12:47:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T12:47:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T12:47:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T12:47:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T12:47:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T12:47:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T12:47:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T12:47:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.1.1-261.ge856d6b2.el9.x86_64 2024-09-05T12:47:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T12:47:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T12:47:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T12:47:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T12:47:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T12:47:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T12:47:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T12:47:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:47:20.596 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-05T12:47:20.988 DEBUG:teuthology.parallel:result is None 2024-09-05T12:47:20.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:47:21.135 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T12:47:21.161 INFO:teuthology.orchestra.run.smithi073.stdout:19.1.1-261.ge856d6b2.el9 2024-09-05T12:47:21.162 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-261.ge856d6b2.el9 2024-09-05T12:47:21.162 INFO:teuthology.task.install:The correct ceph version 19.1.1-261.ge856d6b2 is installed. 2024-09-05T12:47:21.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:47:21.301 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T12:47:21.325 INFO:teuthology.orchestra.run.smithi162.stdout:19.1.1-261.ge856d6b2.el9 2024-09-05T12:47:21.325 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-261.ge856d6b2.el9 2024-09-05T12:47:21.326 INFO:teuthology.task.install:The correct ceph version 19.1.1-261.ge856d6b2 is installed. 2024-09-05T12:47:21.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:47:21.469 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T12:47:21.495 INFO:teuthology.orchestra.run.smithi169.stdout:19.1.1-261.ge856d6b2.el9 2024-09-05T12:47:21.496 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-261.ge856d6b2.el9 2024-09-05T12:47:21.496 INFO:teuthology.task.install:The correct ceph version 19.1.1-261.ge856d6b2 is installed. 2024-09-05T12:47:21.497 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-05T12:47:21.498 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:47:21.498 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T12:47:21.530 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:47:21.531 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T12:47:21.562 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:47:21.562 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T12:47:21.595 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-05T12:47:21.595 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:47:21.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T12:47:21.626 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T12:47:21.694 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:47:21.694 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T12:47:21.723 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T12:47:21.790 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:47:21.790 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T12:47:21.820 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T12:47:21.889 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-05T12:47:21.889 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:47:21.889 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T12:47:21.918 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T12:47:21.987 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:47:21.988 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T12:47:22.015 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T12:47:22.081 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:47:22.081 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T12:47:22.110 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T12:47:22.176 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-05T12:47:22.177 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:47:22.177 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T12:47:22.207 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T12:47:22.277 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:47:22.277 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T12:47:22.304 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T12:47:22.371 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:47:22.371 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T12:47:22.398 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T12:47:22.465 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-05T12:47:22.552 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request', 'SLOW_OPS', 'slow request'], 'sha1': 'e856d6b2462509a377ef39149a05475ed006ebac', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-05T12:47:22.556 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:47:22.556 INFO:tasks.cephadm:Cluster fsid is febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:47:22.557 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-05T12:47:22.557 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.73', 'mon.b': '172.21.15.162', 'mon.c': '172.21.15.169'} 2024-09-05T12:47:22.557 INFO:tasks.cephadm:First mon is mon.a on smithi073 2024-09-05T12:47:22.557 INFO:tasks.cephadm:First mgr is x 2024-09-05T12:47:22.557 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-05T12:47:22.557 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname $(hostname -s) 2024-09-05T12:47:22.587 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-09-05T12:47:22.616 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname $(hostname -s) 2024-09-05T12:47:22.644 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-05T12:47:22.644 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:47:22.782 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e856d6b2462509a377ef39149a05475ed006ebac', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82800/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-261-ge856d6b2', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-261.ge856d6b2'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-05 10:44:16.424921', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-bharath6-testing-2024-09-05-1413-squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-05T12:47:22.918 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-bharath6-testing-2024-09-05-1413-squid, sha1 e856d6b2462509a377ef39149a05475ed006ebac from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:47:22.920 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/x86_64/flavors/default/cephadm 2024-09-05T12:47:22.920 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/x86_64/flavors/default/cephadm 2024-09-05T12:47:22.920 DEBUG:teuthology.orchestra.run.smithi073:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-05T12:47:23.314 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r--. 1 ubuntu ubuntu 784415 Sep 5 12:47 /home/ubuntu/cephtest/cephadm 2024-09-05T12:47:23.315 DEBUG:teuthology.orchestra.run.smithi162:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-05T12:47:23.724 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r--. 1 ubuntu ubuntu 784415 Sep 5 12:47 /home/ubuntu/cephtest/cephadm 2024-09-05T12:47:23.724 DEBUG:teuthology.orchestra.run.smithi169:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-bharath6-testing-2024-09-05-1413-squid/e856d6b2462509a377ef39149a05475ed006ebac/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-05T12:47:24.121 INFO:teuthology.orchestra.run.smithi169.stdout:-rw-r--r--. 1 ubuntu ubuntu 784415 Sep 5 12:47 /home/ubuntu/cephtest/cephadm 2024-09-05T12:47:24.122 DEBUG:teuthology.orchestra.run.smithi073:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-05T12:47:24.142 DEBUG:teuthology.orchestra.run.smithi162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-05T12:47:24.161 DEBUG:teuthology.orchestra.run.smithi169:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-05T12:47:24.200 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac on all hosts... 2024-09-05T12:47:24.200 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac pull 2024-09-05T12:47:24.202 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac pull 2024-09-05T12:47:24.205 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac pull 2024-09-05T12:47:25.781 INFO:teuthology.orchestra.run.smithi169.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac... 2024-09-05T12:47:25.876 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac... 2024-09-05T12:47:25.879 INFO:teuthology.orchestra.run.smithi073.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac... 2024-09-05T12:47:52.895 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-05T12:47:52.895 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 19.1.1-261-ge856d6b2 (e856d6b2462509a377ef39149a05475ed006ebac) squid (stable)", 2024-09-05T12:47:52.895 INFO:teuthology.orchestra.run.smithi169.stdout: "image_id": "1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232", 2024-09-05T12:47:52.895 INFO:teuthology.orchestra.run.smithi169.stdout: "repo_digests": [ 2024-09-05T12:47:52.895 INFO:teuthology.orchestra.run.smithi169.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945" 2024-09-05T12:47:52.895 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-09-05T12:47:52.895 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-05T12:48:01.302 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-05T12:48:01.302 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.1.1-261-ge856d6b2 (e856d6b2462509a377ef39149a05475ed006ebac) squid (stable)", 2024-09-05T12:48:01.302 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232", 2024-09-05T12:48:01.302 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-09-05T12:48:01.302 INFO:teuthology.orchestra.run.smithi162.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945" 2024-09-05T12:48:01.302 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-05T12:48:01.302 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-05T12:48:02.729 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:48:02.729 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-261-ge856d6b2 (e856d6b2462509a377ef39149a05475ed006ebac) squid (stable)", 2024-09-05T12:48:02.729 INFO:teuthology.orchestra.run.smithi073.stdout: "image_id": "1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232", 2024-09-05T12:48:02.729 INFO:teuthology.orchestra.run.smithi073.stdout: "repo_digests": [ 2024-09-05T12:48:02.729 INFO:teuthology.orchestra.run.smithi073.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945" 2024-09-05T12:48:02.730 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-05T12:48:02.730 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:48:02.755 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph 2024-09-05T12:48:02.803 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-09-05T12:48:02.837 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph 2024-09-05T12:48:02.871 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /etc/ceph 2024-09-05T12:48:02.897 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-09-05T12:48:02.926 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /etc/ceph 2024-09-05T12:48:02.955 INFO:tasks.cephadm:Writing seed config... 2024-09-05T12:48:02.956 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-05T12:48:02.956 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-05T12:48:02.956 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-05T12:48:02.956 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-05T12:48:02.956 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-05T12:48:02.956 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-05T12:48:02.956 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-05T12:48:02.957 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-05T12:48:02.958 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-05T12:48:02.959 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-05T12:48:02.960 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:48:02.960 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-05T12:48:02.975 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = febf1dd4-6b84-11ef-bcd6-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-05T12:48:02.976 DEBUG:teuthology.orchestra.run.smithi073:mon.a> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.a.service 2024-09-05T12:48:03.018 DEBUG:teuthology.orchestra.run.smithi073:mgr.x> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.x.service 2024-09-05T12:48:03.062 INFO:tasks.cephadm:Bootstrapping... 2024-09-05T12:48:03.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac -v bootstrap --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.73 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-05T12:48:03.277 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-05T12:48:03.277 INFO:teuthology.orchestra.run.smithi073.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac', '-v', 'bootstrap', '--fsid', 'febf1dd4-6b84-11ef-bcd6-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.73', '--skip-admin-label'] 2024-09-05T12:48:03.278 INFO:teuthology.orchestra.run.smithi073.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-05T12:48:03.278 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying podman|docker is present... 2024-09-05T12:48:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 5.2.2 2024-09-05T12:48:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying lvm2 is present... 2024-09-05T12:48:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying time synchronization is in place... 2024-09-05T12:48:03.309 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-05T12:48:03.309 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-05T12:48:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-05T12:48:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-05T12:48:03.322 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout enabled 2024-09-05T12:48:03.328 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout active 2024-09-05T12:48:03.329 INFO:teuthology.orchestra.run.smithi073.stdout:Unit chronyd.service is enabled and running 2024-09-05T12:48:03.329 INFO:teuthology.orchestra.run.smithi073.stdout:Repeating the final host check... 2024-09-05T12:48:03.350 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 5.2.2 2024-09-05T12:48:03.350 INFO:teuthology.orchestra.run.smithi073.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-05T12:48:03.350 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl is present 2024-09-05T12:48:03.351 INFO:teuthology.orchestra.run.smithi073.stdout:lvcreate is present 2024-09-05T12:48:03.357 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-05T12:48:03.357 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-05T12:48:03.363 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-05T12:48:03.363 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-05T12:48:03.369 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout enabled 2024-09-05T12:48:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout active 2024-09-05T12:48:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:Unit chronyd.service is enabled and running 2024-09-05T12:48:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:Host looks OK 2024-09-05T12:48:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:Cluster fsid: febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:Acquiring lock 140001793340416 on /run/cephadm/febf1dd4-6b84-11ef-bcd6-c7b262605968.lock 2024-09-05T12:48:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:Lock 140001793340416 acquired on /run/cephadm/febf1dd4-6b84-11ef-bcd6-c7b262605968.lock 2024-09-05T12:48:03.377 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying IP 172.21.15.73 port 3300 ... 2024-09-05T12:48:03.377 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying IP 172.21.15.73 port 6789 ... 2024-09-05T12:48:03.377 INFO:teuthology.orchestra.run.smithi073.stdout:Base mon IP(s) is [172.21.15.73:3300, 172.21.15.73:6789], mon addrv is [v2:172.21.15.73:3300,v1:172.21.15.73:6789] 2024-09-05T12:48:03.380 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.73 metric 100 2024-09-05T12:48:03.380 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.73 metric 100 2024-09-05T12:48:03.383 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-05T12:48:03.383 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-05T12:48:03.383 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-05T12:48:03.386 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-05T12:48:03.386 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-05T12:48:03.386 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-05T12:48:03.386 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-05T12:48:03.386 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link noprefixroute 2024-09-05T12:48:03.386 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-05T12:48:03.387 INFO:teuthology.orchestra.run.smithi073.stdout:Mon IP `172.21.15.73` is in CIDR network `172.21.0.0/20` 2024-09-05T12:48:03.387 INFO:teuthology.orchestra.run.smithi073.stdout:Mon IP `172.21.15.73` is in CIDR network `172.21.0.0/20` 2024-09-05T12:48:03.387 INFO:teuthology.orchestra.run.smithi073.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-05T12:48:03.387 INFO:teuthology.orchestra.run.smithi073.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-05T12:48:03.388 INFO:teuthology.orchestra.run.smithi073.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac... 2024-09-05T12:48:03.865 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 2024-09-05T12:48:03.866 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac... 2024-09-05T12:48:03.866 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Getting image source signatures 2024-09-05T12:48:03.866 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying blob sha256:57827424943d9f7b8fbbdf71efc0609494faf4d42198e71777a8add52eb57a7e 2024-09-05T12:48:03.866 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-05T12:48:03.866 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying config sha256:1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 2024-09-05T12:48:03.866 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-05T12:48:04.679 INFO:teuthology.orchestra.run.smithi073.stdout:ceph: stdout ceph version 19.1.1-261-ge856d6b2 (e856d6b2462509a377ef39149a05475ed006ebac) squid (stable) 2024-09-05T12:48:04.679 INFO:teuthology.orchestra.run.smithi073.stdout:Ceph version: ceph version 19.1.1-261-ge856d6b2 (e856d6b2462509a377ef39149a05475ed006ebac) squid (stable) 2024-09-05T12:48:04.679 INFO:teuthology.orchestra.run.smithi073.stdout:Extracting ceph user uid/gid from container image... 2024-09-05T12:48:05.651 INFO:teuthology.orchestra.run.smithi073.stdout:stat: stdout 167 167 2024-09-05T12:48:05.651 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial keys... 2024-09-05T12:48:06.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQCFqNlmlp4XORAAgiDCJdSlrV743IqD7ewiNg== 2024-09-05T12:48:07.555 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQCGqNlmhVF/MhAAylHM/yCHunCdgHuRJMNDhw== 2024-09-05T12:48:08.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQCHqNlmoy5xMxAAfgGm7kh8Xp6HbbhVAFUTAw== 2024-09-05T12:48:08.511 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial monmap... 2024-09-05T12:48:09.451 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-05T12:48:09.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-05T12:48:09.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:09.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-05T12:48:09.452 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool for a [v2:172.21.15.73:3300,v1:172.21.15.73:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-05T12:48:09.452 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = quincy 2024-09-05T12:48:09.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: set fsid to febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:09.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-05T12:48:09.452 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:48:09.452 INFO:teuthology.orchestra.run.smithi073.stdout:Creating mon... 2024-09-05T12:48:10.391 INFO:teuthology.orchestra.run.smithi073.stdout:create mon.a on 2024-09-05T12:48:10.606 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-05T12:48:10.751 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-05T12:48:10.951 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968.target → /etc/systemd/system/ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968.target. 2024-09-05T12:48:10.951 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968.target → /etc/systemd/system/ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968.target. 2024-09-05T12:48:11.190 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.a 2024-09-05T12:48:11.191 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to reset failed state of unit ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.a.service: Unit ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.a.service not loaded. 2024-09-05T12:48:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968.target.wants/ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.a.service → /etc/systemd/system/ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@.service. 2024-09-05T12:48:11.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:11 smithi073 podman[30502]: 2024-09-05 12:48:11.820450642 +0000 UTC m=+0.339047453 container start d1250a326ee0bb7311d0276615522c650548050a40e236359cf305fcb223ddc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, org.label-schema.vendor=CentOS) 2024-09-05T12:48:11.909 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T12:48:11.909 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-09-05T12:48:11.916 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T12:48:11.916 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-05T12:48:11.916 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-09-05T12:48:11.916 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to enable service . firewalld.service is not available 2024-09-05T12:48:11.916 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mon to start... 2024-09-05T12:48:11.916 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mon... 2024-09-05T12:48:12.131 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:11 smithi073 ceph-mon[30521]: mkfs febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:12.131 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:11 smithi073 ceph-mon[30521]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-05T12:48:12.131 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:11 smithi073 bash[30502]: d1250a326ee0bb7311d0276615522c650548050a40e236359cf305fcb223ddc4 2024-09-05T12:48:12.131 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:11 smithi073 systemd[1]: Started Ceph mon.a for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:48:12.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout cluster: 2024-09-05T12:48:12.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout id: febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:12.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-05T12:48:12.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:12.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout services: 2024-09-05T12:48:12.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.534379s) 2024-09-05T12:48:12.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-05T12:48:12.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-05T12:48:12.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:12.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout data: 2024-09-05T12:48:12.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-05T12:48:12.973 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-05T12:48:12.973 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-05T12:48:12.973 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout pgs: 2024-09-05T12:48:12.973 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:12.974 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.320+0000 7f484fc70640 1 Processor -- start 2024-09-05T12:48:12.974 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.321+0000 7f484fc70640 1 -- start start 2024-09-05T12:48:12.974 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.321+0000 7f484fc70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848106a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:12.974 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.321+0000 7f484fc70640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4848106fd0 con 0x7f4848106600 2024-09-05T12:48:12.974 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.321+0000 7f484da0c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848106a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:12.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.321+0000 7f484da0c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848106a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33642/0 (socket says 172.21.15.73:33642) 2024-09-05T12:48:12.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.321+0000 7f484da0c640 1 -- 172.21.15.73:0/3674528490 learned_addr learned my addr 172.21.15.73:0/3674528490 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:12.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.321+0000 7f484da0c640 1 -- 172.21.15.73:0/3674528490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4848107800 con 0x7f4848106600 2024-09-05T12:48:12.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.323+0000 7f484da0c640 1 --2- 172.21.15.73:0/3674528490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848106a00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f483c009820 tx=0x7f483c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29706e7f030b9b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:12.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.323+0000 7f484ca0a640 1 -- 172.21.15.73:0/3674528490 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f483c037070 con 0x7f4848106600 2024-09-05T12:48:12.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.324+0000 7f484ca0a640 1 -- 172.21.15.73:0/3674528490 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f483c032440 con 0x7f4848106600 2024-09-05T12:48:12.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.324+0000 7f484ca0a640 1 -- 172.21.15.73:0/3674528490 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f483c032740 con 0x7f4848106600 2024-09-05T12:48:12.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.324+0000 7f484fc70640 1 -- 172.21.15.73:0/3674528490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 msgr2=0x7f4848106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:12.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.324+0000 7f484fc70640 1 --2- 172.21.15.73:0/3674528490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848106a00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f483c009820 tx=0x7f483c02a270 comp rx=0 tx=0).stop 2024-09-05T12:48:12.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.324+0000 7f484fc70640 1 -- 172.21.15.73:0/3674528490 shutdown_connections 2024-09-05T12:48:12.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.324+0000 7f484fc70640 1 --2- 172.21.15.73:0/3674528490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848106a00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:12.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.324+0000 7f484fc70640 1 -- 172.21.15.73:0/3674528490 >> 172.21.15.73:0/3674528490 conn(0x7f4848101e10 msgr2=0x7f4848104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:12.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.324+0000 7f484fc70640 1 -- 172.21.15.73:0/3674528490 shutdown_connections 2024-09-05T12:48:12.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.324+0000 7f484fc70640 1 -- 172.21.15.73:0/3674528490 wait complete. 2024-09-05T12:48:12.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.325+0000 7f484fc70640 1 Processor -- start 2024-09-05T12:48:12.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.325+0000 7f484fc70640 1 -- start start 2024-09-05T12:48:12.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.325+0000 7f484fc70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:12.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.325+0000 7f484fc70640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4848107da0 con 0x7f4848106600 2024-09-05T12:48:12.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.325+0000 7f484da0c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:12.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.325+0000 7f484da0c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33654/0 (socket says 172.21.15.73:33654) 2024-09-05T12:48:12.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.325+0000 7f484da0c640 1 -- 172.21.15.73:0/1179333731 learned_addr learned my addr 172.21.15.73:0/1179333731 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:12.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.326+0000 7f484da0c640 1 -- 172.21.15.73:0/1179333731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484819a360 con 0x7f4848106600 2024-09-05T12:48:12.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.326+0000 7f484da0c640 1 --2- 172.21.15.73:0/1179333731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848199e20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f483c0090b0 tx=0x7f483c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:12.980 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.326+0000 7f483affd640 1 -- 172.21.15.73:0/1179333731 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f483c041070 con 0x7f4848106600 2024-09-05T12:48:12.980 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.326+0000 7f483affd640 1 -- 172.21.15.73:0/1179333731 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f483c03c7a0 con 0x7f4848106600 2024-09-05T12:48:12.980 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.326+0000 7f483affd640 1 -- 172.21.15.73:0/1179333731 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f483c037040 con 0x7f4848106600 2024-09-05T12:48:12.980 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.326+0000 7f484fc70640 1 -- 172.21.15.73:0/1179333731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484819a5f0 con 0x7f4848106600 2024-09-05T12:48:12.981 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.326+0000 7f484fc70640 1 -- 172.21.15.73:0/1179333731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f484819d2e0 con 0x7f4848106600 2024-09-05T12:48:12.981 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.326+0000 7f483affd640 1 -- 172.21.15.73:0/1179333731 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f483c044070 con 0x7f4848106600 2024-09-05T12:48:12.981 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.326+0000 7f483affd640 1 -- 172.21.15.73:0/1179333731 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f483c03d3f0 con 0x7f4848106600 2024-09-05T12:48:12.981 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.327+0000 7f484fc70640 1 -- 172.21.15.73:0/1179333731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48481083f0 con 0x7f4848106600 2024-09-05T12:48:12.981 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.329+0000 7f483affd640 1 -- 172.21.15.73:0/1179333731 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f483c046450 con 0x7f4848106600 2024-09-05T12:48:12.982 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.388+0000 7f484fc70640 1 -- 172.21.15.73:0/1179333731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f484802d940 con 0x7f4848106600 2024-09-05T12:48:12.982 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.388+0000 7f483affd640 1 -- 172.21.15.73:0/1179333731 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f483c046630 con 0x7f4848106600 2024-09-05T12:48:12.982 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.389+0000 7f484fc70640 1 -- 172.21.15.73:0/1179333731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 msgr2=0x7f4848199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:12.982 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.389+0000 7f484fc70640 1 --2- 172.21.15.73:0/1179333731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848199e20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f483c0090b0 tx=0x7f483c0046c0 comp rx=0 tx=0).stop 2024-09-05T12:48:12.983 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.389+0000 7f484fc70640 1 -- 172.21.15.73:0/1179333731 shutdown_connections 2024-09-05T12:48:12.983 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.389+0000 7f484fc70640 1 --2- 172.21.15.73:0/1179333731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848106600 0x7f4848199e20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:12.983 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.389+0000 7f484fc70640 1 -- 172.21.15.73:0/1179333731 >> 172.21.15.73:0/1179333731 conn(0x7f4848101e10 msgr2=0x7f484818e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:12.983 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.389+0000 7f484fc70640 1 -- 172.21.15.73:0/1179333731 shutdown_connections 2024-09-05T12:48:12.983 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:12.389+0000 7f484fc70640 1 -- 172.21.15.73:0/1179333731 wait complete. 2024-09-05T12:48:12.984 INFO:teuthology.orchestra.run.smithi073.stdout:mon is available 2024-09-05T12:48:12.984 INFO:teuthology.orchestra.run.smithi073.stdout:Assimilating anything we can from ceph.conf... 2024-09-05T12:48:13.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-05T12:48:13.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: monmap epoch 1 2024-09-05T12:48:13.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:13.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: last_changed 2024-09-05T12:48:08.867322+0000 2024-09-05T12:48:13.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: created 2024-09-05T12:48:08.867322+0000 2024-09-05T12:48:13.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: min_mon_release 19 (squid) 2024-09-05T12:48:13.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: election_strategy: 1 2024-09-05T12:48:13.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-05T12:48:13.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: fsmap 2024-09-05T12:48:13.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: osdmap e1: 0 total, 0 up, 0 in 2024-09-05T12:48:13.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: mgrmap e1: no daemons active 2024-09-05T12:48:13.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:12 smithi073 ceph-mon[30521]: from='client.? 172.21.15.73:0/1179333731' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-05T12:48:13.999 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [global] 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout fsid = febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.73:3300,v1:172.21.15.73:6789] 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [osd] 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.385+0000 7f5342647640 1 Processor -- start 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.385+0000 7f5342647640 1 -- start start 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.385+0000 7f5342647640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c107b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.385+0000 7f5342647640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f533c108100 con 0x7f533c107730 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.385+0000 7f533bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c107b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.385+0000 7f533bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c107b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57712/0 (socket says 172.21.15.73:57712) 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.385+0000 7f533bfff640 1 -- 172.21.15.73:0/734671431 learned_addr learned my addr 172.21.15.73:0/734671431 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:14.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.385+0000 7f533bfff640 1 -- 172.21.15.73:0/734671431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c108930 con 0x7f533c107730 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.386+0000 7f533bfff640 1 --2- 172.21.15.73:0/734671431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c107b30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f532c009820 tx=0x7f532c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac71423dcdafdff server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.386+0000 7f533b7fe640 1 -- 172.21.15.73:0/734671431 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c037070 con 0x7f533c107730 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.386+0000 7f533b7fe640 1 -- 172.21.15.73:0/734671431 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c032440 con 0x7f533c107730 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.386+0000 7f533b7fe640 1 -- 172.21.15.73:0/734671431 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c032740 con 0x7f533c107730 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.387+0000 7f5342647640 1 -- 172.21.15.73:0/734671431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 msgr2=0x7f533c107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.387+0000 7f5342647640 1 --2- 172.21.15.73:0/734671431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c107b30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f532c009820 tx=0x7f532c02a270 comp rx=0 tx=0).stop 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.387+0000 7f5342647640 1 -- 172.21.15.73:0/734671431 shutdown_connections 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.387+0000 7f5342647640 1 --2- 172.21.15.73:0/734671431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c107b30 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.387+0000 7f5342647640 1 -- 172.21.15.73:0/734671431 >> 172.21.15.73:0/734671431 conn(0x7f533c102fa0 msgr2=0x7f533c1053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.387+0000 7f5342647640 1 -- 172.21.15.73:0/734671431 shutdown_connections 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.387+0000 7f5342647640 1 -- 172.21.15.73:0/734671431 wait complete. 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.388+0000 7f5342647640 1 Processor -- start 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.388+0000 7f5342647640 1 -- start start 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.388+0000 7f5342647640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:14.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.388+0000 7f5342647640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f533c108ed0 con 0x7f533c107730 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.388+0000 7f533bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.388+0000 7f533bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57720/0 (socket says 172.21.15.73:57720) 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.388+0000 7f533bfff640 1 -- 172.21.15.73:0/1361463027 learned_addr learned my addr 172.21.15.73:0/1361463027 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.388+0000 7f533bfff640 1 -- 172.21.15.73:0/1361463027 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c199240 con 0x7f533c107730 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.388+0000 7f533bfff640 1 --2- 172.21.15.73:0/1361463027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c198d00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f532c0090b0 tx=0x7f532c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.389+0000 7f5339ffb640 1 -- 172.21.15.73:0/1361463027 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c041070 con 0x7f533c107730 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.389+0000 7f5339ffb640 1 -- 172.21.15.73:0/1361463027 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c03c7a0 con 0x7f533c107730 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.389+0000 7f5342647640 1 -- 172.21.15.73:0/1361463027 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c1994d0 con 0x7f533c107730 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.389+0000 7f5339ffb640 1 -- 172.21.15.73:0/1361463027 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c037040 con 0x7f533c107730 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.389+0000 7f5342647640 1 -- 172.21.15.73:0/1361463027 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c19c1b0 con 0x7f533c107730 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.389+0000 7f5339ffb640 1 -- 172.21.15.73:0/1361463027 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f532c044070 con 0x7f533c107730 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.389+0000 7f5339ffb640 1 -- 172.21.15.73:0/1361463027 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f532c046dd0 con 0x7f533c107730 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.390+0000 7f5342647640 1 -- 172.21.15.73:0/1361463027 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533c109520 con 0x7f533c107730 2024-09-05T12:48:14.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.392+0000 7f5339ffb640 1 -- 172.21.15.73:0/1361463027 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f532c046450 con 0x7f533c107730 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.447+0000 7f5342647640 1 -- 172.21.15.73:0/1361463027 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f533c19d910 con 0x7f533c107730 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.450+0000 7f5339ffb640 1 -- 172.21.15.73:0/1361463027 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+454 (secure 0 0 0) 0x7f532c046630 con 0x7f533c107730 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.451+0000 7f5339ffb640 1 -- 172.21.15.73:0/1361463027 <== mon.0 v2:172.21.15.73:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f532c055070 con 0x7f533c107730 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.452+0000 7f5342647640 1 -- 172.21.15.73:0/1361463027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 msgr2=0x7f533c198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.452+0000 7f5342647640 1 --2- 172.21.15.73:0/1361463027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c198d00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f532c0090b0 tx=0x7f532c0046c0 comp rx=0 tx=0).stop 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.452+0000 7f5342647640 1 -- 172.21.15.73:0/1361463027 shutdown_connections 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.452+0000 7f5342647640 1 --2- 172.21.15.73:0/1361463027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c107730 0x7f533c198d00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.452+0000 7f5342647640 1 -- 172.21.15.73:0/1361463027 >> 172.21.15.73:0/1361463027 conn(0x7f533c102fa0 msgr2=0x7f533c103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.452+0000 7f5342647640 1 -- 172.21.15.73:0/1361463027 shutdown_connections 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:13.452+0000 7f5342647640 1 -- 172.21.15.73:0/1361463027 wait complete. 2024-09-05T12:48:14.004 INFO:teuthology.orchestra.run.smithi073.stdout:Generating new minimal ceph.conf... 2024-09-05T12:48:14.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:13 smithi073 ceph-mon[30521]: from='client.? 172.21.15.73:0/1361463027' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-05T12:48:14.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:13 smithi073 ceph-mon[30521]: from='client.? 172.21.15.73:0/1361463027' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-05T12:48:15.064 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:14 smithi073 ceph-mon[30521]: from='client.? 172.21.15.73:0/3420453179' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:48:15.071 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.375+0000 7fee77145640 1 Processor -- start 2024-09-05T12:48:15.071 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.376+0000 7fee77145640 1 -- start start 2024-09-05T12:48:15.071 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.376+0000 7fee77145640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee701063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:15.071 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.376+0000 7fee77145640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fee7007bdf0 con 0x7fee70105fc0 2024-09-05T12:48:15.071 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.376+0000 7fee74ee1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee701063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:15.071 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.376+0000 7fee74ee1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee701063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57736/0 (socket says 172.21.15.73:57736) 2024-09-05T12:48:15.071 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.376+0000 7fee74ee1640 1 -- 172.21.15.73:0/2434534309 learned_addr learned my addr 172.21.15.73:0/2434534309 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:15.071 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.376+0000 7fee74ee1640 1 -- 172.21.15.73:0/2434534309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee70106900 con 0x7fee70105fc0 2024-09-05T12:48:15.071 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.377+0000 7fee74ee1640 1 --2- 172.21.15.73:0/2434534309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee701063c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009820 tx=0x7fee6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c0884b9b67546b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:15.071 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.377+0000 7fee677fe640 1 -- 172.21.15.73:0/2434534309 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee6c037070 con 0x7fee70105fc0 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.377+0000 7fee677fe640 1 -- 172.21.15.73:0/2434534309 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee6c032900 con 0x7fee70105fc0 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.377+0000 7fee677fe640 1 -- 172.21.15.73:0/2434534309 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee6c030850 con 0x7fee70105fc0 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.377+0000 7fee77145640 1 -- 172.21.15.73:0/2434534309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 msgr2=0x7fee701063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.377+0000 7fee77145640 1 --2- 172.21.15.73:0/2434534309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee701063c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009820 tx=0x7fee6c02a270 comp rx=0 tx=0).stop 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee77145640 1 -- 172.21.15.73:0/2434534309 shutdown_connections 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee77145640 1 --2- 172.21.15.73:0/2434534309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee701063c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee77145640 1 -- 172.21.15.73:0/2434534309 >> 172.21.15.73:0/2434534309 conn(0x7fee70101e10 msgr2=0x7fee70104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee77145640 1 -- 172.21.15.73:0/2434534309 shutdown_connections 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee77145640 1 -- 172.21.15.73:0/2434534309 wait complete. 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee77145640 1 Processor -- start 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee77145640 1 -- start start 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee77145640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee7019d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee77145640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fee70107a00 con 0x7fee70105fc0 2024-09-05T12:48:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee74ee1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee7019d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee74ee1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee7019d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57740/0 (socket says 172.21.15.73:57740) 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.378+0000 7fee74ee1640 1 -- 172.21.15.73:0/3420453179 learned_addr learned my addr 172.21.15.73:0/3420453179 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.379+0000 7fee74ee1640 1 -- 172.21.15.73:0/3420453179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7019dec0 con 0x7fee70105fc0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.379+0000 7fee74ee1640 1 --2- 172.21.15.73:0/3420453179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee7019d980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0097f0 tx=0x7fee6c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.379+0000 7fee65ffb640 1 -- 172.21.15.73:0/3420453179 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee6c042070 con 0x7fee70105fc0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.379+0000 7fee65ffb640 1 -- 172.21.15.73:0/3420453179 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee6c032ca0 con 0x7fee70105fc0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.379+0000 7fee77145640 1 -- 172.21.15.73:0/3420453179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7019e150 con 0x7fee70105fc0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.379+0000 7fee65ffb640 1 -- 172.21.15.73:0/3420453179 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee6c037040 con 0x7fee70105fc0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.379+0000 7fee77145640 1 -- 172.21.15.73:0/3420453179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee701a0e40 con 0x7fee70105fc0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.379+0000 7fee65ffb640 1 -- 172.21.15.73:0/3420453179 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee6c045070 con 0x7fee70105fc0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.379+0000 7fee65ffb640 1 -- 172.21.15.73:0/3420453179 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fee6c047a90 con 0x7fee70105fc0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.380+0000 7fee77145640 1 -- 172.21.15.73:0/3420453179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee701063c0 con 0x7fee70105fc0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.382+0000 7fee65ffb640 1 -- 172.21.15.73:0/3420453179 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fee6c03db10 con 0x7fee70105fc0 2024-09-05T12:48:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.440+0000 7fee77145640 1 -- 172.21.15.73:0/3420453179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fee70196df0 con 0x7fee70105fc0 2024-09-05T12:48:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.440+0000 7fee65ffb640 1 -- 172.21.15.73:0/3420453179 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fee6c03d430 con 0x7fee70105fc0 2024-09-05T12:48:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.441+0000 7fee77145640 1 -- 172.21.15.73:0/3420453179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 msgr2=0x7fee7019d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.441+0000 7fee77145640 1 --2- 172.21.15.73:0/3420453179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee7019d980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0097f0 tx=0x7fee6c030ec0 comp rx=0 tx=0).stop 2024-09-05T12:48:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.441+0000 7fee77145640 1 -- 172.21.15.73:0/3420453179 shutdown_connections 2024-09-05T12:48:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.441+0000 7fee77145640 1 --2- 172.21.15.73:0/3420453179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70105fc0 0x7fee7019d980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.441+0000 7fee77145640 1 -- 172.21.15.73:0/3420453179 >> 172.21.15.73:0/3420453179 conn(0x7fee70101e10 msgr2=0x7fee70191c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.442+0000 7fee77145640 1 -- 172.21.15.73:0/3420453179 shutdown_connections 2024-09-05T12:48:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:14.442+0000 7fee77145640 1 -- 172.21.15.73:0/3420453179 wait complete. 2024-09-05T12:48:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:Restarting the monitor... 2024-09-05T12:48:15.342 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:15 smithi073 systemd[1]: Stopping Ceph mon.a for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:48:15.639 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:15 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a[30517]: 2024-09-05T12:48:15.340+0000 7f93a115c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T12:48:15.639 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:15 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a[30517]: 2024-09-05T12:48:15.340+0000 7f93a115c640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-05T12:48:15.639 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:15 smithi073 podman[30761]: 2024-09-05 12:48:15.403142191 +0000 UTC m=+0.176134674 container died d1250a326ee0bb7311d0276615522c650548050a40e236359cf305fcb223ddc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-05T12:48:15.909 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:15 smithi073 podman[30761]: 2024-09-05 12:48:15.733034999 +0000 UTC m=+0.506027474 container cleanup d1250a326ee0bb7311d0276615522c650548050a40e236359cf305fcb223ddc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-05T12:48:15.910 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:15 smithi073 bash[30761]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a 2024-09-05T12:48:16.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:15 smithi073 podman[30774]: 2024-09-05 12:48:15.909095993 +0000 UTC m=+0.507858084 container remove d1250a326ee0bb7311d0276615522c650548050a40e236359cf305fcb223ddc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T12:48:16.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 systemd[1]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-05T12:48:16.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 systemd[1]: Stopped Ceph mon.a for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:48:16.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 systemd[1]: Starting Ceph mon.a for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:48:16.612 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 podman[30864]: 2024-09-05 12:48:16.262460302 +0000 UTC m=+0.016092000 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:48:16.612 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 podman[30864]: 2024-09-05 12:48:16.359920991 +0000 UTC m=+0.113552690 container create d41793c84463611329966ce36eba00866afd4a712939ae45769b6d041aad4bfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-05T12:48:16.612 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 podman[30864]: 2024-09-05 12:48:16.58770058 +0000 UTC m=+0.341332272 container init d41793c84463611329966ce36eba00866afd4a712939ae45769b6d041aad4bfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T12:48:16.612 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 podman[30864]: 2024-09-05 12:48:16.590825109 +0000 UTC m=+0.344456805 container start d41793c84463611329966ce36eba00866afd4a712939ae45769b6d041aad4bfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a, GIT_BRANCH=HEAD, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-05T12:48:16.693 INFO:teuthology.orchestra.run.smithi073.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-05T12:48:16.863 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: set uid:gid to 167:167 (ceph:ceph) 2024-09-05T12:48:16.863 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: ceph version 19.1.1-261-ge856d6b2 (e856d6b2462509a377ef39149a05475ed006ebac) squid (stable), process ceph-mon, pid 2 2024-09-05T12:48:16.863 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: pidfile_write: ignore empty --pid-file 2024-09-05T12:48:16.863 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: load: jerasure load: lrc 2024-09-05T12:48:16.863 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: RocksDB version: 7.9.2 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Git sha 0 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Compile date 2024-09-05 09:22:07 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: DB SUMMARY 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: DB Session ID: 1F45A7RR3BPUB7X7PRRH 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: CURRENT file: CURRENT 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: IDENTITY file: IDENTITY 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105830 ; 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.error_if_exists: 0 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.create_if_missing: 0 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.paranoid_checks: 1 2024-09-05T12:48:16.864 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.env: 0x5561e7953940 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.fs: PosixFileSystem 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.info_log: 0x5561e85eb6e0 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_file_opening_threads: 16 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.statistics: (nil) 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.use_fsync: 0 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_log_file_size: 0 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.keep_log_file_num: 1000 2024-09-05T12:48:16.865 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.recycle_log_file_num: 0 2024-09-05T12:48:16.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.allow_fallocate: 1 2024-09-05T12:48:16.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.allow_mmap_reads: 0 2024-09-05T12:48:16.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.allow_mmap_writes: 0 2024-09-05T12:48:16.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.use_direct_reads: 0 2024-09-05T12:48:16.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-05T12:48:16.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.create_missing_column_families: 0 2024-09-05T12:48:16.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.db_log_dir: 2024-09-05T12:48:16.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.wal_dir: 2024-09-05T12:48:16.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-05T12:48:16.867 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.advise_random_on_open: 1 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.db_write_buffer_size: 0 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.write_buffer_manager: 0x5561e85fadc0 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.rate_limiter: (nil) 2024-09-05T12:48:16.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.wal_recovery_mode: 2 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.enable_thread_tracking: 0 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.enable_pipelined_write: 0 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.unordered_write: 0 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.row_cache: None 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.wal_filter: None 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.allow_ingest_behind: 0 2024-09-05T12:48:16.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.two_write_queues: 0 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.manual_wal_flush: 0 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.wal_compression: 0 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.atomic_flush: 0 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.log_readahead_size: 0 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.best_efforts_recovery: 0 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.allow_data_in_errors: 0 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.db_host_id: __hostname__ 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-05T12:48:16.870 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_background_jobs: 2 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_background_compactions: -1 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_subcompactions: 1 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_total_wal_size: 0 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_open_files: -1 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bytes_per_sync: 0 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-05T12:48:16.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_readahead_size: 0 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_background_flushes: -1 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Compression algorithms supported: 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: kZSTD supported: 0 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: kXpressCompression supported: 0 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: kBZip2Compression supported: 0 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: kLZ4Compression supported: 1 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: kZlibCompression supported: 1 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: kLZ4HCCompression supported: 1 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: kSnappyCompression supported: 1 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-05T12:48:16.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.merge_operator: 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_filter: None 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_filter_factory: None 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.sst_partitioner_factory: None 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5561e85eb320) 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout: cache_index_and_filter_blocks: 1 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout: pin_top_level_index_and_filter: 1 2024-09-05T12:48:16.873 INFO:journalctl@ceph.mon.a.smithi073.stdout: index_type: 0 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: data_block_index_type: 0 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: index_shortening: 1 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: checksum: 4 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: no_block_cache: 0 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache: 0x5561e85df1f0 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache_name: BinnedLRUCache 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache_options: 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: capacity : 536870912 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: num_shard_bits : 4 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: strict_capacity_limit : 0 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: high_pri_pool_ratio: 0.000 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache_compressed: (nil) 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: persistent_cache: (nil) 2024-09-05T12:48:16.874 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_size: 4096 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_size_deviation: 10 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_restart_interval: 16 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: index_block_restart_interval: 1 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: metadata_block_size: 4096 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: partition_filters: 0 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: use_delta_encoding: 1 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: filter_policy: bloomfilter 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: whole_key_filtering: 1 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: verify_compression: 0 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: read_amp_bytes_per_bit: 0 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: format_version: 5 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: enable_index_compression: 1 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_align: 0 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: max_auto_readahead_size: 262144 2024-09-05T12:48:16.875 INFO:journalctl@ceph.mon.a.smithi073.stdout: prepopulate_block_cache: 0 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout: initial_auto_readahead_size: 8192 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout: num_file_reads_for_auto_readahead: 2 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.write_buffer_size: 33554432 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_write_buffer_number: 2 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compression: NoCompression 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bottommost_compression: Disabled 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.prefix_extractor: nullptr 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.num_levels: 7 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-05T12:48:16.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-05T12:48:16.877 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-05T12:48:16.877 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-05T12:48:16.877 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-05T12:48:16.877 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-05T12:48:16.877 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-05T12:48:16.877 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-05T12:48:16.877 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-05T12:48:16.877 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-05T12:48:16.877 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-05T12:48:16.877 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compression_opts.level: 32767 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compression_opts.strategy: 0 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compression_opts.enabled: false 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.target_file_size_base: 67108864 2024-09-05T12:48:16.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-05T12:48:16.879 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.arena_block_size: 1048576 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.disable_auto_compactions: 0 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-05T12:48:16.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.inplace_update_support: 0 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.bloom_locality: 0 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.max_successive_merges: 0 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.paranoid_file_checks: 0 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.force_consistency_checks: 1 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.report_bg_io_stats: 0 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.ttl: 2592000 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-05T12:48:16.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.enable_blob_files: false 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.min_blob_size: 0 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.blob_file_size: 268435456 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.blob_file_starting_level: 0 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: da753048-5e2e-43a1-8b90-f9f70a9f2aac 2024-09-05T12:48:16.882 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725540496616823, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725540496617833, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100833, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98717, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14429, "raw_average_key_size": 49, "raw_value_size": 90926, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725540496, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "da753048-5e2e-43a1-8b90-f9f70a9f2aac", "db_session_id": "1F45A7RR3BPUB7X7PRRH", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725540496617939, "job": 1, "event": "recovery_finished"} 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5561e860ce00 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: DB pointer 0x5561e8708000 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** DB Stats ** 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-05T12:48:16.883 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** Compaction Stats [default] ** 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: L0 2/0 100.33 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 149.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: Sum 2/0 100.33 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 149.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 149.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** Compaction Stats [default] ** 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-05T12:48:16.884 INFO:journalctl@ceph.mon.a.smithi073.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 149.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative compaction: 0.00 GB write, 29.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval compaction: 0.00 GB write, 29.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: Block cache BinnedLRUCache@0x5561e85df1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-05T12:48:16.885 INFO:journalctl@ceph.mon.a.smithi073.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: starting mon.a rank 0 at public addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] at bind addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: mon.a@-1(???) e1 preinit fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: mon.a@-1(???).mds e1 new map 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: mon.a@-1(???).mds e1 print_map 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout: e1 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout: btime 2024-09-05T12:48:11:856233+0000 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout: legacy client fscid: -1 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout: No filesystems configured 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-05T12:48:16.886 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: monmap epoch 1 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: last_changed 2024-09-05T12:48:08.867322+0000 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: created 2024-09-05T12:48:08.867322+0000 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: min_mon_release 19 (squid) 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: election_strategy: 1 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: fsmap 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: osdmap e1: 0 total, 0 up, 0 in 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 ceph-mon[30883]: mgrmap e1: no daemons active 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 bash[30864]: d41793c84463611329966ce36eba00866afd4a712939ae45769b6d041aad4bfe 2024-09-05T12:48:16.887 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:16 smithi073 systemd[1]: Started Ceph mon.a for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:48:17.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.072+0000 7f9e5a347640 1 Processor -- start 2024-09-05T12:48:17.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.072+0000 7f9e5a347640 1 -- start start 2024-09-05T12:48:17.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.072+0000 7f9e5a347640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e54107b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:17.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.072+0000 7f9e5a347640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9e54108100 con 0x7f9e54107730 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.073+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e54107b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.073+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e54107b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57754/0 (socket says 172.21.15.73:57754) 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.073+0000 7f9e53fff640 1 -- 172.21.15.73:0/1144498490 learned_addr learned my addr 172.21.15.73:0/1144498490 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.073+0000 7f9e53fff640 1 -- 172.21.15.73:0/1144498490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e54108930 con 0x7f9e54107730 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.075+0000 7f9e53fff640 1 --2- 172.21.15.73:0/1144498490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e54107b30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009820 tx=0x7f9e4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f925a16e4682146 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.076+0000 7f9e52ffd640 1 -- 172.21.15.73:0/1144498490 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e44037070 con 0x7f9e54107730 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.076+0000 7f9e52ffd640 1 -- 172.21.15.73:0/1144498490 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e44032900 con 0x7f9e54107730 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.076+0000 7f9e52ffd640 1 -- 172.21.15.73:0/1144498490 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e44030850 con 0x7f9e54107730 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.076+0000 7f9e5a347640 1 -- 172.21.15.73:0/1144498490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 msgr2=0x7f9e54107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.076+0000 7f9e5a347640 1 --2- 172.21.15.73:0/1144498490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e54107b30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009820 tx=0x7f9e4402a270 comp rx=0 tx=0).stop 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.076+0000 7f9e5a347640 1 -- 172.21.15.73:0/1144498490 shutdown_connections 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.076+0000 7f9e5a347640 1 --2- 172.21.15.73:0/1144498490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e54107b30 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.076+0000 7f9e5a347640 1 -- 172.21.15.73:0/1144498490 >> 172.21.15.73:0/1144498490 conn(0x7f9e54102fa0 msgr2=0x7f9e541053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:17.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.076+0000 7f9e5a347640 1 -- 172.21.15.73:0/1144498490 shutdown_connections 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.076+0000 7f9e5a347640 1 -- 172.21.15.73:0/1144498490 wait complete. 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.077+0000 7f9e5a347640 1 Processor -- start 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.077+0000 7f9e5a347640 1 -- start start 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.077+0000 7f9e5a347640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e5419b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.077+0000 7f9e5a347640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5410bce0 con 0x7f9e54107730 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.077+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e5419b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.077+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e5419b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57762/0 (socket says 172.21.15.73:57762) 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.077+0000 7f9e53fff640 1 -- 172.21.15.73:0/3291176952 learned_addr learned my addr 172.21.15.73:0/3291176952 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.078+0000 7f9e53fff640 1 -- 172.21.15.73:0/3291176952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5419bc90 con 0x7f9e54107730 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.078+0000 7f9e53fff640 1 --2- 172.21.15.73:0/3291176952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e5419b750 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009940 tx=0x7f9e44032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.078+0000 7f9e517fa640 1 -- 172.21.15.73:0/3291176952 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e44042070 con 0x7f9e54107730 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.078+0000 7f9e517fa640 1 -- 172.21.15.73:0/3291176952 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e440308c0 con 0x7f9e54107730 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.078+0000 7f9e5a347640 1 -- 172.21.15.73:0/3291176952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5419bf20 con 0x7f9e54107730 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.078+0000 7f9e517fa640 1 -- 172.21.15.73:0/3291176952 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e44037040 con 0x7f9e54107730 2024-09-05T12:48:17.687 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.078+0000 7f9e5a347640 1 -- 172.21.15.73:0/3291176952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5419ec10 con 0x7f9e54107730 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.078+0000 7f9e517fa640 1 -- 172.21.15.73:0/3291176952 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9e44045070 con 0x7f9e54107730 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.078+0000 7f9e517fa640 1 -- 172.21.15.73:0/3291176952 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9e44047bc0 con 0x7f9e54107730 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.079+0000 7f9e5a347640 1 -- 172.21.15.73:0/3291176952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e5410be60 con 0x7f9e54107730 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.081+0000 7f9e517fa640 1 -- 172.21.15.73:0/3291176952 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9e440327b0 con 0x7f9e54107730 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.137+0000 7f9e5a347640 1 -- 172.21.15.73:0/3291176952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f9e54107bb0 con 0x7f9e54107730 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.142+0000 7f9e517fa640 1 -- 172.21.15.73:0/3291176952 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f9e4403c870 con 0x7f9e54107730 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.142+0000 7f9e5a347640 1 -- 172.21.15.73:0/3291176952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 msgr2=0x7f9e5419b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.142+0000 7f9e5a347640 1 --2- 172.21.15.73:0/3291176952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e5419b750 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009940 tx=0x7f9e44032ce0 comp rx=0 tx=0).stop 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.143+0000 7f9e5a347640 1 -- 172.21.15.73:0/3291176952 shutdown_connections 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.143+0000 7f9e5a347640 1 --2- 172.21.15.73:0/3291176952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e54107730 0x7f9e5419b750 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.143+0000 7f9e5a347640 1 -- 172.21.15.73:0/3291176952 >> 172.21.15.73:0/3291176952 conn(0x7f9e54102fa0 msgr2=0x7f9e54103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.143+0000 7f9e5a347640 1 -- 172.21.15.73:0/3291176952 shutdown_connections 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:17.143+0000 7f9e5a347640 1 -- 172.21.15.73:0/3291176952 wait complete. 2024-09-05T12:48:17.688 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-05T12:48:17.703 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-05T12:48:17.703 INFO:teuthology.orchestra.run.smithi073.stdout:Creating mgr... 2024-09-05T12:48:17.703 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-05T12:48:17.704 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-05T12:48:17.953 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.x 2024-09-05T12:48:17.953 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to reset failed state of unit ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.x.service: Unit ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.x.service not loaded. 2024-09-05T12:48:18.099 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968.target.wants/ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@.service. 2024-09-05T12:48:18.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:18 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3291176952' entity='client.admin' 2024-09-05T12:48:18.583 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:18 smithi073 podman[31094]: 2024-09-05 12:48:18.526836027 +0000 UTC m=+0.310283326 container start f384e21e7493e107091640cb28203b93603712bf2c26622e61fc46c91dbf8179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T12:48:18.597 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T12:48:18.597 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-09-05T12:48:18.604 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T12:48:18.605 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-05T12:48:18.605 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-09-05T12:48:18.605 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to enable service . firewalld.service is not available 2024-09-05T12:48:18.613 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T12:48:18.613 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-09-05T12:48:18.620 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T12:48:18.620 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-05T12:48:18.621 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-09-05T12:48:18.621 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-05T12:48:18.621 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr to start... 2024-09-05T12:48:18.621 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr... 2024-09-05T12:48:18.864 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:18 smithi073 bash[31094]: f384e21e7493e107091640cb28203b93603712bf2c26622e61fc46c91dbf8179 2024-09-05T12:48:18.864 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:18 smithi073 systemd[1]: Started Ceph mgr.x for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:48:18.864 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:18 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:18.653+0000 7f9043af6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T12:48:18.864 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:18 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:18.710+0000 7f9043af6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T12:48:18.864 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:18 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:18.861+0000 7f9043af6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T12:48:19.127 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:18 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:18.930+0000 7f9043af6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T12:48:19.128 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:19 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:19.087+0000 7f9043af6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T12:48:19.481 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:19 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3815735135' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-05T12:48:19.481 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:19 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:19.239+0000 7f9043af6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T12:48:19.756 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:19 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:19.560+0000 7f9043af6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T12:48:19.756 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:19 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:19.622+0000 7f9043af6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T12:48:19.761 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:19.761 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-05T12:48:19.761 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "febf1dd4-6b84-11ef-bcd6-c7b262605968", 2024-09-05T12:48:19.761 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2024-09-05T12:48:19.761 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-05T12:48:19.761 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-05T12:48:19.761 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-05T12:48:19.761 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "a" 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-05T12:48:19.762 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:19.763 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-05T12:48:19.763 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-05T12:48:19.763 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-05T12:48:19.770 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "btime": "2024-09-05T12:48:11:856233+0000", 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-05T12:48:19.771 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2024-09-05T12:48:11.856875+0000", 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.055+0000 7f35565ae640 1 Processor -- start 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.055+0000 7f35565ae640 1 -- start start 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.055+0000 7f35565ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355010a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.055+0000 7f35565ae640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f355007be10 con 0x7f35501081b0 2024-09-05T12:48:19.772 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.055+0000 7f354ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355010a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.055+0000 7f354ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355010a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57796/0 (socket says 172.21.15.73:57796) 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.055+0000 7f354ffff640 1 -- 172.21.15.73:0/1544789405 learned_addr learned my addr 172.21.15.73:0/1544789405 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.056+0000 7f354ffff640 1 -- 172.21.15.73:0/1544789405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355010aae0 con 0x7f35501081b0 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.056+0000 7f354ffff640 1 --2- 172.21.15.73:0/1544789405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355010a5a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3540009820 tx=0x7f354002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432eb71253306cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.057+0000 7f354effd640 1 -- 172.21.15.73:0/1544789405 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3540037070 con 0x7f35501081b0 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.057+0000 7f354effd640 1 -- 172.21.15.73:0/1544789405 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3540032900 con 0x7f35501081b0 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.057+0000 7f354effd640 1 -- 172.21.15.73:0/1544789405 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3540030850 con 0x7f35501081b0 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.057+0000 7f35565ae640 1 -- 172.21.15.73:0/1544789405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 msgr2=0x7f355010a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.057+0000 7f35565ae640 1 --2- 172.21.15.73:0/1544789405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355010a5a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3540009820 tx=0x7f354002a270 comp rx=0 tx=0).stop 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.057+0000 7f35565ae640 1 -- 172.21.15.73:0/1544789405 shutdown_connections 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.057+0000 7f35565ae640 1 --2- 172.21.15.73:0/1544789405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355010a5a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.057+0000 7f35565ae640 1 -- 172.21.15.73:0/1544789405 >> 172.21.15.73:0/1544789405 conn(0x7f3550101e10 msgr2=0x7f3550104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.057+0000 7f35565ae640 1 -- 172.21.15.73:0/1544789405 shutdown_connections 2024-09-05T12:48:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.057+0000 7f35565ae640 1 -- 172.21.15.73:0/1544789405 wait complete. 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.058+0000 7f35565ae640 1 Processor -- start 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.058+0000 7f35565ae640 1 -- start start 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.058+0000 7f35565ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.058+0000 7f35565ae640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f355010bb20 con 0x7f35501081b0 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.058+0000 7f354ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.059+0000 7f354ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355019b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57800/0 (socket says 172.21.15.73:57800) 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.059+0000 7f354ffff640 1 -- 172.21.15.73:0/3815735135 learned_addr learned my addr 172.21.15.73:0/3815735135 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.059+0000 7f354ffff640 1 -- 172.21.15.73:0/3815735135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355019bca0 con 0x7f35501081b0 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.059+0000 7f354ffff640 1 --2- 172.21.15.73:0/3815735135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355019b760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3540031000 tx=0x7f35400326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.059+0000 7f354d7fa640 1 -- 172.21.15.73:0/3815735135 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3540042070 con 0x7f35501081b0 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.059+0000 7f35565ae640 1 -- 172.21.15.73:0/3815735135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355019bf30 con 0x7f35501081b0 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.059+0000 7f354d7fa640 1 -- 172.21.15.73:0/3815735135 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3540032be0 con 0x7f35501081b0 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.059+0000 7f354d7fa640 1 -- 172.21.15.73:0/3815735135 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3540037040 con 0x7f35501081b0 2024-09-05T12:48:19.774 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.059+0000 7f35565ae640 1 -- 172.21.15.73:0/3815735135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f355019ec20 con 0x7f35501081b0 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.060+0000 7f354d7fa640 1 -- 172.21.15.73:0/3815735135 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3540045070 con 0x7f35501081b0 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.060+0000 7f354d7fa640 1 -- 172.21.15.73:0/3815735135 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3540047b70 con 0x7f35501081b0 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.060+0000 7f35565ae640 1 -- 172.21.15.73:0/3815735135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3550108610 con 0x7f35501081b0 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.064+0000 7f354d7fa640 1 -- 172.21.15.73:0/3815735135 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f354004c030 con 0x7f35501081b0 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.125+0000 7f35565ae640 1 -- 172.21.15.73:0/3815735135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f355019edf0 con 0x7f35501081b0 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.126+0000 7f354d7fa640 1 -- 172.21.15.73:0/3815735135 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f3540032d90 con 0x7f35501081b0 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.127+0000 7f35565ae640 1 -- 172.21.15.73:0/3815735135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 msgr2=0x7f355019b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.127+0000 7f35565ae640 1 --2- 172.21.15.73:0/3815735135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355019b760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3540031000 tx=0x7f35400326e0 comp rx=0 tx=0).stop 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.127+0000 7f35565ae640 1 -- 172.21.15.73:0/3815735135 shutdown_connections 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.127+0000 7f35565ae640 1 --2- 172.21.15.73:0/3815735135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35501081b0 0x7f355019b760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.127+0000 7f35565ae640 1 -- 172.21.15.73:0/3815735135 >> 172.21.15.73:0/3815735135 conn(0x7f3550101e10 msgr2=0x7f3550102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:19.775 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.127+0000 7f35565ae640 1 -- 172.21.15.73:0/3815735135 shutdown_connections 2024-09-05T12:48:19.776 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:19.127+0000 7f35565ae640 1 -- 172.21.15.73:0/3815735135 wait complete. 2024-09-05T12:48:19.776 INFO:teuthology.orchestra.run.smithi073.stdout:mgr not available, waiting (1/15)... 2024-09-05T12:48:20.013 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:19 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:19.811+0000 7f9043af6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T12:48:21.013 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:20 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:20.697+0000 7f9043af6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T12:48:21.013 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:20 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:20.766+0000 7f9043af6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T12:48:21.737 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:21 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:21.479+0000 7f9043af6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T12:48:21.737 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:21 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:21.596+0000 7f9043af6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T12:48:21.737 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:21 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:21.736+0000 7f9043af6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T12:48:21.990 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:21 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:21.800+0000 7f9043af6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T12:48:21.990 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:21 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:21.953+0000 7f9043af6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T12:48:22.255 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:22 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:22.024+0000 7f9043af6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T12:48:22.255 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:22 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:22.086+0000 7f9043af6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T12:48:22.256 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:22 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:22.254+0000 7f9043af6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T12:48:22.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:22 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1311584549' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-05T12:48:22.513 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:22 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:22.325+0000 7f9043af6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T12:48:22.513 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:22 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:22.393+0000 7f9043af6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T12:48:22.513 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:22 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:22.476+0000 7f9043af6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T12:48:22.894 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:22 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:22.535+0000 7f9043af6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T12:48:22.894 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:22 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:22.594+0000 7f9043af6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T12:48:22.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:22.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-05T12:48:22.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "febf1dd4-6b84-11ef-bcd6-c7b262605968", 2024-09-05T12:48:22.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2024-09-05T12:48:22.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-05T12:48:22.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-05T12:48:22.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-05T12:48:22.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:22.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "a" 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:22.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-05T12:48:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "btime": "2024-09-05T12:48:11:856233+0000", 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-05T12:48:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2024-09-05T12:48:11.856875+0000", 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.153+0000 7f540c8ab640 1 Processor -- start 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.153+0000 7f540c8ab640 1 -- start start 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.153+0000 7f540c8ab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f5408106a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.154+0000 7f540c8ab640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5408106fd0 con 0x7f5408106600 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.154+0000 7f540659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f5408106a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.154+0000 7f540659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f5408106a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57806/0 (socket says 172.21.15.73:57806) 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.154+0000 7f540659c640 1 -- 172.21.15.73:0/1439476893 learned_addr learned my addr 172.21.15.73:0/1439476893 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.154+0000 7f540659c640 1 -- 172.21.15.73:0/1439476893 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5408107800 con 0x7f5408106600 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.155+0000 7f540659c640 1 --2- 172.21.15.73:0/1439476893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f5408106a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009820 tx=0x7f53f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6796c5d018d322d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.155+0000 7f5405d9b640 1 -- 172.21.15.73:0/1439476893 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f8037070 con 0x7f5408106600 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.155+0000 7f5405d9b640 1 -- 172.21.15.73:0/1439476893 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53f8032900 con 0x7f5408106600 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.155+0000 7f5405d9b640 1 -- 172.21.15.73:0/1439476893 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f8030850 con 0x7f5408106600 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.156+0000 7f540c8ab640 1 -- 172.21.15.73:0/1439476893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 msgr2=0x7f5408106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.156+0000 7f540c8ab640 1 --2- 172.21.15.73:0/1439476893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f5408106a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009820 tx=0x7f53f802a270 comp rx=0 tx=0).stop 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.156+0000 7f540c8ab640 1 -- 172.21.15.73:0/1439476893 shutdown_connections 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.156+0000 7f540c8ab640 1 --2- 172.21.15.73:0/1439476893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f5408106a00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.156+0000 7f540c8ab640 1 -- 172.21.15.73:0/1439476893 >> 172.21.15.73:0/1439476893 conn(0x7f5408101e10 msgr2=0x7f5408104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.156+0000 7f540c8ab640 1 -- 172.21.15.73:0/1439476893 shutdown_connections 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.156+0000 7f540c8ab640 1 -- 172.21.15.73:0/1439476893 wait complete. 2024-09-05T12:48:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.156+0000 7f540c8ab640 1 Processor -- start 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.156+0000 7f540c8ab640 1 -- start start 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f540c8ab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f540807ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f540c8ab640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f540810abb0 con 0x7f5408106600 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f540659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f540807ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f540659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f540807ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57812/0 (socket says 172.21.15.73:57812) 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f540659c640 1 -- 172.21.15.73:0/1311584549 learned_addr learned my addr 172.21.15.73:0/1311584549 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f540659c640 1 -- 172.21.15.73:0/1311584549 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540819e4e0 con 0x7f5408106600 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f540659c640 1 --2- 172.21.15.73:0/1311584549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f540807ba10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009940 tx=0x7f53f80326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f53ff7fe640 1 -- 172.21.15.73:0/1311584549 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f8042070 con 0x7f5408106600 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f53ff7fe640 1 -- 172.21.15.73:0/1311584549 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53f8032be0 con 0x7f5408106600 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f540c8ab640 1 -- 172.21.15.73:0/1311584549 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540819e6b0 con 0x7f5408106600 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.157+0000 7f53ff7fe640 1 -- 172.21.15.73:0/1311584549 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f8037040 con 0x7f5408106600 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.158+0000 7f540c8ab640 1 -- 172.21.15.73:0/1311584549 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f540819ead0 con 0x7f5408106600 2024-09-05T12:48:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.158+0000 7f53ff7fe640 1 -- 172.21.15.73:0/1311584549 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53f8045070 con 0x7f5408106600 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.158+0000 7f53ff7fe640 1 -- 172.21.15.73:0/1311584549 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f53f8047a80 con 0x7f5408106600 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.158+0000 7f540c8ab640 1 -- 172.21.15.73:0/1311584549 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f540810ad30 con 0x7f5408106600 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.160+0000 7f53ff7fe640 1 -- 172.21.15.73:0/1311584549 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f53f8032d90 con 0x7f5408106600 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.222+0000 7f540c8ab640 1 -- 172.21.15.73:0/1311584549 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f540819ed80 con 0x7f5408106600 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.222+0000 7f53ff7fe640 1 -- 172.21.15.73:0/1311584549 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f53f803d430 con 0x7f5408106600 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.223+0000 7f540c8ab640 1 -- 172.21.15.73:0/1311584549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 msgr2=0x7f540807ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.223+0000 7f540c8ab640 1 --2- 172.21.15.73:0/1311584549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f540807ba10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009940 tx=0x7f53f80326e0 comp rx=0 tx=0).stop 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.223+0000 7f540c8ab640 1 -- 172.21.15.73:0/1311584549 shutdown_connections 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.223+0000 7f540c8ab640 1 --2- 172.21.15.73:0/1311584549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5408106600 0x7f540807ba10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.223+0000 7f540c8ab640 1 -- 172.21.15.73:0/1311584549 >> 172.21.15.73:0/1311584549 conn(0x7f5408101e10 msgr2=0x7f5408102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.223+0000 7f540c8ab640 1 -- 172.21.15.73:0/1311584549 shutdown_connections 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:22.223+0000 7f540c8ab640 1 -- 172.21.15.73:0/1311584549 wait complete. 2024-09-05T12:48:22.958 INFO:teuthology.orchestra.run.smithi073.stdout:mgr not available, waiting (2/15)... 2024-09-05T12:48:23.763 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:23.387+0000 7f9043af6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T12:48:23.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: Activating manager daemon x 2024-09-05T12:48:23.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: mgrmap e2: x(active, starting, since 0.00283179s) 2024-09-05T12:48:23.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: from='mgr.14100 172.21.15.73:0/1826265974' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T12:48:23.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: from='mgr.14100 172.21.15.73:0/1826265974' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T12:48:23.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: from='mgr.14100 172.21.15.73:0/1826265974' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T12:48:23.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: from='mgr.14100 172.21.15.73:0/1826265974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:48:23.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: from='mgr.14100 172.21.15.73:0/1826265974' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T12:48:23.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: Manager daemon x is now available 2024-09-05T12:48:23.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: from='mgr.14100 172.21.15.73:0/1826265974' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T12:48:23.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: from='mgr.14100 172.21.15.73:0/1826265974' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T12:48:23.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: from='mgr.14100 172.21.15.73:0/1826265974' entity='mgr.x' 2024-09-05T12:48:23.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: from='mgr.14100 172.21.15.73:0/1826265974' entity='mgr.x' 2024-09-05T12:48:23.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:23 smithi073 ceph-mon[30883]: from='mgr.14100 172.21.15.73:0/1826265974' entity='mgr.x' 2024-09-05T12:48:25.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:25 smithi073 ceph-mon[30883]: mgrmap e3: x(active, since 1.00671s) 2024-09-05T12:48:26.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:26.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-05T12:48:26.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "febf1dd4-6b84-11ef-bcd6-c7b262605968", 2024-09-05T12:48:26.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2024-09-05T12:48:26.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-05T12:48:26.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-05T12:48:26.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-05T12:48:26.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:26.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "a" 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:26.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-05T12:48:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "btime": "2024-09-05T12:48:11:856233+0000", 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-05T12:48:26.171 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2024-09-05T12:48:11.856875+0000", 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.297+0000 7f614f16d640 1 Processor -- start 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.298+0000 7f614f16d640 1 -- start start 2024-09-05T12:48:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.298+0000 7f614f16d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614810a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.298+0000 7f614f16d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f614807be10 con 0x7f61481081b0 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.298+0000 7f614cf09640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614810a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.298+0000 7f614cf09640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614810a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55698/0 (socket says 172.21.15.73:55698) 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.298+0000 7f614cf09640 1 -- 172.21.15.73:0/3267427335 learned_addr learned my addr 172.21.15.73:0/3267427335 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.298+0000 7f614cf09640 1 -- 172.21.15.73:0/3267427335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614810aae0 con 0x7f61481081b0 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.299+0000 7f614cf09640 1 --2- 172.21.15.73:0/3267427335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614810a5a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6140009820 tx=0x7f614002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5e53bd4c1ef08d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.299+0000 7f61477fe640 1 -- 172.21.15.73:0/3267427335 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6140037070 con 0x7f61481081b0 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.299+0000 7f61477fe640 1 -- 172.21.15.73:0/3267427335 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6140032900 con 0x7f61481081b0 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.299+0000 7f61477fe640 1 -- 172.21.15.73:0/3267427335 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6140030850 con 0x7f61481081b0 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.300+0000 7f614f16d640 1 -- 172.21.15.73:0/3267427335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 msgr2=0x7f614810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.300+0000 7f614f16d640 1 --2- 172.21.15.73:0/3267427335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614810a5a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6140009820 tx=0x7f614002a270 comp rx=0 tx=0).stop 2024-09-05T12:48:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.300+0000 7f614f16d640 1 -- 172.21.15.73:0/3267427335 shutdown_connections 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.300+0000 7f614f16d640 1 --2- 172.21.15.73:0/3267427335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614810a5a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.300+0000 7f614f16d640 1 -- 172.21.15.73:0/3267427335 >> 172.21.15.73:0/3267427335 conn(0x7f6148101e10 msgr2=0x7f6148104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.300+0000 7f614f16d640 1 -- 172.21.15.73:0/3267427335 shutdown_connections 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.300+0000 7f614f16d640 1 -- 172.21.15.73:0/3267427335 wait complete. 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.301+0000 7f614f16d640 1 Processor -- start 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.301+0000 7f614f16d640 1 -- start start 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.301+0000 7f614f16d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614819b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.301+0000 7f614f16d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f614810bb20 con 0x7f61481081b0 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.301+0000 7f614cf09640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614819b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.301+0000 7f614cf09640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614819b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55700/0 (socket says 172.21.15.73:55700) 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.301+0000 7f614cf09640 1 -- 172.21.15.73:0/1980616681 learned_addr learned my addr 172.21.15.73:0/1980616681 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.301+0000 7f614cf09640 1 -- 172.21.15.73:0/1980616681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614819bca0 con 0x7f61481081b0 2024-09-05T12:48:26.174 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.301+0000 7f614cf09640 1 --2- 172.21.15.73:0/1980616681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614819b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f61400097f0 tx=0x7f6140030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.302+0000 7f6145ffb640 1 -- 172.21.15.73:0/1980616681 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6140042070 con 0x7f61481081b0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.302+0000 7f6145ffb640 1 -- 172.21.15.73:0/1980616681 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6140032ca0 con 0x7f61481081b0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.302+0000 7f614f16d640 1 -- 172.21.15.73:0/1980616681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614819bf30 con 0x7f61481081b0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.302+0000 7f6145ffb640 1 -- 172.21.15.73:0/1980616681 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6140037040 con 0x7f61481081b0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.302+0000 7f614f16d640 1 -- 172.21.15.73:0/1980616681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614819ec20 con 0x7f61481081b0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.303+0000 7f6145ffb640 1 -- 172.21.15.73:0/1980616681 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f6140045070 con 0x7f61481081b0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.303+0000 7f6145ffb640 1 --2- 172.21.15.73:0/1980616681 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f6134038e60 0x7f613403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.303+0000 7f614f16d640 1 -- 172.21.15.73:0/1980616681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6148108610 con 0x7f61481081b0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.303+0000 7f6145ffb640 1 -- 172.21.15.73:0/1980616681 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f614006bce0 con 0x7f61481081b0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.303+0000 7f6147fff640 1 --2- 172.21.15.73:0/1980616681 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f6134038e60 0x7f613403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.303+0000 7f6147fff640 1 --2- 172.21.15.73:0/1980616681 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f6134038e60 0x7f613403b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f613800ad30 tx=0x7f61380093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.308+0000 7f6145ffb640 1 -- 172.21.15.73:0/1980616681 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6140045520 con 0x7f61481081b0 2024-09-05T12:48:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.396+0000 7f6145ffb640 1 -- 172.21.15.73:0/1980616681 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f614006a940 con 0x7f61481081b0 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.547+0000 7f614f16d640 1 -- 172.21.15.73:0/1980616681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f614819f1d0 con 0x7f61481081b0 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.548+0000 7f6145ffb640 1 -- 172.21.15.73:0/1980616681 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f614003add0 con 0x7f61481081b0 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.550+0000 7f614f16d640 1 -- 172.21.15.73:0/1980616681 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f6134038e60 msgr2=0x7f613403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.550+0000 7f614f16d640 1 --2- 172.21.15.73:0/1980616681 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f6134038e60 0x7f613403b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f613800ad30 tx=0x7f61380093f0 comp rx=0 tx=0).stop 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.550+0000 7f614f16d640 1 -- 172.21.15.73:0/1980616681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 msgr2=0x7f614819b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.550+0000 7f614f16d640 1 --2- 172.21.15.73:0/1980616681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614819b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f61400097f0 tx=0x7f6140030ec0 comp rx=0 tx=0).stop 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.550+0000 7f614f16d640 1 -- 172.21.15.73:0/1980616681 shutdown_connections 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.550+0000 7f614f16d640 1 --2- 172.21.15.73:0/1980616681 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f6134038e60 0x7f613403b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.550+0000 7f614f16d640 1 --2- 172.21.15.73:0/1980616681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481081b0 0x7f614819b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.550+0000 7f614f16d640 1 -- 172.21.15.73:0/1980616681 >> 172.21.15.73:0/1980616681 conn(0x7f6148101e10 msgr2=0x7f6148102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.550+0000 7f614f16d640 1 -- 172.21.15.73:0/1980616681 shutdown_connections 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:25.550+0000 7f614f16d640 1 -- 172.21.15.73:0/1980616681 wait complete. 2024-09-05T12:48:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:mgr is available 2024-09-05T12:48:26.557 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:26 smithi073 ceph-mon[30883]: mgrmap e4: x(active, since 2s) 2024-09-05T12:48:26.557 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:26 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1980616681' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-05T12:48:27.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:27 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2091674624' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-05T12:48:32.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:32.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [global] 2024-09-05T12:48:32.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout fsid = febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:32.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.73:3300,v1:172.21.15.73:6789] 2024-09-05T12:48:32.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-05T12:48:32.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-05T12:48:32.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [osd] 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.557+0000 7f2e251bb640 1 Processor -- start 2024-09-05T12:48:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.557+0000 7f2e251bb640 1 -- start start 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.557+0000 7f2e251bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2010a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.557+0000 7f2e251bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2007be50 con 0x7f2e20108170 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.557+0000 7f2e1ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2010a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.557+0000 7f2e1ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2010a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55716/0 (socket says 172.21.15.73:55716) 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.557+0000 7f2e1ed9d640 1 -- 172.21.15.73:0/2069942575 learned_addr learned my addr 172.21.15.73:0/2069942575 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.558+0000 7f2e1ed9d640 1 -- 172.21.15.73:0/2069942575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2010aaa0 con 0x7f2e20108170 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.558+0000 7f2e1ed9d640 1 --2- 172.21.15.73:0/2069942575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2010a560 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009e80 tx=0x7f2e1802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44f3e938bf14d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.558+0000 7f2e1dd9b640 1 -- 172.21.15.73:0/2069942575 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e18036070 con 0x7f2e20108170 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.559+0000 7f2e1dd9b640 1 -- 172.21.15.73:0/2069942575 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e180318c0 con 0x7f2e20108170 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.559+0000 7f2e1dd9b640 1 -- 172.21.15.73:0/2069942575 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e18007ab0 con 0x7f2e20108170 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.559+0000 7f2e251bb640 1 -- 172.21.15.73:0/2069942575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 msgr2=0x7f2e2010a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:32.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.559+0000 7f2e251bb640 1 --2- 172.21.15.73:0/2069942575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2010a560 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009e80 tx=0x7f2e1802a7a0 comp rx=0 tx=0).stop 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.559+0000 7f2e251bb640 1 -- 172.21.15.73:0/2069942575 shutdown_connections 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.559+0000 7f2e251bb640 1 --2- 172.21.15.73:0/2069942575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2010a560 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.559+0000 7f2e251bb640 1 -- 172.21.15.73:0/2069942575 >> 172.21.15.73:0/2069942575 conn(0x7f2e20101e10 msgr2=0x7f2e20104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.559+0000 7f2e251bb640 1 -- 172.21.15.73:0/2069942575 shutdown_connections 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.559+0000 7f2e251bb640 1 -- 172.21.15.73:0/2069942575 wait complete. 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.560+0000 7f2e251bb640 1 Processor -- start 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.560+0000 7f2e251bb640 1 -- start start 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.560+0000 7f2e251bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.560+0000 7f2e251bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2010bb40 con 0x7f2e20108170 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.560+0000 7f2e1ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.560+0000 7f2e1ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2019d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55730/0 (socket says 172.21.15.73:55730) 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.560+0000 7f2e1ed9d640 1 -- 172.21.15.73:0/2091674624 learned_addr learned my addr 172.21.15.73:0/2091674624 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.561+0000 7f2e1ed9d640 1 -- 172.21.15.73:0/2091674624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2019ded0 con 0x7f2e20108170 2024-09-05T12:48:32.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.561+0000 7f2e1ed9d640 1 --2- 172.21.15.73:0/2091674624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2019d990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e18031ca0 tx=0x7f2e18031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.561+0000 7f2e17fff640 1 -- 172.21.15.73:0/2091674624 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e18036050 con 0x7f2e20108170 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.561+0000 7f2e251bb640 1 -- 172.21.15.73:0/2091674624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2019e160 con 0x7f2e20108170 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.561+0000 7f2e17fff640 1 -- 172.21.15.73:0/2091674624 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e18042070 con 0x7f2e20108170 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.561+0000 7f2e17fff640 1 -- 172.21.15.73:0/2091674624 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1803d940 con 0x7f2e20108170 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.561+0000 7f2e251bb640 1 -- 172.21.15.73:0/2091674624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e201a0e50 con 0x7f2e20108170 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.562+0000 7f2e17fff640 1 -- 172.21.15.73:0/2091674624 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f2e1803dbf0 con 0x7f2e20108170 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.562+0000 7f2e17fff640 1 --2- 172.21.15.73:0/2091674624 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f2e0c038f70 0x7f2e0c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.562+0000 7f2e17fff640 1 -- 172.21.15.73:0/2091674624 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2e18007e00 con 0x7f2e20108170 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.562+0000 7f2e251bb640 1 -- 172.21.15.73:0/2091674624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e201085d0 con 0x7f2e20108170 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.562+0000 7f2e1e59c640 1 --2- 172.21.15.73:0/2091674624 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f2e0c038f70 0x7f2e0c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.562+0000 7f2e1e59c640 1 --2- 172.21.15.73:0/2091674624 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f2e0c038f70 0x7f2e0c03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2e080098c0 tx=0x7f2e08006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.567+0000 7f2e17fff640 1 -- 172.21.15.73:0/2091674624 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e18044310 con 0x7f2e20108170 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.736+0000 7f2e251bb640 1 -- 172.21.15.73:0/2091674624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f2e201a25a0 con 0x7f2e20108170 2024-09-05T12:48:32.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.737+0000 7f2e17fff640 1 -- 172.21.15.73:0/2091674624 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+454 (secure 0 0 0) 0x7f2e1806cc80 con 0x7f2e20108170 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.739+0000 7f2e251bb640 1 -- 172.21.15.73:0/2091674624 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f2e0c038f70 msgr2=0x7f2e0c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.739+0000 7f2e251bb640 1 --2- 172.21.15.73:0/2091674624 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f2e0c038f70 0x7f2e0c03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2e080098c0 tx=0x7f2e08006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.739+0000 7f2e251bb640 1 -- 172.21.15.73:0/2091674624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 msgr2=0x7f2e2019d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.739+0000 7f2e251bb640 1 --2- 172.21.15.73:0/2091674624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2019d990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e18031ca0 tx=0x7f2e18031cd0 comp rx=0 tx=0).stop 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.739+0000 7f2e251bb640 1 -- 172.21.15.73:0/2091674624 shutdown_connections 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.739+0000 7f2e251bb640 1 --2- 172.21.15.73:0/2091674624 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f2e0c038f70 0x7f2e0c03b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.739+0000 7f2e251bb640 1 --2- 172.21.15.73:0/2091674624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e20108170 0x7f2e2019d990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.739+0000 7f2e251bb640 1 -- 172.21.15.73:0/2091674624 >> 172.21.15.73:0/2091674624 conn(0x7f2e20101e10 msgr2=0x7f2e201029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.739+0000 7f2e251bb640 1 -- 172.21.15.73:0/2091674624 shutdown_connections 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:26.739+0000 7f2e251bb640 1 -- 172.21.15.73:0/2091674624 wait complete. 2024-09-05T12:48:32.607 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling cephadm module... 2024-09-05T12:48:36.024 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:35 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3909819055' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-05T12:48:36.025 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:35 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: ignoring --setuser ceph since I am not root 2024-09-05T12:48:36.025 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:35 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: ignoring --setgroup ceph since I am not root 2024-09-05T12:48:36.025 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:35 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:35.966+0000 7f1f3c375040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T12:48:36.025 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:36 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:36.023+0000 7f1f3c375040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T12:48:36.382 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:36 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:36.169+0000 7f1f3c375040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T12:48:36.382 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:36 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:36.236+0000 7f1f3c375040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T12:48:36.383 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:36 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:36.381+0000 7f1f3c375040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T12:48:36.763 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:36 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:36.521+0000 7f1f3c375040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T12:48:37.076 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:36 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3909819055' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-05T12:48:37.076 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:36 smithi073 ceph-mon[30883]: mgrmap e5: x(active, since 12s) 2024-09-05T12:48:37.076 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:36 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:36.832+0000 7f1f3c375040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T12:48:37.076 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:36 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:36.892+0000 7f1f3c375040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T12:48:37.076 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:37 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:37.074+0000 7f1f3c375040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T12:48:38.263 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:37 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:37.949+0000 7f1f3c375040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T12:48:38.263 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:38 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:38.016+0000 7f1f3c375040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T12:48:38.989 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:38 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:38.730+0000 7f1f3c375040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T12:48:38.989 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:38 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:38.846+0000 7f1f3c375040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T12:48:39.263 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:38 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:38.988+0000 7f1f3c375040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T12:48:39.263 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:39.049+0000 7f1f3c375040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T12:48:39.263 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:39.200+0000 7f1f3c375040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T12:48:39.552 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:39.267+0000 7f1f3c375040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T12:48:39.552 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:39.327+0000 7f1f3c375040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T12:48:39.552 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:39.484+0000 7f1f3c375040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T12:48:39.552 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:39.551+0000 7f1f3c375040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T12:48:39.820 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:39.617+0000 7f1f3c375040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T12:48:39.820 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:39.699+0000 7f1f3c375040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T12:48:39.820 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:39.759+0000 7f1f3c375040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T12:48:39.820 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:39.819+0000 7f1f3c375040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T12:48:39.914 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.542+0000 7f494c11a640 1 Processor -- start 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.542+0000 7f494c11a640 1 -- start start 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.543+0000 7f494c11a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f4944106a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.543+0000 7f494c11a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4944106fd0 con 0x7f4944106600 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.543+0000 7f4949eb6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f4944106a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.543+0000 7f4949eb6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f4944106a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53028/0 (socket says 172.21.15.73:53028) 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.543+0000 7f4949eb6640 1 -- 172.21.15.73:0/169156574 learned_addr learned my addr 172.21.15.73:0/169156574 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.543+0000 7f4949eb6640 1 -- 172.21.15.73:0/169156574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4944107800 con 0x7f4944106600 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.544+0000 7f4949eb6640 1 --2- 172.21.15.73:0/169156574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f4944106a00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4934009e80 tx=0x7f493402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71689e82d15c9771 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.544+0000 7f4948eb4640 1 -- 172.21.15.73:0/169156574 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4934036070 con 0x7f4944106600 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.544+0000 7f4948eb4640 1 -- 172.21.15.73:0/169156574 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f49340318c0 con 0x7f4944106600 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.544+0000 7f4948eb4640 1 -- 172.21.15.73:0/169156574 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4934007ab0 con 0x7f4944106600 2024-09-05T12:48:39.915 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.544+0000 7f494c11a640 1 -- 172.21.15.73:0/169156574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 msgr2=0x7f4944106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.544+0000 7f494c11a640 1 --2- 172.21.15.73:0/169156574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f4944106a00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4934009e80 tx=0x7f493402a7a0 comp rx=0 tx=0).stop 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.544+0000 7f494c11a640 1 -- 172.21.15.73:0/169156574 shutdown_connections 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.544+0000 7f494c11a640 1 --2- 172.21.15.73:0/169156574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f4944106a00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.544+0000 7f494c11a640 1 -- 172.21.15.73:0/169156574 >> 172.21.15.73:0/169156574 conn(0x7f4944101e10 msgr2=0x7f4944104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.544+0000 7f494c11a640 1 -- 172.21.15.73:0/169156574 shutdown_connections 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.545+0000 7f494c11a640 1 -- 172.21.15.73:0/169156574 wait complete. 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.545+0000 7f494c11a640 1 Processor -- start 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.545+0000 7f494c11a640 1 -- start start 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.545+0000 7f494c11a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f494419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.545+0000 7f494c11a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f494410abb0 con 0x7f4944106600 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.545+0000 7f4949eb6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f494419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.545+0000 7f4949eb6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f494419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53034/0 (socket says 172.21.15.73:53034) 2024-09-05T12:48:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.545+0000 7f4949eb6640 1 -- 172.21.15.73:0/3909819055 learned_addr learned my addr 172.21.15.73:0/3909819055 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.545+0000 7f4949eb6640 1 -- 172.21.15.73:0/3909819055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494419bce0 con 0x7f4944106600 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.546+0000 7f4949eb6640 1 --2- 172.21.15.73:0/3909819055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f494419b7a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f493402acc0 tx=0x7f4934031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.546+0000 7f4942ffd640 1 -- 172.21.15.73:0/3909819055 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4934036050 con 0x7f4944106600 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.546+0000 7f4942ffd640 1 -- 172.21.15.73:0/3909819055 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4934037040 con 0x7f4944106600 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.546+0000 7f494c11a640 1 -- 172.21.15.73:0/3909819055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494419bf70 con 0x7f4944106600 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.546+0000 7f4942ffd640 1 -- 172.21.15.73:0/3909819055 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f493403d890 con 0x7f4944106600 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.546+0000 7f494c11a640 1 -- 172.21.15.73:0/3909819055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494419ec60 con 0x7f4944106600 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.547+0000 7f4942ffd640 1 -- 172.21.15.73:0/3909819055 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f4934044020 con 0x7f4944106600 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.547+0000 7f4942ffd640 1 --2- 172.21.15.73:0/3909819055 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f492c038f70 0x7f492c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.547+0000 7f4942ffd640 1 -- 172.21.15.73:0/3909819055 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4934042020 con 0x7f4944106600 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.547+0000 7f49496b5640 1 --2- 172.21.15.73:0/3909819055 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f492c038f70 0x7f492c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.547+0000 7f494c11a640 1 -- 172.21.15.73:0/3909819055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494410ad30 con 0x7f4944106600 2024-09-05T12:48:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.547+0000 7f49496b5640 1 --2- 172.21.15.73:0/3909819055 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f492c038f70 0x7f492c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f49380098c0 tx=0x7f4938006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.552+0000 7f4942ffd640 1 -- 172.21.15.73:0/3909819055 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f493404b020 con 0x7f4944106600 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.763+0000 7f494c11a640 1 -- 172.21.15.73:0/3909819055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f494402d910 con 0x7f4944106600 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.814+0000 7f4942ffd640 1 -- 172.21.15.73:0/3909819055 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f49340371f0 con 0x7f4944106600 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.816+0000 7f4942ffd640 1 -- 172.21.15.73:0/3909819055 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f4934046790 con 0x7f4944106600 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.818+0000 7f494c11a640 1 -- 172.21.15.73:0/3909819055 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f492c038f70 msgr2=0x7f492c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.818+0000 7f494c11a640 1 --2- 172.21.15.73:0/3909819055 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f492c038f70 0x7f492c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f49380098c0 tx=0x7f4938006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.818+0000 7f494c11a640 1 -- 172.21.15.73:0/3909819055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 msgr2=0x7f494419b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.818+0000 7f494c11a640 1 --2- 172.21.15.73:0/3909819055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f494419b7a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f493402acc0 tx=0x7f4934031ca0 comp rx=0 tx=0).stop 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.818+0000 7f494c11a640 1 -- 172.21.15.73:0/3909819055 shutdown_connections 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.818+0000 7f494c11a640 1 --2- 172.21.15.73:0/3909819055 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7f492c038f70 0x7f492c03b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.818+0000 7f494c11a640 1 --2- 172.21.15.73:0/3909819055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4944106600 0x7f494419b7a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.818+0000 7f494c11a640 1 -- 172.21.15.73:0/3909819055 >> 172.21.15.73:0/3909819055 conn(0x7f4944101e10 msgr2=0x7f4944102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.818+0000 7f494c11a640 1 -- 172.21.15.73:0/3909819055 shutdown_connections 2024-09-05T12:48:39.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:35.818+0000 7f494c11a640 1 -- 172.21.15.73:0/3909819055 wait complete. 2024-09-05T12:48:40.838 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:40 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1252899226' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-05T12:48:40.838 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:40 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:40.643+0000 7f1f3c375040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T12:48:41.116 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-05T12:48:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-05T12:48:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-05T12:48:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-05T12:48:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-05T12:48:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-05T12:48:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.320+0000 7fb9b5333640 1 Processor -- start 2024-09-05T12:48:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.320+0000 7fb9b5333640 1 -- start start 2024-09-05T12:48:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.320+0000 7fb9b5333640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b010a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:41.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.320+0000 7fb9b5333640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b007be10 con 0x7fb9b01081c0 2024-09-05T12:48:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.320+0000 7fb9aeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b010a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.320+0000 7fb9aeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b010a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53064/0 (socket says 172.21.15.73:53064) 2024-09-05T12:48:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.320+0000 7fb9aeffd640 1 -- 172.21.15.73:0/3954594752 learned_addr learned my addr 172.21.15.73:0/3954594752 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.321+0000 7fb9aeffd640 1 -- 172.21.15.73:0/3954594752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b010aaf0 con 0x7fb9b01081c0 2024-09-05T12:48:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.321+0000 7fb9aeffd640 1 --2- 172.21.15.73:0/3954594752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b010a5b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009820 tx=0x7fb9a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed12937908d9514a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.322+0000 7fb9adffb640 1 -- 172.21.15.73:0/3954594752 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0037070 con 0x7fb9b01081c0 2024-09-05T12:48:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.322+0000 7fb9adffb640 1 -- 172.21.15.73:0/3954594752 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9a0032900 con 0x7fb9b01081c0 2024-09-05T12:48:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.322+0000 7fb9adffb640 1 -- 172.21.15.73:0/3954594752 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0030850 con 0x7fb9b01081c0 2024-09-05T12:48:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.322+0000 7fb9b5333640 1 -- 172.21.15.73:0/3954594752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 msgr2=0x7fb9b010a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:41.124 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.322+0000 7fb9b5333640 1 --2- 172.21.15.73:0/3954594752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b010a5b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009820 tx=0x7fb9a002a270 comp rx=0 tx=0).stop 2024-09-05T12:48:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.322+0000 7fb9b5333640 1 -- 172.21.15.73:0/3954594752 shutdown_connections 2024-09-05T12:48:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.322+0000 7fb9b5333640 1 --2- 172.21.15.73:0/3954594752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b010a5b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.322+0000 7fb9b5333640 1 -- 172.21.15.73:0/3954594752 >> 172.21.15.73:0/3954594752 conn(0x7fb9b0101e60 msgr2=0x7fb9b0104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.322+0000 7fb9b5333640 1 -- 172.21.15.73:0/3954594752 shutdown_connections 2024-09-05T12:48:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.322+0000 7fb9b5333640 1 -- 172.21.15.73:0/3954594752 wait complete. 2024-09-05T12:48:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.323+0000 7fb9b5333640 1 Processor -- start 2024-09-05T12:48:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.323+0000 7fb9b5333640 1 -- start start 2024-09-05T12:48:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.323+0000 7fb9b5333640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.323+0000 7fb9b5333640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b010bb30 con 0x7fb9b01081c0 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.323+0000 7fb9aeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.324+0000 7fb9aeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b019b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53066/0 (socket says 172.21.15.73:53066) 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.324+0000 7fb9aeffd640 1 -- 172.21.15.73:0/1252899226 learned_addr learned my addr 172.21.15.73:0/1252899226 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.324+0000 7fb9aeffd640 1 -- 172.21.15.73:0/1252899226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b019bc10 con 0x7fb9b01081c0 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.324+0000 7fb9aeffd640 1 --2- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b019b6d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00097f0 tx=0x7fb9a0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.324+0000 7fb997fff640 1 -- 172.21.15.73:0/1252899226 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0037040 con 0x7fb9b01081c0 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.324+0000 7fb997fff640 1 -- 172.21.15.73:0/1252899226 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9a0040070 con 0x7fb9b01081c0 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.324+0000 7fb9b5333640 1 -- 172.21.15.73:0/1252899226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b019bea0 con 0x7fb9b01081c0 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.324+0000 7fb9b5333640 1 -- 172.21.15.73:0/1252899226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b019eb90 con 0x7fb9b01081c0 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.324+0000 7fb997fff640 1 -- 172.21.15.73:0/1252899226 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a003a390 con 0x7fb9b01081c0 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.325+0000 7fb9b5333640 1 -- 172.21.15.73:0/1252899226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99c0052c0 con 0x7fb9b01081c0 2024-09-05T12:48:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.325+0000 7fb997fff640 1 -- 172.21.15.73:0/1252899226 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fb9a003a640 con 0x7fb9b01081c0 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.325+0000 7fb997fff640 1 --2- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7fb998038fc0 0x7fb99803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.326+0000 7fb997fff640 1 -- 172.21.15.73:0/1252899226 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb9a006c0f0 con 0x7fb9b01081c0 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.326+0000 7fb9ae7fc640 1 -- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7fb998038fc0 msgr2=0x7fb99803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3437397159 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.326+0000 7fb9ae7fc640 1 --2- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7fb998038fc0 0x7fb99803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.330+0000 7fb997fff640 1 -- 172.21.15.73:0/1252899226 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9a0042e30 con 0x7fb9b01081c0 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.527+0000 7fb9ae7fc640 1 -- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7fb998038fc0 msgr2=0x7fb99803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3437397159 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.527+0000 7fb9ae7fc640 1 --2- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7fb998038fc0 0x7fb99803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.553+0000 7fb9b5333640 1 -- 172.21.15.73:0/1252899226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb99c005dc0 con 0x7fb9b01081c0 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.553+0000 7fb997fff640 1 -- 172.21.15.73:0/1252899226 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fb9a0043760 con 0x7fb9b01081c0 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.556+0000 7fb9b5333640 1 -- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7fb998038fc0 msgr2=0x7fb99803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.556+0000 7fb9b5333640 1 --2- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7fb998038fc0 0x7fb99803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:41.127 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.556+0000 7fb9b5333640 1 -- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 msgr2=0x7fb9b019b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.556+0000 7fb9b5333640 1 --2- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b019b6d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00097f0 tx=0x7fb9a0030d80 comp rx=0 tx=0).stop 2024-09-05T12:48:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.556+0000 7fb9b5333640 1 -- 172.21.15.73:0/1252899226 shutdown_connections 2024-09-05T12:48:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.556+0000 7fb9b5333640 1 --2- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:6800/3437397159,v1:172.21.15.73:6801/3437397159] conn(0x7fb998038fc0 0x7fb99803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.556+0000 7fb9b5333640 1 --2- 172.21.15.73:0/1252899226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b01081c0 0x7fb9b019b6d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.556+0000 7fb9b5333640 1 -- 172.21.15.73:0/1252899226 >> 172.21.15.73:0/1252899226 conn(0x7fb9b0101e60 msgr2=0x7fb9b01029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.556+0000 7fb9b5333640 1 -- 172.21.15.73:0/1252899226 shutdown_connections 2024-09-05T12:48:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:40.556+0000 7fb9b5333640 1 -- 172.21.15.73:0/1252899226 wait complete. 2024-09-05T12:48:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for the mgr to restart... 2024-09-05T12:48:41.128 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr epoch 5... 2024-09-05T12:48:41.668 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: Active manager daemon x restarted 2024-09-05T12:48:41.668 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: Activating manager daemon x 2024-09-05T12:48:41.668 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: osdmap e2: 0 total, 0 up, 0 in 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: mgrmap e6: x(active, starting, since 0.00396472s) 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: Manager daemon x is now available 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: Found migration_current of "None". Setting to last migration. 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T12:48:41.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T12:48:41.670 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:41.670 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:41 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:42.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-05T12:48:42.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-05T12:48:42.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.493+0000 7fc61c023640 1 Processor -- start 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.493+0000 7fc61c023640 1 -- start start 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.493+0000 7fc61c023640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc614106a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.493+0000 7fc61c023640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc614106fd0 con 0x7fc614106600 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.493+0000 7fc619dbf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc614106a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.493+0000 7fc619dbf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc614106a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53130/0 (socket says 172.21.15.73:53130) 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.493+0000 7fc619dbf640 1 -- 172.21.15.73:0/205258074 learned_addr learned my addr 172.21.15.73:0/205258074 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.494+0000 7fc619dbf640 1 -- 172.21.15.73:0/205258074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc614107800 con 0x7fc614106600 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.494+0000 7fc619dbf640 1 --2- 172.21.15.73:0/205258074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc614106a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc610009820 tx=0x7fc61002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e85c43f46386ce server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.495+0000 7fc618dbd640 1 -- 172.21.15.73:0/205258074 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc610037070 con 0x7fc614106600 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.495+0000 7fc618dbd640 1 -- 172.21.15.73:0/205258074 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc610032900 con 0x7fc614106600 2024-09-05T12:48:42.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.495+0000 7fc618dbd640 1 -- 172.21.15.73:0/205258074 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc610030850 con 0x7fc614106600 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.495+0000 7fc61c023640 1 -- 172.21.15.73:0/205258074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 msgr2=0x7fc614106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.495+0000 7fc61c023640 1 --2- 172.21.15.73:0/205258074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc614106a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc610009820 tx=0x7fc61002a270 comp rx=0 tx=0).stop 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.495+0000 7fc61c023640 1 -- 172.21.15.73:0/205258074 shutdown_connections 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.495+0000 7fc61c023640 1 --2- 172.21.15.73:0/205258074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc614106a00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.495+0000 7fc61c023640 1 -- 172.21.15.73:0/205258074 >> 172.21.15.73:0/205258074 conn(0x7fc614101e10 msgr2=0x7fc614104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.495+0000 7fc61c023640 1 -- 172.21.15.73:0/205258074 shutdown_connections 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.495+0000 7fc61c023640 1 -- 172.21.15.73:0/205258074 wait complete. 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.496+0000 7fc61c023640 1 Processor -- start 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.496+0000 7fc61c023640 1 -- start start 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.496+0000 7fc61c023640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc61407b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.496+0000 7fc61c023640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc61410abb0 con 0x7fc614106600 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.496+0000 7fc619dbf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc61407b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.496+0000 7fc619dbf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc61407b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53134/0 (socket says 172.21.15.73:53134) 2024-09-05T12:48:42.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.496+0000 7fc619dbf640 1 -- 172.21.15.73:0/3493293030 learned_addr learned my addr 172.21.15.73:0/3493293030 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.496+0000 7fc619dbf640 1 -- 172.21.15.73:0/3493293030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61419e500 con 0x7fc614106600 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.497+0000 7fc619dbf640 1 --2- 172.21.15.73:0/3493293030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc61407b9f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc6100097f0 tx=0x7fc610030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.497+0000 7fc60affd640 1 -- 172.21.15.73:0/3493293030 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc610042070 con 0x7fc614106600 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.497+0000 7fc60affd640 1 -- 172.21.15.73:0/3493293030 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc610032ca0 con 0x7fc614106600 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.497+0000 7fc61c023640 1 -- 172.21.15.73:0/3493293030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61419e6d0 con 0x7fc614106600 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.497+0000 7fc60affd640 1 -- 172.21.15.73:0/3493293030 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc610037040 con 0x7fc614106600 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.497+0000 7fc61c023640 1 -- 172.21.15.73:0/3493293030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61419ea70 con 0x7fc614106600 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.498+0000 7fc60affd640 1 -- 172.21.15.73:0/3493293030 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fc610045070 con 0x7fc614106600 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.498+0000 7fc60affd640 1 -- 172.21.15.73:0/3493293030 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc61006bb90 con 0x7fc614106600 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.649+0000 7fc60affd640 1 -- 172.21.15.73:0/3493293030 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fc61006a8b0 con 0x7fc614106600 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.649+0000 7fc60affd640 1 --2- 172.21.15.73:0/3493293030 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fc600039ab0 0x7fc60003bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.649+0000 7fc60affd640 1 -- 172.21.15.73:0/3493293030 --> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc610032900 con 0x7fc600039ab0 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.650+0000 7fc6195be640 1 --2- 172.21.15.73:0/3493293030 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fc600039ab0 0x7fc60003bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:42.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.650+0000 7fc6195be640 1 --2- 172.21.15.73:0/3493293030 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fc600039ab0 0x7fc60003bea0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc6040098c0 tx=0x7fc604006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.651+0000 7fc60affd640 1 -- 172.21.15.73:0/3493293030 <== mgr.14118 v2:172.21.15.73:6800/2037973546 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fc610032900 con 0x7fc600039ab0 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 -- 172.21.15.73:0/3493293030 --> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fc61410ad30 con 0x7fc600039ab0 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc60affd640 1 -- 172.21.15.73:0/3493293030 <== mgr.14118 v2:172.21.15.73:6800/2037973546 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fc61410ad30 con 0x7fc600039ab0 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 -- 172.21.15.73:0/3493293030 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fc600039ab0 msgr2=0x7fc60003bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 --2- 172.21.15.73:0/3493293030 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fc600039ab0 0x7fc60003bea0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc6040098c0 tx=0x7fc604006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 -- 172.21.15.73:0/3493293030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 msgr2=0x7fc61407b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 --2- 172.21.15.73:0/3493293030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc61407b9f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc6100097f0 tx=0x7fc610030ec0 comp rx=0 tx=0).stop 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 -- 172.21.15.73:0/3493293030 shutdown_connections 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 --2- 172.21.15.73:0/3493293030 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fc600039ab0 0x7fc60003bea0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 --2- 172.21.15.73:0/3493293030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc614106600 0x7fc61407b9f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 -- 172.21.15.73:0/3493293030 >> 172.21.15.73:0/3493293030 conn(0x7fc614101e10 msgr2=0x7fc614102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 -- 172.21.15.73:0/3493293030 shutdown_connections 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:41.658+0000 7fc61c023640 1 -- 172.21.15.73:0/3493293030 wait complete. 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:mgr epoch 5 is available 2024-09-05T12:48:42.307 INFO:teuthology.orchestra.run.smithi073.stdout:Setting orchestrator backend to cephadm... 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:42.278+0000 7f1ea8ed6640 -1 log_channel(cephadm) log [ERR] : [05/Sep/2024:12:48:42] ENGINE Error in HTTPServer.serve 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: Traceback (most recent call last): 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: self._connections.run(self.expiration_interval) 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: self._run(expiration_interval) 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T12:48:42.499 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: s = self.context.wrap_socket( 2024-09-05T12:48:42.500 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T12:48:42.500 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: return self.sslsocket_class._create( 2024-09-05T12:48:42.500 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T12:48:42.500 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: self.do_handshake() 2024-09-05T12:48:42.500 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T12:48:42.500 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: self._sslobj.do_handshake() 2024-09-05T12:48:42.500 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T12:48:42.500 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:42.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-mon[30883]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-05T12:48:42.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-mon[30883]: mgrmap e7: x(active, since 1.00618s) 2024-09-05T12:48:42.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-mon[30883]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-05T12:48:42.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:42 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:48:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.668+0000 7f7c4f0aa640 1 Processor -- start 2024-09-05T12:48:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.668+0000 7f7c4f0aa640 1 -- start start 2024-09-05T12:48:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.668+0000 7f7c4f0aa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.668+0000 7f7c4f0aa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7c481063b0 con 0x7f7c481059e0 2024-09-05T12:48:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.668+0000 7f7c4ce46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.668+0000 7f7c4ce46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53140/0 (socket says 172.21.15.73:53140) 2024-09-05T12:48:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.668+0000 7f7c4ce46640 1 -- 172.21.15.73:0/2769141554 learned_addr learned my addr 172.21.15.73:0/2769141554 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.668+0000 7f7c4ce46640 1 -- 172.21.15.73:0/2769141554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c481089c0 con 0x7f7c481059e0 2024-09-05T12:48:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.669+0000 7f7c4ce46640 1 --2- 172.21.15.73:0/2769141554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48105de0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009820 tx=0x7f7c3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf80f20d976192f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:43.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.669+0000 7f7c477fe640 1 -- 172.21.15.73:0/2769141554 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3c037070 con 0x7f7c481059e0 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.669+0000 7f7c477fe640 1 -- 172.21.15.73:0/2769141554 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c3c032900 con 0x7f7c481059e0 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.669+0000 7f7c477fe640 1 -- 172.21.15.73:0/2769141554 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3c030850 con 0x7f7c481059e0 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.670+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/2769141554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 msgr2=0x7f7c48105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.670+0000 7f7c4f0aa640 1 --2- 172.21.15.73:0/2769141554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48105de0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009820 tx=0x7f7c3c02a270 comp rx=0 tx=0).stop 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.670+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/2769141554 shutdown_connections 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.670+0000 7f7c4f0aa640 1 --2- 172.21.15.73:0/2769141554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48105de0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.670+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/2769141554 >> 172.21.15.73:0/2769141554 conn(0x7f7c48101610 msgr2=0x7f7c48103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.670+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/2769141554 shutdown_connections 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.670+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/2769141554 wait complete. 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.670+0000 7f7c4f0aa640 1 Processor -- start 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.670+0000 7f7c4f0aa640 1 -- start start 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c4f0aa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48108240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c4f0aa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4810bbf0 con 0x7f7c481059e0 2024-09-05T12:48:43.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c4ce46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48108240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c4ce46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48108240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53154/0 (socket says 172.21.15.73:53154) 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c4ce46640 1 -- 172.21.15.73:0/3966421714 learned_addr learned my addr 172.21.15.73:0/3966421714 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c4ce46640 1 -- 172.21.15.73:0/3966421714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c48108780 con 0x7f7c481059e0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c4ce46640 1 --2- 172.21.15.73:0/3966421714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48108240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009940 tx=0x7f7c3c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c45ffb640 1 -- 172.21.15.73:0/3966421714 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3c042070 con 0x7f7c481059e0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/3966421714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c48106970 con 0x7f7c481059e0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c45ffb640 1 -- 172.21.15.73:0/3966421714 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c3c0308c0 con 0x7f7c481059e0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c45ffb640 1 -- 172.21.15.73:0/3966421714 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3c037040 con 0x7f7c481059e0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.671+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/3966421714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c48106eb0 con 0x7f7c481059e0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.672+0000 7f7c45ffb640 1 -- 172.21.15.73:0/3966421714 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7c3c045070 con 0x7f7c481059e0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.672+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/3966421714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c48105e60 con 0x7f7c481059e0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.673+0000 7f7c45ffb640 1 --2- 172.21.15.73:0/3966421714 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f7c38038f70 0x7f7c3803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.673+0000 7f7c45ffb640 1 -- 172.21.15.73:0/3966421714 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7c3c06c1d0 con 0x7f7c481059e0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.673+0000 7f7c47fff640 1 --2- 172.21.15.73:0/3966421714 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f7c38038f70 0x7f7c3803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:43.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.673+0000 7f7c47fff640 1 --2- 172.21.15.73:0/3966421714 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f7c38038f70 0x7f7c3803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7c340098c0 tx=0x7f7c34006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.677+0000 7f7c45ffb640 1 -- 172.21.15.73:0/3966421714 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c3c045520 con 0x7f7c481059e0 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.858+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/3966421714 --> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f7c48107760 con 0x7f7c38038f70 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.863+0000 7f7c45ffb640 1 -- 172.21.15.73:0/3966421714 <== mgr.14118 v2:172.21.15.73:6800/2037973546 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7c48107760 con 0x7f7c38038f70 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.866+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/3966421714 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f7c38038f70 msgr2=0x7f7c3803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.866+0000 7f7c4f0aa640 1 --2- 172.21.15.73:0/3966421714 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f7c38038f70 0x7f7c3803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7c340098c0 tx=0x7f7c34006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.866+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/3966421714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 msgr2=0x7f7c48108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.866+0000 7f7c4f0aa640 1 --2- 172.21.15.73:0/3966421714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48108240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009940 tx=0x7f7c3c032ce0 comp rx=0 tx=0).stop 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.866+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/3966421714 shutdown_connections 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.866+0000 7f7c4f0aa640 1 --2- 172.21.15.73:0/3966421714 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f7c38038f70 0x7f7c3803b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.866+0000 7f7c4f0aa640 1 --2- 172.21.15.73:0/3966421714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c481059e0 0x7f7c48108240 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.866+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/3966421714 >> 172.21.15.73:0/3966421714 conn(0x7f7c48101610 msgr2=0x7f7c481021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.866+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/3966421714 shutdown_connections 2024-09-05T12:48:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:42.866+0000 7f7c4f0aa640 1 -- 172.21.15.73:0/3966421714 wait complete. 2024-09-05T12:48:43.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:43 smithi073 ceph-mon[30883]: [05/Sep/2024:12:48:42] ENGINE Bus STARTING 2024-09-05T12:48:43.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:43 smithi073 ceph-mon[30883]: [05/Sep/2024:12:48:42] ENGINE Serving on https://172.21.15.73:7150 2024-09-05T12:48:43.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:43 smithi073 ceph-mon[30883]: [05/Sep/2024:12:48:42] ENGINE Error in HTTPServer.serve 2024-09-05T12:48:43.763 INFO:journalctl@ceph.mon.a.smithi073.stdout: Traceback (most recent call last): 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._connections.run(self.expiration_interval) 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._run(expiration_interval) 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: s = self.context.wrap_socket( 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: return self.sslsocket_class._create( 2024-09-05T12:48:43.764 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T12:48:43.765 INFO:journalctl@ceph.mon.a.smithi073.stdout: self.do_handshake() 2024-09-05T12:48:43.765 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T12:48:43.765 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._sslobj.do_handshake() 2024-09-05T12:48:43.765 INFO:journalctl@ceph.mon.a.smithi073.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T12:48:43.765 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:43 smithi073 ceph-mon[30883]: [05/Sep/2024:12:48:42] ENGINE Serving on http://172.21.15.73:8765 2024-09-05T12:48:43.765 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:43 smithi073 ceph-mon[30883]: [05/Sep/2024:12:48:42] ENGINE Bus STARTED 2024-09-05T12:48:43.765 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:43 smithi073 ceph-mon[30883]: mgrmap e8: x(active, since 2s) 2024-09-05T12:48:43.765 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:43 smithi073 ceph-mon[30883]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:48:43.765 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:43 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:43.765 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:43 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:48:44.833 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-05T12:48:44.833 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.113+0000 7f4d5cbfa640 1 Processor -- start 2024-09-05T12:48:44.833 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.113+0000 7f4d5cbfa640 1 -- start start 2024-09-05T12:48:44.833 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.113+0000 7f4d5cbfa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:44.833 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.113+0000 7f4d5cbfa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5807c890 con 0x7f4d5807de60 2024-09-05T12:48:44.833 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.113+0000 7f4d5659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:44.833 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.114+0000 7f4d5659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5807c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54502/0 (socket says 172.21.15.73:54502) 2024-09-05T12:48:44.833 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.114+0000 7f4d5659c640 1 -- 172.21.15.73:0/27242186 learned_addr learned my addr 172.21.15.73:0/27242186 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:44.833 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.114+0000 7f4d5659c640 1 -- 172.21.15.73:0/27242186 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5807ca10 con 0x7f4d5807de60 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.114+0000 7f4d5659c640 1 --2- 172.21.15.73:0/27242186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5807c2c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009e80 tx=0x7f4d5002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5afcbf8da35a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.115+0000 7f4d5559a640 1 -- 172.21.15.73:0/27242186 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50036070 con 0x7f4d5807de60 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.115+0000 7f4d5559a640 1 -- 172.21.15.73:0/27242186 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d500318c0 con 0x7f4d5807de60 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.115+0000 7f4d5559a640 1 -- 172.21.15.73:0/27242186 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50007ab0 con 0x7f4d5807de60 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.115+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/27242186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 msgr2=0x7f4d5807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.115+0000 7f4d5cbfa640 1 --2- 172.21.15.73:0/27242186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5807c2c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009e80 tx=0x7f4d5002a7a0 comp rx=0 tx=0).stop 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.115+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/27242186 shutdown_connections 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.115+0000 7f4d5cbfa640 1 --2- 172.21.15.73:0/27242186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5807c2c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.115+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/27242186 >> 172.21.15.73:0/27242186 conn(0x7f4d58102fa0 msgr2=0x7f4d581053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.115+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/27242186 shutdown_connections 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.115+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/27242186 wait complete. 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.116+0000 7f4d5cbfa640 1 Processor -- start 2024-09-05T12:48:44.834 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.116+0000 7f4d5cbfa640 1 -- start start 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.116+0000 7f4d5cbfa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.116+0000 7f4d5cbfa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5810dd80 con 0x7f4d5807de60 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.116+0000 7f4d5659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.116+0000 7f4d5659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5819d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54518/0 (socket says 172.21.15.73:54518) 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.116+0000 7f4d5659c640 1 -- 172.21.15.73:0/2092125178 learned_addr learned my addr 172.21.15.73:0/2092125178 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.117+0000 7f4d5659c640 1 -- 172.21.15.73:0/2092125178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5819de90 con 0x7f4d5807de60 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.117+0000 7f4d5659c640 1 --2- 172.21.15.73:0/2092125178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5819d950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4d5002acc0 tx=0x7f4d50031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.117+0000 7f4d4f7fe640 1 -- 172.21.15.73:0/2092125178 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50036050 con 0x7f4d5807de60 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.117+0000 7f4d4f7fe640 1 -- 172.21.15.73:0/2092125178 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d50037040 con 0x7f4d5807de60 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.117+0000 7f4d4f7fe640 1 -- 172.21.15.73:0/2092125178 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5003d8c0 con 0x7f4d5807de60 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.117+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/2092125178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5819e120 con 0x7f4d5807de60 2024-09-05T12:48:44.835 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.117+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/2092125178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d581a0e10 con 0x7f4d5807de60 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.118+0000 7f4d4f7fe640 1 -- 172.21.15.73:0/2092125178 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4d50044020 con 0x7f4d5807de60 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.118+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/2092125178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5807c340 con 0x7f4d5807de60 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.118+0000 7f4d4f7fe640 1 --2- 172.21.15.73:0/2092125178 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4d44038fc0 0x7f4d4403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.118+0000 7f4d4f7fe640 1 -- 172.21.15.73:0/2092125178 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4d50042020 con 0x7f4d5807de60 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.118+0000 7f4d55d9b640 1 --2- 172.21.15.73:0/2092125178 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4d44038fc0 0x7f4d4403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.119+0000 7f4d55d9b640 1 --2- 172.21.15.73:0/2092125178 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4d44038fc0 0x7f4d4403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4d400098c0 tx=0x7f4d40006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.123+0000 7f4d4f7fe640 1 -- 172.21.15.73:0/2092125178 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d5004b020 con 0x7f4d5807de60 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.290+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/2092125178 --> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f4d58104240 con 0x7f4d44038fc0 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.291+0000 7f4d4f7fe640 1 -- 172.21.15.73:0/2092125178 <== mgr.14118 v2:172.21.15.73:6800/2037973546 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f4d58104240 con 0x7f4d44038fc0 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.293+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/2092125178 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4d44038fc0 msgr2=0x7f4d4403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.293+0000 7f4d5cbfa640 1 --2- 172.21.15.73:0/2092125178 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4d44038fc0 0x7f4d4403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4d400098c0 tx=0x7f4d40006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:44.836 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.293+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/2092125178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 msgr2=0x7f4d5819d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:44.837 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.293+0000 7f4d5cbfa640 1 --2- 172.21.15.73:0/2092125178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5819d950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4d5002acc0 tx=0x7f4d50031ca0 comp rx=0 tx=0).stop 2024-09-05T12:48:44.837 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.293+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/2092125178 shutdown_connections 2024-09-05T12:48:44.837 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.293+0000 7f4d5cbfa640 1 --2- 172.21.15.73:0/2092125178 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4d44038fc0 0x7f4d4403b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:44.837 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.293+0000 7f4d5cbfa640 1 --2- 172.21.15.73:0/2092125178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5807de60 0x7f4d5819d950 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:44.837 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.293+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/2092125178 >> 172.21.15.73:0/2092125178 conn(0x7f4d58102fa0 msgr2=0x7f4d58103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:44.837 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.293+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/2092125178 shutdown_connections 2024-09-05T12:48:44.837 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:44.293+0000 7f4d5cbfa640 1 -- 172.21.15.73:0/2092125178 wait complete. 2024-09-05T12:48:44.837 INFO:teuthology.orchestra.run.smithi073.stdout:Generating ssh key... 2024-09-05T12:48:45.173 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:44 smithi073 ceph-mon[30883]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:48:46.013 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: Generating public/private rsa key pair. 2024-09-05T12:48:46.013 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: Your identification has been saved in /tmp/tmph5te4j_d/key 2024-09-05T12:48:46.013 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: Your public key has been saved in /tmp/tmph5te4j_d/key.pub 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: The key fingerprint is: 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: SHA256:ueT0NK7Alh1ZRi6SUjeGgPpdPz5i7aNj+2bSi/vjNTY ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: The key's randomart image is: 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: +---[RSA 3072]----+ 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: | .....+ . | 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: | . ..+ + | 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: | . . o . + | 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: |. ... * | 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: | . . . .S o | 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: | . .. *o* . | 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: | =++.E | 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: | .*oX+ o | 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: | o=#B= | 2024-09-05T12:48:46.014 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:45 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: +----[SHA256]-----+ 2024-09-05T12:48:46.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.257+0000 7f1e0c354640 1 Processor -- start 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.257+0000 7f1e0c354640 1 -- start start 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.258+0000 7f1e0c354640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0410a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.258+0000 7f1e0c354640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0407bd90 con 0x7f1e04108230 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.258+0000 7f1e0a0f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0410a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.258+0000 7f1e0a0f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0410a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54522/0 (socket says 172.21.15.73:54522) 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.258+0000 7f1e0a0f0640 1 -- 172.21.15.73:0/1026586931 learned_addr learned my addr 172.21.15.73:0/1026586931 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.258+0000 7f1e0a0f0640 1 -- 172.21.15.73:0/1026586931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0410ab60 con 0x7f1e04108230 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.259+0000 7f1e0a0f0640 1 --2- 172.21.15.73:0/1026586931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0410a620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009820 tx=0x7f1dfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea39395afcedcda server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.259+0000 7f1e090ee640 1 -- 172.21.15.73:0/1026586931 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dfc037070 con 0x7f1e04108230 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.259+0000 7f1e090ee640 1 -- 172.21.15.73:0/1026586931 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1dfc032900 con 0x7f1e04108230 2024-09-05T12:48:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.259+0000 7f1e090ee640 1 -- 172.21.15.73:0/1026586931 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dfc030850 con 0x7f1e04108230 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.260+0000 7f1e0c354640 1 -- 172.21.15.73:0/1026586931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 msgr2=0x7f1e0410a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.260+0000 7f1e0c354640 1 --2- 172.21.15.73:0/1026586931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0410a620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009820 tx=0x7f1dfc02a270 comp rx=0 tx=0).stop 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.260+0000 7f1e0c354640 1 -- 172.21.15.73:0/1026586931 shutdown_connections 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.260+0000 7f1e0c354640 1 --2- 172.21.15.73:0/1026586931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0410a620 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.260+0000 7f1e0c354640 1 -- 172.21.15.73:0/1026586931 >> 172.21.15.73:0/1026586931 conn(0x7f1e04101e10 msgr2=0x7f1e04104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.260+0000 7f1e0c354640 1 -- 172.21.15.73:0/1026586931 shutdown_connections 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.260+0000 7f1e0c354640 1 -- 172.21.15.73:0/1026586931 wait complete. 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.261+0000 7f1e0c354640 1 Processor -- start 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.261+0000 7f1e0c354640 1 -- start start 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.261+0000 7f1e0c354640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0419d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.261+0000 7f1e0c354640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0410bb40 con 0x7f1e04108230 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.261+0000 7f1e0a0f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0419d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.261+0000 7f1e0a0f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0419d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54526/0 (socket says 172.21.15.73:54526) 2024-09-05T12:48:46.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.261+0000 7f1e0a0f0640 1 -- 172.21.15.73:0/4175737010 learned_addr learned my addr 172.21.15.73:0/4175737010 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.261+0000 7f1e0a0f0640 1 -- 172.21.15.73:0/4175737010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0419df20 con 0x7f1e04108230 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.261+0000 7f1e0a0f0640 1 --2- 172.21.15.73:0/4175737010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0419d9e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0097f0 tx=0x7f1dfc030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.262+0000 7f1e037fe640 1 -- 172.21.15.73:0/4175737010 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dfc042070 con 0x7f1e04108230 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.262+0000 7f1e037fe640 1 -- 172.21.15.73:0/4175737010 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1dfc032ca0 con 0x7f1e04108230 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.262+0000 7f1e0c354640 1 -- 172.21.15.73:0/4175737010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0419e1b0 con 0x7f1e04108230 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.262+0000 7f1e037fe640 1 -- 172.21.15.73:0/4175737010 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dfc037040 con 0x7f1e04108230 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.262+0000 7f1e0c354640 1 -- 172.21.15.73:0/4175737010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e041a0ea0 con 0x7f1e04108230 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.263+0000 7f1e037fe640 1 -- 172.21.15.73:0/4175737010 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1dfc045070 con 0x7f1e04108230 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.263+0000 7f1e037fe640 1 --2- 172.21.15.73:0/4175737010 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f1dec038f70 0x7f1dec03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.263+0000 7f1e037fe640 1 -- 172.21.15.73:0/4175737010 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1dfc03dba0 con 0x7f1e04108230 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.263+0000 7f1e098ef640 1 --2- 172.21.15.73:0/4175737010 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f1dec038f70 0x7f1dec03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.263+0000 7f1e0c354640 1 -- 172.21.15.73:0/4175737010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e04108690 con 0x7f1e04108230 2024-09-05T12:48:46.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.263+0000 7f1e098ef640 1 --2- 172.21.15.73:0/4175737010 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f1dec038f70 0x7f1dec03b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1df800ad30 tx=0x7f1df80093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.268+0000 7f1e037fe640 1 -- 172.21.15.73:0/4175737010 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1dfc045520 con 0x7f1e04108230 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.449+0000 7f1e0c354640 1 -- 172.21.15.73:0/4175737010 --> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f1e041030f0 con 0x7f1dec038f70 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.721+0000 7f1e037fe640 1 -- 172.21.15.73:0/4175737010 <== mgr.14118 v2:172.21.15.73:6800/2037973546 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1e041030f0 con 0x7f1dec038f70 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.723+0000 7f1e0c354640 1 -- 172.21.15.73:0/4175737010 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f1dec038f70 msgr2=0x7f1dec03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.723+0000 7f1e0c354640 1 --2- 172.21.15.73:0/4175737010 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f1dec038f70 0x7f1dec03b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1df800ad30 tx=0x7f1df80093f0 comp rx=0 tx=0).stop 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.723+0000 7f1e0c354640 1 -- 172.21.15.73:0/4175737010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 msgr2=0x7f1e0419d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.723+0000 7f1e0c354640 1 --2- 172.21.15.73:0/4175737010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0419d9e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0097f0 tx=0x7f1dfc030ec0 comp rx=0 tx=0).stop 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.723+0000 7f1e0c354640 1 -- 172.21.15.73:0/4175737010 shutdown_connections 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.723+0000 7f1e0c354640 1 --2- 172.21.15.73:0/4175737010 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f1dec038f70 0x7f1dec03b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.723+0000 7f1e0c354640 1 --2- 172.21.15.73:0/4175737010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e04108230 0x7f1e0419d9e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.723+0000 7f1e0c354640 1 -- 172.21.15.73:0/4175737010 >> 172.21.15.73:0/4175737010 conn(0x7f1e04101e10 msgr2=0x7f1e041029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.724+0000 7f1e0c354640 1 -- 172.21.15.73:0/4175737010 shutdown_connections 2024-09-05T12:48:46.197 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:45.724+0000 7f1e0c354640 1 -- 172.21.15.73:0/4175737010 wait complete. 2024-09-05T12:48:46.761 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:46 smithi073 ceph-mon[30883]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:48:46.761 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:46 smithi073 ceph-mon[30883]: Generating ssh key... 2024-09-05T12:48:46.761 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:46 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:46.761 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:46 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:47.272 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJiJsu7INKx1cT5DUgUTuMcBDZkAYYdRWN11Ofvxqfxd1SwBNoX3oS45WGYrTzKCsgvOq48BPHCNfisr3FB3uEa+Oaj8cGJ6YxmT/PK3ONXV8lc00NntCjHtPXbUT3kbuyh9NxPUIAzBm8g78+iAQfMfFaas9eVZW9dOKAl45MQxGu6wp3vugsfhn9RcY6oHf15vljQBQy1O4747SZMotKWf9AKKJ7lADRrB1mEL04dHAEotbI6dGkaBbdqVoG4uM78UM4s1+7NWjUqd1jnPJMKABOW4Uw93+EUEpQCobQzGPe65egpR0GbAo8zjdVvKRjiL8Att2cPDGHdt0a1o5Hkh8fevukfNWeHeedCL+wsPM/E9CqVCnbfuEjxViTW66DvcsJCop89WaFtGA9FynyvAEvWv5ZXWhr+18k5UDH9IyJF+9S+F8skHEGDlstMph2kHtC9FuGdfuZ0DYrpoQFRXpqBRUG4tFTw3oM7QQqoheTohfbBHFIFnrEoSTnD8s= ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:48:47.272 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.578+0000 7f500b46b640 1 Processor -- start 2024-09-05T12:48:47.272 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.579+0000 7f500b46b640 1 -- start start 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.579+0000 7f500b46b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.579+0000 7f500b46b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f500407c890 con 0x7f500407de60 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.579+0000 7f5009207640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.579+0000 7f5009207640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54542/0 (socket says 172.21.15.73:54542) 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.579+0000 7f5009207640 1 -- 172.21.15.73:0/3753728410 learned_addr learned my addr 172.21.15.73:0/3753728410 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.579+0000 7f5009207640 1 -- 172.21.15.73:0/3753728410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500407ca10 con 0x7f500407de60 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.580+0000 7f5009207640 1 --2- 172.21.15.73:0/3753728410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500407c2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009820 tx=0x7f4ff802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa04a3cc252cd135 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.580+0000 7f4ff7fff640 1 -- 172.21.15.73:0/3753728410 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8037070 con 0x7f500407de60 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.580+0000 7f4ff7fff640 1 -- 172.21.15.73:0/3753728410 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ff8032900 con 0x7f500407de60 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.580+0000 7f4ff7fff640 1 -- 172.21.15.73:0/3753728410 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8030850 con 0x7f500407de60 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.580+0000 7f500b46b640 1 -- 172.21.15.73:0/3753728410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 msgr2=0x7f500407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.580+0000 7f500b46b640 1 --2- 172.21.15.73:0/3753728410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500407c2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009820 tx=0x7f4ff802a270 comp rx=0 tx=0).stop 2024-09-05T12:48:47.273 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.581+0000 7f500b46b640 1 -- 172.21.15.73:0/3753728410 shutdown_connections 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.581+0000 7f500b46b640 1 --2- 172.21.15.73:0/3753728410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500407c2c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.581+0000 7f500b46b640 1 -- 172.21.15.73:0/3753728410 >> 172.21.15.73:0/3753728410 conn(0x7f5004102fa0 msgr2=0x7f50041053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.581+0000 7f500b46b640 1 -- 172.21.15.73:0/3753728410 shutdown_connections 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.581+0000 7f500b46b640 1 -- 172.21.15.73:0/3753728410 wait complete. 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.581+0000 7f500b46b640 1 Processor -- start 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.581+0000 7f500b46b640 1 -- start start 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.581+0000 7f500b46b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500419d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.581+0000 7f500b46b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f500410dd80 con 0x7f500407de60 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.581+0000 7f5009207640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500419d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.582+0000 7f5009207640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500419d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54558/0 (socket says 172.21.15.73:54558) 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.582+0000 7f5009207640 1 -- 172.21.15.73:0/2918518844 learned_addr learned my addr 172.21.15.73:0/2918518844 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.582+0000 7f5009207640 1 -- 172.21.15.73:0/2918518844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500419de90 con 0x7f500407de60 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.582+0000 7f5009207640 1 --2- 172.21.15.73:0/2918518844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500419d950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009940 tx=0x7f4ff8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:47.274 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.582+0000 7f4ff67fc640 1 -- 172.21.15.73:0/2918518844 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8042070 con 0x7f500407de60 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.582+0000 7f4ff67fc640 1 -- 172.21.15.73:0/2918518844 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ff80308c0 con 0x7f500407de60 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.582+0000 7f500b46b640 1 -- 172.21.15.73:0/2918518844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500419e120 con 0x7f500407de60 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.582+0000 7f4ff67fc640 1 -- 172.21.15.73:0/2918518844 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8037040 con 0x7f500407de60 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.582+0000 7f500b46b640 1 -- 172.21.15.73:0/2918518844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50041a0e10 con 0x7f500407de60 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.583+0000 7f4ff67fc640 1 -- 172.21.15.73:0/2918518844 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4ff8045070 con 0x7f500407de60 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.583+0000 7f500b46b640 1 -- 172.21.15.73:0/2918518844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500407c340 con 0x7f500407de60 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.583+0000 7f4ff67fc640 1 --2- 172.21.15.73:0/2918518844 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4ff0038fc0 0x7f4ff003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.583+0000 7f4ff67fc640 1 -- 172.21.15.73:0/2918518844 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4ff806c090 con 0x7f500407de60 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.583+0000 7f5008a06640 1 --2- 172.21.15.73:0/2918518844 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4ff0038fc0 0x7f4ff003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.584+0000 7f5008a06640 1 --2- 172.21.15.73:0/2918518844 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4ff0038fc0 0x7f4ff003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f50000098c0 tx=0x7f5000006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.588+0000 7f4ff67fc640 1 -- 172.21.15.73:0/2918518844 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ff804b170 con 0x7f500407de60 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.760+0000 7f500b46b640 1 -- 172.21.15.73:0/2918518844 --> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f5004104240 con 0x7f4ff0038fc0 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.760+0000 7f4ff67fc640 1 -- 172.21.15.73:0/2918518844 <== mgr.14118 v2:172.21.15.73:6800/2037973546 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f5004104240 con 0x7f4ff0038fc0 2024-09-05T12:48:47.275 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.762+0000 7f500b46b640 1 -- 172.21.15.73:0/2918518844 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4ff0038fc0 msgr2=0x7f4ff003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.762+0000 7f500b46b640 1 --2- 172.21.15.73:0/2918518844 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4ff0038fc0 0x7f4ff003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f50000098c0 tx=0x7f5000006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.762+0000 7f500b46b640 1 -- 172.21.15.73:0/2918518844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 msgr2=0x7f500419d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.762+0000 7f500b46b640 1 --2- 172.21.15.73:0/2918518844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500419d950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009940 tx=0x7f4ff8032ce0 comp rx=0 tx=0).stop 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.763+0000 7f500b46b640 1 -- 172.21.15.73:0/2918518844 shutdown_connections 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.763+0000 7f500b46b640 1 --2- 172.21.15.73:0/2918518844 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f4ff0038fc0 0x7f4ff003b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.763+0000 7f500b46b640 1 --2- 172.21.15.73:0/2918518844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500407de60 0x7f500419d950 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.763+0000 7f500b46b640 1 -- 172.21.15.73:0/2918518844 >> 172.21.15.73:0/2918518844 conn(0x7f5004102fa0 msgr2=0x7f5004103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.763+0000 7f500b46b640 1 -- 172.21.15.73:0/2918518844 shutdown_connections 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:46.763+0000 7f500b46b640 1 -- 172.21.15.73:0/2918518844 wait complete. 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:Adding key to root@localhost authorized_keys... 2024-09-05T12:48:47.276 INFO:teuthology.orchestra.run.smithi073.stdout:Adding host smithi073... 2024-09-05T12:48:47.943 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:47 smithi073 ceph-mon[30883]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:48:49.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:48 smithi073 ceph-mon[30883]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "addr": "172.21.15.73", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:48:50.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:49 smithi073 ceph-mon[30883]: Deploying cephadm binary to smithi073 2024-09-05T12:48:51.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Added host 'smithi073' with addr '172.21.15.73' 2024-09-05T12:48:51.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.647+0000 7f518a482640 1 Processor -- start 2024-09-05T12:48:51.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.647+0000 7f518a482640 1 -- start start 2024-09-05T12:48:51.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.647+0000 7f518a482640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f5184107b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:51.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.647+0000 7f518a482640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5184108130 con 0x7f5184107760 2024-09-05T12:48:51.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.648+0000 7f5183fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f5184107b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:51.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.648+0000 7f5183fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f5184107b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54564/0 (socket says 172.21.15.73:54564) 2024-09-05T12:48:51.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.648+0000 7f5183fff640 1 -- 172.21.15.73:0/533239532 learned_addr learned my addr 172.21.15.73:0/533239532 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.648+0000 7f5183fff640 1 -- 172.21.15.73:0/533239532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5184108960 con 0x7f5184107760 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.649+0000 7f5183fff640 1 --2- 172.21.15.73:0/533239532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f5184107b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5174009820 tx=0x7f517402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ec3c5e43319e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.649+0000 7f5182ffd640 1 -- 172.21.15.73:0/533239532 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5174037070 con 0x7f5184107760 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.649+0000 7f5182ffd640 1 -- 172.21.15.73:0/533239532 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5174032900 con 0x7f5184107760 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.649+0000 7f5182ffd640 1 -- 172.21.15.73:0/533239532 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5174030850 con 0x7f5184107760 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.649+0000 7f518a482640 1 -- 172.21.15.73:0/533239532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 msgr2=0x7f5184107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.649+0000 7f518a482640 1 --2- 172.21.15.73:0/533239532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f5184107b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5174009820 tx=0x7f517402a270 comp rx=0 tx=0).stop 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.649+0000 7f518a482640 1 -- 172.21.15.73:0/533239532 shutdown_connections 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.649+0000 7f518a482640 1 --2- 172.21.15.73:0/533239532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f5184107b60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.649+0000 7f518a482640 1 -- 172.21.15.73:0/533239532 >> 172.21.15.73:0/533239532 conn(0x7f5184102ff0 msgr2=0x7f5184105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.649+0000 7f518a482640 1 -- 172.21.15.73:0/533239532 shutdown_connections 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.650+0000 7f518a482640 1 -- 172.21.15.73:0/533239532 wait complete. 2024-09-05T12:48:51.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.650+0000 7f518a482640 1 Processor -- start 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.650+0000 7f518a482640 1 -- start start 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.650+0000 7f518a482640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f518419b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.650+0000 7f518a482640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f518410bd10 con 0x7f5184107760 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.651+0000 7f5183fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f518419b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.651+0000 7f5183fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f518419b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54576/0 (socket says 172.21.15.73:54576) 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.651+0000 7f5183fff640 1 -- 172.21.15.73:0/1777977969 learned_addr learned my addr 172.21.15.73:0/1777977969 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.651+0000 7f5183fff640 1 -- 172.21.15.73:0/1777977969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518419bcd0 con 0x7f5184107760 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.651+0000 7f5183fff640 1 --2- 172.21.15.73:0/1777977969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f518419b790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5174009940 tx=0x7f5174032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.651+0000 7f51817fa640 1 -- 172.21.15.73:0/1777977969 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5174042070 con 0x7f5184107760 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.651+0000 7f51817fa640 1 -- 172.21.15.73:0/1777977969 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51740308c0 con 0x7f5184107760 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.651+0000 7f518a482640 1 -- 172.21.15.73:0/1777977969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518419bf60 con 0x7f5184107760 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.651+0000 7f51817fa640 1 -- 172.21.15.73:0/1777977969 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5174037040 con 0x7f5184107760 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.651+0000 7f518a482640 1 -- 172.21.15.73:0/1777977969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f518419ec50 con 0x7f5184107760 2024-09-05T12:48:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.652+0000 7f51817fa640 1 -- 172.21.15.73:0/1777977969 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5174045070 con 0x7f5184107760 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.652+0000 7f518a482640 1 -- 172.21.15.73:0/1777977969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f518410be90 con 0x7f5184107760 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.652+0000 7f51817fa640 1 --2- 172.21.15.73:0/1777977969 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f516c038f70 0x7f516c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.652+0000 7f51817fa640 1 -- 172.21.15.73:0/1777977969 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f517406c0c0 con 0x7f5184107760 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.653+0000 7f51837fe640 1 --2- 172.21.15.73:0/1777977969 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f516c038f70 0x7f516c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.653+0000 7f51837fe640 1 --2- 172.21.15.73:0/1777977969 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f516c038f70 0x7f516c03b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51780098c0 tx=0x7f5178006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.657+0000 7f51817fa640 1 -- 172.21.15.73:0/1777977969 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f517406ba50 con 0x7f5184107760 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:47.827+0000 7f518a482640 1 -- 172.21.15.73:0/1777977969 --> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi073", "addr": "172.21.15.73", "target": ["mon-mgr", ""]}) -- 0x7f51841042e0 con 0x7f516c038f70 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.986+0000 7f51817fa640 1 -- 172.21.15.73:0/1777977969 <== mgr.14118 v2:172.21.15.73:6800/2037973546 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f51841042e0 con 0x7f516c038f70 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.989+0000 7f518a482640 1 -- 172.21.15.73:0/1777977969 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f516c038f70 msgr2=0x7f516c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.989+0000 7f518a482640 1 --2- 172.21.15.73:0/1777977969 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f516c038f70 0x7f516c03b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51780098c0 tx=0x7f5178006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.989+0000 7f518a482640 1 -- 172.21.15.73:0/1777977969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 msgr2=0x7f518419b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.989+0000 7f518a482640 1 --2- 172.21.15.73:0/1777977969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f518419b790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5174009940 tx=0x7f5174032ce0 comp rx=0 tx=0).stop 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.989+0000 7f518a482640 1 -- 172.21.15.73:0/1777977969 shutdown_connections 2024-09-05T12:48:51.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.989+0000 7f518a482640 1 --2- 172.21.15.73:0/1777977969 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f516c038f70 0x7f516c03b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:51.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.989+0000 7f518a482640 1 --2- 172.21.15.73:0/1777977969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5184107760 0x7f518419b790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:51.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.989+0000 7f518a482640 1 -- 172.21.15.73:0/1777977969 >> 172.21.15.73:0/1777977969 conn(0x7f5184102ff0 msgr2=0x7f5184103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:51.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.989+0000 7f518a482640 1 -- 172.21.15.73:0/1777977969 shutdown_connections 2024-09-05T12:48:51.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:50.989+0000 7f518a482640 1 -- 172.21.15.73:0/1777977969 wait complete. 2024-09-05T12:48:51.509 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying unmanaged mon service... 2024-09-05T12:48:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:51 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:51 smithi073 ceph-mon[30883]: Added host smithi073 2024-09-05T12:48:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:51 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:48:52.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-05T12:48:52.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.903+0000 7ff8e3506640 1 Processor -- start 2024-09-05T12:48:52.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.904+0000 7ff8e3506640 1 -- start start 2024-09-05T12:48:52.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.904+0000 7ff8e3506640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc107b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:52.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.904+0000 7ff8e3506640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8dc108130 con 0x7ff8dc107760 2024-09-05T12:48:52.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.904+0000 7ff8e12a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc107b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:52.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.904+0000 7ff8e12a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc107b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54590/0 (socket says 172.21.15.73:54590) 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.904+0000 7ff8e12a2640 1 -- 172.21.15.73:0/1715522490 learned_addr learned my addr 172.21.15.73:0/1715522490 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.904+0000 7ff8e12a2640 1 -- 172.21.15.73:0/1715522490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8dc108960 con 0x7ff8dc107760 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.905+0000 7ff8e12a2640 1 --2- 172.21.15.73:0/1715522490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc107b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009820 tx=0x7ff8d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4eca2f8a3e8902 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.905+0000 7ff8dbfff640 1 -- 172.21.15.73:0/1715522490 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d4037070 con 0x7ff8dc107760 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.905+0000 7ff8dbfff640 1 -- 172.21.15.73:0/1715522490 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8d4032900 con 0x7ff8dc107760 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.905+0000 7ff8dbfff640 1 -- 172.21.15.73:0/1715522490 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d4030850 con 0x7ff8dc107760 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.906+0000 7ff8e3506640 1 -- 172.21.15.73:0/1715522490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 msgr2=0x7ff8dc107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.906+0000 7ff8e3506640 1 --2- 172.21.15.73:0/1715522490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc107b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009820 tx=0x7ff8d402a270 comp rx=0 tx=0).stop 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.906+0000 7ff8e3506640 1 -- 172.21.15.73:0/1715522490 shutdown_connections 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.906+0000 7ff8e3506640 1 --2- 172.21.15.73:0/1715522490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc107b60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.906+0000 7ff8e3506640 1 -- 172.21.15.73:0/1715522490 >> 172.21.15.73:0/1715522490 conn(0x7ff8dc102ff0 msgr2=0x7ff8dc105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.906+0000 7ff8e3506640 1 -- 172.21.15.73:0/1715522490 shutdown_connections 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.906+0000 7ff8e3506640 1 -- 172.21.15.73:0/1715522490 wait complete. 2024-09-05T12:48:52.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.906+0000 7ff8e3506640 1 Processor -- start 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8e3506640 1 -- start start 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8e3506640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc19d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8e3506640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8dc10bd10 con 0x7ff8dc107760 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8e12a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc19d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8e12a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc19d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54606/0 (socket says 172.21.15.73:54606) 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8e12a2640 1 -- 172.21.15.73:0/2648325050 learned_addr learned my addr 172.21.15.73:0/2648325050 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8e12a2640 1 -- 172.21.15.73:0/2648325050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8dc19ded0 con 0x7ff8dc107760 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8e12a2640 1 --2- 172.21.15.73:0/2648325050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc19d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009940 tx=0x7ff8d4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8da7fc640 1 -- 172.21.15.73:0/2648325050 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d4042070 con 0x7ff8dc107760 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8e3506640 1 -- 172.21.15.73:0/2648325050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8dc19e160 con 0x7ff8dc107760 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8da7fc640 1 -- 172.21.15.73:0/2648325050 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8d40308c0 con 0x7ff8dc107760 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8da7fc640 1 -- 172.21.15.73:0/2648325050 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d4037040 con 0x7ff8dc107760 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.907+0000 7ff8e3506640 1 -- 172.21.15.73:0/2648325050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8dc1a0e50 con 0x7ff8dc107760 2024-09-05T12:48:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.908+0000 7ff8da7fc640 1 -- 172.21.15.73:0/2648325050 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff8d4045070 con 0x7ff8dc107760 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.909+0000 7ff8da7fc640 1 --2- 172.21.15.73:0/2648325050 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7ff8c4038f70 0x7ff8c403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.909+0000 7ff8e3506640 1 -- 172.21.15.73:0/2648325050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8dc10be90 con 0x7ff8dc107760 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.909+0000 7ff8da7fc640 1 -- 172.21.15.73:0/2648325050 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff8d406c310 con 0x7ff8dc107760 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.909+0000 7ff8e0aa1640 1 --2- 172.21.15.73:0/2648325050 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7ff8c4038f70 0x7ff8c403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.909+0000 7ff8e0aa1640 1 --2- 172.21.15.73:0/2648325050 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7ff8c4038f70 0x7ff8c403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00098c0 tx=0x7ff8d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:51.914+0000 7ff8da7fc640 1 -- 172.21.15.73:0/2648325050 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8d403cd90 con 0x7ff8dc107760 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.099+0000 7ff8e3506640 1 -- 172.21.15.73:0/2648325050 --> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff8dc104230 con 0x7ff8c4038f70 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.104+0000 7ff8da7fc640 1 -- 172.21.15.73:0/2648325050 <== mgr.14118 v2:172.21.15.73:6800/2037973546 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff8dc104230 con 0x7ff8c4038f70 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.106+0000 7ff8e3506640 1 -- 172.21.15.73:0/2648325050 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7ff8c4038f70 msgr2=0x7ff8c403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.106+0000 7ff8e3506640 1 --2- 172.21.15.73:0/2648325050 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7ff8c4038f70 0x7ff8c403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00098c0 tx=0x7ff8d0006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:52.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.106+0000 7ff8e3506640 1 -- 172.21.15.73:0/2648325050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 msgr2=0x7ff8dc19d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:52.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.106+0000 7ff8e3506640 1 --2- 172.21.15.73:0/2648325050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc19d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009940 tx=0x7ff8d4032ce0 comp rx=0 tx=0).stop 2024-09-05T12:48:52.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.106+0000 7ff8e3506640 1 -- 172.21.15.73:0/2648325050 shutdown_connections 2024-09-05T12:48:52.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.106+0000 7ff8e3506640 1 --2- 172.21.15.73:0/2648325050 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7ff8c4038f70 0x7ff8c403b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:52.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.106+0000 7ff8e3506640 1 --2- 172.21.15.73:0/2648325050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8dc107760 0x7ff8dc19d990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:52.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.106+0000 7ff8e3506640 1 -- 172.21.15.73:0/2648325050 >> 172.21.15.73:0/2648325050 conn(0x7ff8dc102ff0 msgr2=0x7ff8dc103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:52.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.106+0000 7ff8e3506640 1 -- 172.21.15.73:0/2648325050 shutdown_connections 2024-09-05T12:48:52.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:52.106+0000 7ff8e3506640 1 -- 172.21.15.73:0/2648325050 wait complete. 2024-09-05T12:48:52.912 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying unmanaged mgr service... 2024-09-05T12:48:53.228 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:53 smithi073 ceph-mon[30883]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:48:53.228 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:53 smithi073 ceph-mon[30883]: Saving service mon spec with placement count:5 2024-09-05T12:48:53.228 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:53 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:55.138 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:55 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:55.138 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:55 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:55.138 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:55 smithi073 ceph-mon[30883]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:48:55.138 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:55 smithi073 ceph-mon[30883]: Saving service mgr spec with placement count:2 2024-09-05T12:48:55.138 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:55 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:55.145 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-05T12:48:55.145 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.363+0000 7f0588758640 1 Processor -- start 2024-09-05T12:48:55.145 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.363+0000 7f0588758640 1 -- start start 2024-09-05T12:48:55.145 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.364+0000 7f0588758640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f0580106a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:55.145 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.364+0000 7f0588758640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0580106fd0 con 0x7f0580106600 2024-09-05T12:48:55.145 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.364+0000 7f05864f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f0580106a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:55.145 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.364+0000 7f05864f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f0580106a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54224/0 (socket says 172.21.15.73:54224) 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.364+0000 7f05864f4640 1 -- 172.21.15.73:0/3098305327 learned_addr learned my addr 172.21.15.73:0/3098305327 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.364+0000 7f05864f4640 1 -- 172.21.15.73:0/3098305327 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0580107800 con 0x7f0580106600 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.365+0000 7f05864f4640 1 --2- 172.21.15.73:0/3098305327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f0580106a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f057c009820 tx=0x7f057c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27130ccc8b0f03fe server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.365+0000 7f05854f2640 1 -- 172.21.15.73:0/3098305327 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c037070 con 0x7f0580106600 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.365+0000 7f05854f2640 1 -- 172.21.15.73:0/3098305327 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f057c032920 con 0x7f0580106600 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.365+0000 7f05854f2640 1 -- 172.21.15.73:0/3098305327 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c030810 con 0x7f0580106600 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.366+0000 7f0588758640 1 -- 172.21.15.73:0/3098305327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 msgr2=0x7f0580106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.366+0000 7f0588758640 1 --2- 172.21.15.73:0/3098305327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f0580106a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f057c009820 tx=0x7f057c02a270 comp rx=0 tx=0).stop 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.366+0000 7f0588758640 1 -- 172.21.15.73:0/3098305327 shutdown_connections 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.366+0000 7f0588758640 1 --2- 172.21.15.73:0/3098305327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f0580106a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.366+0000 7f0588758640 1 -- 172.21.15.73:0/3098305327 >> 172.21.15.73:0/3098305327 conn(0x7f0580101e10 msgr2=0x7f0580104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.366+0000 7f0588758640 1 -- 172.21.15.73:0/3098305327 shutdown_connections 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.366+0000 7f0588758640 1 -- 172.21.15.73:0/3098305327 wait complete. 2024-09-05T12:48:55.146 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f0588758640 1 Processor -- start 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f0588758640 1 -- start start 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f0588758640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f058019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f0588758640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f058010abb0 con 0x7f0580106600 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f05864f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f058019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f05864f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f058019a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54228/0 (socket says 172.21.15.73:54228) 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f05864f4640 1 -- 172.21.15.73:0/2813997202 learned_addr learned my addr 172.21.15.73:0/2813997202 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f05864f4640 1 -- 172.21.15.73:0/2813997202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058019ac20 con 0x7f0580106600 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f05864f4640 1 --2- 172.21.15.73:0/2813997202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f058019a6e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f057c030560 tx=0x7f057c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f05777fe640 1 -- 172.21.15.73:0/2813997202 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c037040 con 0x7f0580106600 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f05777fe640 1 -- 172.21.15.73:0/2813997202 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f057c040070 con 0x7f0580106600 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f0588758640 1 -- 172.21.15.73:0/2813997202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058019aeb0 con 0x7f0580106600 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.367+0000 7f05777fe640 1 -- 172.21.15.73:0/2813997202 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c03a6d0 con 0x7f0580106600 2024-09-05T12:48:55.147 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.368+0000 7f0588758640 1 -- 172.21.15.73:0/2813997202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058019dba0 con 0x7f0580106600 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.368+0000 7f05777fe640 1 -- 172.21.15.73:0/2813997202 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f057c03a870 con 0x7f0580106600 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.368+0000 7f0588758640 1 -- 172.21.15.73:0/2813997202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058010ad30 con 0x7f0580106600 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.369+0000 7f05777fe640 1 --2- 172.21.15.73:0/2813997202 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f056c038fc0 0x7f056c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.369+0000 7f05777fe640 1 -- 172.21.15.73:0/2813997202 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f057c06c5f0 con 0x7f0580106600 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.369+0000 7f0585cf3640 1 --2- 172.21.15.73:0/2813997202 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f056c038fc0 0x7f056c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.369+0000 7f0585cf3640 1 --2- 172.21.15.73:0/2813997202 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f056c038fc0 0x7f056c03b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f05700098c0 tx=0x7f0570006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.373+0000 7f05777fe640 1 -- 172.21.15.73:0/2813997202 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f057c044c70 con 0x7f0580106600 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.562+0000 7f0588758640 1 -- 172.21.15.73:0/2813997202 --> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f05801031b0 con 0x7f056c038fc0 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.567+0000 7f05777fe640 1 -- 172.21.15.73:0/2813997202 <== mgr.14118 v2:172.21.15.73:6800/2037973546 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f05801031b0 con 0x7f056c038fc0 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.569+0000 7f0588758640 1 -- 172.21.15.73:0/2813997202 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f056c038fc0 msgr2=0x7f056c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.569+0000 7f0588758640 1 --2- 172.21.15.73:0/2813997202 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f056c038fc0 0x7f056c03b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f05700098c0 tx=0x7f0570006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.569+0000 7f0588758640 1 -- 172.21.15.73:0/2813997202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 msgr2=0x7f058019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.569+0000 7f0588758640 1 --2- 172.21.15.73:0/2813997202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f058019a6e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f057c030560 tx=0x7f057c032670 comp rx=0 tx=0).stop 2024-09-05T12:48:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.569+0000 7f0588758640 1 -- 172.21.15.73:0/2813997202 shutdown_connections 2024-09-05T12:48:55.149 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.569+0000 7f0588758640 1 --2- 172.21.15.73:0/2813997202 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f056c038fc0 0x7f056c03b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:55.149 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.569+0000 7f0588758640 1 --2- 172.21.15.73:0/2813997202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0580106600 0x7f058019a6e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:55.149 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.569+0000 7f0588758640 1 -- 172.21.15.73:0/2813997202 >> 172.21.15.73:0/2813997202 conn(0x7f0580101e10 msgr2=0x7f0580102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:55.149 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.569+0000 7f0588758640 1 -- 172.21.15.73:0/2813997202 shutdown_connections 2024-09-05T12:48:55.149 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:54.569+0000 7f0588758640 1 -- 172.21.15.73:0/2813997202 wait complete. 2024-09-05T12:48:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.544+0000 7fb14b765640 1 Processor -- start 2024-09-05T12:48:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.544+0000 7fb14b765640 1 -- start start 2024-09-05T12:48:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.544+0000 7fb14b765640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb144105e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.544+0000 7fb14b765640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb144106400 con 0x7fb144105a30 2024-09-05T12:48:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.544+0000 7fb149501640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb144105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.545+0000 7fb149501640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb144105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54230/0 (socket says 172.21.15.73:54230) 2024-09-05T12:48:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.545+0000 7fb149501640 1 -- 172.21.15.73:0/952932098 learned_addr learned my addr 172.21.15.73:0/952932098 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.545+0000 7fb149501640 1 -- 172.21.15.73:0/952932098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb144108a10 con 0x7fb144105a30 2024-09-05T12:48:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.545+0000 7fb149501640 1 --2- 172.21.15.73:0/952932098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb144105e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb140009820 tx=0x7fb14002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a0c24a0de7d681 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.546+0000 7fb13bfff640 1 -- 172.21.15.73:0/952932098 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb140037070 con 0x7fb144105a30 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.546+0000 7fb13bfff640 1 -- 172.21.15.73:0/952932098 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb140032920 con 0x7fb144105a30 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.546+0000 7fb13bfff640 1 -- 172.21.15.73:0/952932098 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb140030810 con 0x7fb144105a30 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.546+0000 7fb14b765640 1 -- 172.21.15.73:0/952932098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 msgr2=0x7fb144105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.546+0000 7fb14b765640 1 --2- 172.21.15.73:0/952932098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb144105e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb140009820 tx=0x7fb14002a270 comp rx=0 tx=0).stop 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.546+0000 7fb14b765640 1 -- 172.21.15.73:0/952932098 shutdown_connections 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.546+0000 7fb14b765640 1 --2- 172.21.15.73:0/952932098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb144105e30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.546+0000 7fb14b765640 1 -- 172.21.15.73:0/952932098 >> 172.21.15.73:0/952932098 conn(0x7fb144101660 msgr2=0x7fb144103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.546+0000 7fb14b765640 1 -- 172.21.15.73:0/952932098 shutdown_connections 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.546+0000 7fb14b765640 1 -- 172.21.15.73:0/952932098 wait complete. 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.547+0000 7fb14b765640 1 Processor -- start 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.547+0000 7fb14b765640 1 -- start start 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.547+0000 7fb14b765640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb14419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.547+0000 7fb14b765640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb14410bc40 con 0x7fb144105a30 2024-09-05T12:48:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.547+0000 7fb149501640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb14419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:56.631 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.547+0000 7fb149501640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb14419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54236/0 (socket says 172.21.15.73:54236) 2024-09-05T12:48:56.631 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.547+0000 7fb149501640 1 -- 172.21.15.73:0/1299655274 learned_addr learned my addr 172.21.15.73:0/1299655274 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:56.631 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.548+0000 7fb149501640 1 -- 172.21.15.73:0/1299655274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14419bcf0 con 0x7fb144105a30 2024-09-05T12:48:56.631 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.548+0000 7fb149501640 1 --2- 172.21.15.73:0/1299655274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb14419b7b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1400097f0 tx=0x7fb140030d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:56.631 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.548+0000 7fb13a7fc640 1 -- 172.21.15.73:0/1299655274 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb140037040 con 0x7fb144105a30 2024-09-05T12:48:56.631 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.548+0000 7fb13a7fc640 1 -- 172.21.15.73:0/1299655274 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb140040070 con 0x7fb144105a30 2024-09-05T12:48:56.631 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.548+0000 7fb14b765640 1 -- 172.21.15.73:0/1299655274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14419bf80 con 0x7fb144105a30 2024-09-05T12:48:56.631 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.548+0000 7fb13a7fc640 1 -- 172.21.15.73:0/1299655274 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14003a6d0 con 0x7fb144105a30 2024-09-05T12:48:56.631 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.548+0000 7fb14b765640 1 -- 172.21.15.73:0/1299655274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14419ec70 con 0x7fb144105a30 2024-09-05T12:48:56.632 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.549+0000 7fb13a7fc640 1 -- 172.21.15.73:0/1299655274 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb14003a990 con 0x7fb144105a30 2024-09-05T12:48:56.632 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.549+0000 7fb14b765640 1 -- 172.21.15.73:0/1299655274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb144105eb0 con 0x7fb144105a30 2024-09-05T12:48:56.632 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.549+0000 7fb13a7fc640 1 --2- 172.21.15.73:0/1299655274 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fb130038f70 0x7fb13003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:56.632 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.549+0000 7fb13a7fc640 1 -- 172.21.15.73:0/1299655274 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb14006c590 con 0x7fb144105a30 2024-09-05T12:48:56.632 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.549+0000 7fb148d00640 1 --2- 172.21.15.73:0/1299655274 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fb130038f70 0x7fb13003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:56.632 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.549+0000 7fb148d00640 1 --2- 172.21.15.73:0/1299655274 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fb130038f70 0x7fb13003b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb1340098c0 tx=0x7fb134006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:56.632 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.554+0000 7fb13a7fc640 1 -- 172.21.15.73:0/1299655274 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1400313a0 con 0x7fb144105a30 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.731+0000 7fb14b765640 1 -- 172.21.15.73:0/1299655274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fb14419f270 con 0x7fb144105a30 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.733+0000 7fb13a7fc640 1 -- 172.21.15.73:0/1299655274 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fb14004a200 con 0x7fb144105a30 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.736+0000 7fb14b765640 1 -- 172.21.15.73:0/1299655274 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fb130038f70 msgr2=0x7fb13003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.736+0000 7fb14b765640 1 --2- 172.21.15.73:0/1299655274 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fb130038f70 0x7fb13003b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb1340098c0 tx=0x7fb134006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.736+0000 7fb14b765640 1 -- 172.21.15.73:0/1299655274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 msgr2=0x7fb14419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.736+0000 7fb14b765640 1 --2- 172.21.15.73:0/1299655274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb14419b7b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1400097f0 tx=0x7fb140030d40 comp rx=0 tx=0).stop 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.736+0000 7fb14b765640 1 -- 172.21.15.73:0/1299655274 shutdown_connections 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.736+0000 7fb14b765640 1 --2- 172.21.15.73:0/1299655274 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fb130038f70 0x7fb13003b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.736+0000 7fb14b765640 1 --2- 172.21.15.73:0/1299655274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb144105a30 0x7fb14419b7b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.736+0000 7fb14b765640 1 -- 172.21.15.73:0/1299655274 >> 172.21.15.73:0/1299655274 conn(0x7fb144101660 msgr2=0x7fb1441021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.736+0000 7fb14b765640 1 -- 172.21.15.73:0/1299655274 shutdown_connections 2024-09-05T12:48:56.633 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:55.736+0000 7fb14b765640 1 -- 172.21.15.73:0/1299655274 wait complete. 2024-09-05T12:48:57.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:56 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1299655274' entity='client.admin' 2024-09-05T12:48:58.062 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.391+0000 7fa6ce0eb640 1 Processor -- start 2024-09-05T12:48:58.062 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.391+0000 7fa6ce0eb640 1 -- start start 2024-09-05T12:48:58.062 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.391+0000 7fa6ce0eb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c810a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:58.062 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.391+0000 7fa6ce0eb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c807be10 con 0x7fa6c81081b0 2024-09-05T12:48:58.062 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.391+0000 7fa6c77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c810a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:58.062 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.391+0000 7fa6c77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c810a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54252/0 (socket says 172.21.15.73:54252) 2024-09-05T12:48:58.062 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.391+0000 7fa6c77fe640 1 -- 172.21.15.73:0/1627521941 learned_addr learned my addr 172.21.15.73:0/1627521941 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.391+0000 7fa6c77fe640 1 -- 172.21.15.73:0/1627521941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c810aae0 con 0x7fa6c81081b0 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.392+0000 7fa6c77fe640 1 --2- 172.21.15.73:0/1627521941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c810a5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009820 tx=0x7fa6b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e3aba0c8a61b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.392+0000 7fa6c6ffd640 1 -- 172.21.15.73:0/1627521941 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8037070 con 0x7fa6c81081b0 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.392+0000 7fa6c6ffd640 1 -- 172.21.15.73:0/1627521941 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6b8032920 con 0x7fa6c81081b0 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.392+0000 7fa6c6ffd640 1 -- 172.21.15.73:0/1627521941 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8030810 con 0x7fa6c81081b0 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.393+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/1627521941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 msgr2=0x7fa6c810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.393+0000 7fa6ce0eb640 1 --2- 172.21.15.73:0/1627521941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c810a5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009820 tx=0x7fa6b802a270 comp rx=0 tx=0).stop 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.393+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/1627521941 shutdown_connections 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.393+0000 7fa6ce0eb640 1 --2- 172.21.15.73:0/1627521941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c810a5a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.393+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/1627521941 >> 172.21.15.73:0/1627521941 conn(0x7fa6c8101e10 msgr2=0x7fa6c8104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.393+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/1627521941 shutdown_connections 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.393+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/1627521941 wait complete. 2024-09-05T12:48:58.063 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.394+0000 7fa6ce0eb640 1 Processor -- start 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.394+0000 7fa6ce0eb640 1 -- start start 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.394+0000 7fa6ce0eb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c819d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.394+0000 7fa6ce0eb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c810bb60 con 0x7fa6c81081b0 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.394+0000 7fa6c77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c819d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.394+0000 7fa6c77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c819d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54254/0 (socket says 172.21.15.73:54254) 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.394+0000 7fa6c77fe640 1 -- 172.21.15.73:0/2212587514 learned_addr learned my addr 172.21.15.73:0/2212587514 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.395+0000 7fa6c77fe640 1 -- 172.21.15.73:0/2212587514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c819dec0 con 0x7fa6c81081b0 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.395+0000 7fa6c77fe640 1 --2- 172.21.15.73:0/2212587514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c819d980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80097f0 tx=0x7fa6b80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.395+0000 7fa6c57fa640 1 -- 172.21.15.73:0/2212587514 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8037040 con 0x7fa6c81081b0 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.395+0000 7fa6c57fa640 1 -- 172.21.15.73:0/2212587514 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6b8030c40 con 0x7fa6c81081b0 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.395+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/2212587514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c819e150 con 0x7fa6c81081b0 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.395+0000 7fa6c57fa640 1 -- 172.21.15.73:0/2212587514 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b803a5d0 con 0x7fa6c81081b0 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.395+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/2212587514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c81a0e40 con 0x7fa6c81081b0 2024-09-05T12:48:58.064 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.396+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/2212587514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c8108610 con 0x7fa6c81081b0 2024-09-05T12:48:58.065 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.396+0000 7fa6c57fa640 1 -- 172.21.15.73:0/2212587514 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa6b803a7c0 con 0x7fa6c81081b0 2024-09-05T12:48:58.065 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.396+0000 7fa6c57fa640 1 --2- 172.21.15.73:0/2212587514 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fa6b4038fc0 0x7fa6b403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:48:58.065 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.396+0000 7fa6c57fa640 1 -- 172.21.15.73:0/2212587514 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa6b806c430 con 0x7fa6c81081b0 2024-09-05T12:48:58.065 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.396+0000 7fa6bffff640 1 --2- 172.21.15.73:0/2212587514 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fa6b4038fc0 0x7fa6b403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:48:58.065 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.397+0000 7fa6bffff640 1 --2- 172.21.15.73:0/2212587514 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fa6b4038fc0 0x7fa6b403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00098c0 tx=0x7fa6b0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:48:58.065 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.401+0000 7fa6c57fa640 1 -- 172.21.15.73:0/2212587514 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6b80371e0 con 0x7fa6c81081b0 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.572+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/2212587514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa6c81a14a0 con 0x7fa6c81081b0 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.574+0000 7fa6c57fa640 1 -- 172.21.15.73:0/2212587514 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa6b8030df0 con 0x7fa6c81081b0 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.577+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/2212587514 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fa6b4038fc0 msgr2=0x7fa6b403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.577+0000 7fa6ce0eb640 1 --2- 172.21.15.73:0/2212587514 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fa6b4038fc0 0x7fa6b403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00098c0 tx=0x7fa6b0006db0 comp rx=0 tx=0).stop 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.577+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/2212587514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 msgr2=0x7fa6c819d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.577+0000 7fa6ce0eb640 1 --2- 172.21.15.73:0/2212587514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c819d980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80097f0 tx=0x7fa6b80327b0 comp rx=0 tx=0).stop 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.577+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/2212587514 shutdown_connections 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.577+0000 7fa6ce0eb640 1 --2- 172.21.15.73:0/2212587514 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7fa6b4038fc0 0x7fa6b403b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.577+0000 7fa6ce0eb640 1 --2- 172.21.15.73:0/2212587514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6c81081b0 0x7fa6c819d980 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.577+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/2212587514 >> 172.21.15.73:0/2212587514 conn(0x7fa6c8101e10 msgr2=0x7fa6c8102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.577+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/2212587514 shutdown_connections 2024-09-05T12:48:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:57.577+0000 7fa6ce0eb640 1 -- 172.21.15.73:0/2212587514 wait complete. 2024-09-05T12:48:58.067 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling the dashboard module... 2024-09-05T12:48:58.155 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:57 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:58.155 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:57 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2212587514' entity='client.admin' 2024-09-05T12:48:58.155 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:57 smithi073 ceph-mon[30883]: from='mgr.14118 172.21.15.73:0/4170592912' entity='mgr.x' 2024-09-05T12:48:59.120 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:58 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/750614936' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-05T12:48:59.120 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: ignoring --setuser ceph since I am not root 2024-09-05T12:48:59.120 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: ignoring --setgroup ceph since I am not root 2024-09-05T12:48:59.120 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:59.117+0000 7f33fd8b7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T12:48:59.393 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:59.175+0000 7f33fd8b7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T12:48:59.393 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:59.322+0000 7f33fd8b7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T12:48:59.393 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:59.391+0000 7f33fd8b7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T12:48:59.685 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:59.540+0000 7f33fd8b7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T12:48:59.685 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:48:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:59.683+0000 7f33fd8b7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T12:49:00.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.391+0000 7f8131a6d640 1 Processor -- start 2024-09-05T12:49:00.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.391+0000 7f8131a6d640 1 -- start start 2024-09-05T12:49:00.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.391+0000 7f8131a6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c105da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:00.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.391+0000 7f8131a6d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f812c106370 con 0x7f812c1059a0 2024-09-05T12:49:00.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.391+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c105da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:00.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.391+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c105da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54266/0 (socket says 172.21.15.73:54266) 2024-09-05T12:49:00.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.391+0000 7f812b7fe640 1 -- 172.21.15.73:0/3433749919 learned_addr learned my addr 172.21.15.73:0/3433749919 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:00.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.391+0000 7f812b7fe640 1 -- 172.21.15.73:0/3433749919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c1064f0 con 0x7f812c1059a0 2024-09-05T12:49:00.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.392+0000 7f812b7fe640 1 --2- 172.21.15.73:0/3433749919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c105da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f811c009820 tx=0x7f811c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2369379913de04d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:00.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.392+0000 7f812a7fc640 1 -- 172.21.15.73:0/3433749919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f811c037070 con 0x7f812c1059a0 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.392+0000 7f812a7fc640 1 -- 172.21.15.73:0/3433749919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f811c032920 con 0x7f812c1059a0 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.392+0000 7f812a7fc640 1 -- 172.21.15.73:0/3433749919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f811c030810 con 0x7f812c1059a0 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.393+0000 7f8131a6d640 1 -- 172.21.15.73:0/3433749919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 msgr2=0x7f812c105da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.393+0000 7f8131a6d640 1 --2- 172.21.15.73:0/3433749919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c105da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f811c009820 tx=0x7f811c02a270 comp rx=0 tx=0).stop 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.393+0000 7f8131a6d640 1 -- 172.21.15.73:0/3433749919 shutdown_connections 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.393+0000 7f8131a6d640 1 --2- 172.21.15.73:0/3433749919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c105da0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.393+0000 7f8131a6d640 1 -- 172.21.15.73:0/3433749919 >> 172.21.15.73:0/3433749919 conn(0x7f812c101660 msgr2=0x7f812c103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.393+0000 7f8131a6d640 1 -- 172.21.15.73:0/3433749919 shutdown_connections 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.393+0000 7f8131a6d640 1 -- 172.21.15.73:0/3433749919 wait complete. 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.393+0000 7f8131a6d640 1 Processor -- start 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.394+0000 7f8131a6d640 1 -- start start 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.394+0000 7f8131a6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c108290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.394+0000 7f8131a6d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f812c10bc40 con 0x7f812c1059a0 2024-09-05T12:49:00.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.394+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c108290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.394+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c108290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54280/0 (socket says 172.21.15.73:54280) 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.394+0000 7f812b7fe640 1 -- 172.21.15.73:0/750614936 learned_addr learned my addr 172.21.15.73:0/750614936 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.394+0000 7f812b7fe640 1 -- 172.21.15.73:0/750614936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c1087d0 con 0x7f812c1059a0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.394+0000 7f812b7fe640 1 --2- 172.21.15.73:0/750614936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c108290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f811c030560 tx=0x7f811c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.394+0000 7f8128ff9640 1 -- 172.21.15.73:0/750614936 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f811c037040 con 0x7f812c1059a0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.395+0000 7f8131a6d640 1 -- 172.21.15.73:0/750614936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c1069c0 con 0x7f812c1059a0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.395+0000 7f8128ff9640 1 -- 172.21.15.73:0/750614936 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f811c040070 con 0x7f812c1059a0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.395+0000 7f8128ff9640 1 -- 172.21.15.73:0/750614936 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f811c03a740 con 0x7f812c1059a0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.395+0000 7f8131a6d640 1 -- 172.21.15.73:0/750614936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c106f00 con 0x7f812c1059a0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.395+0000 7f8128ff9640 1 -- 172.21.15.73:0/750614936 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f811c03a9b0 con 0x7f812c1059a0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.395+0000 7f8128ff9640 1 --2- 172.21.15.73:0/750614936 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f8114038f70 0x7f811403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.396+0000 7f8128ff9640 1 -- 172.21.15.73:0/750614936 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f811c06c880 con 0x7f812c1059a0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.396+0000 7f812affd640 1 --2- 172.21.15.73:0/750614936 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f8114038f70 0x7f811403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.396+0000 7f8131a6d640 1 -- 172.21.15.73:0/750614936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c105e20 con 0x7f812c1059a0 2024-09-05T12:49:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.396+0000 7f812affd640 1 --2- 172.21.15.73:0/750614936 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f8114038f70 0x7f811403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f81200098c0 tx=0x7f8120006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.401+0000 7f8128ff9640 1 -- 172.21.15.73:0/750614936 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f811c041270 con 0x7f812c1059a0 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.621+0000 7f8131a6d640 1 -- 172.21.15.73:0/750614936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f812c1074b0 con 0x7f812c1059a0 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.971+0000 7f8128ff9640 1 -- 172.21.15.73:0/750614936 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f811c0328f0 con 0x7f812c1059a0 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.972+0000 7f8128ff9640 1 -- 172.21.15.73:0/750614936 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f811c061030 con 0x7f812c1059a0 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.973+0000 7f8131a6d640 1 -- 172.21.15.73:0/750614936 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f8114038f70 msgr2=0x7f811403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.974+0000 7f8131a6d640 1 --2- 172.21.15.73:0/750614936 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f8114038f70 0x7f811403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f81200098c0 tx=0x7f8120006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.974+0000 7f8131a6d640 1 -- 172.21.15.73:0/750614936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 msgr2=0x7f812c108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.974+0000 7f8131a6d640 1 --2- 172.21.15.73:0/750614936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c108290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f811c030560 tx=0x7f811c032670 comp rx=0 tx=0).stop 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.974+0000 7f8131a6d640 1 -- 172.21.15.73:0/750614936 shutdown_connections 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.974+0000 7f8131a6d640 1 --2- 172.21.15.73:0/750614936 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f8114038f70 0x7f811403b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.974+0000 7f8131a6d640 1 --2- 172.21.15.73:0/750614936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f812c1059a0 0x7f812c108290 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:00.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.974+0000 7f8131a6d640 1 -- 172.21.15.73:0/750614936 >> 172.21.15.73:0/750614936 conn(0x7f812c101660 msgr2=0x7f812c102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:00.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.974+0000 7f8131a6d640 1 -- 172.21.15.73:0/750614936 shutdown_connections 2024-09-05T12:49:00.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:48:58.974+0000 7f8131a6d640 1 -- 172.21.15.73:0/750614936 wait complete. 2024-09-05T12:49:00.257 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:59 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/750614936' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-05T12:49:00.257 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:48:59 smithi073 ceph-mon[30883]: mgrmap e9: x(active, since 18s) 2024-09-05T12:49:00.257 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:00 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:48:59.999+0000 7f33fd8b7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T12:49:00.257 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:00 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:00.059+0000 7f33fd8b7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T12:49:00.257 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:00 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:00.254+0000 7f33fd8b7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T12:49:01.174 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:00 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1240365235' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-05T12:49:01.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-05T12:49:01.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-05T12:49:01.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-05T12:49:01.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-05T12:49:01.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-05T12:49:01.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-05T12:49:01.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.583+0000 7f53bec84640 1 Processor -- start 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.583+0000 7f53bec84640 1 -- start start 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.583+0000 7f53bec84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b810a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.583+0000 7f53bec84640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f53b807bdf0 con 0x7f53b81081f0 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.583+0000 7f53bca20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b810a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.584+0000 7f53bca20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b810a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54302/0 (socket says 172.21.15.73:54302) 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.584+0000 7f53bca20640 1 -- 172.21.15.73:0/4248393861 learned_addr learned my addr 172.21.15.73:0/4248393861 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.584+0000 7f53bca20640 1 -- 172.21.15.73:0/4248393861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b810ab20 con 0x7f53b81081f0 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.584+0000 7f53bca20640 1 --2- 172.21.15.73:0/4248393861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b810a5e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009820 tx=0x7f53ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f03ef027a84fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.585+0000 7f53b77fe640 1 -- 172.21.15.73:0/4248393861 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53ac037070 con 0x7f53b81081f0 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.585+0000 7f53b77fe640 1 -- 172.21.15.73:0/4248393861 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53ac032920 con 0x7f53b81081f0 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.585+0000 7f53b77fe640 1 -- 172.21.15.73:0/4248393861 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53ac030810 con 0x7f53b81081f0 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.586+0000 7f53bec84640 1 -- 172.21.15.73:0/4248393861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 msgr2=0x7f53b810a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.586+0000 7f53bec84640 1 --2- 172.21.15.73:0/4248393861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b810a5e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009820 tx=0x7f53ac02a270 comp rx=0 tx=0).stop 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.586+0000 7f53bec84640 1 -- 172.21.15.73:0/4248393861 shutdown_connections 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.586+0000 7f53bec84640 1 --2- 172.21.15.73:0/4248393861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b810a5e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.586+0000 7f53bec84640 1 -- 172.21.15.73:0/4248393861 >> 172.21.15.73:0/4248393861 conn(0x7f53b8101e30 msgr2=0x7f53b8104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.586+0000 7f53bec84640 1 -- 172.21.15.73:0/4248393861 shutdown_connections 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.586+0000 7f53bec84640 1 -- 172.21.15.73:0/4248393861 wait complete. 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.586+0000 7f53bec84640 1 Processor -- start 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53bec84640 1 -- start start 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53bec84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53bec84640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f53b810bba0 con 0x7f53b81081f0 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53bca20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53bca20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b819b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54312/0 (socket says 172.21.15.73:54312) 2024-09-05T12:49:01.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53bca20640 1 -- 172.21.15.73:0/1240365235 learned_addr learned my addr 172.21.15.73:0/1240365235 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53bca20640 1 -- 172.21.15.73:0/1240365235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b819bc50 con 0x7f53b81081f0 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53bca20640 1 --2- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b819b710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53ac030380 tx=0x7f53ac032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53b5ffb640 1 -- 172.21.15.73:0/1240365235 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53ac037040 con 0x7f53b81081f0 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53b5ffb640 1 -- 172.21.15.73:0/1240365235 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53ac040070 con 0x7f53b81081f0 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53bec84640 1 -- 172.21.15.73:0/1240365235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b819bee0 con 0x7f53b81081f0 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.587+0000 7f53b5ffb640 1 -- 172.21.15.73:0/1240365235 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53ac03a7b0 con 0x7f53b81081f0 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.588+0000 7f53bec84640 1 -- 172.21.15.73:0/1240365235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b819ebd0 con 0x7f53b81081f0 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.588+0000 7f53b5ffb640 1 -- 172.21.15.73:0/1240365235 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f53ac03a9e0 con 0x7f53b81081f0 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.589+0000 7f53bec84640 1 -- 172.21.15.73:0/1240365235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b8108650 con 0x7f53b81081f0 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.589+0000 7f53b5ffb640 1 --2- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f53a8039020 0x7f53a803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.589+0000 7f53b5ffb640 1 -- 172.21.15.73:0/1240365235 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f53ac06d670 con 0x7f53b81081f0 2024-09-05T12:49:01.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.589+0000 7f53b7fff640 1 -- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f53a8039020 msgr2=0x7f53a803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2037973546 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.589+0000 7f53b7fff640 1 --2- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f53a8039020 0x7f53a803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.593+0000 7f53b5ffb640 1 -- 172.21.15.73:0/1240365235 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53ac044c70 con 0x7f53b81081f0 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.790+0000 7f53b7fff640 1 -- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f53a8039020 msgr2=0x7f53a803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2037973546 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.790+0000 7f53b7fff640 1 --2- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f53a8039020 0x7f53a803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.811+0000 7f53bec84640 1 -- 172.21.15.73:0/1240365235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f53b819eda0 con 0x7f53b81081f0 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.811+0000 7f53b5ffb640 1 -- 172.21.15.73:0/1240365235 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f53ac03ae20 con 0x7f53b81081f0 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.813+0000 7f53bec84640 1 -- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f53a8039020 msgr2=0x7f53a803b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.813+0000 7f53bec84640 1 --2- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f53a8039020 0x7f53a803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.813+0000 7f53bec84640 1 -- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 msgr2=0x7f53b819b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.813+0000 7f53bec84640 1 --2- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b819b710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53ac030380 tx=0x7f53ac032670 comp rx=0 tx=0).stop 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.814+0000 7f53bec84640 1 -- 172.21.15.73:0/1240365235 shutdown_connections 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.814+0000 7f53bec84640 1 --2- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f53a8039020 0x7f53a803b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.814+0000 7f53bec84640 1 --2- 172.21.15.73:0/1240365235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53b81081f0 0x7f53b819b710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:01.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.814+0000 7f53bec84640 1 -- 172.21.15.73:0/1240365235 >> 172.21.15.73:0/1240365235 conn(0x7f53b8101e30 msgr2=0x7f53b81029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:01.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.814+0000 7f53bec84640 1 -- 172.21.15.73:0/1240365235 shutdown_connections 2024-09-05T12:49:01.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:00.814+0000 7f53bec84640 1 -- 172.21.15.73:0/1240365235 wait complete. 2024-09-05T12:49:01.404 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for the mgr to restart... 2024-09-05T12:49:01.404 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr epoch 9... 2024-09-05T12:49:01.507 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:01 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:01.171+0000 7f33fd8b7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T12:49:01.508 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:01 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:01.240+0000 7f33fd8b7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T12:49:02.085 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:01 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:01.967+0000 7f33fd8b7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T12:49:02.085 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:02.082+0000 7f33fd8b7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T12:49:02.355 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:02.232+0000 7f33fd8b7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T12:49:02.355 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:02.296+0000 7f33fd8b7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T12:49:02.756 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:02.453+0000 7f33fd8b7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T12:49:02.756 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:02.525+0000 7f33fd8b7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T12:49:02.757 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:02.589+0000 7f33fd8b7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T12:49:02.757 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:02.754+0000 7f33fd8b7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T12:49:03.013 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:02.822+0000 7f33fd8b7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T12:49:03.013 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:02.890+0000 7f33fd8b7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T12:49:03.013 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:02.975+0000 7f33fd8b7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T12:49:03.331 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:03.037+0000 7f33fd8b7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T12:49:03.331 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:03.097+0000 7f33fd8b7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T12:49:04.263 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:03.891+0000 7f33fd8b7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T12:49:04.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: Active manager daemon x restarted 2024-09-05T12:49:04.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: Activating manager daemon x 2024-09-05T12:49:04.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: osdmap e3: 0 total, 0 up, 0 in 2024-09-05T12:49:04.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: mgrmap e10: x(active, starting, since 0.00336259s) 2024-09-05T12:49:04.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:49:04.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T12:49:04.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T12:49:04.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T12:49:04.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T12:49:04.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: Manager daemon x is now available 2024-09-05T12:49:04.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:04.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T12:49:04.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:05.030+0000 7f3368bc7640 -1 log_channel(cephadm) log [ERR] : [05/Sep/2024:12:49:05] ENGINE Error in HTTPServer.serve 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: Traceback (most recent call last): 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: self._connections.run(self.expiration_interval) 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: self._run(expiration_interval) 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T12:49:05.351 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T12:49:05.352 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: s = self.context.wrap_socket( 2024-09-05T12:49:05.352 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T12:49:05.352 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: return self.sslsocket_class._create( 2024-09-05T12:49:05.352 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T12:49:05.352 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: self.do_handshake() 2024-09-05T12:49:05.352 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T12:49:05.352 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: self._sslobj.do_handshake() 2024-09-05T12:49:05.352 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T12:49:05.352 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:49:05.643 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.803+0000 7f010335a640 1 Processor -- start 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.803+0000 7f010335a640 1 -- start start 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.803+0000 7f010335a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc106a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.803+0000 7f010335a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc106fd0 con 0x7f00fc106600 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.803+0000 7f01010f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc106a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.804+0000 7f01010f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc106a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54324/0 (socket says 172.21.15.73:54324) 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.804+0000 7f01010f6640 1 -- 172.21.15.73:0/2672467465 learned_addr learned my addr 172.21.15.73:0/2672467465 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.804+0000 7f01010f6640 1 -- 172.21.15.73:0/2672467465 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc107800 con 0x7f00fc106600 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.804+0000 7f01010f6640 1 --2- 172.21.15.73:0/2672467465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc106a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009820 tx=0x7f00f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e59f2a56d2c8dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.805+0000 7f00effff640 1 -- 172.21.15.73:0/2672467465 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f8037070 con 0x7f00fc106600 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.805+0000 7f00effff640 1 -- 172.21.15.73:0/2672467465 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00f8032920 con 0x7f00fc106600 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.805+0000 7f00effff640 1 -- 172.21.15.73:0/2672467465 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f8030810 con 0x7f00fc106600 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.805+0000 7f010335a640 1 -- 172.21.15.73:0/2672467465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 msgr2=0x7f00fc106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.805+0000 7f010335a640 1 --2- 172.21.15.73:0/2672467465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc106a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009820 tx=0x7f00f802a270 comp rx=0 tx=0).stop 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.805+0000 7f010335a640 1 -- 172.21.15.73:0/2672467465 shutdown_connections 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.805+0000 7f010335a640 1 --2- 172.21.15.73:0/2672467465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc106a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.805+0000 7f010335a640 1 -- 172.21.15.73:0/2672467465 >> 172.21.15.73:0/2672467465 conn(0x7f00fc101e10 msgr2=0x7f00fc104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.805+0000 7f010335a640 1 -- 172.21.15.73:0/2672467465 shutdown_connections 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.805+0000 7f010335a640 1 -- 172.21.15.73:0/2672467465 wait complete. 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.806+0000 7f010335a640 1 Processor -- start 2024-09-05T12:49:05.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.806+0000 7f010335a640 1 -- start start 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.806+0000 7f010335a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc191830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.806+0000 7f010335a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc10abb0 con 0x7f00fc106600 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.806+0000 7f01010f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc191830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.806+0000 7f01010f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc191830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54330/0 (socket says 172.21.15.73:54330) 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.806+0000 7f01010f6640 1 -- 172.21.15.73:0/2939033615 learned_addr learned my addr 172.21.15.73:0/2939033615 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.807+0000 7f01010f6640 1 -- 172.21.15.73:0/2939033615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc191d70 con 0x7f00fc106600 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.807+0000 7f01010f6640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc191830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00f80097f0 tx=0x7f00f80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.807+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f8037040 con 0x7f00fc106600 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.807+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00f8030c40 con 0x7f00fc106600 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.807+0000 7f010335a640 1 -- 172.21.15.73:0/2939033615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc18ff60 con 0x7f00fc106600 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.807+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f803a5b0 con 0x7f00fc106600 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.807+0000 7f010335a640 1 -- 172.21.15.73:0/2939033615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc1904a0 con 0x7f00fc106600 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.808+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f00f803a7f0 con 0x7f00fc106600 2024-09-05T12:49:05.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.808+0000 7f00ee7fc640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 0x7f00e803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.808+0000 7f010335a640 1 -- 172.21.15.73:0/2939033615 --> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f00fc106a80 con 0x7f00e8038fc0 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.808+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f00f806c4d0 con 0x7f00fc106600 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.808+0000 7f01008f5640 1 -- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 msgr2=0x7f00e803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2037973546 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:01.808+0000 7f01008f5640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 0x7f00e803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:02.009+0000 7f01008f5640 1 -- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 msgr2=0x7f00e803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2037973546 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:02.009+0000 7f01008f5640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 0x7f00e803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:02.410+0000 7f01008f5640 1 -- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 msgr2=0x7f00e803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2037973546 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:02.410+0000 7f01008f5640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 0x7f00e803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:03.211+0000 7f01008f5640 1 -- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 msgr2=0x7f00e803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2037973546 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:03.211+0000 7f01008f5640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 0x7f00e803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:03.895+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f00f806b040 con 0x7f00fc106600 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:03.895+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 msgr2=0x7f00e803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T12:49:05.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:03.895+0000 7f00ee7fc640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 0x7f00e803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.896+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f00f8044400 con 0x7f00fc106600 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.896+0000 7f00ee7fc640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f00e803c890 0x7f00e803ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.896+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f00f8040ec0 con 0x7f00e803c890 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.897+0000 7f01008f5640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f00e803c890 0x7f00e803ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.897+0000 7f01008f5640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f00e803c890 0x7f00e803ec80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f00f0003980 tx=0x7f00f0006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.898+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f00f8040ec0 con 0x7f00e803c890 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.905+0000 7f010335a640 1 -- 172.21.15.73:0/2939033615 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f00fc10ad30 con 0x7f00e803c890 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.905+0000 7f00ee7fc640 1 -- 172.21.15.73:0/2939033615 <== mgr.14150 v2:172.21.15.73:6800/3294068694 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f00fc10ad30 con 0x7f00e803c890 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.905+0000 7f010335a640 1 -- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f00e803c890 msgr2=0x7f00e803ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.905+0000 7f010335a640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f00e803c890 0x7f00e803ec80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f00f0003980 tx=0x7f00f0006e10 comp rx=0 tx=0).stop 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.905+0000 7f010335a640 1 -- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 msgr2=0x7f00fc191830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.905+0000 7f010335a640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc191830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00f80097f0 tx=0x7f00f80327b0 comp rx=0 tx=0).stop 2024-09-05T12:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.906+0000 7f010335a640 1 -- 172.21.15.73:0/2939033615 shutdown_connections 2024-09-05T12:49:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.906+0000 7f010335a640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f00e803c890 0x7f00e803ec80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.906+0000 7f010335a640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:6800/2037973546,v1:172.21.15.73:6801/2037973546] conn(0x7f00e8038fc0 0x7f00e803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.906+0000 7f010335a640 1 --2- 172.21.15.73:0/2939033615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc106600 0x7f00fc191830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.906+0000 7f010335a640 1 -- 172.21.15.73:0/2939033615 >> 172.21.15.73:0/2939033615 conn(0x7f00fc101e10 msgr2=0x7f00fc102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.906+0000 7f010335a640 1 -- 172.21.15.73:0/2939033615 shutdown_connections 2024-09-05T12:49:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:04.906+0000 7f010335a640 1 -- 172.21.15.73:0/2939033615 wait complete. 2024-09-05T12:49:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:mgr epoch 9 is available 2024-09-05T12:49:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:Generating a dashboard self-signed certificate... 2024-09-05T12:49:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-mon[30883]: mgrmap e11: x(active, since 1.00612s) 2024-09-05T12:49:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-mon[30883]: [05/Sep/2024:12:49:04] ENGINE Bus STARTING 2024-09-05T12:49:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:05 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:06.948 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-05T12:49:06.948 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.071+0000 7f85859ff640 1 Processor -- start 2024-09-05T12:49:06.948 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.071+0000 7f85859ff640 1 -- start start 2024-09-05T12:49:06.948 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.071+0000 7f85859ff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f8580107b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:06.948 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.071+0000 7f85859ff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8580108130 con 0x7f8580107760 2024-09-05T12:49:06.948 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.071+0000 7f857effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f8580107b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:06.948 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.071+0000 7f857effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f8580107b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57402/0 (socket says 172.21.15.73:57402) 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.071+0000 7f857effd640 1 -- 172.21.15.73:0/210483387 learned_addr learned my addr 172.21.15.73:0/210483387 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.072+0000 7f857effd640 1 -- 172.21.15.73:0/210483387 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8580108960 con 0x7f8580107760 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.072+0000 7f857effd640 1 --2- 172.21.15.73:0/210483387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f8580107b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8570009820 tx=0x7f857002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9bca4333895ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.073+0000 7f857e7fc640 1 -- 172.21.15.73:0/210483387 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8570037070 con 0x7f8580107760 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.073+0000 7f857e7fc640 1 -- 172.21.15.73:0/210483387 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8570032920 con 0x7f8580107760 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.073+0000 7f857e7fc640 1 -- 172.21.15.73:0/210483387 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8570030810 con 0x7f8580107760 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.073+0000 7f85859ff640 1 -- 172.21.15.73:0/210483387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 msgr2=0x7f8580107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.073+0000 7f85859ff640 1 --2- 172.21.15.73:0/210483387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f8580107b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8570009820 tx=0x7f857002a270 comp rx=0 tx=0).stop 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.073+0000 7f85859ff640 1 -- 172.21.15.73:0/210483387 shutdown_connections 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.073+0000 7f85859ff640 1 --2- 172.21.15.73:0/210483387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f8580107b60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.073+0000 7f85859ff640 1 -- 172.21.15.73:0/210483387 >> 172.21.15.73:0/210483387 conn(0x7f8580102ff0 msgr2=0x7f8580105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.073+0000 7f85859ff640 1 -- 172.21.15.73:0/210483387 shutdown_connections 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.073+0000 7f85859ff640 1 -- 172.21.15.73:0/210483387 wait complete. 2024-09-05T12:49:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.074+0000 7f85859ff640 1 Processor -- start 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.074+0000 7f85859ff640 1 -- start start 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.074+0000 7f85859ff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f858019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.074+0000 7f85859ff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f858010bd10 con 0x7f8580107760 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.074+0000 7f857effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f858019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.074+0000 7f857effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f858019b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57410/0 (socket says 172.21.15.73:57410) 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.074+0000 7f857effd640 1 -- 172.21.15.73:0/331582580 learned_addr learned my addr 172.21.15.73:0/331582580 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.074+0000 7f857effd640 1 -- 172.21.15.73:0/331582580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858019bd00 con 0x7f8580107760 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.074+0000 7f857effd640 1 --2- 172.21.15.73:0/331582580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f858019b7c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8570030560 tx=0x7f8570032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.075+0000 7f85849fd640 1 -- 172.21.15.73:0/331582580 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8570037040 con 0x7f8580107760 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.075+0000 7f85859ff640 1 -- 172.21.15.73:0/331582580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858019bf90 con 0x7f8580107760 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.075+0000 7f85849fd640 1 -- 172.21.15.73:0/331582580 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8570040070 con 0x7f8580107760 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.075+0000 7f85849fd640 1 -- 172.21.15.73:0/331582580 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f857003a740 con 0x7f8580107760 2024-09-05T12:49:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.075+0000 7f85859ff640 1 -- 172.21.15.73:0/331582580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858019ec80 con 0x7f8580107760 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.076+0000 7f85849fd640 1 -- 172.21.15.73:0/331582580 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f857003bb90 con 0x7f8580107760 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.076+0000 7f85859ff640 1 -- 172.21.15.73:0/331582580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858010be90 con 0x7f8580107760 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.076+0000 7f85849fd640 1 --2- 172.21.15.73:0/331582580 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f856c038eb0 0x7f856c03b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.076+0000 7f85849fd640 1 -- 172.21.15.73:0/331582580 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f857006c530 con 0x7f8580107760 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.076+0000 7f8577fff640 1 --2- 172.21.15.73:0/331582580 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f856c038eb0 0x7f856c03b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.076+0000 7f8577fff640 1 --2- 172.21.15.73:0/331582580 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f856c038eb0 0x7f856c03b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f85680098c0 tx=0x7f8568006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.081+0000 7f85849fd640 1 -- 172.21.15.73:0/331582580 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f857004a200 con 0x7f8580107760 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.279+0000 7f85859ff640 1 -- 172.21.15.73:0/331582580 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f8580104300 con 0x7f856c038eb0 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.325+0000 7f85849fd640 1 -- 172.21.15.73:0/331582580 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f8580104300 con 0x7f856c038eb0 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.327+0000 7f85859ff640 1 -- 172.21.15.73:0/331582580 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f856c038eb0 msgr2=0x7f856c03b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.327+0000 7f85859ff640 1 --2- 172.21.15.73:0/331582580 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f856c038eb0 0x7f856c03b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f85680098c0 tx=0x7f8568006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.327+0000 7f85859ff640 1 -- 172.21.15.73:0/331582580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 msgr2=0x7f858019b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.327+0000 7f85859ff640 1 --2- 172.21.15.73:0/331582580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f858019b7c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8570030560 tx=0x7f8570032670 comp rx=0 tx=0).stop 2024-09-05T12:49:06.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.327+0000 7f85859ff640 1 -- 172.21.15.73:0/331582580 shutdown_connections 2024-09-05T12:49:06.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.327+0000 7f85859ff640 1 --2- 172.21.15.73:0/331582580 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f856c038eb0 0x7f856c03b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:06.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.327+0000 7f85859ff640 1 --2- 172.21.15.73:0/331582580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8580107760 0x7f858019b7c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:06.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.327+0000 7f85859ff640 1 -- 172.21.15.73:0/331582580 >> 172.21.15.73:0/331582580 conn(0x7f8580102ff0 msgr2=0x7f8580103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:06.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.327+0000 7f85859ff640 1 -- 172.21.15.73:0/331582580 shutdown_connections 2024-09-05T12:49:06.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:06.327+0000 7f85859ff640 1 -- 172.21.15.73:0/331582580 wait complete. 2024-09-05T12:49:06.952 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial admin user... 2024-09-05T12:49:07.069 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:06 smithi073 ceph-mon[30883]: [05/Sep/2024:12:49:05] ENGINE Serving on https://172.21.15.73:7150 2024-09-05T12:49:07.069 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:06 smithi073 ceph-mon[30883]: [05/Sep/2024:12:49:05] ENGINE Error in HTTPServer.serve 2024-09-05T12:49:07.069 INFO:journalctl@ceph.mon.a.smithi073.stdout: Traceback (most recent call last): 2024-09-05T12:49:07.069 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T12:49:07.069 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._connections.run(self.expiration_interval) 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._run(expiration_interval) 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: s = self.context.wrap_socket( 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: return self.sslsocket_class._create( 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: self.do_handshake() 2024-09-05T12:49:07.070 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T12:49:07.071 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._sslobj.do_handshake() 2024-09-05T12:49:07.071 INFO:journalctl@ceph.mon.a.smithi073.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T12:49:07.071 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:06 smithi073 ceph-mon[30883]: [05/Sep/2024:12:49:05] ENGINE Serving on http://172.21.15.73:8765 2024-09-05T12:49:07.071 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:06 smithi073 ceph-mon[30883]: [05/Sep/2024:12:49:05] ENGINE Bus STARTED 2024-09-05T12:49:07.071 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:07.071 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:07.071 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:07.071 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:06 smithi073 ceph-mon[30883]: mgrmap e12: x(active, since 2s) 2024-09-05T12:49:08.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:07 smithi073 ceph-mon[30883]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:49:08.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:07 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:08.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ZQwqt5CiuSayV6hUIAEBn.8ddHnloWaqJUMZWuLLS1JrzspRsgCRi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725540547, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-05T12:49:08.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.364+0000 7fb69a3ee640 1 Processor -- start 2024-09-05T12:49:08.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.364+0000 7fb69a3ee640 1 -- start start 2024-09-05T12:49:08.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.364+0000 7fb69a3ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb694107b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:08.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.364+0000 7fb69a3ee640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb694108100 con 0x7fb694107730 2024-09-05T12:49:08.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.364+0000 7fb693fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb694107b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:08.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.364+0000 7fb693fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb694107b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57426/0 (socket says 172.21.15.73:57426) 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.364+0000 7fb693fff640 1 -- 172.21.15.73:0/3262704618 learned_addr learned my addr 172.21.15.73:0/3262704618 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.365+0000 7fb693fff640 1 -- 172.21.15.73:0/3262704618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb694108930 con 0x7fb694107730 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.365+0000 7fb693fff640 1 --2- 172.21.15.73:0/3262704618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb694107b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb684009820 tx=0x7fb68402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a007a5e02c33e8f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.365+0000 7fb692ffd640 1 -- 172.21.15.73:0/3262704618 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb684037070 con 0x7fb694107730 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.366+0000 7fb692ffd640 1 -- 172.21.15.73:0/3262704618 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb684032920 con 0x7fb694107730 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.366+0000 7fb692ffd640 1 -- 172.21.15.73:0/3262704618 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb684030810 con 0x7fb694107730 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.366+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3262704618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 msgr2=0x7fb694107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.366+0000 7fb69a3ee640 1 --2- 172.21.15.73:0/3262704618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb694107b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb684009820 tx=0x7fb68402a270 comp rx=0 tx=0).stop 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.366+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3262704618 shutdown_connections 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.366+0000 7fb69a3ee640 1 --2- 172.21.15.73:0/3262704618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb694107b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.366+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3262704618 >> 172.21.15.73:0/3262704618 conn(0x7fb694102fa0 msgr2=0x7fb6941053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.366+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3262704618 shutdown_connections 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.366+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3262704618 wait complete. 2024-09-05T12:49:08.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.367+0000 7fb69a3ee640 1 Processor -- start 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.367+0000 7fb69a3ee640 1 -- start start 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.367+0000 7fb69a3ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb69419b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.367+0000 7fb69a3ee640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb69410bce0 con 0x7fb694107730 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.367+0000 7fb693fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb69419b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.367+0000 7fb693fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb69419b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57440/0 (socket says 172.21.15.73:57440) 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.367+0000 7fb693fff640 1 -- 172.21.15.73:0/3864298611 learned_addr learned my addr 172.21.15.73:0/3864298611 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.367+0000 7fb693fff640 1 -- 172.21.15.73:0/3864298611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69419bca0 con 0x7fb694107730 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.368+0000 7fb693fff640 1 --2- 172.21.15.73:0/3864298611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb69419b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb684030560 tx=0x7fb684032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.368+0000 7fb6917fa640 1 -- 172.21.15.73:0/3864298611 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb684037040 con 0x7fb694107730 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.368+0000 7fb6917fa640 1 -- 172.21.15.73:0/3864298611 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb684040070 con 0x7fb694107730 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.368+0000 7fb6917fa640 1 -- 172.21.15.73:0/3864298611 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68403a740 con 0x7fb694107730 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.368+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3864298611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb69419bf30 con 0x7fb694107730 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.368+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3864298611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb69419ec20 con 0x7fb694107730 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.369+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3864298611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69410be60 con 0x7fb694107730 2024-09-05T12:49:08.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.369+0000 7fb6917fa640 1 -- 172.21.15.73:0/3864298611 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fb68403b420 con 0x7fb694107730 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.369+0000 7fb6917fa640 1 --2- 172.21.15.73:0/3864298611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb67c039020 0x7fb67c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.369+0000 7fb6917fa640 1 -- 172.21.15.73:0/3864298611 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb68406c670 con 0x7fb694107730 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.369+0000 7fb6937fe640 1 --2- 172.21.15.73:0/3864298611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb67c039020 0x7fb67c03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.370+0000 7fb6937fe640 1 --2- 172.21.15.73:0/3864298611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb67c039020 0x7fb67c03b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb6880098c0 tx=0x7fb688006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.374+0000 7fb6917fa640 1 -- 172.21.15.73:0/3864298611 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb68404a200 con 0x7fb694107730 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.569+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3864298611 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fb694107bb0 con 0x7fb67c039020 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.798+0000 7fb6917fa640 1 -- 172.21.15.73:0/3864298611 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fb694107bb0 con 0x7fb67c039020 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.800+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3864298611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb67c039020 msgr2=0x7fb67c03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.800+0000 7fb69a3ee640 1 --2- 172.21.15.73:0/3864298611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb67c039020 0x7fb67c03b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb6880098c0 tx=0x7fb688006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.800+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3864298611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 msgr2=0x7fb69419b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.800+0000 7fb69a3ee640 1 --2- 172.21.15.73:0/3864298611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb69419b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb684030560 tx=0x7fb684032670 comp rx=0 tx=0).stop 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.800+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3864298611 shutdown_connections 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.800+0000 7fb69a3ee640 1 --2- 172.21.15.73:0/3864298611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb67c039020 0x7fb67c03b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:08.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.800+0000 7fb69a3ee640 1 --2- 172.21.15.73:0/3864298611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb694107730 0x7fb69419b760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:08.923 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.800+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3864298611 >> 172.21.15.73:0/3864298611 conn(0x7fb694102fa0 msgr2=0x7fb694103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:08.923 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.800+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3864298611 shutdown_connections 2024-09-05T12:49:08.923 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:07.800+0000 7fb69a3ee640 1 -- 172.21.15.73:0/3864298611 wait complete. 2024-09-05T12:49:08.923 INFO:teuthology.orchestra.run.smithi073.stdout:Fetching dashboard port number... 2024-09-05T12:49:09.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:08 smithi073 ceph-mon[30883]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:49:10.117 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 8443 2024-09-05T12:49:10.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.376+0000 7fef6729f640 1 Processor -- start 2024-09-05T12:49:10.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.376+0000 7fef6729f640 1 -- start start 2024-09-05T12:49:10.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.376+0000 7fef6729f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef60107b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:10.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.376+0000 7fef6729f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fef60108100 con 0x7fef60107730 2024-09-05T12:49:10.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.376+0000 7fef6503b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef60107b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:10.118 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.376+0000 7fef6503b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef60107b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57444/0 (socket says 172.21.15.73:57444) 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.376+0000 7fef6503b640 1 -- 172.21.15.73:0/2150048407 learned_addr learned my addr 172.21.15.73:0/2150048407 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.377+0000 7fef6503b640 1 -- 172.21.15.73:0/2150048407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef60108930 con 0x7fef60107730 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.377+0000 7fef6503b640 1 --2- 172.21.15.73:0/2150048407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef60107b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009820 tx=0x7fef5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4190d3f89056b92f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.378+0000 7fef57fff640 1 -- 172.21.15.73:0/2150048407 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef5c037070 con 0x7fef60107730 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.378+0000 7fef57fff640 1 -- 172.21.15.73:0/2150048407 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef5c032920 con 0x7fef60107730 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.378+0000 7fef57fff640 1 -- 172.21.15.73:0/2150048407 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef5c030810 con 0x7fef60107730 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.378+0000 7fef6729f640 1 -- 172.21.15.73:0/2150048407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 msgr2=0x7fef60107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.378+0000 7fef6729f640 1 --2- 172.21.15.73:0/2150048407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef60107b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009820 tx=0x7fef5c02a270 comp rx=0 tx=0).stop 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.378+0000 7fef6729f640 1 -- 172.21.15.73:0/2150048407 shutdown_connections 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.378+0000 7fef6729f640 1 --2- 172.21.15.73:0/2150048407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef60107b30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.378+0000 7fef6729f640 1 -- 172.21.15.73:0/2150048407 >> 172.21.15.73:0/2150048407 conn(0x7fef60102fa0 msgr2=0x7fef601053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.378+0000 7fef6729f640 1 -- 172.21.15.73:0/2150048407 shutdown_connections 2024-09-05T12:49:10.119 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.378+0000 7fef6729f640 1 -- 172.21.15.73:0/2150048407 wait complete. 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.379+0000 7fef6729f640 1 Processor -- start 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.379+0000 7fef6729f640 1 -- start start 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.379+0000 7fef6729f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef6007db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.379+0000 7fef6729f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fef6010bce0 con 0x7fef60107730 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.379+0000 7fef6503b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef6007db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.379+0000 7fef6503b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef6007db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57456/0 (socket says 172.21.15.73:57456) 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.379+0000 7fef6503b640 1 -- 172.21.15.73:0/1562677527 learned_addr learned my addr 172.21.15.73:0/1562677527 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.379+0000 7fef6503b640 1 -- 172.21.15.73:0/1562677527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6007e050 con 0x7fef60107730 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.379+0000 7fef6503b640 1 --2- 172.21.15.73:0/1562677527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef6007db10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0097f0 tx=0x7fef5c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.379+0000 7fef567fc640 1 -- 172.21.15.73:0/1562677527 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef5c037040 con 0x7fef60107730 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.380+0000 7fef567fc640 1 -- 172.21.15.73:0/1562677527 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef5c030cc0 con 0x7fef60107730 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.380+0000 7fef6729f640 1 -- 172.21.15.73:0/1562677527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6007c240 con 0x7fef60107730 2024-09-05T12:49:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.380+0000 7fef567fc640 1 -- 172.21.15.73:0/1562677527 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef5c03a640 con 0x7fef60107730 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.380+0000 7fef6729f640 1 -- 172.21.15.73:0/1562677527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef6007c780 con 0x7fef60107730 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.381+0000 7fef567fc640 1 -- 172.21.15.73:0/1562677527 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fef5c03a940 con 0x7fef60107730 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.381+0000 7fef6729f640 1 -- 172.21.15.73:0/1562677527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef6010be60 con 0x7fef60107730 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.381+0000 7fef567fc640 1 --2- 172.21.15.73:0/1562677527 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fef4c038fc0 0x7fef4c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.381+0000 7fef567fc640 1 -- 172.21.15.73:0/1562677527 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fef5c06c7a0 con 0x7fef60107730 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.381+0000 7fef6483a640 1 --2- 172.21.15.73:0/1562677527 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fef4c038fc0 0x7fef4c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.381+0000 7fef6483a640 1 --2- 172.21.15.73:0/1562677527 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fef4c038fc0 0x7fef4c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fef500098c0 tx=0x7fef50006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.386+0000 7fef567fc640 1 -- 172.21.15.73:0/1562677527 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef5c03ba40 con 0x7fef60107730 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.554+0000 7fef6729f640 1 -- 172.21.15.73:0/1562677527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fef60107bb0 con 0x7fef60107730 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.554+0000 7fef567fc640 1 -- 172.21.15.73:0/1562677527 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fef5c03ad80 con 0x7fef60107730 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.556+0000 7fef6729f640 1 -- 172.21.15.73:0/1562677527 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fef4c038fc0 msgr2=0x7fef4c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.556+0000 7fef6729f640 1 --2- 172.21.15.73:0/1562677527 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fef4c038fc0 0x7fef4c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fef500098c0 tx=0x7fef50006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:10.122 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.556+0000 7fef6729f640 1 -- 172.21.15.73:0/1562677527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 msgr2=0x7fef6007db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:10.122 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.556+0000 7fef6729f640 1 --2- 172.21.15.73:0/1562677527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef6007db10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0097f0 tx=0x7fef5c0327b0 comp rx=0 tx=0).stop 2024-09-05T12:49:10.122 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.556+0000 7fef6729f640 1 -- 172.21.15.73:0/1562677527 shutdown_connections 2024-09-05T12:49:10.122 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.556+0000 7fef6729f640 1 --2- 172.21.15.73:0/1562677527 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fef4c038fc0 0x7fef4c03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:10.122 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.556+0000 7fef6729f640 1 --2- 172.21.15.73:0/1562677527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef60107730 0x7fef6007db10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:10.122 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.556+0000 7fef6729f640 1 -- 172.21.15.73:0/1562677527 >> 172.21.15.73:0/1562677527 conn(0x7fef60102fa0 msgr2=0x7fef60103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:10.122 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.556+0000 7fef6729f640 1 -- 172.21.15.73:0/1562677527 shutdown_connections 2024-09-05T12:49:10.122 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:09.556+0000 7fef6729f640 1 -- 172.21.15.73:0/1562677527 wait complete. 2024-09-05T12:49:10.123 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T12:49:10.123 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-09-05T12:49:10.130 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T12:49:10.130 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-05T12:49:10.130 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-09-05T12:49:10.130 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-05T12:49:10.132 INFO:teuthology.orchestra.run.smithi073.stdout:Ceph Dashboard is now available at: 2024-09-05T12:49:10.132 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:10.132 INFO:teuthology.orchestra.run.smithi073.stdout: URL: https://smithi073:8443/ 2024-09-05T12:49:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: User: admin 2024-09-05T12:49:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: Password: 69jvxec8zz 2024-09-05T12:49:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:10.133 INFO:teuthology.orchestra.run.smithi073.stdout:Saving cluster configuration to /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config directory 2024-09-05T12:49:10.252 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:09 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1562677527' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-05T12:49:11.073 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:10 smithi073 ceph-mon[30883]: mgrmap e13: x(active, since 6s) 2024-09-05T12:49:11.073 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:10 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1504868797' entity='client.admin' 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.505+0000 7f7dfb38e640 1 Processor -- start 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.505+0000 7f7dfb38e640 1 -- start start 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.505+0000 7f7dfb38e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df410a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.505+0000 7f7dfb38e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7df407be10 con 0x7f7df41081b0 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.506+0000 7f7df912a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df410a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.506+0000 7f7df912a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df410a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57468/0 (socket says 172.21.15.73:57468) 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.506+0000 7f7df912a640 1 -- 172.21.15.73:0/2771423672 learned_addr learned my addr 172.21.15.73:0/2771423672 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.506+0000 7f7df912a640 1 -- 172.21.15.73:0/2771423672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df410aae0 con 0x7f7df41081b0 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.507+0000 7f7df912a640 1 --2- 172.21.15.73:0/2771423672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df410a5a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009820 tx=0x7f7df002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9cd4d8804087136 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.507+0000 7f7debfff640 1 -- 172.21.15.73:0/2771423672 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df0037070 con 0x7f7df41081b0 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.507+0000 7f7debfff640 1 -- 172.21.15.73:0/2771423672 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7df0032920 con 0x7f7df41081b0 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.507+0000 7f7debfff640 1 -- 172.21.15.73:0/2771423672 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df0030810 con 0x7f7df41081b0 2024-09-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.507+0000 7f7dfb38e640 1 -- 172.21.15.73:0/2771423672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 msgr2=0x7f7df410a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.507+0000 7f7dfb38e640 1 --2- 172.21.15.73:0/2771423672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df410a5a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009820 tx=0x7f7df002a270 comp rx=0 tx=0).stop 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.507+0000 7f7dfb38e640 1 -- 172.21.15.73:0/2771423672 shutdown_connections 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.507+0000 7f7dfb38e640 1 --2- 172.21.15.73:0/2771423672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df410a5a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.507+0000 7f7dfb38e640 1 -- 172.21.15.73:0/2771423672 >> 172.21.15.73:0/2771423672 conn(0x7f7df4101e10 msgr2=0x7f7df4104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.507+0000 7f7dfb38e640 1 -- 172.21.15.73:0/2771423672 shutdown_connections 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.508+0000 7f7dfb38e640 1 -- 172.21.15.73:0/2771423672 wait complete. 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.508+0000 7f7dfb38e640 1 Processor -- start 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.508+0000 7f7dfb38e640 1 -- start start 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.508+0000 7f7dfb38e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df419b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.508+0000 7f7dfb38e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7df410bb60 con 0x7f7df41081b0 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.508+0000 7f7df912a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df419b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.508+0000 7f7df912a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df419b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57470/0 (socket says 172.21.15.73:57470) 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.508+0000 7f7df912a640 1 -- 172.21.15.73:0/1504868797 learned_addr learned my addr 172.21.15.73:0/1504868797 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.509+0000 7f7df912a640 1 -- 172.21.15.73:0/1504868797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df419bcc0 con 0x7f7df41081b0 2024-09-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.509+0000 7f7df912a640 1 --2- 172.21.15.73:0/1504868797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df419b780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7df00097f0 tx=0x7f7df00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.509+0000 7f7dea7fc640 1 -- 172.21.15.73:0/1504868797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df0037040 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.509+0000 7f7dfb38e640 1 -- 172.21.15.73:0/1504868797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df419bf50 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.509+0000 7f7dea7fc640 1 -- 172.21.15.73:0/1504868797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7df0030c40 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.509+0000 7f7dea7fc640 1 -- 172.21.15.73:0/1504868797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df003a5d0 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.509+0000 7f7dfb38e640 1 -- 172.21.15.73:0/1504868797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df419ec40 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.510+0000 7f7dea7fc640 1 -- 172.21.15.73:0/1504868797 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7df003b3f0 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.510+0000 7f7dfb38e640 1 -- 172.21.15.73:0/1504868797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df4108610 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.510+0000 7f7dea7fc640 1 --2- 172.21.15.73:0/1504868797 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7de0039060 0x7f7de003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.510+0000 7f7dea7fc640 1 -- 172.21.15.73:0/1504868797 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7df006c6a0 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.510+0000 7f7df8929640 1 --2- 172.21.15.73:0/1504868797 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7de0039060 0x7f7de003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.511+0000 7f7df8929640 1 --2- 172.21.15.73:0/1504868797 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7de0039060 0x7f7de003b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7de40098c0 tx=0x7f7de4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.515+0000 7f7dea7fc640 1 -- 172.21.15.73:0/1504868797 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7df0041af0 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.770+0000 7f7dfb38e640 1 -- 172.21.15.73:0/1504868797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f7df419ee10 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.773+0000 7f7dea7fc640 1 -- 172.21.15.73:0/1504868797 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f7df00313a0 con 0x7f7df41081b0 2024-09-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.775+0000 7f7dfb38e640 1 -- 172.21.15.73:0/1504868797 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7de0039060 msgr2=0x7f7de003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.775+0000 7f7dfb38e640 1 --2- 172.21.15.73:0/1504868797 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7de0039060 0x7f7de003b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7de40098c0 tx=0x7f7de4006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.775+0000 7f7dfb38e640 1 -- 172.21.15.73:0/1504868797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 msgr2=0x7f7df419b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.775+0000 7f7dfb38e640 1 --2- 172.21.15.73:0/1504868797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df419b780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7df00097f0 tx=0x7f7df00327b0 comp rx=0 tx=0).stop 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.775+0000 7f7dfb38e640 1 -- 172.21.15.73:0/1504868797 shutdown_connections 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.775+0000 7f7dfb38e640 1 --2- 172.21.15.73:0/1504868797 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7de0039060 0x7f7de003b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.775+0000 7f7dfb38e640 1 --2- 172.21.15.73:0/1504868797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df41081b0 0x7f7df419b780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.775+0000 7f7dfb38e640 1 -- 172.21.15.73:0/1504868797 >> 172.21.15.73:0/1504868797 conn(0x7f7df4101e10 msgr2=0x7f7df4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.775+0000 7f7dfb38e640 1 -- 172.21.15.73:0/1504868797 shutdown_connections 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-05T12:49:10.775+0000 7f7dfb38e640 1 -- 172.21.15.73:0/1504868797 wait complete. 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-05T12:49:11.293 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout:Or, if you are only running a single cluster on this host: 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: ceph telemetry on 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout:For more information see: 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:11.294 INFO:teuthology.orchestra.run.smithi073.stdout:Bootstrap complete. 2024-09-05T12:49:11.330 INFO:tasks.cephadm:Fetching config... 2024-09-05T12:49:11.330 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:49:11.330 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-05T12:49:11.346 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-05T12:49:11.346 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:49:11.346 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-05T12:49:11.402 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-05T12:49:11.403 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:49:11.403 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-05T12:49:11.468 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-05T12:49:11.469 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:49:11.469 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-05T12:49:11.525 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-05T12:49:11.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJiJsu7INKx1cT5DUgUTuMcBDZkAYYdRWN11Ofvxqfxd1SwBNoX3oS45WGYrTzKCsgvOq48BPHCNfisr3FB3uEa+Oaj8cGJ6YxmT/PK3ONXV8lc00NntCjHtPXbUT3kbuyh9NxPUIAzBm8g78+iAQfMfFaas9eVZW9dOKAl45MQxGu6wp3vugsfhn9RcY6oHf15vljQBQy1O4747SZMotKWf9AKKJ7lADRrB1mEL04dHAEotbI6dGkaBbdqVoG4uM78UM4s1+7NWjUqd1jnPJMKABOW4Uw93+EUEpQCobQzGPe65egpR0GbAo8zjdVvKRjiL8Att2cPDGHdt0a1o5Hkh8fevukfNWeHeedCL+wsPM/E9CqVCnbfuEjxViTW66DvcsJCop89WaFtGA9FynyvAEvWv5ZXWhr+18k5UDH9IyJF+9S+F8skHEGDlstMph2kHtC9FuGdfuZ0DYrpoQFRXpqBRUG4tFTw3oM7QQqoheTohfbBHFIFnrEoSTnD8s= ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi073.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJiJsu7INKx1cT5DUgUTuMcBDZkAYYdRWN11Ofvxqfxd1SwBNoX3oS45WGYrTzKCsgvOq48BPHCNfisr3FB3uEa+Oaj8cGJ6YxmT/PK3ONXV8lc00NntCjHtPXbUT3kbuyh9NxPUIAzBm8g78+iAQfMfFaas9eVZW9dOKAl45MQxGu6wp3vugsfhn9RcY6oHf15vljQBQy1O4747SZMotKWf9AKKJ7lADRrB1mEL04dHAEotbI6dGkaBbdqVoG4uM78UM4s1+7NWjUqd1jnPJMKABOW4Uw93+EUEpQCobQzGPe65egpR0GbAo8zjdVvKRjiL8Att2cPDGHdt0a1o5Hkh8fevukfNWeHeedCL+wsPM/E9CqVCnbfuEjxViTW66DvcsJCop89WaFtGA9FynyvAEvWv5ZXWhr+18k5UDH9IyJF+9S+F8skHEGDlstMph2kHtC9FuGdfuZ0DYrpoQFRXpqBRUG4tFTw3oM7QQqoheTohfbBHFIFnrEoSTnD8s= ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:11.614 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJiJsu7INKx1cT5DUgUTuMcBDZkAYYdRWN11Ofvxqfxd1SwBNoX3oS45WGYrTzKCsgvOq48BPHCNfisr3FB3uEa+Oaj8cGJ6YxmT/PK3ONXV8lc00NntCjHtPXbUT3kbuyh9NxPUIAzBm8g78+iAQfMfFaas9eVZW9dOKAl45MQxGu6wp3vugsfhn9RcY6oHf15vljQBQy1O4747SZMotKWf9AKKJ7lADRrB1mEL04dHAEotbI6dGkaBbdqVoG4uM78UM4s1+7NWjUqd1jnPJMKABOW4Uw93+EUEpQCobQzGPe65egpR0GbAo8zjdVvKRjiL8Att2cPDGHdt0a1o5Hkh8fevukfNWeHeedCL+wsPM/E9CqVCnbfuEjxViTW66DvcsJCop89WaFtGA9FynyvAEvWv5ZXWhr+18k5UDH9IyJF+9S+F8skHEGDlstMph2kHtC9FuGdfuZ0DYrpoQFRXpqBRUG4tFTw3oM7QQqoheTohfbBHFIFnrEoSTnD8s= ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-05T12:49:11.656 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJiJsu7INKx1cT5DUgUTuMcBDZkAYYdRWN11Ofvxqfxd1SwBNoX3oS45WGYrTzKCsgvOq48BPHCNfisr3FB3uEa+Oaj8cGJ6YxmT/PK3ONXV8lc00NntCjHtPXbUT3kbuyh9NxPUIAzBm8g78+iAQfMfFaas9eVZW9dOKAl45MQxGu6wp3vugsfhn9RcY6oHf15vljQBQy1O4747SZMotKWf9AKKJ7lADRrB1mEL04dHAEotbI6dGkaBbdqVoG4uM78UM4s1+7NWjUqd1jnPJMKABOW4Uw93+EUEpQCobQzGPe65egpR0GbAo8zjdVvKRjiL8Att2cPDGHdt0a1o5Hkh8fevukfNWeHeedCL+wsPM/E9CqVCnbfuEjxViTW66DvcsJCop89WaFtGA9FynyvAEvWv5ZXWhr+18k5UDH9IyJF+9S+F8skHEGDlstMph2kHtC9FuGdfuZ0DYrpoQFRXpqBRUG4tFTw3oM7QQqoheTohfbBHFIFnrEoSTnD8s= ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:11.669 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJiJsu7INKx1cT5DUgUTuMcBDZkAYYdRWN11Ofvxqfxd1SwBNoX3oS45WGYrTzKCsgvOq48BPHCNfisr3FB3uEa+Oaj8cGJ6YxmT/PK3ONXV8lc00NntCjHtPXbUT3kbuyh9NxPUIAzBm8g78+iAQfMfFaas9eVZW9dOKAl45MQxGu6wp3vugsfhn9RcY6oHf15vljQBQy1O4747SZMotKWf9AKKJ7lADRrB1mEL04dHAEotbI6dGkaBbdqVoG4uM78UM4s1+7NWjUqd1jnPJMKABOW4Uw93+EUEpQCobQzGPe65egpR0GbAo8zjdVvKRjiL8Att2cPDGHdt0a1o5Hkh8fevukfNWeHeedCL+wsPM/E9CqVCnbfuEjxViTW66DvcsJCop89WaFtGA9FynyvAEvWv5ZXWhr+18k5UDH9IyJF+9S+F8skHEGDlstMph2kHtC9FuGdfuZ0DYrpoQFRXpqBRUG4tFTw3oM7QQqoheTohfbBHFIFnrEoSTnD8s= ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi169.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJiJsu7INKx1cT5DUgUTuMcBDZkAYYdRWN11Ofvxqfxd1SwBNoX3oS45WGYrTzKCsgvOq48BPHCNfisr3FB3uEa+Oaj8cGJ6YxmT/PK3ONXV8lc00NntCjHtPXbUT3kbuyh9NxPUIAzBm8g78+iAQfMfFaas9eVZW9dOKAl45MQxGu6wp3vugsfhn9RcY6oHf15vljQBQy1O4747SZMotKWf9AKKJ7lADRrB1mEL04dHAEotbI6dGkaBbdqVoG4uM78UM4s1+7NWjUqd1jnPJMKABOW4Uw93+EUEpQCobQzGPe65egpR0GbAo8zjdVvKRjiL8Att2cPDGHdt0a1o5Hkh8fevukfNWeHeedCL+wsPM/E9CqVCnbfuEjxViTW66DvcsJCop89WaFtGA9FynyvAEvWv5ZXWhr+18k5UDH9IyJF+9S+F8skHEGDlstMph2kHtC9FuGdfuZ0DYrpoQFRXpqBRUG4tFTw3oM7QQqoheTohfbBHFIFnrEoSTnD8s= ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:11.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.480+0000 7f2d3e40f640 1 -- 172.21.15.73:0/2375113228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d381020a0 msgr2=0x7f2d38104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.480+0000 7f2d3e40f640 1 --2- 172.21.15.73:0/2375113228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d381020a0 0x7f2d38104490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009880 tx=0x7f2d2802a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.480+0000 7f2d3e40f640 1 -- 172.21.15.73:0/2375113228 shutdown_connections 2024-09-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.480+0000 7f2d3e40f640 1 --2- 172.21.15.73:0/2375113228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d381020a0 0x7f2d38104490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.480+0000 7f2d3e40f640 1 -- 172.21.15.73:0/2375113228 >> 172.21.15.73:0/2375113228 conn(0x7f2d380fbc80 msgr2=0x7f2d380fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.480+0000 7f2d3e40f640 1 -- 172.21.15.73:0/2375113228 shutdown_connections 2024-09-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.480+0000 7f2d3e40f640 1 -- 172.21.15.73:0/2375113228 wait complete. 2024-09-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.481+0000 7f2d3e40f640 1 Processor -- start 2024-09-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.481+0000 7f2d3e40f640 1 -- start start 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.481+0000 7f2d3e40f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d381020a0 0x7f2d38196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.481+0000 7f2d3e40f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381076b0 con 0x7f2d381020a0 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.481+0000 7f2d37fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d381020a0 0x7f2d38196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.482+0000 7f2d37fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d381020a0 0x7f2d38196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57480/0 (socket says 172.21.15.73:57480) 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.482+0000 7f2d37fff640 1 -- 172.21.15.73:0/1247616854 learned_addr learned my addr 172.21.15.73:0/1247616854 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.482+0000 7f2d37fff640 1 -- 172.21.15.73:0/1247616854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d38197240 con 0x7f2d381020a0 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.482+0000 7f2d37fff640 1 --2- 172.21.15.73:0/1247616854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d381020a0 0x7f2d38196d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2d28004f60 tx=0x7f2d280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.482+0000 7f2d357fa640 1 -- 172.21.15.73:0/1247616854 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d2803f070 con 0x7f2d381020a0 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.482+0000 7f2d357fa640 1 -- 172.21.15.73:0/1247616854 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d28003ad0 con 0x7f2d381020a0 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.482+0000 7f2d3e40f640 1 -- 172.21.15.73:0/1247616854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d38197530 con 0x7f2d381020a0 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.482+0000 7f2d357fa640 1 -- 172.21.15.73:0/1247616854 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d28035030 con 0x7f2d381020a0 2024-09-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.482+0000 7f2d3e40f640 1 -- 172.21.15.73:0/1247616854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3819a1b0 con 0x7f2d381020a0 2024-09-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.483+0000 7f2d357fa640 1 -- 172.21.15.73:0/1247616854 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2d28042070 con 0x7f2d381020a0 2024-09-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.483+0000 7f2d3e40f640 1 -- 172.21.15.73:0/1247616854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d38107e30 con 0x7f2d381020a0 2024-09-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.483+0000 7f2d357fa640 1 --2- 172.21.15.73:0/1247616854 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2d20039060 0x7f2d2003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.483+0000 7f2d357fa640 1 -- 172.21.15.73:0/1247616854 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2d2806cf70 con 0x7f2d381020a0 2024-09-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.483+0000 7f2d377fe640 1 --2- 172.21.15.73:0/1247616854 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2d20039060 0x7f2d2003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.484+0000 7f2d377fe640 1 --2- 172.21.15.73:0/1247616854 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2d20039060 0x7f2d2003b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098c0 tx=0x7f2d2c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.488+0000 7f2d357fa640 1 -- 172.21.15.73:0/1247616854 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d280433b0 con 0x7f2d381020a0 2024-09-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.661+0000 7f2d3e40f640 1 -- 172.21.15.73:0/1247616854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f2d3802d8d0 con 0x7f2d381020a0 2024-09-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.663+0000 7f2d357fa640 1 -- 172.21.15.73:0/1247616854 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f2d28039350 con 0x7f2d381020a0 2024-09-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.665+0000 7f2d3e40f640 1 -- 172.21.15.73:0/1247616854 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2d20039060 msgr2=0x7f2d2003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.665+0000 7f2d3e40f640 1 --2- 172.21.15.73:0/1247616854 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2d20039060 0x7f2d2003b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098c0 tx=0x7f2d2c006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.665+0000 7f2d3e40f640 1 -- 172.21.15.73:0/1247616854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d381020a0 msgr2=0x7f2d38196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.665+0000 7f2d3e40f640 1 --2- 172.21.15.73:0/1247616854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d381020a0 0x7f2d38196d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2d28004f60 tx=0x7f2d280048f0 comp rx=0 tx=0).stop 2024-09-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.665+0000 7f2d3e40f640 1 -- 172.21.15.73:0/1247616854 shutdown_connections 2024-09-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.665+0000 7f2d3e40f640 1 --2- 172.21.15.73:0/1247616854 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2d20039060 0x7f2d2003b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.665+0000 7f2d3e40f640 1 --2- 172.21.15.73:0/1247616854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d381020a0 0x7f2d38196d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.665+0000 7f2d3e40f640 1 -- 172.21.15.73:0/1247616854 >> 172.21.15.73:0/1247616854 conn(0x7f2d380fbc80 msgr2=0x7f2d380fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.665+0000 7f2d3e40f640 1 -- 172.21.15.73:0/1247616854 shutdown_connections 2024-09-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:12.665+0000 7f2d3e40f640 1 -- 172.21.15.73:0/1247616854 wait complete. 2024-09-05T12:49:14.008 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:13 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1247616854' entity='client.admin' 2024-09-05T12:49:14.056 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-05T12:49:14.056 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.132+0000 7f821c446640 1 -- 172.21.15.73:0/3588423951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8214100510 msgr2=0x7f8214100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.132+0000 7f821c446640 1 --2- 172.21.15.73:0/3588423951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8214100510 0x7f8214100910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8210009880 tx=0x7f821002a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.132+0000 7f821c446640 1 -- 172.21.15.73:0/3588423951 shutdown_connections 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.132+0000 7f821c446640 1 --2- 172.21.15.73:0/3588423951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8214100510 0x7f8214100910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.132+0000 7f821c446640 1 -- 172.21.15.73:0/3588423951 >> 172.21.15.73:0/3588423951 conn(0x7f82140fbc80 msgr2=0x7f82140fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.132+0000 7f821c446640 1 -- 172.21.15.73:0/3588423951 shutdown_connections 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.132+0000 7f821c446640 1 -- 172.21.15.73:0/3588423951 wait complete. 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.133+0000 7f821c446640 1 Processor -- start 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.133+0000 7f821c446640 1 -- start start 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.133+0000 7f821c446640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8214100510 0x7f8214196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.133+0000 7f821c446640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8214106620 con 0x7f8214100510 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.133+0000 7f821a1e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8214100510 0x7f8214196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.133+0000 7f821a1e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8214100510 0x7f8214196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52794/0 (socket says 172.21.15.73:52794) 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.133+0000 7f821a1e2640 1 -- 172.21.15.73:0/1385788040 learned_addr learned my addr 172.21.15.73:0/1385788040 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.134+0000 7f821a1e2640 1 -- 172.21.15.73:0/1385788040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82141972e0 con 0x7f8214100510 2024-09-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.134+0000 7f821a1e2640 1 --2- 172.21.15.73:0/1385788040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8214100510 0x7f8214196da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8210004f60 tx=0x7f82100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.134+0000 7f820b7fe640 1 -- 172.21.15.73:0/1385788040 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f821003f070 con 0x7f8214100510 2024-09-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.134+0000 7f820b7fe640 1 -- 172.21.15.73:0/1385788040 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8210004d40 con 0x7f8214100510 2024-09-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.134+0000 7f820b7fe640 1 -- 172.21.15.73:0/1385788040 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8210035030 con 0x7f8214100510 2024-09-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.134+0000 7f821c446640 1 -- 172.21.15.73:0/1385788040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8214197570 con 0x7f8214100510 2024-09-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.134+0000 7f821c446640 1 -- 172.21.15.73:0/1385788040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821419a220 con 0x7f8214100510 2024-09-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.135+0000 7f820b7fe640 1 -- 172.21.15.73:0/1385788040 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8210042070 con 0x7f8214100510 2024-09-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.135+0000 7f820b7fe640 1 --2- 172.21.15.73:0/1385788040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8200039060 0x7f820003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.135+0000 7f820b7fe640 1 -- 172.21.15.73:0/1385788040 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f821006cd60 con 0x7f8214100510 2024-09-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.135+0000 7f821c446640 1 -- 172.21.15.73:0/1385788040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8214106da0 con 0x7f8214100510 2024-09-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.135+0000 7f82199e1640 1 --2- 172.21.15.73:0/1385788040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8200039060 0x7f820003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.136+0000 7f82199e1640 1 --2- 172.21.15.73:0/1385788040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8200039060 0x7f820003b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f82040098c0 tx=0x7f8204006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.140+0000 7f820b7fe640 1 -- 172.21.15.73:0/1385788040 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8210039350 con 0x7f8214100510 2024-09-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.308+0000 7f821c446640 1 -- 172.21.15.73:0/1385788040 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f8214062630 con 0x7f8200039060 2024-09-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.312+0000 7f820b7fe640 1 -- 172.21.15.73:0/1385788040 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8214062630 con 0x7f8200039060 2024-09-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.314+0000 7f821c446640 1 -- 172.21.15.73:0/1385788040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8200039060 msgr2=0x7f820003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.314+0000 7f821c446640 1 --2- 172.21.15.73:0/1385788040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8200039060 0x7f820003b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f82040098c0 tx=0x7f8204006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.314+0000 7f821c446640 1 -- 172.21.15.73:0/1385788040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8214100510 msgr2=0x7f8214196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.314+0000 7f821c446640 1 --2- 172.21.15.73:0/1385788040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8214100510 0x7f8214196da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8210004f60 tx=0x7f82100048f0 comp rx=0 tx=0).stop 2024-09-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.314+0000 7f821c446640 1 -- 172.21.15.73:0/1385788040 shutdown_connections 2024-09-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.314+0000 7f821c446640 1 --2- 172.21.15.73:0/1385788040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8200039060 0x7f820003b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.314+0000 7f821c446640 1 --2- 172.21.15.73:0/1385788040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8214100510 0x7f8214196da0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.314+0000 7f821c446640 1 -- 172.21.15.73:0/1385788040 >> 172.21.15.73:0/1385788040 conn(0x7f82140fbc80 msgr2=0x7f821406a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.314+0000 7f821c446640 1 -- 172.21.15.73:0/1385788040 shutdown_connections 2024-09-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:15.314+0000 7f821c446640 1 -- 172.21.15.73:0/1385788040 wait complete. 2024-09-05T12:49:16.005 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:16.005 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:16.005 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:49:16.005 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:16.005 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:16.005 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:16.005 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:16.006 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:16.006 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:16.006 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:16.041 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-09-05T12:49:16.041 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:49:16.042 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-09-05T12:49:16.061 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:49:16.061 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T12:49:16.119 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-09-05T12:49:16.119 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch host add smithi162 2024-09-05T12:49:16.367 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:49:16.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:16 smithi073 ceph-mon[30883]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:49:16.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:16 smithi073 ceph-mon[30883]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-05T12:49:16.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:16 smithi073 ceph-mon[30883]: Updating smithi073:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:16.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:16 smithi073 ceph-mon[30883]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-09-05T12:49:16.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:16 smithi073 ceph-mon[30883]: Updating smithi073:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T12:49:16.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:16.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:16.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.829+0000 7f55c928f640 1 -- 172.21.15.73:0/4133047233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55c4106560 msgr2=0x7f55c4106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.829+0000 7f55c928f640 1 --2- 172.21.15.73:0/4133047233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55c4106560 0x7f55c4106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009880 tx=0x7f55b402a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.829+0000 7f55c928f640 1 -- 172.21.15.73:0/4133047233 shutdown_connections 2024-09-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.829+0000 7f55c928f640 1 --2- 172.21.15.73:0/4133047233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55c4106560 0x7f55c4106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.829+0000 7f55c928f640 1 -- 172.21.15.73:0/4133047233 >> 172.21.15.73:0/4133047233 conn(0x7f55c40fc1b0 msgr2=0x7f55c40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.829+0000 7f55c928f640 1 -- 172.21.15.73:0/4133047233 shutdown_connections 2024-09-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.829+0000 7f55c928f640 1 -- 172.21.15.73:0/4133047233 wait complete. 2024-09-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.829+0000 7f55c928f640 1 Processor -- start 2024-09-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c928f640 1 -- start start 2024-09-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c928f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55c4106560 0x7f55c4073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c928f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f55c410ab90 con 0x7f55c4106560 2024-09-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55c4106560 0x7f55c4073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55c4106560 0x7f55c4073d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52812/0 (socket says 172.21.15.73:52812) 2024-09-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c2ffd640 1 -- 172.21.15.73:0/2396235866 learned_addr learned my addr 172.21.15.73:0/2396235866 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c2ffd640 1 -- 172.21.15.73:0/2396235866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c4074250 con 0x7f55c4106560 2024-09-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c2ffd640 1 --2- 172.21.15.73:0/2396235866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55c4106560 0x7f55c4073d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009230 tx=0x7f55b4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c0ff9640 1 -- 172.21.15.73:0/2396235866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b403f070 con 0x7f55c4106560 2024-09-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c0ff9640 1 -- 172.21.15.73:0/2396235866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55b403bc80 con 0x7f55c4106560 2024-09-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.830+0000 7f55c928f640 1 -- 172.21.15.73:0/2396235866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c406bce0 con 0x7f55c4106560 2024-09-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.831+0000 7f55c0ff9640 1 -- 172.21.15.73:0/2396235866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b4035030 con 0x7f55c4106560 2024-09-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.831+0000 7f55c928f640 1 -- 172.21.15.73:0/2396235866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c406c1a0 con 0x7f55c4106560 2024-09-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.831+0000 7f55c0ff9640 1 -- 172.21.15.73:0/2396235866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f55b4042070 con 0x7f55c4106560 2024-09-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.832+0000 7f55c928f640 1 -- 172.21.15.73:0/2396235866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c4101bd0 con 0x7f55c4106560 2024-09-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.832+0000 7f55c0ff9640 1 --2- 172.21.15.73:0/2396235866 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f55b003b270 0x7f55b003d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.832+0000 7f55c0ff9640 1 -- 172.21.15.73:0/2396235866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f55b406cdc0 con 0x7f55c4106560 2024-09-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.832+0000 7f55ba7fc640 1 --2- 172.21.15.73:0/2396235866 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f55b003b270 0x7f55b003d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.832+0000 7f55ba7fc640 1 --2- 172.21.15.73:0/2396235866 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f55b003b270 0x7f55b003d730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0098c0 tx=0x7f55ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:16.837+0000 7f55c0ff9640 1 -- 172.21.15.73:0/2396235866 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55b4042db0 con 0x7f55c4106560 2024-09-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:17.009+0000 7f55c928f640 1 -- 172.21.15.73:0/2396235866 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}) -- 0x7f55c406d210 con 0x7f55b003b270 2024-09-05T12:49:18.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:17 smithi073 ceph-mon[30883]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:49:19.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:18 smithi073 ceph-mon[30883]: Deploying cephadm binary to smithi162 2024-09-05T12:49:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.152+0000 7f55c0ff9640 1 -- 172.21.15.73:0/2396235866 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f55c406d210 con 0x7f55b003b270 2024-09-05T12:49:20.153 INFO:teuthology.orchestra.run.smithi073.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-09-05T12:49:20.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.154+0000 7f55c928f640 1 -- 172.21.15.73:0/2396235866 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f55b003b270 msgr2=0x7f55b003d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:20.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.154+0000 7f55c928f640 1 --2- 172.21.15.73:0/2396235866 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f55b003b270 0x7f55b003d730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0098c0 tx=0x7f55ac006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:20.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.154+0000 7f55c928f640 1 -- 172.21.15.73:0/2396235866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55c4106560 msgr2=0x7f55c4073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.154+0000 7f55c928f640 1 --2- 172.21.15.73:0/2396235866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55c4106560 0x7f55c4073d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009230 tx=0x7f55b4003d40 comp rx=0 tx=0).stop 2024-09-05T12:49:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.154+0000 7f55c928f640 1 -- 172.21.15.73:0/2396235866 shutdown_connections 2024-09-05T12:49:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.154+0000 7f55c928f640 1 --2- 172.21.15.73:0/2396235866 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f55b003b270 0x7f55b003d730 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.154+0000 7f55c928f640 1 --2- 172.21.15.73:0/2396235866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55c4106560 0x7f55c4073d10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.154+0000 7f55c928f640 1 -- 172.21.15.73:0/2396235866 >> 172.21.15.73:0/2396235866 conn(0x7f55c40fc1b0 msgr2=0x7f55c40fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.154+0000 7f55c928f640 1 -- 172.21.15.73:0/2396235866 shutdown_connections 2024-09-05T12:49:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:20.154+0000 7f55c928f640 1 -- 172.21.15.73:0/2396235866 wait complete. 2024-09-05T12:49:20.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch host ls --format=json 2024-09-05T12:49:20.975 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:49:21.397 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:21 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:21.397 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:21 smithi073 ceph-mon[30883]: Added host smithi162 2024-09-05T12:49:21.397 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:21 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:21.397 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:21 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:21.398 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:21 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.475+0000 7f2510b0f640 1 -- 172.21.15.73:0/476262411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c106580 msgr2=0x7f250c106960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.475+0000 7f2510b0f640 1 --2- 172.21.15.73:0/476262411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c106580 0x7f250c106960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009880 tx=0x7f24fc02a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.475+0000 7f2510b0f640 1 -- 172.21.15.73:0/476262411 shutdown_connections 2024-09-05T12:49:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.475+0000 7f2510b0f640 1 --2- 172.21.15.73:0/476262411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c106580 0x7f250c106960 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.475+0000 7f2510b0f640 1 -- 172.21.15.73:0/476262411 >> 172.21.15.73:0/476262411 conn(0x7f250c0fc170 msgr2=0x7f250c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.476+0000 7f2510b0f640 1 -- 172.21.15.73:0/476262411 shutdown_connections 2024-09-05T12:49:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.476+0000 7f2510b0f640 1 -- 172.21.15.73:0/476262411 wait complete. 2024-09-05T12:49:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.476+0000 7f2510b0f640 1 Processor -- start 2024-09-05T12:49:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.476+0000 7f2510b0f640 1 -- start start 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f2510b0f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c106580 0x7f250c0fc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f2510b0f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f250c10abb0 con 0x7f250c106580 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f250a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c106580 0x7f250c0fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f250a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c106580 0x7f250c0fc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52832/0 (socket says 172.21.15.73:52832) 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f250a59c640 1 -- 172.21.15.73:0/2288691496 learned_addr learned my addr 172.21.15.73:0/2288691496 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f250a59c640 1 -- 172.21.15.73:0/2288691496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c0fe510 con 0x7f250c106580 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f250a59c640 1 --2- 172.21.15.73:0/2288691496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c106580 0x7f250c0fc620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009230 tx=0x7f24fc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f2503fff640 1 -- 172.21.15.73:0/2288691496 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc03f070 con 0x7f250c106580 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f2510b0f640 1 -- 172.21.15.73:0/2288691496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250c0fcb60 con 0x7f250c106580 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f2503fff640 1 -- 172.21.15.73:0/2288691496 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24fc03bc80 con 0x7f250c106580 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f2503fff640 1 -- 172.21.15.73:0/2288691496 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc035030 con 0x7f250c106580 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.477+0000 7f2510b0f640 1 -- 172.21.15.73:0/2288691496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250c0fd020 con 0x7f250c106580 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.478+0000 7f2503fff640 1 -- 172.21.15.73:0/2288691496 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f24fc042070 con 0x7f250c106580 2024-09-05T12:49:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.478+0000 7f2510b0f640 1 -- 172.21.15.73:0/2288691496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250c101bf0 con 0x7f250c106580 2024-09-05T12:49:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.478+0000 7f2503fff640 1 --2- 172.21.15.73:0/2288691496 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f8039060 0x7f24f803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.478+0000 7f2503fff640 1 -- 172.21.15.73:0/2288691496 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f24fc06ccd0 con 0x7f250c106580 2024-09-05T12:49:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.479+0000 7f2501d9b640 1 --2- 172.21.15.73:0/2288691496 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f8039060 0x7f24f803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.479+0000 7f2501d9b640 1 --2- 172.21.15.73:0/2288691496 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f8039060 0x7f24f803b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f24f40098c0 tx=0x7f24f4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.483+0000 7f2503fff640 1 -- 172.21.15.73:0/2288691496 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24fc04c350 con 0x7f250c106580 2024-09-05T12:49:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.655+0000 7f2510b0f640 1 -- 172.21.15.73:0/2288691496 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f250c0fdbc0 con 0x7f24f8039060 2024-09-05T12:49:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.657+0000 7f2503fff640 1 -- 172.21.15.73:0/2288691496 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f250c0fdbc0 con 0x7f24f8039060 2024-09-05T12:49:21.658 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:21.658 INFO:teuthology.orchestra.run.smithi073.stdout:[{"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-09-05T12:49:21.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.659+0000 7f2510b0f640 1 -- 172.21.15.73:0/2288691496 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f8039060 msgr2=0x7f24f803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:21.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.659+0000 7f2510b0f640 1 --2- 172.21.15.73:0/2288691496 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f8039060 0x7f24f803b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f24f40098c0 tx=0x7f24f4006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:21.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.659+0000 7f2510b0f640 1 -- 172.21.15.73:0/2288691496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c106580 msgr2=0x7f250c0fc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:21.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.659+0000 7f2510b0f640 1 --2- 172.21.15.73:0/2288691496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c106580 0x7f250c0fc620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009230 tx=0x7f24fc003d40 comp rx=0 tx=0).stop 2024-09-05T12:49:21.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.659+0000 7f2510b0f640 1 -- 172.21.15.73:0/2288691496 shutdown_connections 2024-09-05T12:49:21.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.659+0000 7f2510b0f640 1 --2- 172.21.15.73:0/2288691496 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f8039060 0x7f24f803b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:21.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.659+0000 7f2510b0f640 1 --2- 172.21.15.73:0/2288691496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c106580 0x7f250c0fc620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:21.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.659+0000 7f2510b0f640 1 -- 172.21.15.73:0/2288691496 >> 172.21.15.73:0/2288691496 conn(0x7f250c0fc170 msgr2=0x7f250c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:21.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.659+0000 7f2510b0f640 1 -- 172.21.15.73:0/2288691496 shutdown_connections 2024-09-05T12:49:21.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:21.659+0000 7f2510b0f640 1 -- 172.21.15.73:0/2288691496 wait complete. 2024-09-05T12:49:22.212 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi169 2024-09-05T12:49:22.213 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:49:22.213 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.conf 2024-09-05T12:49:22.231 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:49:22.232 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T12:49:22.290 INFO:tasks.cephadm:Adding host smithi169 to orchestrator... 2024-09-05T12:49:22.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch host add smithi169 2024-09-05T12:49:22.528 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:49:22.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:22 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:22.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:22 smithi073 ceph-mon[30883]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:49:22.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.892+0000 7fbb515f3640 1 -- 172.21.15.73:0/46795570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb4c107580 msgr2=0x7fbb4c107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:22.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.892+0000 7fbb515f3640 1 --2- 172.21.15.73:0/46795570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb4c107580 0x7fbb4c107960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009880 tx=0x7fbb3c02a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.892+0000 7fbb515f3640 1 -- 172.21.15.73:0/46795570 shutdown_connections 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.892+0000 7fbb515f3640 1 --2- 172.21.15.73:0/46795570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb4c107580 0x7fbb4c107960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.892+0000 7fbb515f3640 1 -- 172.21.15.73:0/46795570 >> 172.21.15.73:0/46795570 conn(0x7fbb4c0fb920 msgr2=0x7fbb4c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.892+0000 7fbb515f3640 1 -- 172.21.15.73:0/46795570 shutdown_connections 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.892+0000 7fbb515f3640 1 -- 172.21.15.73:0/46795570 wait complete. 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.892+0000 7fbb515f3640 1 Processor -- start 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.892+0000 7fbb515f3640 1 -- start start 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb515f3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb4c107580 0x7fbb4c100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb515f3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c10bc40 con 0x7fbb4c107580 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb4affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb4c107580 0x7fbb4c100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb4affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb4c107580 0x7fbb4c100cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52852/0 (socket says 172.21.15.73:52852) 2024-09-05T12:49:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb4affd640 1 -- 172.21.15.73:0/2654160054 learned_addr learned my addr 172.21.15.73:0/2654160054 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:22.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb4affd640 1 -- 172.21.15.73:0/2654160054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c102ba0 con 0x7fbb4c107580 2024-09-05T12:49:22.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb4affd640 1 --2- 172.21.15.73:0/2654160054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb4c107580 0x7fbb4c100cb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009230 tx=0x7fbb3c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:22.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb43fff640 1 -- 172.21.15.73:0/2654160054 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3c03f070 con 0x7fbb4c107580 2024-09-05T12:49:22.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb43fff640 1 -- 172.21.15.73:0/2654160054 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb3c03bc80 con 0x7fbb4c107580 2024-09-05T12:49:22.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb515f3640 1 -- 172.21.15.73:0/2654160054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4c101250 con 0x7fbb4c107580 2024-09-05T12:49:22.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb43fff640 1 -- 172.21.15.73:0/2654160054 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3c035030 con 0x7fbb4c107580 2024-09-05T12:49:22.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.893+0000 7fbb515f3640 1 -- 172.21.15.73:0/2654160054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4c101710 con 0x7fbb4c107580 2024-09-05T12:49:22.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.894+0000 7fbb43fff640 1 -- 172.21.15.73:0/2654160054 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbb3c042070 con 0x7fbb4c107580 2024-09-05T12:49:22.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.894+0000 7fbb43fff640 1 --2- 172.21.15.73:0/2654160054 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbb38039060 0x7fbb3803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:22.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.894+0000 7fbb515f3640 1 -- 172.21.15.73:0/2654160054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4c1079e0 con 0x7fbb4c107580 2024-09-05T12:49:22.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.895+0000 7fbb43fff640 1 -- 172.21.15.73:0/2654160054 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbb3c06ce60 con 0x7fbb4c107580 2024-09-05T12:49:22.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.895+0000 7fbb4a7fc640 1 --2- 172.21.15.73:0/2654160054 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbb38039060 0x7fbb3803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:22.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.895+0000 7fbb4a7fc640 1 --2- 172.21.15.73:0/2654160054 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbb38039060 0x7fbb3803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbb340098c0 tx=0x7fbb34006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:22.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:22.899+0000 7fbb43fff640 1 -- 172.21.15.73:0/2654160054 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb3c04c350 con 0x7fbb4c107580 2024-09-05T12:49:23.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:23.069+0000 7fbb515f3640 1 -- 172.21.15.73:0/2654160054 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}) -- 0x7fbb4c102e40 con 0x7fbb38039060 2024-09-05T12:49:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:24 smithi073 ceph-mon[30883]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:49:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:24 smithi073 ceph-mon[30883]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:24 smithi073 ceph-mon[30883]: Deploying cephadm binary to smithi169 2024-09-05T12:49:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:49:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:26.243 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:25 smithi073 ceph-mon[30883]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-05T12:49:26.243 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:25 smithi073 ceph-mon[30883]: Updating smithi162:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:26.243 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:25 smithi073 ceph-mon[30883]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-05T12:49:26.243 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:26.243 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:26.244 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:26.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.242+0000 7fbb43fff640 1 -- 172.21.15.73:0/2654160054 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fbb340094d0 con 0x7fbb38039060 2024-09-05T12:49:26.244 INFO:teuthology.orchestra.run.smithi073.stdout:Added host 'smithi169' with addr '172.21.15.169' 2024-09-05T12:49:26.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.245+0000 7fbb515f3640 1 -- 172.21.15.73:0/2654160054 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbb38039060 msgr2=0x7fbb3803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:26.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.245+0000 7fbb515f3640 1 --2- 172.21.15.73:0/2654160054 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbb38039060 0x7fbb3803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbb340098c0 tx=0x7fbb34006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:26.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.245+0000 7fbb515f3640 1 -- 172.21.15.73:0/2654160054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb4c107580 msgr2=0x7fbb4c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:26.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.245+0000 7fbb515f3640 1 --2- 172.21.15.73:0/2654160054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb4c107580 0x7fbb4c100cb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009230 tx=0x7fbb3c003d40 comp rx=0 tx=0).stop 2024-09-05T12:49:26.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.245+0000 7fbb515f3640 1 -- 172.21.15.73:0/2654160054 shutdown_connections 2024-09-05T12:49:26.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.245+0000 7fbb515f3640 1 --2- 172.21.15.73:0/2654160054 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbb38039060 0x7fbb3803b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:26.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.245+0000 7fbb515f3640 1 --2- 172.21.15.73:0/2654160054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb4c107580 0x7fbb4c100cb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:26.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.245+0000 7fbb515f3640 1 -- 172.21.15.73:0/2654160054 >> 172.21.15.73:0/2654160054 conn(0x7fbb4c0fb920 msgr2=0x7fbb4c0fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:26.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.245+0000 7fbb515f3640 1 -- 172.21.15.73:0/2654160054 shutdown_connections 2024-09-05T12:49:26.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:26.245+0000 7fbb515f3640 1 -- 172.21.15.73:0/2654160054 wait complete. 2024-09-05T12:49:26.835 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch host ls --format=json 2024-09-05T12:49:27.074 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:49:27.194 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:26 smithi073 ceph-mon[30883]: Updating smithi162:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T12:49:27.195 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:26 smithi073 ceph-mon[30883]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:27.195 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:26 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:27.195 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:26 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:27.195 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:26 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:27.195 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:26 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.488+0000 7efccc980640 1 -- 172.21.15.73:0/2814863002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc8109770 msgr2=0x7efcc8109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.488+0000 7efccc980640 1 --2- 172.21.15.73:0/2814863002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc8109770 0x7efcc8109b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009880 tx=0x7efcb802a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.488+0000 7efccc980640 1 -- 172.21.15.73:0/2814863002 shutdown_connections 2024-09-05T12:49:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.488+0000 7efccc980640 1 --2- 172.21.15.73:0/2814863002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc8109770 0x7efcc8109b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.488+0000 7efccc980640 1 -- 172.21.15.73:0/2814863002 >> 172.21.15.73:0/2814863002 conn(0x7efcc80ff450 msgr2=0x7efcc8101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.488+0000 7efccc980640 1 -- 172.21.15.73:0/2814863002 shutdown_connections 2024-09-05T12:49:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.488+0000 7efccc980640 1 -- 172.21.15.73:0/2814863002 wait complete. 2024-09-05T12:49:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.489+0000 7efccc980640 1 Processor -- start 2024-09-05T12:49:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.489+0000 7efccc980640 1 -- start start 2024-09-05T12:49:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.489+0000 7efccc980640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc8109770 0x7efcc81993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.489+0000 7efccc980640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efcc810de30 con 0x7efcc8109770 2024-09-05T12:49:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.489+0000 7efcc659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc8109770 0x7efcc81993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.489+0000 7efcc659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc8109770 0x7efcc81993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35408/0 (socket says 172.21.15.73:35408) 2024-09-05T12:49:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.489+0000 7efcc659c640 1 -- 172.21.15.73:0/3306898698 learned_addr learned my addr 172.21.15.73:0/3306898698 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.490+0000 7efcc659c640 1 -- 172.21.15.73:0/3306898698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc81998e0 con 0x7efcc8109770 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.490+0000 7efcc659c640 1 --2- 172.21.15.73:0/3306898698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc8109770 0x7efcc81993a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009230 tx=0x7efcb8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.490+0000 7efcb77fe640 1 -- 172.21.15.73:0/3306898698 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcb803f070 con 0x7efcc8109770 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.490+0000 7efcb77fe640 1 -- 172.21.15.73:0/3306898698 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcb803bc80 con 0x7efcc8109770 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.490+0000 7efcb77fe640 1 -- 172.21.15.73:0/3306898698 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcb8035030 con 0x7efcc8109770 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.490+0000 7efccc980640 1 -- 172.21.15.73:0/3306898698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc8199bd0 con 0x7efcc8109770 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.490+0000 7efccc980640 1 -- 172.21.15.73:0/3306898698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc819dc70 con 0x7efcc8109770 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.491+0000 7efcb77fe640 1 -- 172.21.15.73:0/3306898698 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efcb8042070 con 0x7efcc8109770 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.491+0000 7efccc980640 1 -- 172.21.15.73:0/3306898698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc8104eb0 con 0x7efcc8109770 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.491+0000 7efcb77fe640 1 --2- 172.21.15.73:0/3306898698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7efcb0039060 0x7efcb003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.491+0000 7efcb77fe640 1 -- 172.21.15.73:0/3306898698 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efcb806cd20 con 0x7efcc8109770 2024-09-05T12:49:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.491+0000 7efcc5d9b640 1 --2- 172.21.15.73:0/3306898698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7efcb0039060 0x7efcb003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.492+0000 7efcc5d9b640 1 --2- 172.21.15.73:0/3306898698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7efcb0039060 0x7efcb003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0098c0 tx=0x7efcbc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.496+0000 7efcb77fe640 1 -- 172.21.15.73:0/3306898698 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcb8031e20 con 0x7efcc8109770 2024-09-05T12:49:27.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.666+0000 7efccc980640 1 -- 172.21.15.73:0/3306898698 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efcc8109c30 con 0x7efcb0039060 2024-09-05T12:49:27.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.667+0000 7efcb77fe640 1 -- 172.21.15.73:0/3306898698 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7efcc8109c30 con 0x7efcb0039060 2024-09-05T12:49:27.668 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:49:27.668 INFO:teuthology.orchestra.run.smithi073.stdout:[{"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}, {"addr": "172.21.15.169", "hostname": "smithi169", "labels": [], "status": ""}] 2024-09-05T12:49:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.669+0000 7efccc980640 1 -- 172.21.15.73:0/3306898698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7efcb0039060 msgr2=0x7efcb003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.669+0000 7efccc980640 1 --2- 172.21.15.73:0/3306898698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7efcb0039060 0x7efcb003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0098c0 tx=0x7efcbc006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.669+0000 7efccc980640 1 -- 172.21.15.73:0/3306898698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc8109770 msgr2=0x7efcc81993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.669+0000 7efccc980640 1 --2- 172.21.15.73:0/3306898698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc8109770 0x7efcc81993a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009230 tx=0x7efcb8003d40 comp rx=0 tx=0).stop 2024-09-05T12:49:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.669+0000 7efccc980640 1 -- 172.21.15.73:0/3306898698 shutdown_connections 2024-09-05T12:49:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.669+0000 7efccc980640 1 --2- 172.21.15.73:0/3306898698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7efcb0039060 0x7efcb003b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.669+0000 7efccc980640 1 --2- 172.21.15.73:0/3306898698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc8109770 0x7efcc81993a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.669+0000 7efccc980640 1 -- 172.21.15.73:0/3306898698 >> 172.21.15.73:0/3306898698 conn(0x7efcc80ff450 msgr2=0x7efcc8107280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.669+0000 7efccc980640 1 -- 172.21.15.73:0/3306898698 shutdown_connections 2024-09-05T12:49:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:27.669+0000 7efccc980640 1 -- 172.21.15.73:0/3306898698 wait complete. 2024-09-05T12:49:28.205 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:27 smithi073 ceph-mon[30883]: Added host smithi169 2024-09-05T12:49:28.205 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:28.231 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-05T12:49:28.231 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd crush tunables default 2024-09-05T12:49:28.468 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:49:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.921+0000 7faa749c0640 1 -- 172.21.15.73:0/3258939517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa70106570 msgr2=0x7faa70106950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.921+0000 7faa749c0640 1 --2- 172.21.15.73:0/3258939517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa70106570 0x7faa70106950 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa60009880 tx=0x7faa6002a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.921+0000 7faa749c0640 1 -- 172.21.15.73:0/3258939517 shutdown_connections 2024-09-05T12:49:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.921+0000 7faa749c0640 1 --2- 172.21.15.73:0/3258939517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa70106570 0x7faa70106950 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.921+0000 7faa749c0640 1 -- 172.21.15.73:0/3258939517 >> 172.21.15.73:0/3258939517 conn(0x7faa700fc180 msgr2=0x7faa700fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.921+0000 7faa749c0640 1 -- 172.21.15.73:0/3258939517 shutdown_connections 2024-09-05T12:49:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.921+0000 7faa749c0640 1 -- 172.21.15.73:0/3258939517 wait complete. 2024-09-05T12:49:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.921+0000 7faa749c0640 1 Processor -- start 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.921+0000 7faa749c0640 1 -- start start 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa749c0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa70106570 0x7faa70197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa749c0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faa7010aba0 con 0x7faa70106570 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa6e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa70106570 0x7faa70197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa6e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa70106570 0x7faa70197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35420/0 (socket says 172.21.15.73:35420) 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa6e59c640 1 -- 172.21.15.73:0/1052471002 learned_addr learned my addr 172.21.15.73:0/1052471002 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa6e59c640 1 -- 172.21.15.73:0/1052471002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa701984a0 con 0x7faa70106570 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa6e59c640 1 --2- 172.21.15.73:0/1052471002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa70106570 0x7faa70197f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faa60009230 tx=0x7faa60003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa5f7fe640 1 -- 172.21.15.73:0/1052471002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa6003f070 con 0x7faa70106570 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa5f7fe640 1 -- 172.21.15.73:0/1052471002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa6003bc80 con 0x7faa70106570 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa749c0640 1 -- 172.21.15.73:0/1052471002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa70198730 con 0x7faa70106570 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa5f7fe640 1 -- 172.21.15.73:0/1052471002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa60035030 con 0x7faa70106570 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.922+0000 7faa749c0640 1 -- 172.21.15.73:0/1052471002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa70198b90 con 0x7faa70106570 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.923+0000 7faa5f7fe640 1 -- 172.21.15.73:0/1052471002 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7faa60042070 con 0x7faa70106570 2024-09-05T12:49:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.923+0000 7faa5f7fe640 1 --2- 172.21.15.73:0/1052471002 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7faa58039060 0x7faa5803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.923+0000 7faa5f7fe640 1 -- 172.21.15.73:0/1052471002 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7faa6006cdf0 con 0x7faa70106570 2024-09-05T12:49:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.923+0000 7faa749c0640 1 -- 172.21.15.73:0/1052471002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa70101be0 con 0x7faa70106570 2024-09-05T12:49:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.923+0000 7faa6dd9b640 1 --2- 172.21.15.73:0/1052471002 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7faa58039060 0x7faa5803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.924+0000 7faa6dd9b640 1 --2- 172.21.15.73:0/1052471002 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7faa58039060 0x7faa5803b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faa640098c0 tx=0x7faa64006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:28.928+0000 7faa5f7fe640 1 -- 172.21.15.73:0/1052471002 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa6004c350 con 0x7faa70106570 2024-09-05T12:49:29.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.097+0000 7faa749c0640 1 -- 172.21.15.73:0/1052471002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7faa701069d0 con 0x7faa70106570 2024-09-05T12:49:29.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:28 smithi073 ceph-mon[30883]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:49:29.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:28 smithi073 ceph-mon[30883]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:29.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.907+0000 7faa5f7fe640 1 -- 172.21.15.73:0/1052471002 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7faa600314c0 con 0x7faa70106570 2024-09-05T12:49:29.909 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-09-05T12:49:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.911+0000 7faa749c0640 1 -- 172.21.15.73:0/1052471002 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7faa58039060 msgr2=0x7faa5803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.911+0000 7faa749c0640 1 --2- 172.21.15.73:0/1052471002 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7faa58039060 0x7faa5803b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faa640098c0 tx=0x7faa64006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.911+0000 7faa749c0640 1 -- 172.21.15.73:0/1052471002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa70106570 msgr2=0x7faa70197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.911+0000 7faa749c0640 1 --2- 172.21.15.73:0/1052471002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa70106570 0x7faa70197f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faa60009230 tx=0x7faa60003d40 comp rx=0 tx=0).stop 2024-09-05T12:49:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.911+0000 7faa749c0640 1 -- 172.21.15.73:0/1052471002 shutdown_connections 2024-09-05T12:49:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.911+0000 7faa749c0640 1 --2- 172.21.15.73:0/1052471002 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7faa58039060 0x7faa5803b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.911+0000 7faa749c0640 1 --2- 172.21.15.73:0/1052471002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa70106570 0x7faa70197f60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.911+0000 7faa749c0640 1 -- 172.21.15.73:0/1052471002 >> 172.21.15.73:0/1052471002 conn(0x7faa700fc180 msgr2=0x7faa700fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.911+0000 7faa749c0640 1 -- 172.21.15.73:0/1052471002 shutdown_connections 2024-09-05T12:49:29.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:29.911+0000 7faa749c0640 1 -- 172.21.15.73:0/1052471002 wait complete. 2024-09-05T12:49:30.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:29 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1052471002' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-05T12:49:30.509 INFO:tasks.cephadm:Adding mon.a on smithi073 2024-09-05T12:49:30.510 INFO:tasks.cephadm:Adding mon.b on smithi162 2024-09-05T12:49:30.510 INFO:tasks.cephadm:Adding mon.c on smithi169 2024-09-05T12:49:30.510 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch apply mon '3;smithi073:172.21.15.73=a;smithi162:172.21.15.162=b;smithi169:172.21.15.169=c' 2024-09-05T12:49:30.756 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-05T12:49:30.809 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-05T12:49:31.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.230+0000 7f9139a29640 1 -- 172.21.15.169:0/3023266815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91341020d0 msgr2=0x7f91341044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:31.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.230+0000 7f9139a29640 1 --2- 172.21.15.169:0/3023266815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91341020d0 0x7f91341044c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9124009880 tx=0x7f912402a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.230+0000 7f9139a29640 1 -- 172.21.15.169:0/3023266815 shutdown_connections 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.230+0000 7f9139a29640 1 --2- 172.21.15.169:0/3023266815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91341020d0 0x7f91341044c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.230+0000 7f9139a29640 1 -- 172.21.15.169:0/3023266815 >> 172.21.15.169:0/3023266815 conn(0x7f91340fbcd0 msgr2=0x7f91340fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.230+0000 7f9139a29640 1 -- 172.21.15.169:0/3023266815 shutdown_connections 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.230+0000 7f9139a29640 1 -- 172.21.15.169:0/3023266815 wait complete. 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.230+0000 7f9139a29640 1 Processor -- start 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.231+0000 7f9139a29640 1 -- start start 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.231+0000 7f9139a29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91341020d0 0x7f9134101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.231+0000 7f9139a29640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9134107670 con 0x7f91341020d0 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.231+0000 7f9132ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91341020d0 0x7f9134101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.231+0000 7f9132ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91341020d0 0x7f9134101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.169:53370/0 (socket says 172.21.15.169:53370) 2024-09-05T12:49:31.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.231+0000 7f9132ffd640 1 -- 172.21.15.169:0/1064179262 learned_addr learned my addr 172.21.15.169:0/1064179262 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.231+0000 7f9132ffd640 1 -- 172.21.15.169:0/1064179262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9134101e90 con 0x7f91341020d0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.232+0000 7f9132ffd640 1 --2- 172.21.15.169:0/1064179262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91341020d0 0x7f9134101950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9124004f60 tx=0x7f91240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.232+0000 7f9138a27640 1 -- 172.21.15.169:0/1064179262 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f912403f070 con 0x7f91341020d0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.232+0000 7f9139a29640 1 -- 172.21.15.169:0/1064179262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9134100080 con 0x7f91341020d0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.232+0000 7f9138a27640 1 -- 172.21.15.169:0/1064179262 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9124003ad0 con 0x7f91341020d0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.232+0000 7f9138a27640 1 -- 172.21.15.169:0/1064179262 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9124035030 con 0x7f91341020d0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.232+0000 7f9139a29640 1 -- 172.21.15.169:0/1064179262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91341005c0 con 0x7f91341020d0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.233+0000 7f9138a27640 1 -- 172.21.15.169:0/1064179262 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f9124042070 con 0x7f91341020d0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.233+0000 7f9139a29640 1 -- 172.21.15.169:0/1064179262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9134107df0 con 0x7f91341020d0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.233+0000 7f9138a27640 1 --2- 172.21.15.169:0/1064179262 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9120039060 0x7f912003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.233+0000 7f9138a27640 1 -- 172.21.15.169:0/1064179262 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f912406d070 con 0x7f91341020d0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.234+0000 7f91327fc640 1 --2- 172.21.15.169:0/1064179262 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9120039060 0x7f912003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:31.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.234+0000 7f91327fc640 1 --2- 172.21.15.169:0/1064179262 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9120039060 0x7f912003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f911c0098c0 tx=0x7f911c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:31.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.238+0000 7f9138a27640 1 -- 172.21.15.169:0/1064179262 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9124039350 con 0x7f91341020d0 2024-09-05T12:49:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:30 smithi073 ceph-mon[30883]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:30 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1052471002' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-05T12:49:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:30 smithi073 ceph-mon[30883]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T12:49:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:49:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:31.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.420+0000 7f9139a29640 1 -- 172.21.15.169:0/1064179262 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi073:172.21.15.73=a;smithi162:172.21.15.162=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}) -- 0x7f9134190410 con 0x7f9120039060 2024-09-05T12:49:31.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.425+0000 7f9138a27640 1 -- 172.21.15.169:0/1064179262 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9134190410 con 0x7f9120039060 2024-09-05T12:49:31.426 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mon update... 2024-09-05T12:49:31.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.427+0000 7f9139a29640 1 -- 172.21.15.169:0/1064179262 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9120039060 msgr2=0x7f912003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:31.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.427+0000 7f9139a29640 1 --2- 172.21.15.169:0/1064179262 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9120039060 0x7f912003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f911c0098c0 tx=0x7f911c006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:31.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.427+0000 7f9139a29640 1 -- 172.21.15.169:0/1064179262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91341020d0 msgr2=0x7f9134101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:31.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.427+0000 7f9139a29640 1 --2- 172.21.15.169:0/1064179262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91341020d0 0x7f9134101950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9124004f60 tx=0x7f91240048f0 comp rx=0 tx=0).stop 2024-09-05T12:49:31.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.427+0000 7f9139a29640 1 -- 172.21.15.169:0/1064179262 shutdown_connections 2024-09-05T12:49:31.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.427+0000 7f9139a29640 1 --2- 172.21.15.169:0/1064179262 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9120039060 0x7f912003b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:31.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.427+0000 7f9139a29640 1 --2- 172.21.15.169:0/1064179262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91341020d0 0x7f9134101950 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:31.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.427+0000 7f9139a29640 1 -- 172.21.15.169:0/1064179262 >> 172.21.15.169:0/1064179262 conn(0x7f91340fbcd0 msgr2=0x7f91340fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:31.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.427+0000 7f9139a29640 1 -- 172.21.15.169:0/1064179262 shutdown_connections 2024-09-05T12:49:31.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:31.427+0000 7f9139a29640 1 -- 172.21.15.169:0/1064179262 wait complete. 2024-09-05T12:49:32.020 DEBUG:teuthology.orchestra.run.smithi162:mon.b> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.b.service 2024-09-05T12:49:32.023 DEBUG:teuthology.orchestra.run.smithi169:mon.c> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.c.service 2024-09-05T12:49:32.025 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T12:49:32.026 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T12:49:32.165 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-05T12:49:32.165 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: Updating smithi169:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:32.165 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-05T12:49:32.165 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:32.165 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:32.165 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:32.166 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:32.166 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:32.166 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:32.166 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:32.166 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:32.166 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:32.166 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:32.776 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.186+0000 7f78d3b3f640 1 -- 172.21.15.169:0/2916015204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78cc106580 msgr2=0x7f78cc106960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.186+0000 7f78d3b3f640 1 --2- 172.21.15.169:0/2916015204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78cc106580 0x7f78cc106960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009880 tx=0x7f78c802a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.186+0000 7f78d3b3f640 1 -- 172.21.15.169:0/2916015204 shutdown_connections 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.186+0000 7f78d3b3f640 1 --2- 172.21.15.169:0/2916015204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78cc106580 0x7f78cc106960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.186+0000 7f78d3b3f640 1 -- 172.21.15.169:0/2916015204 >> 172.21.15.169:0/2916015204 conn(0x7f78cc0fc170 msgr2=0x7f78cc0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.186+0000 7f78d3b3f640 1 -- 172.21.15.169:0/2916015204 shutdown_connections 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.186+0000 7f78d3b3f640 1 -- 172.21.15.169:0/2916015204 wait complete. 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.187+0000 7f78d3b3f640 1 Processor -- start 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.187+0000 7f78d3b3f640 1 -- start start 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.187+0000 7f78d3b3f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78cc106580 0x7f78cc199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:33.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.187+0000 7f78d3b3f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc10abb0 con 0x7f78cc106580 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.187+0000 7f78d18db640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78cc106580 0x7f78cc199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.187+0000 7f78d18db640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78cc106580 0x7f78cc199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.169:53386/0 (socket says 172.21.15.169:53386) 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.187+0000 7f78d18db640 1 -- 172.21.15.169:0/499987677 learned_addr learned my addr 172.21.15.169:0/499987677 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.187+0000 7f78d18db640 1 -- 172.21.15.169:0/499987677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc1998d0 con 0x7f78cc106580 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.188+0000 7f78d18db640 1 --2- 172.21.15.169:0/499987677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78cc106580 0x7f78cc199390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009230 tx=0x7f78c8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.188+0000 7f78beffd640 1 -- 172.21.15.169:0/499987677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c803f070 con 0x7f78cc106580 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.188+0000 7f78d3b3f640 1 -- 172.21.15.169:0/499987677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78cc199b60 con 0x7f78cc106580 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.188+0000 7f78beffd640 1 -- 172.21.15.169:0/499987677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78c803bc80 con 0x7f78cc106580 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.188+0000 7f78beffd640 1 -- 172.21.15.169:0/499987677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c8035030 con 0x7f78cc106580 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.188+0000 7f78d3b3f640 1 -- 172.21.15.169:0/499987677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78cc199fc0 con 0x7f78cc106580 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.189+0000 7f78beffd640 1 -- 172.21.15.169:0/499987677 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f78c8042070 con 0x7f78cc106580 2024-09-05T12:49:33.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.189+0000 7f78beffd640 1 --2- 172.21.15.169:0/499987677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f78b8039060 0x7f78b803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:33.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.189+0000 7f78d3b3f640 1 -- 172.21.15.169:0/499987677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78cc101bf0 con 0x7f78cc106580 2024-09-05T12:49:33.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.189+0000 7f78beffd640 1 -- 172.21.15.169:0/499987677 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f78c806cdc0 con 0x7f78cc106580 2024-09-05T12:49:33.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.189+0000 7f78d10da640 1 --2- 172.21.15.169:0/499987677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f78b8039060 0x7f78b803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:33.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.189+0000 7f78d10da640 1 --2- 172.21.15.169:0/499987677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f78b8039060 0x7f78b803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f78c00098c0 tx=0x7f78c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:33.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.194+0000 7f78beffd640 1 -- 172.21.15.169:0/499987677 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f78c80372d0 con 0x7f78cc106580 2024-09-05T12:49:33.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:32 smithi073 ceph-mon[30883]: Updating smithi169:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T12:49:33.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:32 smithi073 ceph-mon[30883]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi073:172.21.15.73=a;smithi162:172.21.15.162=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:49:33.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:32 smithi073 ceph-mon[30883]: Saving service mon spec with placement smithi073:172.21.15.73=a;smithi162:172.21.15.162=b;smithi169:172.21.15.169=c;count:3 2024-09-05T12:49:33.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:32 smithi073 ceph-mon[30883]: Deploying daemon mon.c on smithi169 2024-09-05T12:49:33.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:32 smithi073 ceph-mon[30883]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:33.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.429+0000 7f78d3b3f640 1 -- 172.21.15.169:0/499987677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f78cc19a720 con 0x7f78cc106580 2024-09-05T12:49:33.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.430+0000 7f78beffd640 1 -- 172.21.15.169:0/499987677 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f78c80314c0 con 0x7f78cc106580 2024-09-05T12:49:33.431 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:49:33.431 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":1,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","modified":"2024-09-05T12:48:08.867322Z","created":"2024-09-05T12:48:08.867322Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-05T12:49:33.431 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 1 2024-09-05T12:49:33.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.432+0000 7f78d3b3f640 1 -- 172.21.15.169:0/499987677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f78b8039060 msgr2=0x7f78b803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:33.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.432+0000 7f78d3b3f640 1 --2- 172.21.15.169:0/499987677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f78b8039060 0x7f78b803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f78c00098c0 tx=0x7f78c0006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:33.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.432+0000 7f78d3b3f640 1 -- 172.21.15.169:0/499987677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78cc106580 msgr2=0x7f78cc199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:33.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.432+0000 7f78d3b3f640 1 --2- 172.21.15.169:0/499987677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78cc106580 0x7f78cc199390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009230 tx=0x7f78c8003d40 comp rx=0 tx=0).stop 2024-09-05T12:49:33.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.432+0000 7f78d3b3f640 1 -- 172.21.15.169:0/499987677 shutdown_connections 2024-09-05T12:49:33.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.432+0000 7f78d3b3f640 1 --2- 172.21.15.169:0/499987677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f78b8039060 0x7f78b803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:33.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.432+0000 7f78d3b3f640 1 --2- 172.21.15.169:0/499987677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78cc106580 0x7f78cc199390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:33.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.432+0000 7f78d3b3f640 1 -- 172.21.15.169:0/499987677 >> 172.21.15.169:0/499987677 conn(0x7f78cc0fc170 msgr2=0x7f78cc069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:33.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.432+0000 7f78d3b3f640 1 -- 172.21.15.169:0/499987677 shutdown_connections 2024-09-05T12:49:33.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:33.432+0000 7f78d3b3f640 1 -- 172.21.15.169:0/499987677 wait complete. 2024-09-05T12:49:34.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:33 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/499987677' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:34.951 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T12:49:34.951 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T12:49:35.213 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:49:35.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:34 smithi073 ceph-mon[30883]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:35.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.702+0000 7f50903b8640 1 -- 172.21.15.169:0/1819485008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50881028c0 msgr2=0x7f5088102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:35.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.702+0000 7f50903b8640 1 --2- 172.21.15.169:0/1819485008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50881028c0 0x7f5088102ca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5084009880 tx=0x7f508402a670 comp rx=0 tx=0).stop 2024-09-05T12:49:35.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.702+0000 7f50903b8640 1 -- 172.21.15.169:0/1819485008 shutdown_connections 2024-09-05T12:49:35.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.702+0000 7f50903b8640 1 --2- 172.21.15.169:0/1819485008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50881028c0 0x7f5088102ca0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:35.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.702+0000 7f50903b8640 1 -- 172.21.15.169:0/1819485008 >> 172.21.15.169:0/1819485008 conn(0x7f50880fc280 msgr2=0x7f50880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:35.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.702+0000 7f50903b8640 1 -- 172.21.15.169:0/1819485008 shutdown_connections 2024-09-05T12:49:35.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.702+0000 7f50903b8640 1 -- 172.21.15.169:0/1819485008 wait complete. 2024-09-05T12:49:35.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.703+0000 7f50903b8640 1 Processor -- start 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.703+0000 7f50903b8640 1 -- start start 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.703+0000 7f50903b8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50881028c0 0x7f5088100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.703+0000 7f50903b8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f508810bda0 con 0x7f50881028c0 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.703+0000 7f508e154640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50881028c0 0x7f5088100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.703+0000 7f508e154640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50881028c0 0x7f5088100520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.169:53400/0 (socket says 172.21.15.169:53400) 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.703+0000 7f508e154640 1 -- 172.21.15.169:0/2454185960 learned_addr learned my addr 172.21.15.169:0/2454185960 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.704+0000 7f508e154640 1 -- 172.21.15.169:0/2454185960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5088102410 con 0x7f50881028c0 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.704+0000 7f508e154640 1 --2- 172.21.15.169:0/2454185960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50881028c0 0x7f5088100520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5084009230 tx=0x7f5084003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.704+0000 7f507f7fe640 1 -- 172.21.15.169:0/2454185960 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508403f070 con 0x7f50881028c0 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.704+0000 7f507f7fe640 1 -- 172.21.15.169:0/2454185960 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f508403bc80 con 0x7f50881028c0 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.704+0000 7f50903b8640 1 -- 172.21.15.169:0/2454185960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5088100a60 con 0x7f50881028c0 2024-09-05T12:49:35.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.704+0000 7f507f7fe640 1 -- 172.21.15.169:0/2454185960 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084035030 con 0x7f50881028c0 2024-09-05T12:49:35.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.704+0000 7f50903b8640 1 -- 172.21.15.169:0/2454185960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5088100f20 con 0x7f50881028c0 2024-09-05T12:49:35.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.705+0000 7f507f7fe640 1 -- 172.21.15.169:0/2454185960 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5084042070 con 0x7f50881028c0 2024-09-05T12:49:35.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.705+0000 7f50903b8640 1 -- 172.21.15.169:0/2454185960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f508806a470 con 0x7f50881028c0 2024-09-05T12:49:35.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.705+0000 7f507f7fe640 1 --2- 172.21.15.169:0/2454185960 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5074039060 0x7f507403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:35.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.705+0000 7f507f7fe640 1 -- 172.21.15.169:0/2454185960 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f508406cd60 con 0x7f50881028c0 2024-09-05T12:49:35.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.705+0000 7f508d953640 1 --2- 172.21.15.169:0/2454185960 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5074039060 0x7f507403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:35.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.706+0000 7f508d953640 1 --2- 172.21.15.169:0/2454185960 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5074039060 0x7f507403b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50780098c0 tx=0x7f5078006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:35.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.710+0000 7f507f7fe640 1 -- 172.21.15.169:0/2454185960 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f508404c350 con 0x7f50881028c0 2024-09-05T12:49:35.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.956+0000 7f50903b8640 1 -- 172.21.15.169:0/2454185960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5088101a50 con 0x7f50881028c0 2024-09-05T12:49:35.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.956+0000 7f507f7fe640 1 -- 172.21.15.169:0/2454185960 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f5084031e20 con 0x7f50881028c0 2024-09-05T12:49:35.958 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:49:35.958 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":1,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","modified":"2024-09-05T12:48:08.867322Z","created":"2024-09-05T12:48:08.867322Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-05T12:49:35.958 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 1 2024-09-05T12:49:35.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.959+0000 7f50903b8640 1 -- 172.21.15.169:0/2454185960 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5074039060 msgr2=0x7f507403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:35.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.959+0000 7f50903b8640 1 --2- 172.21.15.169:0/2454185960 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5074039060 0x7f507403b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50780098c0 tx=0x7f5078006db0 comp rx=0 tx=0).stop 2024-09-05T12:49:35.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.959+0000 7f50903b8640 1 -- 172.21.15.169:0/2454185960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50881028c0 msgr2=0x7f5088100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:35.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.959+0000 7f50903b8640 1 --2- 172.21.15.169:0/2454185960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50881028c0 0x7f5088100520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5084009230 tx=0x7f5084003d40 comp rx=0 tx=0).stop 2024-09-05T12:49:35.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.959+0000 7f50903b8640 1 -- 172.21.15.169:0/2454185960 shutdown_connections 2024-09-05T12:49:35.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.959+0000 7f50903b8640 1 --2- 172.21.15.169:0/2454185960 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5074039060 0x7f507403b520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:35.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.959+0000 7f50903b8640 1 --2- 172.21.15.169:0/2454185960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50881028c0 0x7f5088100520 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:35.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.959+0000 7f50903b8640 1 -- 172.21.15.169:0/2454185960 >> 172.21.15.169:0/2454185960 conn(0x7f50880fc280 msgr2=0x7f5088105680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:35.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.959+0000 7f50903b8640 1 -- 172.21.15.169:0/2454185960 shutdown_connections 2024-09-05T12:49:35.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:35.959+0000 7f50903b8640 1 -- 172.21.15.169:0/2454185960 wait complete. 2024-09-05T12:49:37.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:37 smithi169 systemd[1]: Started Ceph mon.c for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:49:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:36 smithi073 ceph-mon[30883]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:36 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/2454185960' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:37.561 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T12:49:37.561 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T12:49:37.838 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: mon.a calling monitor election 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: mon.c calling monitor election 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: monmap epoch 2 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: last_changed 2024-09-05T12:49:37.023196+0000 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: created 2024-09-05T12:48:08.867322+0000 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: min_mon_release 19 (squid) 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: election_strategy: 1 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: fsmap 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: mgrmap e13: x(active, since 38s) 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: overall HEALTH_OK 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:42.370 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:42.371 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:42.371 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: mon.a calling monitor election 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: mon.c calling monitor election 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:42.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: monmap epoch 2 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: last_changed 2024-09-05T12:49:37.023196+0000 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: created 2024-09-05T12:48:08.867322+0000 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: min_mon_release 19 (squid) 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: election_strategy: 1 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: fsmap 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: mgrmap e13: x(active, since 38s) 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: overall HEALTH_OK 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:42.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:42.516 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:42.516 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:42.516 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.606+0000 7f16b38f9640 1 -- 172.21.15.169:0/4002874805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1698003530 msgr2=0x7f16980059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.606+0000 7f16b38f9640 1 --2- 172.21.15.169:0/4002874805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1698003530 0x7f16980059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16ac102af0 tx=0x7f169c02c490 comp rx=0 tx=0).stop 2024-09-05T12:49:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.606+0000 7f16b38f9640 1 -- 172.21.15.169:0/4002874805 shutdown_connections 2024-09-05T12:49:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.606+0000 7f16b38f9640 1 --2- 172.21.15.169:0/4002874805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1698003530 0x7f16980059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.606+0000 7f16b38f9640 1 -- 172.21.15.169:0/4002874805 >> 172.21.15.169:0/4002874805 conn(0x7f16ac0fd320 msgr2=0x7f16ac0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.606+0000 7f16b38f9640 1 -- 172.21.15.169:0/4002874805 shutdown_connections 2024-09-05T12:49:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.606+0000 7f16b38f9640 1 -- 172.21.15.169:0/4002874805 wait complete. 2024-09-05T12:49:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.607+0000 7f16b38f9640 1 Processor -- start 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.607+0000 7f16b38f9640 1 -- start start 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.607+0000 7f16b38f9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1698003530 0x7f16ac1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.607+0000 7f16b38f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16ac197800 0x7f16ac19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.607+0000 7f16b38f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac109780 con 0x7f16ac197800 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.607+0000 7f16b38f9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac109600 con 0x7f1698003530 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b1695640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1698003530 0x7f16ac1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b1695640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1698003530 0x7f16ac1972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:60614/0 (socket says 172.21.15.169:60614) 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b1695640 1 -- 172.21.15.169:0/1441266333 learned_addr learned my addr 172.21.15.169:0/1441266333 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b0e94640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16ac197800 0x7f16ac19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b1695640 1 -- 172.21.15.169:0/1441266333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1698003530 msgr2=0x7f16ac1972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b1695640 1 -- 172.21.15.169:0/1441266333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1698003530 msgr2=0x7f16ac1972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T12:49:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b1695640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1698003530 0x7f16ac1972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T12:49:42.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b1695640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1698003530 0x7f16ac1972c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T12:49:42.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b0e94640 1 -- 172.21.15.169:0/1441266333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1698003530 msgr2=0x7f16ac1972c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T12:49:42.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b0e94640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1698003530 0x7f16ac1972c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:42.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b0e94640 1 -- 172.21.15.169:0/1441266333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ac197e20 con 0x7f16ac197800 2024-09-05T12:49:42.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.608+0000 7f16b0e94640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16ac197800 0x7f16ac19bb90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f16a800b3d0 tx=0x7f16a800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:42.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.609+0000 7f16a27fc640 1 -- 172.21.15.169:0/1441266333 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f16a8011630 con 0x7f16ac197800 2024-09-05T12:49:42.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.609+0000 7f16a27fc640 1 -- 172.21.15.169:0/1441266333 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16a8011cb0 con 0x7f16ac197800 2024-09-05T12:49:42.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.609+0000 7f16b38f9640 1 -- 172.21.15.169:0/1441266333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ac19c0d0 con 0x7f16ac197800 2024-09-05T12:49:42.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.609+0000 7f16a27fc640 1 -- 172.21.15.169:0/1441266333 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f16a8010df0 con 0x7f16ac197800 2024-09-05T12:49:42.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.609+0000 7f16b38f9640 1 -- 172.21.15.169:0/1441266333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ac19c610 con 0x7f16ac197800 2024-09-05T12:49:42.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.610+0000 7f16a27fc640 1 -- 172.21.15.169:0/1441266333 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f16a8018020 con 0x7f16ac197800 2024-09-05T12:49:42.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.610+0000 7f16a27fc640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1690038e50 0x7f169003b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:42.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.610+0000 7f16b38f9640 1 -- 172.21.15.169:0/1441266333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ac102da0 con 0x7f16ac197800 2024-09-05T12:49:42.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.610+0000 7f16a27fc640 1 -- 172.21.15.169:0/1441266333 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f16a804bc50 con 0x7f16ac197800 2024-09-05T12:49:42.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.610+0000 7f16b1695640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1690038e50 0x7f169003b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:42.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.611+0000 7f16b1695640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1690038e50 0x7f169003b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f169c0129e0 tx=0x7f169c02c9f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:42.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.616+0000 7f16a27fc640 1 -- 172.21.15.169:0/1441266333 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16a801f020 con 0x7f16ac197800 2024-09-05T12:49:42.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.850+0000 7f16b38f9640 1 -- 172.21.15.169:0/1441266333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f16ac190f90 con 0x7f16ac197800 2024-09-05T12:49:42.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.851+0000 7f16a27fc640 1 -- 172.21.15.169:0/1441266333 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f16a8017500 con 0x7f16ac197800 2024-09-05T12:49:42.853 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:49:42.853 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":2,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","modified":"2024-09-05T12:49:37.023196Z","created":"2024-09-05T12:48:08.867322Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-05T12:49:42.854 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 2 2024-09-05T12:49:42.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 -- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1690038e50 msgr2=0x7f169003b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:42.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1690038e50 0x7f169003b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f169c0129e0 tx=0x7f169c02c9f0 comp rx=0 tx=0).stop 2024-09-05T12:49:42.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 -- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16ac197800 msgr2=0x7f16ac19bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:42.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16ac197800 0x7f16ac19bb90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f16a800b3d0 tx=0x7f16a800b890 comp rx=0 tx=0).stop 2024-09-05T12:49:42.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 -- 172.21.15.169:0/1441266333 shutdown_connections 2024-09-05T12:49:42.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1690038e50 0x7f169003b310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:42.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16ac197800 0x7f16ac19bb90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:42.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 --2- 172.21.15.169:0/1441266333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1698003530 0x7f16ac1972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:42.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 -- 172.21.15.169:0/1441266333 >> 172.21.15.169:0/1441266333 conn(0x7f16ac0fd320 msgr2=0x7f16ac0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:42.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 -- 172.21.15.169:0/1441266333 shutdown_connections 2024-09-05T12:49:42.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:42.853+0000 7f16b38f9640 1 -- 172.21.15.169:0/1441266333 wait complete. 2024-09-05T12:49:43.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:43 smithi169 ceph-mon[34823]: Deploying daemon mon.b on smithi162 2024-09-05T12:49:43.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:43 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/1441266333' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:43.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:43 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:43 smithi073 ceph-mon[30883]: Deploying daemon mon.b on smithi162 2024-09-05T12:49:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:43 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/1441266333' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:43 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:44.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:44 smithi169 ceph-mon[34823]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:44.420 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T12:49:44.421 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T12:49:44.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:44 smithi073 ceph-mon[30883]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:44.676 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.073+0000 7fc064a83640 1 -- 172.21.15.169:0/822300756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc060106630 msgr2=0x7fc060106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.073+0000 7fc064a83640 1 --2- 172.21.15.169:0/822300756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc060106630 0x7fc060106a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc050009880 tx=0x7fc05002a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.073+0000 7fc064a83640 1 -- 172.21.15.169:0/822300756 shutdown_connections 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.073+0000 7fc064a83640 1 --2- 172.21.15.169:0/822300756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc060106630 0x7fc060106a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.073+0000 7fc064a83640 1 -- 172.21.15.169:0/822300756 >> 172.21.15.169:0/822300756 conn(0x7fc0600fc220 msgr2=0x7fc0600fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.073+0000 7fc064a83640 1 -- 172.21.15.169:0/822300756 shutdown_connections 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.073+0000 7fc064a83640 1 -- 172.21.15.169:0/822300756 wait complete. 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.074+0000 7fc064a83640 1 Processor -- start 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.074+0000 7fc064a83640 1 -- start start 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.074+0000 7fc064a83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc060106630 0x7fc060198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.074+0000 7fc064a83640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc060198750 0x7fc060198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.074+0000 7fc064a83640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc06010ac60 con 0x7fc060106630 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.074+0000 7fc064a83640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc06010aae0 con 0x7fc060198750 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05dd9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc060198750 0x7fc060198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05dd9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc060198750 0x7fc060198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:60618/0 (socket says 172.21.15.169:60618) 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05dd9b640 1 -- 172.21.15.169:0/215016572 learned_addr learned my addr 172.21.15.169:0/215016572 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05dd9b640 1 -- 172.21.15.169:0/215016572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc060198750 msgr2=0x7fc060198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05dd9b640 1 -- 172.21.15.169:0/215016572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc060198750 msgr2=0x7fc060198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05dd9b640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc060198750 0x7fc060198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05e59c640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc060106630 0x7fc060198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05dd9b640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc060198750 0x7fc060198bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05e59c640 1 -- 172.21.15.169:0/215016572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc060198750 msgr2=0x7fc060198bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05e59c640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc060198750 0x7fc060198bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05e59c640 1 -- 172.21.15.169:0/215016572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0601a1280 con 0x7fc060106630 2024-09-05T12:49:45.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.075+0000 7fc05e59c640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc060106630 0x7fc060198210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc050000c00 tx=0x7fc050032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:45.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.076+0000 7fc0577fe640 1 -- 172.21.15.169:0/215016572 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc050035070 con 0x7fc060106630 2024-09-05T12:49:45.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.076+0000 7fc064a83640 1 -- 172.21.15.169:0/215016572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0601a1450 con 0x7fc060106630 2024-09-05T12:49:45.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.076+0000 7fc0577fe640 1 -- 172.21.15.169:0/215016572 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc050032e40 con 0x7fc060106630 2024-09-05T12:49:45.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.076+0000 7fc0577fe640 1 -- 172.21.15.169:0/215016572 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc05003bc30 con 0x7fc060106630 2024-09-05T12:49:45.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.076+0000 7fc064a83640 1 -- 172.21.15.169:0/215016572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0601a1900 con 0x7fc060106630 2024-09-05T12:49:45.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.077+0000 7fc0577fe640 1 -- 172.21.15.169:0/215016572 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc050042030 con 0x7fc060106630 2024-09-05T12:49:45.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.077+0000 7fc064a83640 1 -- 172.21.15.169:0/215016572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc060101ca0 con 0x7fc060106630 2024-09-05T12:49:45.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.077+0000 7fc0577fe640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc04c038e00 0x7fc04c03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:45.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.077+0000 7fc0577fe640 1 -- 172.21.15.169:0/215016572 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc050040070 con 0x7fc060106630 2024-09-05T12:49:45.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.077+0000 7fc05dd9b640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc04c038e00 0x7fc04c03b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:45.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.077+0000 7fc05dd9b640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc04c038e00 0x7fc04c03b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc048009100 tx=0x7fc048008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:45.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.082+0000 7fc0577fe640 1 -- 172.21.15.169:0/215016572 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc05003b510 con 0x7fc060106630 2024-09-05T12:49:45.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.310+0000 7fc064a83640 1 -- 172.21.15.169:0/215016572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc0601a1c70 con 0x7fc060106630 2024-09-05T12:49:45.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.311+0000 7fc0577fe640 1 -- 172.21.15.169:0/215016572 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fc0500433c0 con 0x7fc060106630 2024-09-05T12:49:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:49:45.314 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":2,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","modified":"2024-09-05T12:49:37.023196Z","created":"2024-09-05T12:48:08.867322Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-05T12:49:45.314 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 2 2024-09-05T12:49:45.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 -- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc04c038e00 msgr2=0x7fc04c03b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:45.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc04c038e00 0x7fc04c03b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc048009100 tx=0x7fc048008040 comp rx=0 tx=0).stop 2024-09-05T12:49:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 -- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc060106630 msgr2=0x7fc060198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc060106630 0x7fc060198210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc050000c00 tx=0x7fc050032c50 comp rx=0 tx=0).stop 2024-09-05T12:49:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 -- 172.21.15.169:0/215016572 shutdown_connections 2024-09-05T12:49:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc04c038e00 0x7fc04c03b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc060198750 0x7fc060198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 --2- 172.21.15.169:0/215016572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc060106630 0x7fc060198210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 -- 172.21.15.169:0/215016572 >> 172.21.15.169:0/215016572 conn(0x7fc0600fc220 msgr2=0x7fc0600fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 -- 172.21.15.169:0/215016572 shutdown_connections 2024-09-05T12:49:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:45.313+0000 7fc064a83640 1 -- 172.21.15.169:0/215016572 wait complete. 2024-09-05T12:49:45.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:45 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/215016572' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:45.693 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 podman[34201]: 2024-09-05 12:49:45.692300184 +0000 UTC m=+0.280625737 container init af79306ec132869658a37b5954efa133432ea169a3e6210e8cf383432bb9a53f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T12:49:45.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:45 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/215016572' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:46.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 podman[34201]: 2024-09-05 12:49:45.695559041 +0000 UTC m=+0.283884604 container start af79306ec132869658a37b5954efa133432ea169a3e6210e8cf383432bb9a53f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-05T12:49:46.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: set uid:gid to 167:167 (ceph:ceph) 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: ceph version 19.1.1-261-ge856d6b2 (e856d6b2462509a377ef39149a05475ed006ebac) squid (stable), process ceph-mon, pid 2 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: pidfile_write: ignore empty --pid-file 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: load: jerasure load: lrc 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: RocksDB version: 7.9.2 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Git sha 0 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Compile date 2024-09-05 09:22:07 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: DB SUMMARY 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: DB Session ID: 2CPHO2POH2WLFPGCZ2OP 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: CURRENT file: CURRENT 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: IDENTITY file: IDENTITY 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-05T12:49:46.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.error_if_exists: 0 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.create_if_missing: 0 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.paranoid_checks: 1 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.env: 0x55cd9a5dc940 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.fs: PosixFileSystem 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.info_log: 0x55cd9b6436e0 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_file_opening_threads: 16 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.statistics: (nil) 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.use_fsync: 0 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_log_file_size: 0 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-05T12:49:46.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.keep_log_file_num: 1000 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.recycle_log_file_num: 0 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.allow_fallocate: 1 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.allow_mmap_reads: 0 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.allow_mmap_writes: 0 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.use_direct_reads: 0 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.create_missing_column_families: 0 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.db_log_dir: 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.wal_dir: 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-05T12:49:46.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.advise_random_on_open: 1 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.db_write_buffer_size: 0 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.write_buffer_manager: 0x55cd9b652dc0 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.rate_limiter: (nil) 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.wal_recovery_mode: 2 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.enable_thread_tracking: 0 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.enable_pipelined_write: 0 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.unordered_write: 0 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-05T12:49:46.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.row_cache: None 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.wal_filter: None 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.allow_ingest_behind: 0 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.two_write_queues: 0 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.manual_wal_flush: 0 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.wal_compression: 0 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.atomic_flush: 0 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-05T12:49:46.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.log_readahead_size: 0 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.best_efforts_recovery: 0 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.allow_data_in_errors: 0 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.db_host_id: __hostname__ 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_background_jobs: 2 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_background_compactions: -1 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_subcompactions: 1 2024-09-05T12:49:46.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-05T12:49:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-05T12:49:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-05T12:49:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_total_wal_size: 0 2024-09-05T12:49:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-05T12:49:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-05T12:49:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-05T12:49:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-05T12:49:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_open_files: -1 2024-09-05T12:49:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bytes_per_sync: 0 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_readahead_size: 0 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_background_flushes: -1 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Compression algorithms supported: 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: kZSTD supported: 0 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: kXpressCompression supported: 0 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: kBZip2Compression supported: 0 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: kLZ4Compression supported: 1 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: kZlibCompression supported: 1 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: kLZ4HCCompression supported: 1 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: kSnappyCompression supported: 1 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-05T12:49:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.merge_operator: 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_filter: None 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_filter_factory: None 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.sst_partitioner_factory: None 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cd9b643320) 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout: cache_index_and_filter_blocks: 1 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout: pin_top_level_index_and_filter: 1 2024-09-05T12:49:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_type: 0 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: data_block_index_type: 0 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_shortening: 1 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: checksum: 4 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: no_block_cache: 0 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache: 0x55cd9b6371f0 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_name: BinnedLRUCache 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_options: 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: capacity : 536870912 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: num_shard_bits : 4 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: strict_capacity_limit : 0 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: high_pri_pool_ratio: 0.000 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_compressed: (nil) 2024-09-05T12:49:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout: persistent_cache: (nil) 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_size: 4096 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_size_deviation: 10 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_restart_interval: 16 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_block_restart_interval: 1 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: metadata_block_size: 4096 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: partition_filters: 0 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: use_delta_encoding: 1 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: filter_policy: bloomfilter 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: whole_key_filtering: 1 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: verify_compression: 0 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: read_amp_bytes_per_bit: 0 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: format_version: 5 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: enable_index_compression: 1 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_align: 0 2024-09-05T12:49:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout: max_auto_readahead_size: 262144 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout: prepopulate_block_cache: 0 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout: initial_auto_readahead_size: 8192 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout: num_file_reads_for_auto_readahead: 2 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.write_buffer_size: 33554432 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_write_buffer_number: 2 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compression: NoCompression 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bottommost_compression: Disabled 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.prefix_extractor: nullptr 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.num_levels: 7 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-05T12:49:46.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compression_opts.level: 32767 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compression_opts.strategy: 0 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-05T12:49:46.125 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compression_opts.enabled: false 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.target_file_size_base: 67108864 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-05T12:49:46.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.arena_block_size: 1048576 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.disable_auto_compactions: 0 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-05T12:49:46.127 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.inplace_update_support: 0 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.bloom_locality: 0 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.max_successive_merges: 0 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.paranoid_file_checks: 0 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.force_consistency_checks: 1 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.report_bg_io_stats: 0 2024-09-05T12:49:46.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.ttl: 2592000 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.enable_blob_files: false 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.min_blob_size: 0 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.blob_file_size: 268435456 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.blob_file_starting_level: 0 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-05T12:49:46.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4fff3a9d-34eb-498c-8ea9-994258b14277 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725540585722605, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725540585723018, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725540585, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4fff3a9d-34eb-498c-8ea9-994258b14277", "db_session_id": "2CPHO2POH2WLFPGCZ2OP", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725540585723111, "job": 1, "event": "recovery_finished"} 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cd9b664e00 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: DB pointer 0x55cd9b760000 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-05T12:49:46.130 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** DB Stats ** 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-05T12:49:46.131 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-05T12:49:46.132 INFO:journalctl@ceph.mon.b.smithi162.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-05T12:49:46.133 INFO:journalctl@ceph.mon.b.smithi162.stdout: Block cache BinnedLRUCache@0x55cd9b6371f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-05T12:49:46.133 INFO:journalctl@ceph.mon.b.smithi162.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-05T12:49:46.133 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-05T12:49:46.133 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-05T12:49:46.133 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-05T12:49:46.133 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: using public_addr v2:172.21.15.162:0/0 -> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-05T12:49:46.133 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: starting mon.b rank -1 at public addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] at bind addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(???) e0 preinit fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).mds e1 new map 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout: e1 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout: btime 2024-09-05T12:48:11:856233+0000 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout: legacy client fscid: -1 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout: No filesystems configured 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-05T12:49:46.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1052471002' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1052471002' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: Updating smithi169:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:46.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: Updating smithi169:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi073:172.21.15.73=a;smithi162:172.21.15.162=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: Saving service mon spec with placement smithi073:172.21.15.73=a;smithi162:172.21.15.162=b;smithi169:172.21.15.169=c;count:3 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: Deploying daemon mon.c on smithi169 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/499987677' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/2454185960' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:46.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.a calling monitor election 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.c calling monitor election 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: monmap epoch 2 2024-09-05T12:49:46.138 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: last_changed 2024-09-05T12:49:37.023196+0000 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: created 2024-09-05T12:48:08.867322+0000 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: min_mon_release 19 (squid) 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: election_strategy: 1 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: fsmap 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mgrmap e13: x(active, since 38s) 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: overall HEALTH_OK 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:46.139 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: Deploying daemon mon.b on smithi162 2024-09-05T12:49:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/1441266333' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/215016572' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 ceph-mon[34220]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-05T12:49:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 bash[34201]: af79306ec132869658a37b5954efa133432ea169a3e6210e8cf383432bb9a53f 2024-09-05T12:49:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:45 smithi162 systemd[1]: Started Ceph mon.b for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:49:46.926 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T12:49:46.926 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T12:49:47.174 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:49:50.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.780+0000 7f8d60301640 1 -- 172.21.15.169:0/1563900673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d44003530 msgr2=0x7f8d440059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:50.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.780+0000 7f8d60301640 1 --2- 172.21.15.169:0/1563900673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d44003530 0x7f8d440059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d58102af0 tx=0x7f8d5402c150 comp rx=0 tx=0).stop 2024-09-05T12:49:50.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.780+0000 7f8d60301640 1 -- 172.21.15.169:0/1563900673 shutdown_connections 2024-09-05T12:49:50.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.780+0000 7f8d60301640 1 --2- 172.21.15.169:0/1563900673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d44003530 0x7f8d440059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:50.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.780+0000 7f8d60301640 1 -- 172.21.15.169:0/1563900673 >> 172.21.15.169:0/1563900673 conn(0x7f8d580fd320 msgr2=0x7f8d580ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:50.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.780+0000 7f8d60301640 1 -- 172.21.15.169:0/1563900673 shutdown_connections 2024-09-05T12:49:50.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.780+0000 7f8d60301640 1 -- 172.21.15.169:0/1563900673 wait complete. 2024-09-05T12:49:50.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.781+0000 7f8d60301640 1 Processor -- start 2024-09-05T12:49:50.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.781+0000 7f8d60301640 1 -- start start 2024-09-05T12:49:50.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.781+0000 7f8d60301640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d44003530 0x7f8d58197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:50.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.781+0000 7f8d60301640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d58197860 0x7f8d5819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:50.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.781+0000 7f8d60301640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d5819c130 0x7f8d5819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:50.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d60301640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8d58109780 con 0x7f8d44003530 2024-09-05T12:49:50.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d60301640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8d58109600 con 0x7f8d58197860 2024-09-05T12:49:50.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d60301640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8d58109900 con 0x7f8d5819c130 2024-09-05T12:49:50.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e89e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d5819c130 0x7f8d5819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:50.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e09d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d44003530 0x7f8d58197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e89e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d5819c130 0x7f8d5819c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:56826/0 (socket says 172.21.15.169:56826) 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e09d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d44003530 0x7f8d58197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.169:42574/0 (socket says 172.21.15.169:42574) 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e89e640 1 -- 172.21.15.169:0/2989262155 learned_addr learned my addr 172.21.15.169:0/2989262155 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e89e640 1 -- 172.21.15.169:0/2989262155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d5819c130 msgr2=0x7f8d5819c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5d89c640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d58197860 0x7f8d5819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e89e640 1 -- 172.21.15.169:0/2989262155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d5819c130 msgr2=0x7f8d5819c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e89e640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d5819c130 0x7f8d5819c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e89e640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d5819c130 0x7f8d5819c5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5d89c640 1 -- 172.21.15.169:0/2989262155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d58197860 msgr2=0x7f8d5819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5d89c640 1 -- 172.21.15.169:0/2989262155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d58197860 msgr2=0x7f8d5819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5d89c640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d58197860 0x7f8d5819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5d89c640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d58197860 0x7f8d5819bbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T12:49:50.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e09d640 1 -- 172.21.15.169:0/2989262155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d5819c130 msgr2=0x7f8d5819c5e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e09d640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d5819c130 0x7f8d5819c5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e09d640 1 -- 172.21.15.169:0/2989262155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d58197860 msgr2=0x7f8d5819bbf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e09d640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d58197860 0x7f8d5819bbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.782+0000 7f8d5e09d640 1 -- 172.21.15.169:0/2989262155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d581a3ea0 con 0x7f8d44003530 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.783+0000 7f8d5e09d640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d44003530 0x7f8d58197320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d54036000 tx=0x7f8d54004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.783+0000 7f8d4f7fe640 1 -- 172.21.15.169:0/2989262155 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54032040 con 0x7f8d44003530 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.783+0000 7f8d4f7fe640 1 -- 172.21.15.169:0/2989262155 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d54043070 con 0x7f8d44003530 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.783+0000 7f8d4f7fe640 1 -- 172.21.15.169:0/2989262155 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54036670 con 0x7f8d44003530 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.783+0000 7f8d60301640 1 -- 172.21.15.169:0/2989262155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d581a4070 con 0x7f8d44003530 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.783+0000 7f8d60301640 1 -- 172.21.15.169:0/2989262155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d581a4530 con 0x7f8d44003530 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.784+0000 7f8d4f7fe640 1 -- 172.21.15.169:0/2989262155 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8d54036810 con 0x7f8d44003530 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.784+0000 7f8d4f7fe640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8d3c0394f0 0x7f8d3c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.784+0000 7f8d4f7fe640 1 -- 172.21.15.169:0/2989262155 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8d5406ee80 con 0x7f8d44003530 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.784+0000 7f8d5d89c640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8d3c0394f0 0x7f8d3c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:50.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.784+0000 7f8d60301640 1 -- 172.21.15.169:0/2989262155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5810a8b0 con 0x7f8d44003530 2024-09-05T12:49:50.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.785+0000 7f8d5d89c640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8d3c0394f0 0x7f8d3c03b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d48006fd0 tx=0x7f8d48008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:50.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:50.789+0000 7f8d4f7fe640 1 -- 172.21.15.169:0/2989262155 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d54045bd0 con 0x7f8d44003530 2024-09-05T12:49:51.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.034+0000 7f8d60301640 1 -- 172.21.15.169:0/2989262155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8d581a4760 con 0x7f8d44003530 2024-09-05T12:49:51.037 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:49:51.037 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.037 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: mon.a calling monitor election 2024-09-05T12:49:51.037 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: mon.c calling monitor election 2024-09-05T12:49:51.037 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:51.037 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:51.037 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.037 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: mon.b calling monitor election 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: monmap epoch 3 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: last_changed 2024-09-05T12:49:45.748567+0000 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: created 2024-09-05T12:48:08.867322+0000 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: min_mon_release 19 (squid) 2024-09-05T12:49:51.038 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: election_strategy: 1 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: fsmap 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: mgrmap e13: x(active, since 46s) 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: overall HEALTH_OK 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.039 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.035+0000 7f8d4f7fe640 1 -- 172.21.15.169:0/2989262155 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7f8d5403d380 con 0x7f8d44003530 2024-09-05T12:49:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:49:51.040 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":3,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","modified":"2024-09-05T12:49:45.748567Z","created":"2024-09-05T12:48:08.867322Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 3 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.037+0000 7f8d60301640 1 -- 172.21.15.169:0/2989262155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8d3c0394f0 msgr2=0x7f8d3c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.037+0000 7f8d60301640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8d3c0394f0 0x7f8d3c03b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d48006fd0 tx=0x7f8d48008040 comp rx=0 tx=0).stop 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.037+0000 7f8d60301640 1 -- 172.21.15.169:0/2989262155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d44003530 msgr2=0x7f8d58197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.037+0000 7f8d60301640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d44003530 0x7f8d58197320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d54036000 tx=0x7f8d54004d30 comp rx=0 tx=0).stop 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.037+0000 7f8d60301640 1 -- 172.21.15.169:0/2989262155 shutdown_connections 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.037+0000 7f8d60301640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8d3c0394f0 0x7f8d3c03b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.037+0000 7f8d60301640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d5819c130 0x7f8d5819c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.037+0000 7f8d60301640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d58197860 0x7f8d5819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.037+0000 7f8d60301640 1 --2- 172.21.15.169:0/2989262155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d44003530 0x7f8d58197320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:51.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.037+0000 7f8d60301640 1 -- 172.21.15.169:0/2989262155 >> 172.21.15.169:0/2989262155 conn(0x7f8d580fd320 msgr2=0x7f8d580ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:51.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.038+0000 7f8d60301640 1 -- 172.21.15.169:0/2989262155 shutdown_connections 2024-09-05T12:49:51.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:51.038+0000 7f8d60301640 1 -- 172.21.15.169:0/2989262155 wait complete. 2024-09-05T12:49:51.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:49:51.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: mon.a calling monitor election 2024-09-05T12:49:51.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: mon.c calling monitor election 2024-09-05T12:49:51.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:51.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:51.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: mon.b calling monitor election 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: monmap epoch 3 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: last_changed 2024-09-05T12:49:45.748567+0000 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: created 2024-09-05T12:48:08.867322+0000 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: min_mon_release 19 (squid) 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: election_strategy: 1 2024-09-05T12:49:51.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-05T12:49:51.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-05T12:49:51.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-05T12:49:51.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: fsmap 2024-09-05T12:49:51.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T12:49:51.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: mgrmap e13: x(active, since 46s) 2024-09-05T12:49:51.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: overall HEALTH_OK 2024-09-05T12:49:51.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:49:51.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: mon.a calling monitor election 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: mon.c calling monitor election 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: mon.b calling monitor election 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: monmap epoch 3 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: last_changed 2024-09-05T12:49:45.748567+0000 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: created 2024-09-05T12:48:08.867322+0000 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: min_mon_release 19 (squid) 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: election_strategy: 1 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: fsmap 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: mgrmap e13: x(active, since 46s) 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: overall HEALTH_OK 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.266 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:51.622 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-05T12:49:51.622 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph config generate-minimal-conf 2024-09-05T12:49:51.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:51 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:51.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:51 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/2989262155' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:51.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:51 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:51.878 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:49:51.999 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:51 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:51.999 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:51 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/2989262155' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:51.999 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:51 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:52.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:51 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:52.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:51 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/2989262155' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T12:49:52.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:51 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:49:52.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.341+0000 7f41c5f31640 1 -- 172.21.15.73:0/3915497950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0107660 msgr2=0x7f41c0107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:52.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.341+0000 7f41c5f31640 1 --2- 172.21.15.73:0/3915497950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0107660 0x7f41c0107a40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009880 tx=0x7f41b002a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:52.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.341+0000 7f41c5f31640 1 -- 172.21.15.73:0/3915497950 shutdown_connections 2024-09-05T12:49:52.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.341+0000 7f41c5f31640 1 --2- 172.21.15.73:0/3915497950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0107660 0x7f41c0107a40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:52.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.341+0000 7f41c5f31640 1 -- 172.21.15.73:0/3915497950 >> 172.21.15.73:0/3915497950 conn(0x7f41c00fd290 msgr2=0x7f41c00ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:52.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.341+0000 7f41c5f31640 1 -- 172.21.15.73:0/3915497950 shutdown_connections 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.341+0000 7f41c5f31640 1 -- 172.21.15.73:0/3915497950 wait complete. 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41c5f31640 1 Processor -- start 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41c5f31640 1 -- start start 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41c5f31640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c0107660 0x7f41c0197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41c5f31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c01978c0 0x7f41c019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41c5f31640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c019c190 0x7f41c019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41c5f31640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f41c010bc40 con 0x7f41c019c190 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41c5f31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41c010bac0 con 0x7f41c01978c0 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41c5f31640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41c010bdc0 con 0x7f41c0107660 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41bffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c019c190 0x7f41c019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41bffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c019c190 0x7f41c019c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46820/0 (socket says 172.21.15.73:46820) 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.342+0000 7f41bffff640 1 -- 172.21.15.73:0/1615087150 learned_addr learned my addr 172.21.15.73:0/1615087150 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:49:52.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41bf7fe640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c0107660 0x7f41c0197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41beffd640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c01978c0 0x7f41c019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41bffff640 1 -- 172.21.15.73:0/1615087150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c0107660 msgr2=0x7f41c0197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41bffff640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c0107660 0x7f41c0197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41bffff640 1 -- 172.21.15.73:0/1615087150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c01978c0 msgr2=0x7f41c019bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41bffff640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c01978c0 0x7f41c019bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41bffff640 1 -- 172.21.15.73:0/1615087150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c01a3f00 con 0x7f41c019c190 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41beffd640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c01978c0 0x7f41c019bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41bffff640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c019c190 0x7f41c019c640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f41b800ba50 tx=0x7f41b800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41bcff9640 1 -- 172.21.15.73:0/1615087150 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8019070 con 0x7f41c019c190 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41bcff9640 1 -- 172.21.15.73:0/1615087150 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41b800cbe0 con 0x7f41c019c190 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41c5f31640 1 -- 172.21.15.73:0/1615087150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c01a4130 con 0x7f41c019c190 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41bcff9640 1 -- 172.21.15.73:0/1615087150 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b80076a0 con 0x7f41c019c190 2024-09-05T12:49:52.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.343+0000 7f41c5f31640 1 -- 172.21.15.73:0/1615087150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c01a4670 con 0x7f41c019c190 2024-09-05T12:49:52.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.344+0000 7f41bcff9640 1 -- 172.21.15.73:0/1615087150 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f41b801c070 con 0x7f41c019c190 2024-09-05T12:49:52.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.344+0000 7f41c5f31640 1 -- 172.21.15.73:0/1615087150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c0107ac0 con 0x7f41c019c190 2024-09-05T12:49:52.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.344+0000 7f41bcff9640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f41a80394f0 0x7f41a803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:52.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.344+0000 7f41bcff9640 1 -- 172.21.15.73:0/1615087150 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f41b804ba90 con 0x7f41c019c190 2024-09-05T12:49:52.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.344+0000 7f41bf7fe640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f41a80394f0 0x7f41a803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:52.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.345+0000 7f41bf7fe640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f41a80394f0 0x7f41a803b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f41b00096c0 tx=0x7f41b0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:52.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.349+0000 7f41bcff9640 1 -- 172.21.15.73:0/1615087150 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41b80112a0 con 0x7f41c019c190 2024-09-05T12:49:52.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.538+0000 7f41c5f31640 1 -- 172.21.15.73:0/1615087150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f41c01a4a60 con 0x7f41c019c190 2024-09-05T12:49:52.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.539+0000 7f41bcff9640 1 -- 172.21.15.73:0/1615087150 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f41b800e090 con 0x7f41c019c190 2024-09-05T12:49:52.540 INFO:teuthology.orchestra.run.smithi073.stdout:# minimal ceph.conf for febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:52.540 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-09-05T12:49:52.540 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:49:52.540 INFO:teuthology.orchestra.run.smithi073.stdout: mon_host = [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] 2024-09-05T12:49:52.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 -- 172.21.15.73:0/1615087150 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f41a80394f0 msgr2=0x7f41a803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:52.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f41a80394f0 0x7f41a803b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f41b00096c0 tx=0x7f41b0005a20 comp rx=0 tx=0).stop 2024-09-05T12:49:52.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 -- 172.21.15.73:0/1615087150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c019c190 msgr2=0x7f41c019c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:52.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c019c190 0x7f41c019c640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f41b800ba50 tx=0x7f41b800bf10 comp rx=0 tx=0).stop 2024-09-05T12:49:52.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 -- 172.21.15.73:0/1615087150 shutdown_connections 2024-09-05T12:49:52.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f41a80394f0 0x7f41a803b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:52.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c019c190 0x7f41c019c640 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:52.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c01978c0 0x7f41c019bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:52.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 --2- 172.21.15.73:0/1615087150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c0107660 0x7f41c0197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:52.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 -- 172.21.15.73:0/1615087150 >> 172.21.15.73:0/1615087150 conn(0x7f41c00fd290 msgr2=0x7f41c00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:52.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 -- 172.21.15.73:0/1615087150 shutdown_connections 2024-09-05T12:49:52.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:49:52.541+0000 7f41c5f31640 1 -- 172.21.15.73:0/1615087150 wait complete. 2024-09-05T12:49:53.252 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.252 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:52 smithi073 ceph-mon[30883]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:53.252 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.252 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.252 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.252 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:53.252 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:53.252 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:52 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1615087150' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:53.281 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-05T12:49:53.282 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:49:53.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.conf 2024-09-05T12:49:53.308 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:49:53.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T12:49:53.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:52 smithi162 ceph-mon[34220]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:52 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1615087150' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:53.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:52 smithi169 ceph-mon[34823]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:53.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:53.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:53.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:53.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:52 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1615087150' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:53.372 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:49:53.372 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-09-05T12:49:53.400 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:49:53.400 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T12:49:53.465 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:49:53.465 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.conf 2024-09-05T12:49:53.493 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:49:53.493 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T12:49:53.558 INFO:tasks.cephadm:Adding mgr.x on smithi073 2024-09-05T12:49:53.558 INFO:tasks.cephadm:Adding mgr.y on smithi162 2024-09-05T12:49:53.558 INFO:tasks.cephadm:Adding mgr.z on smithi169 2024-09-05T12:49:53.559 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch apply mgr '3;smithi073=x;smithi162=y;smithi169=z' 2024-09-05T12:49:53.836 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:49:54.200 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-05T12:49:54.200 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: Updating smithi073:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: Updating smithi169:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: Updating smithi162:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:54.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T12:49:54.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:54.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.235 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-05T12:49:54.235 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-05T12:49:54.235 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-05T12:49:54.235 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: Updating smithi073:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:54.235 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: Updating smithi169:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:54.235 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: Updating smithi162:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:54.237 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T12:49:54.237 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:54.237 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.232+0000 7f5f98327640 1 -- 172.21.15.169:0/2855921199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f901005f0 msgr2=0x7f5f901009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:54.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.232+0000 7f5f98327640 1 --2- 172.21.15.169:0/2855921199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f901005f0 0x7f5f901009f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009880 tx=0x7f5f8c02a5d0 comp rx=0 tx=0).stop 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.232+0000 7f5f98327640 1 -- 172.21.15.169:0/2855921199 shutdown_connections 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.232+0000 7f5f98327640 1 --2- 172.21.15.169:0/2855921199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f901005f0 0x7f5f901009f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.232+0000 7f5f98327640 1 -- 172.21.15.169:0/2855921199 >> 172.21.15.169:0/2855921199 conn(0x7f5f900fbda0 msgr2=0x7f5f900fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.232+0000 7f5f98327640 1 -- 172.21.15.169:0/2855921199 shutdown_connections 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.232+0000 7f5f98327640 1 -- 172.21.15.169:0/2855921199 wait complete. 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f98327640 1 Processor -- start 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f98327640 1 -- start start 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f98327640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f901005f0 0x7f5f9006afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f98327640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f90199d10 0x7f5f9019c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f98327640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f9019c690 0x7f5f9019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f98327640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901066e0 con 0x7f5f90199d10 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f98327640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f90106560 con 0x7f5f9019c690 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f98327640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5f90106860 con 0x7f5f901005f0 2024-09-05T12:49:54.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f960c3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f901005f0 0x7f5f9006afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f960c3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f901005f0 0x7f5f9006afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:56832/0 (socket says 172.21.15.169:56832) 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f960c3640 1 -- 172.21.15.169:0/2233599505 learned_addr learned my addr 172.21.15.169:0/2233599505 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.233+0000 7f5f958c2640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f90199d10 0x7f5f9019c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f968c4640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f9019c690 0x7f5f9019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f960c3640 1 -- 172.21.15.169:0/2233599505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f9019c690 msgr2=0x7f5f9019eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f960c3640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f9019c690 0x7f5f9019eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f960c3640 1 -- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f90199d10 msgr2=0x7f5f9019c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f960c3640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f90199d10 0x7f5f9019c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f960c3640 1 -- 172.21.15.169:0/2233599505 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9019f3e0 con 0x7f5f901005f0 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f958c2640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f90199d10 0x7f5f9019c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f960c3640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f901005f0 0x7f5f9006afb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c031610 tx=0x7f5f8c0043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f877fe640 1 -- 172.21.15.169:0/2233599505 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c03f030 con 0x7f5f901005f0 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f877fe640 1 -- 172.21.15.169:0/2233599505 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f8c003ce0 con 0x7f5f901005f0 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f98327640 1 -- 172.21.15.169:0/2233599505 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9019f670 con 0x7f5f901005f0 2024-09-05T12:49:54.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f877fe640 1 -- 172.21.15.169:0/2233599505 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c035070 con 0x7f5f901005f0 2024-09-05T12:49:54.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.234+0000 7f5f98327640 1 -- 172.21.15.169:0/2233599505 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9019fc20 con 0x7f5f901005f0 2024-09-05T12:49:54.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.235+0000 7f5f877fe640 1 -- 172.21.15.169:0/2233599505 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5f8c042030 con 0x7f5f901005f0 2024-09-05T12:49:54.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.235+0000 7f5f98327640 1 -- 172.21.15.169:0/2233599505 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9018f4a0 con 0x7f5f901005f0 2024-09-05T12:49:54.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.235+0000 7f5f877fe640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f7c0394f0 0x7f5f7c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:49:54.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.235+0000 7f5f877fe640 1 -- 172.21.15.169:0/2233599505 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5f8c06ca90 con 0x7f5f901005f0 2024-09-05T12:49:54.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.235+0000 7f5f958c2640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f7c0394f0 0x7f5f7c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:49:54.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.236+0000 7f5f958c2640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f7c0394f0 0x7f5f7c03b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5f9006b510 tx=0x7f5f80009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:49:54.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.240+0000 7f5f877fe640 1 -- 172.21.15.169:0/2233599505 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f8c03ac70 con 0x7f5f901005f0 2024-09-05T12:49:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-05T12:49:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-05T12:49:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-05T12:49:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: Updating smithi073:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: Updating smithi169:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: Updating smithi162:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T12:49:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T12:49:54.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:54.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:54.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.418+0000 7f5f98327640 1 -- 172.21.15.169:0/2233599505 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi162=y;smithi169=z", "target": ["mon-mgr", ""]}) -- 0x7f5f900626c0 con 0x7f5f7c0394f0 2024-09-05T12:49:54.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.423+0000 7f5f877fe640 1 -- 172.21.15.169:0/2233599505 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5f900626c0 con 0x7f5f7c0394f0 2024-09-05T12:49:54.425 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mgr update... 2024-09-05T12:49:54.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.425+0000 7f5f98327640 1 -- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f7c0394f0 msgr2=0x7f5f7c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:54.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.425+0000 7f5f98327640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f7c0394f0 0x7f5f7c03b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5f9006b510 tx=0x7f5f80009190 comp rx=0 tx=0).stop 2024-09-05T12:49:54.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.425+0000 7f5f98327640 1 -- 172.21.15.169:0/2233599505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f901005f0 msgr2=0x7f5f9006afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:49:54.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.425+0000 7f5f98327640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f901005f0 0x7f5f9006afb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c031610 tx=0x7f5f8c0043c0 comp rx=0 tx=0).stop 2024-09-05T12:49:54.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.425+0000 7f5f98327640 1 -- 172.21.15.169:0/2233599505 shutdown_connections 2024-09-05T12:49:54.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.425+0000 7f5f98327640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f7c0394f0 0x7f5f7c03b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:54.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.425+0000 7f5f98327640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f9019c690 0x7f5f9019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:54.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.425+0000 7f5f98327640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f90199d10 0x7f5f9019c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:54.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.425+0000 7f5f98327640 1 --2- 172.21.15.169:0/2233599505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f901005f0 0x7f5f9006afb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:49:54.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.425+0000 7f5f98327640 1 -- 172.21.15.169:0/2233599505 >> 172.21.15.169:0/2233599505 conn(0x7f5f900fbda0 msgr2=0x7f5f900fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:49:54.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.426+0000 7f5f98327640 1 -- 172.21.15.169:0/2233599505 shutdown_connections 2024-09-05T12:49:54.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:49:54.426+0000 7f5f98327640 1 -- 172.21.15.169:0/2233599505 wait complete. 2024-09-05T12:49:55.078 DEBUG:teuthology.orchestra.run.smithi162:mgr.y> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.y.service 2024-09-05T12:49:55.080 DEBUG:teuthology.orchestra.run.smithi169:mgr.z> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.z.service 2024-09-05T12:49:55.082 INFO:tasks.cephadm:Deploying OSDs... 2024-09-05T12:49:55.082 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:49:55.082 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T12:49:55.099 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T12:49:55.099 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-05T12:49:55.154 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T12:49:55.155 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:55.155 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-05T12:49:55.155 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:55.155 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:55.155 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-05 12:49:13.853576182 +0000 2024-09-05T12:49:55.155 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-05 12:45:04.906969192 +0000 2024-09-05T12:49:55.155 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-05 12:45:04.906969192 +0000 2024-09-05T12:49:55.155 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-05 12:45:04.906969192 +0000 2024-09-05T12:49:55.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T12:49:55.185 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:55 smithi073 ceph-mon[30883]: Reconfiguring mon.a (unknown last config time)... 2024-09-05T12:49:55.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:55 smithi073 ceph-mon[30883]: Reconfiguring daemon mon.a on smithi073 2024-09-05T12:49:55.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:55 smithi073 ceph-mon[30883]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:55.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:55.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:55.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:55.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T12:49:55.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T12:49:55.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-05T12:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-05T12:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000276421 s, 1.9 MB/s 2024-09-05T12:49:55.211 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T12:49:55.268 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-05T12:49:55.323 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T12:49:55.323 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:55.323 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-05T12:49:55.323 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:55.323 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:55.323 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-05 12:49:13.879575608 +0000 2024-09-05T12:49:55.323 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-05 12:45:05.255961219 +0000 2024-09-05T12:49:55.323 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-05 12:45:05.255961219 +0000 2024-09-05T12:49:55.323 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-05 12:45:05.255961219 +0000 2024-09-05T12:49:55.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T12:49:55.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:55 smithi162 ceph-mon[34220]: Reconfiguring mon.a (unknown last config time)... 2024-09-05T12:49:55.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:55 smithi162 ceph-mon[34220]: Reconfiguring daemon mon.a on smithi073 2024-09-05T12:49:55.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:55 smithi162 ceph-mon[34220]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T12:49:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T12:49:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:55 smithi169 ceph-mon[34823]: Reconfiguring mon.a (unknown last config time)... 2024-09-05T12:49:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:55 smithi169 ceph-mon[34823]: Reconfiguring daemon mon.a on smithi073 2024-09-05T12:49:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:55 smithi169 ceph-mon[34823]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T12:49:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T12:49:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:55.386 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-05T12:49:55.386 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-05T12:49:55.386 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000195997 s, 2.6 MB/s 2024-09-05T12:49:55.387 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T12:49:55.443 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-05T12:49:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T12:49:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:55.500 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-05T12:49:55.500 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:55.500 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:55.500 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-05 12:49:13.904575055 +0000 2024-09-05T12:49:55.500 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-05 12:45:05.575953907 +0000 2024-09-05T12:49:55.500 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-05 12:45:05.575953907 +0000 2024-09-05T12:49:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-05 12:45:05.575953907 +0000 2024-09-05T12:49:55.500 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T12:49:55.562 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-05T12:49:55.562 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-05T12:49:55.562 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00019481 s, 2.6 MB/s 2024-09-05T12:49:55.564 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T12:49:55.620 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-05T12:49:55.675 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T12:49:55.675 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:55.675 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-05T12:49:55.675 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:55.675 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:55.676 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-05 12:49:13.930574481 +0000 2024-09-05T12:49:55.676 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-05 12:45:05.909946276 +0000 2024-09-05T12:49:55.676 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-05 12:45:05.909946276 +0000 2024-09-05T12:49:55.676 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-05 12:45:05.909946276 +0000 2024-09-05T12:49:55.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T12:49:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-05T12:49:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-05T12:49:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000168268 s, 3.0 MB/s 2024-09-05T12:49:55.740 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T12:49:55.796 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-05T12:49:55.796 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T12:49:55.814 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T12:49:55.814 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-05T12:49:55.870 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T12:49:55.870 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:55.871 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-05T12:49:55.871 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:55.871 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:55.871 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-05 12:49:45.236376037 +0000 2024-09-05T12:49:55.871 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-05 12:45:25.323698481 +0000 2024-09-05T12:49:55.871 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-05 12:45:25.323698481 +0000 2024-09-05T12:49:55.871 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-05 12:45:25.323698481 +0000 2024-09-05T12:49:55.871 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T12:49:55.937 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-05T12:49:55.937 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-05T12:49:55.937 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.00025077 s, 2.0 MB/s 2024-09-05T12:49:55.938 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T12:49:55.994 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-05T12:49:56.050 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T12:49:56.050 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:56.050 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-05T12:49:56.050 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:56.050 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:56.051 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-05 12:49:45.236376037 +0000 2024-09-05T12:49:56.051 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-05 12:45:25.653691750 +0000 2024-09-05T12:49:56.051 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-05 12:45:25.653691750 +0000 2024-09-05T12:49:56.051 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-05 12:45:25.653691750 +0000 2024-09-05T12:49:56.051 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T12:49:56.114 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-05T12:49:56.114 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-05T12:49:56.114 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000178095 s, 2.9 MB/s 2024-09-05T12:49:56.116 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T12:49:56.173 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-05T12:49:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T12:49:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:56.230 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-05T12:49:56.230 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:56.230 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:56.230 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-05 12:49:45.237376017 +0000 2024-09-05T12:49:56.230 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-05 12:45:25.976685159 +0000 2024-09-05T12:49:56.230 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-05 12:45:25.976685159 +0000 2024-09-05T12:49:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-05 12:45:25.976685159 +0000 2024-09-05T12:49:56.230 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T12:49:56.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:56 smithi073 ceph-mon[30883]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi162=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:49:56.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:56 smithi073 ceph-mon[30883]: Saving service mgr spec with placement smithi073=x;smithi162=y;smithi169=z;count:3 2024-09-05T12:49:56.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:56 smithi073 ceph-mon[30883]: Reconfiguring mgr.x (unknown last config time)... 2024-09-05T12:49:56.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:56 smithi073 ceph-mon[30883]: Reconfiguring daemon mgr.x on smithi073 2024-09-05T12:49:56.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:56.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:56.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:56.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T12:49:56.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:56.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:56 smithi162 ceph-mon[34220]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi162=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:49:56.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:56 smithi162 ceph-mon[34220]: Saving service mgr spec with placement smithi073=x;smithi162=y;smithi169=z;count:3 2024-09-05T12:49:56.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:56 smithi162 ceph-mon[34220]: Reconfiguring mgr.x (unknown last config time)... 2024-09-05T12:49:56.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:56 smithi162 ceph-mon[34220]: Reconfiguring daemon mgr.x on smithi073 2024-09-05T12:49:56.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:56.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:56.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:56.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T12:49:56.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:56.293 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-05T12:49:56.293 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-05T12:49:56.294 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.00017358 s, 2.9 MB/s 2024-09-05T12:49:56.295 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T12:49:56.351 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-05T12:49:56.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:56 smithi169 ceph-mon[34823]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi162=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:49:56.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:56 smithi169 ceph-mon[34823]: Saving service mgr spec with placement smithi073=x;smithi162=y;smithi169=z;count:3 2024-09-05T12:49:56.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:56 smithi169 ceph-mon[34823]: Reconfiguring mgr.x (unknown last config time)... 2024-09-05T12:49:56.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:56 smithi169 ceph-mon[34823]: Reconfiguring daemon mgr.x on smithi073 2024-09-05T12:49:56.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:56.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:56.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:56.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T12:49:56.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:56.407 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T12:49:56.407 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:56.407 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-05T12:49:56.408 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:56.408 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:56.408 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-05 12:49:45.237376017 +0000 2024-09-05T12:49:56.408 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-05 12:45:26.313678282 +0000 2024-09-05T12:49:56.408 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-05 12:45:26.313678282 +0000 2024-09-05T12:49:56.408 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-05 12:45:26.313678282 +0000 2024-09-05T12:49:56.408 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T12:49:56.472 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-05T12:49:56.472 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-05T12:49:56.472 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000188128 s, 2.7 MB/s 2024-09-05T12:49:56.474 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T12:49:56.531 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-05T12:49:56.531 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T12:49:56.551 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T12:49:56.551 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-09-05T12:49:56.608 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T12:49:56.609 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:56.609 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-05T12:49:56.609 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:56.609 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:56.609 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-05 12:49:36.133051108 +0000 2024-09-05T12:49:56.609 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-05 12:45:24.370183733 +0000 2024-09-05T12:49:56.609 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-05 12:45:24.370183733 +0000 2024-09-05T12:49:56.609 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-05 12:45:24.370183733 +0000 2024-09-05T12:49:56.609 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T12:49:56.676 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-05T12:49:56.676 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-05T12:49:56.676 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000267694 s, 1.9 MB/s 2024-09-05T12:49:56.678 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T12:49:56.738 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-09-05T12:49:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T12:49:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:56.796 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-05T12:49:56.796 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:56.797 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:56.797 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-05 12:49:36.133051108 +0000 2024-09-05T12:49:56.797 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-05 12:45:24.697176596 +0000 2024-09-05T12:49:56.797 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-05 12:45:24.697176596 +0000 2024-09-05T12:49:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-05 12:45:24.697176596 +0000 2024-09-05T12:49:56.797 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T12:49:56.865 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-05T12:49:56.865 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-05T12:49:56.865 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000304667 s, 1.7 MB/s 2024-09-05T12:49:56.867 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T12:49:56.926 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-09-05T12:49:56.983 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T12:49:56.983 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:56.983 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-05T12:49:56.983 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:56.984 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:56.984 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-05 12:49:36.133051108 +0000 2024-09-05T12:49:56.984 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-05 12:45:25.017169611 +0000 2024-09-05T12:49:56.984 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-05 12:45:25.017169611 +0000 2024-09-05T12:49:56.984 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-05 12:45:25.017169611 +0000 2024-09-05T12:49:56.984 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T12:49:57.050 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-05T12:49:57.050 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-05T12:49:57.050 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000243187 s, 2.1 MB/s 2024-09-05T12:49:57.051 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T12:49:57.111 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-09-05T12:49:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T12:49:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T12:49:57.169 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-05T12:49:57.169 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:49:57.169 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T12:49:57.169 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-05 12:49:36.133051108 +0000 2024-09-05T12:49:57.169 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-05 12:45:25.342162517 +0000 2024-09-05T12:49:57.169 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-05 12:45:25.342162517 +0000 2024-09-05T12:49:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-05 12:45:25.342162517 +0000 2024-09-05T12:49:57.169 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T12:49:57.235 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-05T12:49:57.235 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-05T12:49:57.235 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000278102 s, 1.8 MB/s 2024-09-05T12:49:57.236 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T12:49:57.284 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:57 smithi162 ceph-mon[34220]: Reconfiguring mon.b (monmap changed)... 2024-09-05T12:49:57.284 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:57 smithi162 ceph-mon[34220]: Reconfiguring daemon mon.b on smithi162 2024-09-05T12:49:57.284 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:57 smithi162 ceph-mon[34220]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:57.295 INFO:tasks.cephadm:Deploying osd.0 on smithi073 with /dev/vg_nvme/lv_4... 2024-09-05T12:49:57.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-05T12:49:57.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:57 smithi073 ceph-mon[30883]: Reconfiguring mon.b (monmap changed)... 2024-09-05T12:49:57.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:57 smithi073 ceph-mon[30883]: Reconfiguring daemon mon.b on smithi162 2024-09-05T12:49:57.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:57 smithi073 ceph-mon[30883]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:57.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:57 smithi169 ceph-mon[34823]: Reconfiguring mon.b (monmap changed)... 2024-09-05T12:49:57.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:57 smithi169 ceph-mon[34823]: Reconfiguring daemon mon.b on smithi162 2024-09-05T12:49:57.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:57 smithi169 ceph-mon[34823]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:57.542 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:49:58.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:58.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:58.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:58 smithi169 ceph-mon[34823]: Reconfiguring mon.c (monmap changed)... 2024-09-05T12:49:58.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:58.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T12:49:58.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:58.548 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:58 smithi169 ceph-mon[34823]: Reconfiguring daemon mon.c on smithi169 2024-09-05T12:49:58.548 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:58 smithi169 ceph-mon[34823]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:58.553 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:58.553 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:58.553 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:58 smithi073 ceph-mon[30883]: Reconfiguring mon.c (monmap changed)... 2024-09-05T12:49:58.554 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:58.554 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T12:49:58.554 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:58.554 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:58 smithi073 ceph-mon[30883]: Reconfiguring daemon mon.c on smithi169 2024-09-05T12:49:58.554 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:58 smithi073 ceph-mon[30883]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:58 smithi162 ceph-mon[34220]: Reconfiguring mon.c (monmap changed)... 2024-09-05T12:49:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T12:49:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T12:49:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:58 smithi162 ceph-mon[34220]: Reconfiguring daemon mon.c on smithi169 2024-09-05T12:49:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:58 smithi162 ceph-mon[34220]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:49:59.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:59.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:59.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:59.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:59.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:59.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:59.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T12:49:59.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T12:49:59.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T12:49:59.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:59.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:49:59 smithi162 ceph-mon[34220]: Deploying daemon mgr.z on smithi169 2024-09-05T12:49:59.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:59.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:59.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:59.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:59.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:59.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:59.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T12:49:59.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T12:49:59.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T12:49:59.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:59.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:49:59 smithi169 ceph-mon[34823]: Deploying daemon mgr.z on smithi169 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:49:59.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:49:59 smithi073 ceph-mon[30883]: Deploying daemon mgr.z on smithi169 2024-09-05T12:49:59.997 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:50:00.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_4 2024-09-05T12:50:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:50:00.606 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:00 smithi169 podman[36618]: 2024-09-05 12:50:00.426954905 +0000 UTC m=+0.015526634 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:50:00.689 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:00 smithi073 ceph-mon[30883]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:00.689 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:00 smithi073 ceph-mon[30883]: overall HEALTH_OK 2024-09-05T12:50:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.713+0000 7f82f5255640 1 -- 172.21.15.73:0/3465055144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82f01037c0 msgr2=0x7f82f010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.713+0000 7f82f5255640 1 --2- 172.21.15.73:0/3465055144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82f01037c0 0x7f82f010a050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009ca0 tx=0x7f82e802a8c0 comp rx=0 tx=0).stop 2024-09-05T12:50:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.713+0000 7f82f5255640 1 -- 172.21.15.73:0/3465055144 shutdown_connections 2024-09-05T12:50:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.713+0000 7f82f5255640 1 --2- 172.21.15.73:0/3465055144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82f01037c0 0x7f82f010a050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.713+0000 7f82f5255640 1 --2- 172.21.15.73:0/3465055144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82f0102e00 0x7f82f0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.713+0000 7f82f5255640 1 --2- 172.21.15.73:0/3465055144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0101c00 0x7f82f0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.713+0000 7f82f5255640 1 -- 172.21.15.73:0/3465055144 >> 172.21.15.73:0/3465055144 conn(0x7f82f00fd390 msgr2=0x7f82f00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:50:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.713+0000 7f82f5255640 1 -- 172.21.15.73:0/3465055144 shutdown_connections 2024-09-05T12:50:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.713+0000 7f82f5255640 1 -- 172.21.15.73:0/3465055144 wait complete. 2024-09-05T12:50:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82f5255640 1 Processor -- start 2024-09-05T12:50:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82f5255640 1 -- start start 2024-09-05T12:50:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82f5255640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0101c00 0x7f82f0198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82f5255640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82f0102e00 0x7f82f0198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82f5255640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82f01037c0 0x7f82f019f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82f5255640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f82f010d980 con 0x7f82f0102e00 2024-09-05T12:50:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82f5255640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82f010d800 con 0x7f82f0101c00 2024-09-05T12:50:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82f5255640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f82f010db00 con 0x7f82f01037c0 2024-09-05T12:50:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82ee59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82f0102e00 0x7f82f0198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82ee59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82f0102e00 0x7f82f0198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34592/0 (socket says 172.21.15.73:34592) 2024-09-05T12:50:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82ee59c640 1 -- 172.21.15.73:0/2483563463 learned_addr learned my addr 172.21.15.73:0/2483563463 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:50:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82eed9d640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0101c00 0x7f82f0198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.714+0000 7f82ef59e640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82f01037c0 0x7f82f019f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82ee59c640 1 -- 172.21.15.73:0/2483563463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82f01037c0 msgr2=0x7f82f019f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82ee59c640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82f01037c0 0x7f82f019f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82ee59c640 1 -- 172.21.15.73:0/2483563463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0101c00 msgr2=0x7f82f0198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82ee59c640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0101c00 0x7f82f0198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82ee59c640 1 -- 172.21.15.73:0/2483563463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f019fc60 con 0x7f82f0102e00 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82ee59c640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82f0102e00 0x7f82f0198570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f82e400b4a0 tx=0x7f82e400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82d7fff640 1 -- 172.21.15.73:0/2483563463 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e4015020 con 0x7f82f0102e00 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82f5255640 1 -- 172.21.15.73:0/2483563463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f019ff50 con 0x7f82f0102e00 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82d7fff640 1 -- 172.21.15.73:0/2483563463 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82e4011d10 con 0x7f82f0102e00 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82d7fff640 1 -- 172.21.15.73:0/2483563463 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e400f2e0 con 0x7f82f0102e00 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.715+0000 7f82f5255640 1 -- 172.21.15.73:0/2483563463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f01a0480 con 0x7f82f0102e00 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.716+0000 7f82d7fff640 1 -- 172.21.15.73:0/2483563463 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f82e4018020 con 0x7f82f0102e00 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.716+0000 7f82d7fff640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f82d80392c0 0x7f82d803b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.716+0000 7f82f5255640 1 -- 172.21.15.73:0/2483563463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f0108fa0 con 0x7f82f0102e00 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.716+0000 7f82d7fff640 1 -- 172.21.15.73:0/2483563463 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f82e404bad0 con 0x7f82f0102e00 2024-09-05T12:50:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.716+0000 7f82eed9d640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f82d80392c0 0x7f82d803b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.716+0000 7f82eed9d640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f82d80392c0 0x7f82d803b780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82f0102c60 tx=0x7f82e0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:50:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.721+0000 7f82d7fff640 1 -- 172.21.15.73:0/2483563463 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82e401f020 con 0x7f82f0102e00 2024-09-05T12:50:00.860 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:00 smithi162 ceph-mon[34220]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:00.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:00 smithi162 ceph-mon[34220]: overall HEALTH_OK 2024-09-05T12:50:00.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:00 smithi169 ceph-mon[34823]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:00.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:00 smithi169 ceph-mon[34823]: overall HEALTH_OK 2024-09-05T12:50:00.867 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:00 smithi169 podman[36618]: 2024-09-05 12:50:00.716122505 +0000 UTC m=+0.304694224 container init 87f7f5ba38acc4685ab3ec4f976a6ef8606fc14977c15d168bab645890794f11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-05T12:50:00.867 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:00 smithi169 podman[36618]: 2024-09-05 12:50:00.718842438 +0000 UTC m=+0.307414165 container start 87f7f5ba38acc4685ab3ec4f976a6ef8606fc14977c15d168bab645890794f11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-05T12:50:00.868 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:00 smithi169 ceph-mgr[36638]: -- 172.21.15.169:0/779812254 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55daeaa090e0 con 0x55daea9e7000 2024-09-05T12:50:00.868 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:00 smithi169 bash[36618]: 87f7f5ba38acc4685ab3ec4f976a6ef8606fc14977c15d168bab645890794f11 2024-09-05T12:50:00.868 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:00 smithi169 systemd[1]: Started Ceph mgr.z for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:50:00.868 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:00 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:00.848+0000 7f1ae2142040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T12:50:00.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:00.903+0000 7f82f5255640 1 -- 172.21.15.73:0/2483563463 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f82f0062630 con 0x7f82d80392c0 2024-09-05T12:50:01.271 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:00 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:00.907+0000 7f1ae2142040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T12:50:01.271 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:01.056+0000 7f1ae2142040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T12:50:01.271 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:01.123+0000 7f1ae2142040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T12:50:01.271 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:01.270+0000 7f1ae2142040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T12:50:01.620 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:01.410+0000 7f1ae2142040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T12:50:02.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:02.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:02.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:02.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T12:50:02.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T12:50:02.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T12:50:02.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:02.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: Deploying daemon mgr.y on smithi162 2024-09-05T12:50:02.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:50:02.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:50:02.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:50:02.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:02.117 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:01.726+0000 7f1ae2142040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T12:50:02.117 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:01.788+0000 7f1ae2142040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T12:50:02.117 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:01.974+0000 7f1ae2142040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T12:50:02.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:02.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:02.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:02.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T12:50:02.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T12:50:02.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T12:50:02.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:02.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: Deploying daemon mgr.y on smithi162 2024-09-05T12:50:02.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:50:02.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:50:02.119 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:50:02.119 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:02.211 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:02.212 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:02.212 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:02.212 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T12:50:02.212 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T12:50:02.212 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T12:50:02.212 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:02.212 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: Deploying daemon mgr.y on smithi162 2024-09-05T12:50:02.212 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:50:02.212 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:50:02.212 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:50:02.213 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:02.861 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:02 smithi162 podman[35577]: 2024-09-05 12:50:02.751217596 +0000 UTC m=+0.115497771 container create ced4666a5ca30880ce76fa4fdf948c433c1efca844546ab59cfa0f419de5606d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T12:50:03.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:02 smithi169 ceph-mon[34823]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:03.118 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:02 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:02.856+0000 7f1ae2142040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T12:50:03.118 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:02 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:02.924+0000 7f1ae2142040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T12:50:03.173 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:02 smithi162 ceph-mon[34220]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:03.173 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:02 smithi162 podman[35577]: 2024-09-05 12:50:02.987041825 +0000 UTC m=+0.351322000 container init ced4666a5ca30880ce76fa4fdf948c433c1efca844546ab59cfa0f419de5606d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T12:50:03.173 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:02 smithi162 podman[35577]: 2024-09-05 12:50:02.989777009 +0000 UTC m=+0.354057180 container start ced4666a5ca30880ce76fa4fdf948c433c1efca844546ab59cfa0f419de5606d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-05T12:50:03.173 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mgr[35596]: -- 172.21.15.162:0/686680199 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b56cc30e0 con 0x557b56ca1400 2024-09-05T12:50:03.173 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:03 smithi162 bash[35577]: ced4666a5ca30880ce76fa4fdf948c433c1efca844546ab59cfa0f419de5606d 2024-09-05T12:50:03.173 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:03 smithi162 systemd[1]: Started Ceph mgr.y for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:50:03.173 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:03.109+0000 7ff92cb1b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T12:50:03.174 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:03.172+0000 7ff92cb1b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T12:50:03.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:02 smithi073 ceph-mon[30883]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:03.557 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:03.327+0000 7ff92cb1b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T12:50:03.557 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:03.397+0000 7ff92cb1b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T12:50:03.557 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:03.555+0000 7ff92cb1b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T12:50:03.842 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:03.716+0000 7ff92cb1b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T12:50:03.963 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:03.695+0000 7f1ae2142040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T12:50:03.963 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:03.812+0000 7f1ae2142040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T12:50:03.963 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:03.961+0000 7f1ae2142040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T12:50:03.963 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3168721654' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f66519cc-c789-455a-bb2a-a7872eeb6102"}]: dispatch 2024-09-05T12:50:03.963 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3168721654' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f66519cc-c789-455a-bb2a-a7872eeb6102"}]': finished 2024-09-05T12:50:03.963 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-mon[34823]: osdmap e5: 1 total, 0 up, 1 in 2024-09-05T12:50:03.963 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:03.963 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:03.964 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:03.964 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:03.964 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:03.964 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:03.964 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:03 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/821356826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:50:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:03 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3168721654' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f66519cc-c789-455a-bb2a-a7872eeb6102"}]: dispatch 2024-09-05T12:50:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:03 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3168721654' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f66519cc-c789-455a-bb2a-a7872eeb6102"}]': finished 2024-09-05T12:50:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:03 smithi073 ceph-mon[30883]: osdmap e5: 1 total, 0 up, 1 in 2024-09-05T12:50:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:04.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:04.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:03 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/821356826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:50:04.103 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:04.040+0000 7ff92cb1b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T12:50:04.103 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:04.101+0000 7ff92cb1b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T12:50:04.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3168721654' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f66519cc-c789-455a-bb2a-a7872eeb6102"}]: dispatch 2024-09-05T12:50:04.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3168721654' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f66519cc-c789-455a-bb2a-a7872eeb6102"}]': finished 2024-09-05T12:50:04.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mon[34220]: osdmap e5: 1 total, 0 up, 1 in 2024-09-05T12:50:04.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:04.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:04.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:04.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:04.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:04.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:04.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:03 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/821356826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:50:04.250 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:04.026+0000 7f1ae2142040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T12:50:04.250 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:04.181+0000 7f1ae2142040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T12:50:04.251 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:04.249+0000 7f1ae2142040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T12:50:04.360 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:04.296+0000 7ff92cb1b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T12:50:04.543 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:04.311+0000 7f1ae2142040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T12:50:04.544 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:04.476+0000 7f1ae2142040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T12:50:04.544 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:04.542+0000 7f1ae2142040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T12:50:04.820 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:04.612+0000 7f1ae2142040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T12:50:04.820 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:04.699+0000 7f1ae2142040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T12:50:04.821 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:04.760+0000 7f1ae2142040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T12:50:04.821 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:04.819+0000 7f1ae2142040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T12:50:05.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:05.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.194 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:05.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:05.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:05.610 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:05 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:05.192+0000 7ff92cb1b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T12:50:05.610 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:05 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:05.258+0000 7ff92cb1b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T12:50:05.867 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 12:50:05 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z[36634]: 2024-09-05T12:50:05.610+0000 7f1ae2142040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T12:50:05.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:05.945+0000 7f82d7fff640 1 -- 172.21.15.73:0/2483563463 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f82e404abe0 con 0x7f82f0102e00 2024-09-05T12:50:06.239 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:05 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:05.978+0000 7ff92cb1b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T12:50:06.239 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:06.093+0000 7ff92cb1b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T12:50:06.239 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:06.237+0000 7ff92cb1b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T12:50:06.240 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:05 smithi162 ceph-mon[34220]: Standby manager daemon z started 2024-09-05T12:50:06.240 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:05 smithi162 ceph-mon[34220]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T12:50:06.240 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:05 smithi162 ceph-mon[34220]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T12:50:06.240 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:05 smithi162 ceph-mon[34220]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T12:50:06.240 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:05 smithi162 ceph-mon[34220]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T12:50:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:05 smithi073 ceph-mon[30883]: Standby manager daemon z started 2024-09-05T12:50:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:05 smithi073 ceph-mon[30883]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T12:50:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:05 smithi073 ceph-mon[30883]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T12:50:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:05 smithi073 ceph-mon[30883]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T12:50:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:05 smithi073 ceph-mon[30883]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T12:50:06.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:05 smithi169 ceph-mon[34823]: Standby manager daemon z started 2024-09-05T12:50:06.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:05 smithi169 ceph-mon[34823]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T12:50:06.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:05 smithi169 ceph-mon[34823]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T12:50:06.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:05 smithi169 ceph-mon[34823]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T12:50:06.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:05 smithi169 ceph-mon[34823]: from='mgr.? 172.21.15.169:0/1006808346' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T12:50:06.515 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:06.298+0000 7ff92cb1b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T12:50:06.516 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:06.446+0000 7ff92cb1b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T12:50:06.516 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:06.513+0000 7ff92cb1b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T12:50:06.795 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:06.572+0000 7ff92cb1b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T12:50:06.795 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:06.727+0000 7ff92cb1b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T12:50:06.795 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:06.793+0000 7ff92cb1b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T12:50:07.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-mon[34220]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:07.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-mon[34220]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-05T12:50:07.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T12:50:07.062 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:06.858+0000 7ff92cb1b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T12:50:07.063 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:06.940+0000 7ff92cb1b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T12:50:07.063 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:07 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:07.000+0000 7ff92cb1b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T12:50:07.063 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:07 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:07.059+0000 7ff92cb1b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T12:50:07.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:06 smithi073 ceph-mon[30883]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:07.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:06 smithi073 ceph-mon[30883]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-05T12:50:07.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T12:50:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:06 smithi169 ceph-mon[34823]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:06 smithi169 ceph-mon[34823]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-05T12:50:07.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:06 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T12:50:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:07.954+0000 7f82d7fff640 1 -- 172.21.15.73:0/2483563463 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f82e4015c70 con 0x7f82f0102e00 2024-09-05T12:50:08.111 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 12:50:07 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y[35592]: 2024-09-05T12:50:07.841+0000 7ff92cb1b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T12:50:08.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:07 smithi162 ceph-mon[34220]: Standby manager daemon y started 2024-09-05T12:50:08.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:07 smithi162 ceph-mon[34220]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T12:50:08.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:07 smithi162 ceph-mon[34220]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T12:50:08.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:07 smithi162 ceph-mon[34220]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T12:50:08.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:07 smithi162 ceph-mon[34220]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T12:50:08.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:07 smithi073 ceph-mon[30883]: Standby manager daemon y started 2024-09-05T12:50:08.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:07 smithi073 ceph-mon[30883]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T12:50:08.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:07 smithi073 ceph-mon[30883]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T12:50:08.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:07 smithi073 ceph-mon[30883]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T12:50:08.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:07 smithi073 ceph-mon[30883]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T12:50:08.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:07 smithi169 ceph-mon[34823]: Standby manager daemon y started 2024-09-05T12:50:08.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:07 smithi169 ceph-mon[34823]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T12:50:08.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:07 smithi169 ceph-mon[34823]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T12:50:08.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:07 smithi169 ceph-mon[34823]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T12:50:08.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:07 smithi169 ceph-mon[34823]: from='mgr.? 172.21.15.162:0/3084068737' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T12:50:09.230 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:08 smithi073 ceph-mon[30883]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:09.230 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:08 smithi073 ceph-mon[30883]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-05T12:50:09.230 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:08 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T12:50:09.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:08 smithi162 ceph-mon[34220]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:09.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:08 smithi162 ceph-mon[34220]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-05T12:50:09.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:08 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T12:50:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:08 smithi169 ceph-mon[34823]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:08 smithi169 ceph-mon[34823]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-05T12:50:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:08 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T12:50:11.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:10 smithi073 ceph-mon[30883]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:11.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:10 smithi162 ceph-mon[34220]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:11.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:10 smithi169 ceph-mon[34823]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:12.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-05T12:50:12.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:12.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-05T12:50:12.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:12.268 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-05T12:50:12.269 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:12.980 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:12 smithi073 ceph-mon[30883]: Deploying daemon osd.0 on smithi073 2024-09-05T12:50:12.980 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:12 smithi073 ceph-mon[30883]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:13.285 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:12 smithi169 ceph-mon[34823]: Deploying daemon osd.0 on smithi073 2024-09-05T12:50:13.285 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:12 smithi169 ceph-mon[34823]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:13.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:12 smithi162 ceph-mon[34220]: Deploying daemon osd.0 on smithi073 2024-09-05T12:50:13.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:12 smithi162 ceph-mon[34220]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:15.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:14 smithi073 ceph-mon[30883]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:15.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:14 smithi162 ceph-mon[34220]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:15.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:14 smithi169 ceph-mon[34823]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:17.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:16 smithi073 ceph-mon[30883]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:17.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:17.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:17.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:16 smithi162 ceph-mon[34220]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:16 smithi169 ceph-mon[34823]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:19.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:18 smithi073 ceph-mon[30883]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:19.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:19.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:18 smithi162 ceph-mon[34220]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:18 smithi169 ceph-mon[34823]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:20.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:19 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:20.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:19 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:20.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:19 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:20.336 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 0 on host 'smithi073' 2024-09-05T12:50:20.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.334+0000 7f82d7fff640 1 -- 172.21.15.73:0/2483563463 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f82f0062630 con 0x7f82d80392c0 2024-09-05T12:50:20.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.337+0000 7f82f5255640 1 -- 172.21.15.73:0/2483563463 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f82d80392c0 msgr2=0x7f82d803b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.337+0000 7f82f5255640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f82d80392c0 0x7f82d803b780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82f0102c60 tx=0x7f82e0009110 comp rx=0 tx=0).stop 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.337+0000 7f82f5255640 1 -- 172.21.15.73:0/2483563463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82f0102e00 msgr2=0x7f82f0198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.337+0000 7f82f5255640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82f0102e00 0x7f82f0198570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f82e400b4a0 tx=0x7f82e400b8a0 comp rx=0 tx=0).stop 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.337+0000 7f82f5255640 1 -- 172.21.15.73:0/2483563463 shutdown_connections 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.337+0000 7f82f5255640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f82d80392c0 0x7f82d803b780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.337+0000 7f82f5255640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82f01037c0 0x7f82f019f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.337+0000 7f82f5255640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82f0102e00 0x7f82f0198570 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.337+0000 7f82f5255640 1 --2- 172.21.15.73:0/2483563463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0101c00 0x7f82f0198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.337+0000 7f82f5255640 1 -- 172.21.15.73:0/2483563463 >> 172.21.15.73:0/2483563463 conn(0x7f82f00fd390 msgr2=0x7f82f0106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.338+0000 7f82f5255640 1 -- 172.21.15.73:0/2483563463 shutdown_connections 2024-09-05T12:50:20.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:50:20.338+0000 7f82f5255640 1 -- 172.21.15.73:0/2483563463 wait complete. 2024-09-05T12:50:20.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:19 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:20.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:19 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:20.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:19 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:20.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:19 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:20.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:19 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:20.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:19 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:21.007 DEBUG:teuthology.orchestra.run.smithi073:osd.0> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.0.service 2024-09-05T12:50:21.009 INFO:tasks.cephadm:Deploying osd.1 on smithi162 with /dev/vg_nvme/lv_4... 2024-09-05T12:50:21.009 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-05T12:50:21.262 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T12:50:21.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:21 smithi073 ceph-mon[30883]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:21.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:21 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:21.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:21 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:21.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:21 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:21.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:21 smithi162 ceph-mon[34220]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:21 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:21 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:21 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:21 smithi169 ceph-mon[34823]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:21 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:21 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:21 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:22.264 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:50:22 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0[44413]: 2024-09-05T12:50:22.189+0000 7fa16f320640 -1 osd.0 0 log_to_monitors true 2024-09-05T12:50:23.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:23 smithi073 ceph-mon[30883]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:23.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:23 smithi073 ceph-mon[30883]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-05T12:50:23.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:23 smithi162 ceph-mon[34220]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:23.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:23 smithi162 ceph-mon[34220]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-05T12:50:23.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:23 smithi169 ceph-mon[34823]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:23.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:23 smithi169 ceph-mon[34823]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-05T12:50:23.680 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:50:23.705 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-09-05T12:50:23.949 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T12:50:24.191 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-05T12:50:24.191 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: osdmap e6: 1 total, 0 up, 1 in 2024-09-05T12:50:24.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:50:24.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:24.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:50:24.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:24.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:24.193 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.193 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:24 smithi162 ceph-mon[34220]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:50:24.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-05T12:50:24.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: osdmap e6: 1 total, 0 up, 1 in 2024-09-05T12:50:24.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:50:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:50:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-mon[30883]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:50:24.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: osdmap e6: 1 total, 0 up, 1 in 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:24 smithi169 ceph-mon[34823]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.404+0000 7feb274ec640 1 -- 172.21.15.162:0/1628759896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb20102690 msgr2=0x7feb20108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.404+0000 7feb274ec640 1 --2- 172.21.15.162:0/1628759896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb20102690 0x7feb20108f20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feb18009ca0 tx=0x7feb1802a8c0 comp rx=0 tx=0).stop 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.404+0000 7feb274ec640 1 -- 172.21.15.162:0/1628759896 shutdown_connections 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.404+0000 7feb274ec640 1 --2- 172.21.15.162:0/1628759896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb20102690 0x7feb20108f20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.404+0000 7feb274ec640 1 --2- 172.21.15.162:0/1628759896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb20101cd0 0x7feb20102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.404+0000 7feb274ec640 1 --2- 172.21.15.162:0/1628759896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb20100ad0 0x7feb20100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.404+0000 7feb274ec640 1 -- 172.21.15.162:0/1628759896 >> 172.21.15.162:0/1628759896 conn(0x7feb200fc280 msgr2=0x7feb200fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.404+0000 7feb274ec640 1 -- 172.21.15.162:0/1628759896 shutdown_connections 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.404+0000 7feb274ec640 1 -- 172.21.15.162:0/1628759896 wait complete. 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb274ec640 1 Processor -- start 2024-09-05T12:50:24.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb274ec640 1 -- start start 2024-09-05T12:50:24.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb274ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb20100ad0 0x7feb20197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:24.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb274ec640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb20101cd0 0x7feb20198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:24.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb274ec640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb20102690 0x7feb2019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:24.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb274ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feb2010c800 con 0x7feb20100ad0 2024-09-05T12:50:24.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb274ec640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb2010c680 con 0x7feb20101cd0 2024-09-05T12:50:24.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb274ec640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb2010c980 con 0x7feb20102690 2024-09-05T12:50:24.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb24a87640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb20101cd0 0x7feb20198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:24.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb24a87640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb20101cd0 0x7feb20198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34540/0 (socket says 172.21.15.162:34540) 2024-09-05T12:50:24.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb24a87640 1 -- 172.21.15.162:0/2518052617 learned_addr learned my addr 172.21.15.162:0/2518052617 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-05T12:50:24.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb25288640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb20100ad0 0x7feb20197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:24.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb25a89640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb20102690 0x7feb2019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:24.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb24a87640 1 -- 172.21.15.162:0/2518052617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb20102690 msgr2=0x7feb2019f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:24.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb24a87640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb20102690 0x7feb2019f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:24.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb24a87640 1 -- 172.21.15.162:0/2518052617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb20100ad0 msgr2=0x7feb20197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:24.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb24a87640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb20100ad0 0x7feb20197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:24.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.405+0000 7feb24a87640 1 -- 172.21.15.162:0/2518052617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2019fb80 con 0x7feb20101cd0 2024-09-05T12:50:24.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.406+0000 7feb24a87640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb20101cd0 0x7feb20198490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00d770 tx=0x7feb1c00db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:50:24.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.406+0000 7feb167fc640 1 -- 172.21.15.162:0/2518052617 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c017070 con 0x7feb20101cd0 2024-09-05T12:50:24.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.406+0000 7feb167fc640 1 -- 172.21.15.162:0/2518052617 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb1c009820 con 0x7feb20101cd0 2024-09-05T12:50:24.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.406+0000 7feb274ec640 1 -- 172.21.15.162:0/2518052617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2019fe70 con 0x7feb20101cd0 2024-09-05T12:50:24.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.406+0000 7feb167fc640 1 -- 172.21.15.162:0/2518052617 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c004cd0 con 0x7feb20101cd0 2024-09-05T12:50:24.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.406+0000 7feb274ec640 1 -- 172.21.15.162:0/2518052617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb201a0350 con 0x7feb20101cd0 2024-09-05T12:50:24.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.407+0000 7feb274ec640 1 -- 172.21.15.162:0/2518052617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb201a0580 con 0x7feb20101cd0 2024-09-05T12:50:24.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.408+0000 7feb167fc640 1 -- 172.21.15.162:0/2518052617 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7feb1c0099d0 con 0x7feb20101cd0 2024-09-05T12:50:24.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.409+0000 7feb167fc640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feb0c0a2b20 0x7feb0c0a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:24.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.409+0000 7feb167fc640 1 -- 172.21.15.162:0/2518052617 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7feb1c0cce80 con 0x7feb20101cd0 2024-09-05T12:50:24.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.409+0000 7feb25288640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feb0c0a2b20 0x7feb0c0a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:24.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.409+0000 7feb25288640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feb0c0a2b20 0x7feb0c0a4fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb20101b30 tx=0x7feb10009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:50:24.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.413+0000 7feb167fc640 1 -- 172.21.15.162:0/2518052617 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb1c09b970 con 0x7feb20101cd0 2024-09-05T12:50:24.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:24.588+0000 7feb274ec640 1 -- 172.21.15.162:0/2518052617 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7feb200fe4a0 con 0x7feb0c0a2b20 2024-09-05T12:50:24.763 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0[44413]: 2024-09-05T12:50:24.418+0000 7fa16b2a3640 -1 osd.0 0 waiting for initial osdmap 2024-09-05T12:50:24.763 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:50:24 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0[44413]: 2024-09-05T12:50:24.421+0000 7fa1630c3640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:50:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:25 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi073 2024-09-05T12:50:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:25 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi073 to 17088M 2024-09-05T12:50:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:25 smithi073 ceph-mon[30883]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:25 smithi073 ceph-mon[30883]: osdmap e7: 1 total, 0 up, 1 in 2024-09-05T12:50:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:25 smithi073 ceph-mon[30883]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' 2024-09-05T12:50:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:50:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:50:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:25.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:25 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi073 2024-09-05T12:50:25.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:25 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi073 to 17088M 2024-09-05T12:50:25.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:25 smithi162 ceph-mon[34220]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:25.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:25 smithi162 ceph-mon[34220]: osdmap e7: 1 total, 0 up, 1 in 2024-09-05T12:50:25.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:25.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:25.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:25 smithi162 ceph-mon[34220]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' 2024-09-05T12:50:25.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:50:25.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:50:25.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:25 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi073 2024-09-05T12:50:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:25 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi073 to 17088M 2024-09-05T12:50:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:25 smithi169 ceph-mon[34823]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:25 smithi169 ceph-mon[34823]: osdmap e7: 1 total, 0 up, 1 in 2024-09-05T12:50:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:25 smithi169 ceph-mon[34823]: from='osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118]' entity='osd.0' 2024-09-05T12:50:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:50:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:50:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:26.147 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:26 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:50:26.148 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:26 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:50:26.148 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:26 smithi162 ceph-mon[34220]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:50:26.148 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:26 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:26.148 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:26 smithi162 ceph-mon[34220]: osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] boot 2024-09-05T12:50:26.148 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:26 smithi162 ceph-mon[34220]: osdmap e8: 1 total, 1 up, 1 in 2024-09-05T12:50:26.148 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:26 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:26.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:26 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:50:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:26 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:50:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:26 smithi169 ceph-mon[34823]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:50:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:26 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:26 smithi169 ceph-mon[34823]: osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] boot 2024-09-05T12:50:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:26 smithi169 ceph-mon[34823]: osdmap e8: 1 total, 1 up, 1 in 2024-09-05T12:50:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:26 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:26.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:26 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:50:26.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:26 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:50:26.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:26 smithi073 ceph-mon[30883]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:50:26.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:26 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:26.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:26 smithi073 ceph-mon[30883]: osd.0 [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] boot 2024-09-05T12:50:26.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:26 smithi073 ceph-mon[30883]: osdmap e8: 1 total, 1 up, 1 in 2024-09-05T12:50:26.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:26 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T12:50:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:27 smithi162 ceph-mon[34220]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:27 smithi162 ceph-mon[34220]: from='client.? 172.21.15.162:0/2507662658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f31a701-6a71-46f4-b80e-0b3da55579f1"}]: dispatch 2024-09-05T12:50:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:27 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f31a701-6a71-46f4-b80e-0b3da55579f1"}]: dispatch 2024-09-05T12:50:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:27 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f31a701-6a71-46f4-b80e-0b3da55579f1"}]': finished 2024-09-05T12:50:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:27 smithi162 ceph-mon[34220]: osdmap e9: 2 total, 1 up, 2 in 2024-09-05T12:50:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:27 smithi169 ceph-mon[34823]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:27 smithi169 ceph-mon[34823]: from='client.? 172.21.15.162:0/2507662658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f31a701-6a71-46f4-b80e-0b3da55579f1"}]: dispatch 2024-09-05T12:50:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:27 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f31a701-6a71-46f4-b80e-0b3da55579f1"}]: dispatch 2024-09-05T12:50:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:27 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f31a701-6a71-46f4-b80e-0b3da55579f1"}]': finished 2024-09-05T12:50:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:27 smithi169 ceph-mon[34823]: osdmap e9: 2 total, 1 up, 2 in 2024-09-05T12:50:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:27 smithi073 ceph-mon[30883]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T12:50:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:27 smithi073 ceph-mon[30883]: from='client.? 172.21.15.162:0/2507662658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f31a701-6a71-46f4-b80e-0b3da55579f1"}]: dispatch 2024-09-05T12:50:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:27 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f31a701-6a71-46f4-b80e-0b3da55579f1"}]: dispatch 2024-09-05T12:50:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:27 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f31a701-6a71-46f4-b80e-0b3da55579f1"}]': finished 2024-09-05T12:50:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:27 smithi073 ceph-mon[30883]: osdmap e9: 2 total, 1 up, 2 in 2024-09-05T12:50:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:28 smithi162 ceph-mon[34220]: from='client.? 172.21.15.162:0/557653886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:50:28.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:28 smithi169 ceph-mon[34823]: from='client.? 172.21.15.162:0/557653886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:50:28.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:28 smithi073 ceph-mon[30883]: from='client.? 172.21.15.162:0/557653886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:50:29.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:29 smithi162 ceph-mon[34220]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:29.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:29 smithi169 ceph-mon[34823]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:29.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:29 smithi073 ceph-mon[30883]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:31 smithi162 ceph-mon[34220]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:31 smithi169 ceph-mon[34823]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:31.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:31 smithi073 ceph-mon[30883]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:33.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:33 smithi162 ceph-mon[34220]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:33.315 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:33 smithi073 ceph-mon[30883]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:33.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:33 smithi169 ceph-mon[34823]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:35.225 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:35 smithi162 ceph-mon[34220]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:35.226 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-05T12:50:35.226 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:35.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:35 smithi073 ceph-mon[30883]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:35.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-05T12:50:35.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:35.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:35 smithi169 ceph-mon[34823]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:35.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-05T12:50:35.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:36.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:36 smithi162 ceph-mon[34220]: Deploying daemon osd.1 on smithi162 2024-09-05T12:50:36.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:36 smithi169 ceph-mon[34823]: Deploying daemon osd.1 on smithi162 2024-09-05T12:50:36.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:36 smithi073 ceph-mon[30883]: Deploying daemon osd.1 on smithi162 2024-09-05T12:50:37.297 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:37 smithi162 ceph-mon[34220]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:37.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:37 smithi169 ceph-mon[34823]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:37.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:37 smithi073 ceph-mon[30883]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:38 smithi162 ceph-mon[34220]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:38 smithi169 ceph-mon[34823]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:38.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:38 smithi073 ceph-mon[30883]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:40.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:40.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:40.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:40.100 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:40.100 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:40.100 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:40.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:40.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:40.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:41.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:40 smithi073 ceph-mon[30883]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:41.029 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:40 smithi162 ceph-mon[34220]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:41.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:40 smithi169 ceph-mon[34823]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:43.225 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:42 smithi162 ceph-mon[34220]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:43.226 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:43.226 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:43.226 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:43.226 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:43.226 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:42 smithi073 ceph-mon[30883]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:42 smithi169 ceph-mon[34823]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:43.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:43.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:43.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:43.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:43.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:43.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.907+0000 7feb167fc640 1 -- 172.21.15.162:0/2518052617 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feb200fe4a0 con 0x7feb0c0a2b20 2024-09-05T12:50:43.910 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 1 on host 'smithi162' 2024-09-05T12:50:43.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 -- 172.21.15.162:0/2518052617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feb0c0a2b20 msgr2=0x7feb0c0a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:43.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feb0c0a2b20 0x7feb0c0a4fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb20101b30 tx=0x7feb10009110 comp rx=0 tx=0).stop 2024-09-05T12:50:43.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 -- 172.21.15.162:0/2518052617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb20101cd0 msgr2=0x7feb20198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:43.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb20101cd0 0x7feb20198490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00d770 tx=0x7feb1c00db70 comp rx=0 tx=0).stop 2024-09-05T12:50:43.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 -- 172.21.15.162:0/2518052617 shutdown_connections 2024-09-05T12:50:43.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feb0c0a2b20 0x7feb0c0a4fe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:43.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb20102690 0x7feb2019f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:43.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb20101cd0 0x7feb20198490 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:43.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 --2- 172.21.15.162:0/2518052617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb20100ad0 0x7feb20197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:43.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 -- 172.21.15.162:0/2518052617 >> 172.21.15.162:0/2518052617 conn(0x7feb200fc280 msgr2=0x7feb200fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:50:43.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 -- 172.21.15.162:0/2518052617 shutdown_connections 2024-09-05T12:50:43.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:50:43.910+0000 7feb274ec640 1 -- 172.21.15.162:0/2518052617 wait complete. 2024-09-05T12:50:44.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:43 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:44.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:43 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:44.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:43 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:44.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:43 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:44.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:43 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:44.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:43 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:44.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:43 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:50:44.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:43 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:44.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:43 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:44.548 DEBUG:teuthology.orchestra.run.smithi162:osd.1> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.1.service 2024-09-05T12:50:44.550 INFO:tasks.cephadm:Deploying osd.2 on smithi169 with /dev/vg_nvme/lv_4... 2024-09-05T12:50:44.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-05T12:50:44.823 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:50:45.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:44 smithi162 ceph-mon[34220]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:45.197 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:44 smithi169 ceph-mon[34823]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:45.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:44 smithi073 ceph-mon[30883]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:46.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:45 smithi162 ceph-mon[34220]: from='osd.1 [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T12:50:46.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:45 smithi162 ceph-mon[34220]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T12:50:46.111 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:50:45 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1[38558]: 2024-09-05T12:50:45.783+0000 7fbf10a20640 -1 osd.1 0 log_to_monitors true 2024-09-05T12:50:46.147 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:45 smithi169 ceph-mon[34823]: from='osd.1 [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T12:50:46.147 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:45 smithi169 ceph-mon[34823]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T12:50:46.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:45 smithi073 ceph-mon[30883]: from='osd.1 [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T12:50:46.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:45 smithi073 ceph-mon[30883]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T12:50:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:50:47.149 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_4 2024-09-05T12:50:47.220 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:50:46 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1[38558]: 2024-09-05T12:50:46.980+0000 7fbf0c9a3640 -1 osd.1 0 waiting for initial osdmap 2024-09-05T12:50:47.220 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:50:46 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1[38558]: 2024-09-05T12:50:46.985+0000 7fbf087cb640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:50:47.220 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:46 smithi162 ceph-mon[34220]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:47.220 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:46 smithi162 ceph-mon[34220]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-05T12:50:47.221 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:46 smithi162 ceph-mon[34220]: from='osd.1 [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:50:47.221 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:46 smithi162 ceph-mon[34220]: osdmap e10: 2 total, 1 up, 2 in 2024-09-05T12:50:47.221 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:46 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:47.221 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:46 smithi162 ceph-mon[34220]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:50:47.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:46 smithi073 ceph-mon[30883]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:47.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:46 smithi073 ceph-mon[30883]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-05T12:50:47.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:46 smithi073 ceph-mon[30883]: from='osd.1 [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:50:47.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:46 smithi073 ceph-mon[30883]: osdmap e10: 2 total, 1 up, 2 in 2024-09-05T12:50:47.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:46 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:47.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:46 smithi073 ceph-mon[30883]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:50:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:46 smithi169 ceph-mon[34823]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:46 smithi169 ceph-mon[34823]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-05T12:50:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:46 smithi169 ceph-mon[34823]: from='osd.1 [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:50:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:46 smithi169 ceph-mon[34823]: osdmap e10: 2 total, 1 up, 2 in 2024-09-05T12:50:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:46 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:47.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:46 smithi169 ceph-mon[34823]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:50:47.394 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:50:47.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.833+0000 7f4d5de36640 1 -- 172.21.15.169:0/2302412351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d580761a0 msgr2=0x7f4d58074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:47.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.833+0000 7f4d5de36640 1 --2- 172.21.15.169:0/2302412351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d580761a0 0x7f4d58074600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009ca0 tx=0x7f4d4802a8c0 comp rx=0 tx=0).stop 2024-09-05T12:50:47.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.833+0000 7f4d5de36640 1 -- 172.21.15.169:0/2302412351 shutdown_connections 2024-09-05T12:50:47.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.833+0000 7f4d5de36640 1 --2- 172.21.15.169:0/2302412351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d58109a70 0x7f4d5810bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:47.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.833+0000 7f4d5de36640 1 --2- 172.21.15.169:0/2302412351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d58074b40 0x7f4d58074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:47.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.833+0000 7f4d5de36640 1 --2- 172.21.15.169:0/2302412351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d580761a0 0x7f4d58074600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:47.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.833+0000 7f4d5de36640 1 -- 172.21.15.169:0/2302412351 >> 172.21.15.169:0/2302412351 conn(0x7f4d580fd390 msgr2=0x7f4d580ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:50:47.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.834+0000 7f4d5de36640 1 -- 172.21.15.169:0/2302412351 shutdown_connections 2024-09-05T12:50:47.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.834+0000 7f4d5de36640 1 -- 172.21.15.169:0/2302412351 wait complete. 2024-09-05T12:50:47.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.834+0000 7f4d5de36640 1 Processor -- start 2024-09-05T12:50:47.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.834+0000 7f4d5de36640 1 -- start start 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.834+0000 7f4d5de36640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d58074b40 0x7f4d5819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.834+0000 7f4d5de36640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d580761a0 0x7f4d5819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.834+0000 7f4d5de36640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d58109a70 0x7f4d581a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.834+0000 7f4d5de36640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5810fb50 con 0x7f4d580761a0 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.834+0000 7f4d5de36640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5810f9d0 con 0x7f4d58074b40 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.834+0000 7f4d5de36640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5810fcd0 con 0x7f4d58109a70 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d57fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d58109a70 0x7f4d581a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d57fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d58109a70 0x7f4d581a17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:35894/0 (socket says 172.21.15.169:35894) 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d57fff640 1 -- 172.21.15.169:0/2225572529 learned_addr learned my addr 172.21.15.169:0/2225572529 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d56ffd640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d580761a0 0x7f4d5819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d577fe640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d58074b40 0x7f4d5819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d57fff640 1 -- 172.21.15.169:0/2225572529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d58074b40 msgr2=0x7f4d5819a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:47.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d57fff640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d58074b40 0x7f4d5819a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:47.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d57fff640 1 -- 172.21.15.169:0/2225572529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d580761a0 msgr2=0x7f4d5819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:50:47.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d57fff640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d580761a0 0x7f4d5819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:50:47.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d57fff640 1 -- 172.21.15.169:0/2225572529 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d581a1e10 con 0x7f4d58109a70 2024-09-05T12:50:47.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d57fff640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d58109a70 0x7f4d581a17a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009fd0 tx=0x7f4d5000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:50:47.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d54ff9640 1 -- 172.21.15.169:0/2225572529 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d50011830 con 0x7f4d58109a70 2024-09-05T12:50:47.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d54ff9640 1 -- 172.21.15.169:0/2225572529 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d50016070 con 0x7f4d58109a70 2024-09-05T12:50:47.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d5de36640 1 -- 172.21.15.169:0/2225572529 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d581a2100 con 0x7f4d58109a70 2024-09-05T12:50:47.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d54ff9640 1 -- 172.21.15.169:0/2225572529 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000f2e0 con 0x7f4d58109a70 2024-09-05T12:50:47.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.835+0000 7f4d5de36640 1 -- 172.21.15.169:0/2225572529 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d581a26c0 con 0x7f4d58109a70 2024-09-05T12:50:47.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.836+0000 7f4d5de36640 1 -- 172.21.15.169:0/2225572529 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d58108880 con 0x7f4d58109a70 2024-09-05T12:50:47.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.837+0000 7f4d54ff9640 1 -- 172.21.15.169:0/2225572529 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f4d500119d0 con 0x7f4d58109a70 2024-09-05T12:50:47.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.838+0000 7f4d54ff9640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4d400a2b20 0x7f4d400a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:50:47.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.838+0000 7f4d54ff9640 1 -- 172.21.15.169:0/2225572529 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7f4d500ccd30 con 0x7f4d58109a70 2024-09-05T12:50:47.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.838+0000 7f4d577fe640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4d400a2b20 0x7f4d400a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:50:47.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.839+0000 7f4d577fe640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4d400a2b20 0x7f4d400a4fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4d48000f80 tx=0x7f4d48005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:50:47.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:47.843+0000 7f4d54ff9640 1 -- 172.21.15.169:0/2225572529 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d500d1070 con 0x7f4d58109a70 2024-09-05T12:50:48.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:50:48.021+0000 7f4d5de36640 1 -- 172.21.15.169:0/2225572529 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4d58062630 con 0x7f4d400a2b20 2024-09-05T12:50:48.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:50:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: osdmap e11: 2 total, 1 up, 2 in 2024-09-05T12:50:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:50:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:47 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:50:48.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: osdmap e11: 2 total, 1 up, 2 in 2024-09-05T12:50:48.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:48.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:48.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:50:48.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:48.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:48.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:47 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:50:48.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: osdmap e11: 2 total, 1 up, 2 in 2024-09-05T12:50:48.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:48.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:48.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:50:48.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:48.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:48.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:50:48.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:47 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi162 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: osd.1 [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] boot 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: osdmap e12: 2 total, 2 up, 2 in 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:50:49.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:49.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:50:49.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:50:49.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi162 2024-09-05T12:50:49.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-05T12:50:49.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:49.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: osd.1 [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] boot 2024-09-05T12:50:49.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: osdmap e12: 2 total, 2 up, 2 in 2024-09-05T12:50:49.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:49.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:50:49.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:50:49.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:50:49.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:50:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:50:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi162 2024-09-05T12:50:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-05T12:50:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T12:50:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: osd.1 [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] boot 2024-09-05T12:50:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: osdmap e12: 2 total, 2 up, 2 in 2024-09-05T12:50:49.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T12:50:49.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:50:49.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:50:49.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:50:49.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:50.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:50 smithi169 ceph-mon[34823]: osdmap e13: 2 total, 2 up, 2 in 2024-09-05T12:50:50.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:50 smithi169 ceph-mon[34823]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:50.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:50 smithi162 ceph-mon[34220]: osdmap e13: 2 total, 2 up, 2 in 2024-09-05T12:50:50.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:50 smithi162 ceph-mon[34220]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:50.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:50 smithi073 ceph-mon[30883]: osdmap e13: 2 total, 2 up, 2 in 2024-09-05T12:50:50.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:50 smithi073 ceph-mon[30883]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:51.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:51 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/2841844991' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ca9a85b-64f2-42c6-89d8-5acf031950ca"}]: dispatch 2024-09-05T12:50:51.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:51 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ca9a85b-64f2-42c6-89d8-5acf031950ca"}]: dispatch 2024-09-05T12:50:51.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:51 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ca9a85b-64f2-42c6-89d8-5acf031950ca"}]': finished 2024-09-05T12:50:51.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:51 smithi162 ceph-mon[34220]: osdmap e14: 3 total, 2 up, 3 in 2024-09-05T12:50:51.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:51 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:50:51.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:51 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/1457527598' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:50:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:51 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/2841844991' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ca9a85b-64f2-42c6-89d8-5acf031950ca"}]: dispatch 2024-09-05T12:50:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:51 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ca9a85b-64f2-42c6-89d8-5acf031950ca"}]: dispatch 2024-09-05T12:50:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:51 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ca9a85b-64f2-42c6-89d8-5acf031950ca"}]': finished 2024-09-05T12:50:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:51 smithi169 ceph-mon[34823]: osdmap e14: 3 total, 2 up, 3 in 2024-09-05T12:50:51.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:51 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:50:51.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:51 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/1457527598' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:50:51.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:51 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/2841844991' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ca9a85b-64f2-42c6-89d8-5acf031950ca"}]: dispatch 2024-09-05T12:50:51.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:51 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ca9a85b-64f2-42c6-89d8-5acf031950ca"}]: dispatch 2024-09-05T12:50:51.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:51 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ca9a85b-64f2-42c6-89d8-5acf031950ca"}]': finished 2024-09-05T12:50:51.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:51 smithi073 ceph-mon[30883]: osdmap e14: 3 total, 2 up, 3 in 2024-09-05T12:50:51.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:51 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:50:51.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:51 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/1457527598' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:50:52.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:52 smithi162 ceph-mon[34220]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:52.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:52 smithi169 ceph-mon[34823]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:52.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:52 smithi073 ceph-mon[30883]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:55.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:54 smithi073 ceph-mon[30883]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:55.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:54 smithi162 ceph-mon[34220]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:54 smithi169 ceph-mon[34823]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:57.088 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:56 smithi169 ceph-mon[34823]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:57.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:56 smithi073 ceph-mon[30883]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:57.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:56 smithi162 ceph-mon[34220]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:59.225 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:58 smithi169 ceph-mon[34823]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:59.225 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-05T12:50:59.225 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:59.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:58 smithi073 ceph-mon[30883]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:59.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-05T12:50:59.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:50:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:58 smithi162 ceph-mon[34220]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:50:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-05T12:50:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:00.198 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:50:59 smithi169 ceph-mon[34823]: Deploying daemon osd.2 on smithi169 2024-09-05T12:51:00.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:50:59 smithi073 ceph-mon[30883]: Deploying daemon osd.2 on smithi169 2024-09-05T12:51:00.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:50:59 smithi162 ceph-mon[34220]: Deploying daemon osd.2 on smithi169 2024-09-05T12:51:01.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:00 smithi073 ceph-mon[30883]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:01.337 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:00 smithi169 ceph-mon[34823]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:01.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:00 smithi162 ceph-mon[34220]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:03.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:02 smithi169 ceph-mon[34823]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:03.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:02 smithi073 ceph-mon[30883]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:03.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:02 smithi162 ceph-mon[34220]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:04.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:04.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:04.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:04.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:04.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:04.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:05.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:04 smithi073 ceph-mon[30883]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:05.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:04 smithi162 ceph-mon[34220]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:04 smithi169 ceph-mon[34823]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:06.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:06.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:06.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:06.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:06.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:06.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:06 smithi073 ceph-mon[30883]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:06.831 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:06 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:06.832 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:06 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:06.832 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:06 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:06.832 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:06 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:06.832 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:06 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:06.832 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:06 smithi169 ceph-mon[34823]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:06.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:06 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:06.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:06 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:06.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:06 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:06.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:06 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:06.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:06 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:06.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:06 smithi162 ceph-mon[34220]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:07.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.441+0000 7f4d54ff9640 1 -- 172.21.15.169:0/2225572529 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4d58062630 con 0x7f4d400a2b20 2024-09-05T12:51:07.442 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 2 on host 'smithi169' 2024-09-05T12:51:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 -- 172.21.15.169:0/2225572529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4d400a2b20 msgr2=0x7f4d400a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4d400a2b20 0x7f4d400a4fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4d48000f80 tx=0x7f4d48005f80 comp rx=0 tx=0).stop 2024-09-05T12:51:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 -- 172.21.15.169:0/2225572529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d58109a70 msgr2=0x7f4d581a17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d58109a70 0x7f4d581a17a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009fd0 tx=0x7f4d5000b8e0 comp rx=0 tx=0).stop 2024-09-05T12:51:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 -- 172.21.15.169:0/2225572529 shutdown_connections 2024-09-05T12:51:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4d400a2b20 0x7f4d400a4fe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d58109a70 0x7f4d581a17a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d580761a0 0x7f4d5819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 --2- 172.21.15.169:0/2225572529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d58074b40 0x7f4d5819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 -- 172.21.15.169:0/2225572529 >> 172.21.15.169:0/2225572529 conn(0x7f4d580fd390 msgr2=0x7f4d58105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:51:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 -- 172.21.15.169:0/2225572529 shutdown_connections 2024-09-05T12:51:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:07.443+0000 7f4d5de36640 1 -- 172.21.15.169:0/2225572529 wait complete. 2024-09-05T12:51:07.741 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:07 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:07.741 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:07 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:07.741 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:07 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:07.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:07 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:07.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:07 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:07.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:07 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:07.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:07 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:07.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:07 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:07.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:07 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:08.058 DEBUG:teuthology.orchestra.run.smithi169:osd.2> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.2.service 2024-09-05T12:51:08.060 INFO:tasks.cephadm:Deploying osd.3 on smithi073 with /dev/vg_nvme/lv_3... 2024-09-05T12:51:08.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-05T12:51:08.316 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:51:08.586 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:08 smithi169 ceph-mon[34823]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:08.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:08 smithi073 ceph-mon[30883]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:08.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:08 smithi162 ceph-mon[34220]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:09.490 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:09 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2[39767]: 2024-09-05T12:51:09.259+0000 7f4533b29640 -1 osd.2 0 log_to_monitors true 2024-09-05T12:51:09.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:09 smithi073 ceph-mon[30883]: from='osd.2 [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T12:51:09.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:09 smithi073 ceph-mon[30883]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T12:51:09.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:09 smithi162 ceph-mon[34220]: from='osd.2 [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T12:51:09.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:09 smithi162 ceph-mon[34220]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T12:51:09.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:09 smithi169 ceph-mon[34823]: from='osd.2 [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T12:51:09.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:09 smithi169 ceph-mon[34823]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T12:51:10.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:10 smithi073 ceph-mon[30883]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-05T12:51:10.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:10 smithi073 ceph-mon[30883]: osdmap e15: 3 total, 2 up, 3 in 2024-09-05T12:51:10.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:10 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:10.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:10 smithi073 ceph-mon[30883]: from='osd.2 [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:51:10.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:10 smithi073 ceph-mon[30883]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:51:10.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:10 smithi073 ceph-mon[30883]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:10.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:10 smithi162 ceph-mon[34220]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-05T12:51:10.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:10 smithi162 ceph-mon[34220]: osdmap e15: 3 total, 2 up, 3 in 2024-09-05T12:51:10.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:10 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:10.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:10 smithi162 ceph-mon[34220]: from='osd.2 [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:51:10.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:10 smithi162 ceph-mon[34220]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:51:10.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:10 smithi162 ceph-mon[34220]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:10.867 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:10 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2[39767]: 2024-09-05T12:51:10.510+0000 7f452faac640 -1 osd.2 0 waiting for initial osdmap 2024-09-05T12:51:10.867 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:10 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2[39767]: 2024-09-05T12:51:10.514+0000 7f452b8d4640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:51:10.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:10 smithi169 ceph-mon[34823]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-05T12:51:10.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:10 smithi169 ceph-mon[34823]: osdmap e15: 3 total, 2 up, 3 in 2024-09-05T12:51:10.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:10 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:10.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:10 smithi169 ceph-mon[34823]: from='osd.2 [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:51:10.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:10 smithi169 ceph-mon[34823]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:51:10.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:10 smithi169 ceph-mon[34823]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-05T12:51:10.870 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:51:10.896 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_3 2024-09-05T12:51:11.173 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:51:11.562 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: osdmap e16: 3 total, 2 up, 3 in 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi169 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:11.563 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.644+0000 7f6d4629a640 1 -- 172.21.15.73:0/1950411666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d40101c00 msgr2=0x7f6d40102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:11.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.644+0000 7f6d4629a640 1 --2- 172.21.15.73:0/1950411666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d40101c00 0x7f6d40102000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009900 tx=0x7f6d3002a410 comp rx=0 tx=0).stop 2024-09-05T12:51:11.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.644+0000 7f6d4629a640 1 -- 172.21.15.73:0/1950411666 shutdown_connections 2024-09-05T12:51:11.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.644+0000 7f6d4629a640 1 --2- 172.21.15.73:0/1950411666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d401037c0 0x7f6d4010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:11.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.644+0000 7f6d4629a640 1 --2- 172.21.15.73:0/1950411666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d40102e00 0x7f6d40103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:11.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.644+0000 7f6d4629a640 1 --2- 172.21.15.73:0/1950411666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d40101c00 0x7f6d40102000 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:11.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.644+0000 7f6d4629a640 1 -- 172.21.15.73:0/1950411666 >> 172.21.15.73:0/1950411666 conn(0x7f6d400fd390 msgr2=0x7f6d400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:51:11.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.644+0000 7f6d4629a640 1 -- 172.21.15.73:0/1950411666 shutdown_connections 2024-09-05T12:51:11.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.644+0000 7f6d4629a640 1 -- 172.21.15.73:0/1950411666 wait complete. 2024-09-05T12:51:11.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.645+0000 7f6d4629a640 1 Processor -- start 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.645+0000 7f6d4629a640 1 -- start start 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.645+0000 7f6d4629a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d40101c00 0x7f6d40197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.645+0000 7f6d4629a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d40102e00 0x7f6d401984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.645+0000 7f6d4629a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d401037c0 0x7f6d4019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.645+0000 7f6d4629a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4010d8e0 con 0x7f6d40102e00 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.645+0000 7f6d4629a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4010d760 con 0x7f6d401037c0 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.645+0000 7f6d4629a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4010da60 con 0x7f6d40101c00 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d40102e00 0x7f6d401984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d40102e00 0x7f6d401984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55998/0 (socket says 172.21.15.73:55998) 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3f7fe640 1 -- 172.21.15.73:0/2158132593 learned_addr learned my addr 172.21.15.73:0/2158132593 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d44837640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d401037c0 0x7f6d4019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3ffff640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d40101c00 0x7f6d40197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3f7fe640 1 -- 172.21.15.73:0/2158132593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d40101c00 msgr2=0x7f6d40197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3f7fe640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d40101c00 0x7f6d40197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3f7fe640 1 -- 172.21.15.73:0/2158132593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d401037c0 msgr2=0x7f6d4019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3f7fe640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d401037c0 0x7f6d4019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3f7fe640 1 -- 172.21.15.73:0/2158132593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4019fba0 con 0x7f6d40102e00 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3f7fe640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d40102e00 0x7f6d401984b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400b4a0 tx=0x7f6d3400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3d7fa640 1 -- 172.21.15.73:0/2158132593 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34014070 con 0x7f6d40102e00 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d4629a640 1 -- 172.21.15.73:0/2158132593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4019fe90 con 0x7f6d40102e00 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3d7fa640 1 -- 172.21.15.73:0/2158132593 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d34010af0 con 0x7f6d40102e00 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d3d7fa640 1 -- 172.21.15.73:0/2158132593 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34017d10 con 0x7f6d40102e00 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.646+0000 7f6d4629a640 1 -- 172.21.15.73:0/2158132593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d401a0410 con 0x7f6d40102e00 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.647+0000 7f6d4629a640 1 -- 172.21.15.73:0/2158132593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d40108ff0 con 0x7f6d40102e00 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.648+0000 7f6d3d7fa640 1 -- 172.21.15.73:0/2158132593 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f6d34017070 con 0x7f6d40102e00 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.649+0000 7f6d3d7fa640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6d280a2b20 0x7f6d280a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:11.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.649+0000 7f6d3ffff640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6d280a2b20 0x7f6d280a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:11.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.649+0000 7f6d3d7fa640 1 -- 172.21.15.73:0/2158132593 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2851+0+0 (secure 0 0 0) 0x7f6d340ccd30 con 0x7f6d40102e00 2024-09-05T12:51:11.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.650+0000 7f6d3ffff640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6d280a2b20 0x7f6d280a4fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006010 tx=0x7f6d30000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:51:11.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.654+0000 7f6d3d7fa640 1 -- 172.21.15.73:0/2158132593 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d340d1070 con 0x7f6d40102e00 2024-09-05T12:51:11.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:11.827+0000 7f6d4629a640 1 -- 172.21.15.73:0/2158132593 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6d40062630 con 0x7f6d280a2b20 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: osdmap e16: 3 total, 2 up, 3 in 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi169 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:11.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:11.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: osdmap e16: 3 total, 2 up, 3 in 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi169 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:11.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:12.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:51:12.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:51:12.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: osd.2 [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] boot 2024-09-05T12:51:12.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: osdmap e17: 3 total, 3 up, 3 in 2024-09-05T12:51:12.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:12.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:51:12.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:51:12.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:51:12.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:12.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: pgmap v71: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:12.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:12 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: osd.2 [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] boot 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: osdmap e17: 3 total, 3 up, 3 in 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: pgmap v71: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:12.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:12 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-05T12:51:12.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:51:12.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:51:12.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: osd.2 [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] boot 2024-09-05T12:51:12.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: osdmap e17: 3 total, 3 up, 3 in 2024-09-05T12:51:12.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T12:51:12.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:51:12.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:51:12.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:51:12.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:12.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: pgmap v71: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:12.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:12 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-05T12:51:13.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-05T12:51:13.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:13 smithi073 ceph-mon[30883]: osdmap e18: 3 total, 3 up, 3 in 2024-09-05T12:51:13.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T12:51:13.769 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-05T12:51:13.769 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:13 smithi169 ceph-mon[34823]: osdmap e18: 3 total, 3 up, 3 in 2024-09-05T12:51:13.769 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T12:51:13.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-05T12:51:13.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:13 smithi162 ceph-mon[34220]: osdmap e18: 3 total, 3 up, 3 in 2024-09-05T12:51:13.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T12:51:14.115 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:51:13 smithi073 sudo[49111]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T12:51:14.115 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:51:13 smithi073 sudo[49111]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:14.115 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:51:13 smithi073 sudo[49111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:14.115 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:51:13 smithi073 sudo[49111]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:14.414 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:51:14 smithi073 sudo[49146]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T12:51:14.414 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:51:14 smithi073 sudo[49146]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:14.414 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:51:14 smithi073 sudo[49146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:14.415 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 12:51:14 smithi073 sudo[49146]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:14.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:14.528+0000 7f6d3d7fa640 1 -- 172.21.15.73:0/2158132593 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6d34010ca0 con 0x7f6d40102e00 2024-09-05T12:51:14.641 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:51:14 smithi162 sudo[42811]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T12:51:14.641 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:51:14 smithi162 sudo[42811]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:14.641 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:51:14 smithi162 sudo[42811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:14.641 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:51:14 smithi162 sudo[42811]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:14.641 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-05T12:51:14.641 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:14 smithi162 ceph-mon[34220]: osdmap e19: 3 total, 3 up, 3 in 2024-09-05T12:51:14.641 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:14 smithi162 ceph-mon[34220]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:14.642 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:14.642 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:14 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1601605358' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "872dac25-184d-4a09-8f6f-05ed823cac56"}]: dispatch 2024-09-05T12:51:14.642 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:14 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1601605358' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "872dac25-184d-4a09-8f6f-05ed823cac56"}]': finished 2024-09-05T12:51:14.642 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:14 smithi162 ceph-mon[34220]: osdmap e20: 4 total, 3 up, 4 in 2024-09-05T12:51:14.642 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:14.744 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-05T12:51:14.744 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:14 smithi073 ceph-mon[30883]: osdmap e19: 3 total, 3 up, 3 in 2024-09-05T12:51:14.744 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:14 smithi073 ceph-mon[30883]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:14.744 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:14.744 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:14 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1601605358' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "872dac25-184d-4a09-8f6f-05ed823cac56"}]: dispatch 2024-09-05T12:51:14.744 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:14 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1601605358' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "872dac25-184d-4a09-8f6f-05ed823cac56"}]': finished 2024-09-05T12:51:14.744 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:14 smithi073 ceph-mon[30883]: osdmap e20: 4 total, 3 up, 4 in 2024-09-05T12:51:14.744 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:14.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-05T12:51:14.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:14 smithi169 ceph-mon[34823]: osdmap e19: 3 total, 3 up, 3 in 2024-09-05T12:51:14.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:14 smithi169 ceph-mon[34823]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:14.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:14.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:14 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1601605358' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "872dac25-184d-4a09-8f6f-05ed823cac56"}]: dispatch 2024-09-05T12:51:14.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:14 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1601605358' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "872dac25-184d-4a09-8f6f-05ed823cac56"}]': finished 2024-09-05T12:51:14.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:14 smithi169 ceph-mon[34823]: osdmap e20: 4 total, 3 up, 4 in 2024-09-05T12:51:14.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:15.110 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:51:14 smithi162 sudo[42814]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T12:51:15.111 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:51:14 smithi162 sudo[42814]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:15.111 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:51:14 smithi162 sudo[42814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:15.111 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 12:51:14 smithi162 sudo[42814]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:15.178 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:14 smithi169 sudo[43833]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T12:51:15.178 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:14 smithi169 sudo[43833]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:15.178 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:14 smithi169 sudo[43833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:15.178 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:14 smithi169 sudo[43833]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:15.617 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:15 smithi169 sudo[43837]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T12:51:15.617 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:15 smithi169 sudo[43837]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:15.618 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:15 smithi169 sudo[43837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:15.618 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 12:51:15 smithi169 sudo[43837]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:15.710 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 sudo[49227]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T12:51:15.710 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 sudo[49227]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:15.710 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 sudo[49227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:15.710 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 sudo[49227]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:15.971 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:15 smithi169 ceph-mon[34823]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-05T12:51:15.971 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:15.972 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:15 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2146158089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:51:15.972 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:15.972 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:15 smithi169 ceph-mon[34823]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T12:51:15.972 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:15 smithi169 sudo[43840]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T12:51:15.972 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:15 smithi169 sudo[43840]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:15.972 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:15 smithi169 sudo[43840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:15.972 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:15 smithi169 sudo[43840]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:16.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 sudo[49415]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T12:51:16.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 sudo[49415]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:16.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 sudo[49415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:16.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 sudo[49415]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:16.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 ceph-mon[30883]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-05T12:51:16.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:16.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2146158089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:51:16.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:16.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:15 smithi073 ceph-mon[30883]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T12:51:16.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:15 smithi162 ceph-mon[34220]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-05T12:51:16.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:16.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:15 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2146158089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:51:16.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:16.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:15 smithi162 ceph-mon[34220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T12:51:16.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 sudo[43843]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T12:51:16.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 sudo[43843]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:16.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 sudo[43843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:16.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 sudo[43843]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:16.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 sudo[42817]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T12:51:16.720 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 sudo[42817]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:16.720 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 sudo[42817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:16.720 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 sudo[42817]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:17.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T12:51:17.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: pgmap v76: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:51:17.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:51:17.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 sudo[42820]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T12:51:17.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 sudo[42820]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T12:51:17.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 sudo[42820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T12:51:17.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 sudo[42820]: pam_unix(sudo:session): session closed for user root 2024-09-05T12:51:17.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T12:51:17.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:51:17.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:51:17.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:51:17.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T12:51:17.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:51:17.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:51:17.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:51:17.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: pgmap v76: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:17.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T12:51:17.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:51:17.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:51:17.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:51:17.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T12:51:17.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:51:17.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:51:17.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:51:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T12:51:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:51:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:51:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:51:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: pgmap v76: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T12:51:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T12:51:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T12:51:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T12:51:18.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:17 smithi073 ceph-mon[30883]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T12:51:18.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:17 smithi073 ceph-mon[30883]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T12:51:18.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:17 smithi162 ceph-mon[34220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T12:51:18.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:17 smithi162 ceph-mon[34220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T12:51:18.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:17 smithi169 ceph-mon[34823]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T12:51:18.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:17 smithi169 ceph-mon[34823]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T12:51:18.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:18 smithi073 ceph-mon[30883]: pgmap v77: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:19.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:18 smithi162 ceph-mon[34220]: pgmap v77: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:19.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:18 smithi169 ceph-mon[34823]: pgmap v77: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:21.208 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:20 smithi073 ceph-mon[30883]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 320 KiB/s wr, 21 op/s 2024-09-05T12:51:21.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:20 smithi162 ceph-mon[34220]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 320 KiB/s wr, 21 op/s 2024-09-05T12:51:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:20 smithi169 ceph-mon[34823]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 320 KiB/s wr, 21 op/s 2024-09-05T12:51:23.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:22 smithi073 ceph-mon[30883]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 237 KiB/s wr, 15 op/s 2024-09-05T12:51:23.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:22 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-05T12:51:23.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:22 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:23.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:22 smithi162 ceph-mon[34220]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 237 KiB/s wr, 15 op/s 2024-09-05T12:51:23.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:22 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-05T12:51:23.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:22 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:23.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:22 smithi169 ceph-mon[34823]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 237 KiB/s wr, 15 op/s 2024-09-05T12:51:23.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:22 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-05T12:51:23.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:22 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:24.234 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:23 smithi073 ceph-mon[30883]: Deploying daemon osd.3 on smithi073 2024-09-05T12:51:24.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:23 smithi162 ceph-mon[34220]: Deploying daemon osd.3 on smithi073 2024-09-05T12:51:24.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:23 smithi169 ceph-mon[34823]: Deploying daemon osd.3 on smithi073 2024-09-05T12:51:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:24 smithi073 ceph-mon[30883]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 188 KiB/s wr, 12 op/s 2024-09-05T12:51:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:24 smithi162 ceph-mon[34220]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 188 KiB/s wr, 12 op/s 2024-09-05T12:51:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:24 smithi169 ceph-mon[34823]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 188 KiB/s wr, 12 op/s 2024-09-05T12:51:27.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:26 smithi073 ceph-mon[30883]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 156 KiB/s wr, 10 op/s 2024-09-05T12:51:27.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:26 smithi162 ceph-mon[34220]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 156 KiB/s wr, 10 op/s 2024-09-05T12:51:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:26 smithi169 ceph-mon[34823]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 156 KiB/s wr, 10 op/s 2024-09-05T12:51:28.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:28.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:28.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:28.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:28.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:28.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:28.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:29.107 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:28 smithi073 ceph-mon[30883]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-05T12:51:29.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:28 smithi162 ceph-mon[34220]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-05T12:51:29.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:28 smithi169 ceph-mon[34823]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-05T12:51:31.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:30 smithi073 ceph-mon[30883]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-05T12:51:31.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:31.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:31.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.078+0000 7f6d3d7fa640 1 -- 172.21.15.73:0/2158132593 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6d40062630 con 0x7f6d280a2b20 2024-09-05T12:51:31.080 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 3 on host 'smithi073' 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.080+0000 7f6d4629a640 1 -- 172.21.15.73:0/2158132593 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6d280a2b20 msgr2=0x7f6d280a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.080+0000 7f6d4629a640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6d280a2b20 0x7f6d280a4fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006010 tx=0x7f6d30000bc0 comp rx=0 tx=0).stop 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.080+0000 7f6d4629a640 1 -- 172.21.15.73:0/2158132593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d40102e00 msgr2=0x7f6d401984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.080+0000 7f6d4629a640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d40102e00 0x7f6d401984b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400b4a0 tx=0x7f6d3400b960 comp rx=0 tx=0).stop 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.081+0000 7f6d4629a640 1 -- 172.21.15.73:0/2158132593 shutdown_connections 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.081+0000 7f6d4629a640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6d280a2b20 0x7f6d280a4fe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.081+0000 7f6d4629a640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d401037c0 0x7f6d4019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.081+0000 7f6d4629a640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d40102e00 0x7f6d401984b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.081+0000 7f6d4629a640 1 --2- 172.21.15.73:0/2158132593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d40101c00 0x7f6d40197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.081+0000 7f6d4629a640 1 -- 172.21.15.73:0/2158132593 >> 172.21.15.73:0/2158132593 conn(0x7f6d400fd390 msgr2=0x7f6d401061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.081+0000 7f6d4629a640 1 -- 172.21.15.73:0/2158132593 shutdown_connections 2024-09-05T12:51:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:51:31.081+0000 7f6d4629a640 1 -- 172.21.15.73:0/2158132593 wait complete. 2024-09-05T12:51:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:30 smithi162 ceph-mon[34220]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-05T12:51:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:30 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:30 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:30 smithi169 ceph-mon[34823]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-05T12:51:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:30 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:30 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:31.713 DEBUG:teuthology.orchestra.run.smithi073:osd.3> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.3.service 2024-09-05T12:51:31.716 INFO:tasks.cephadm:Deploying osd.4 on smithi162 with /dev/vg_nvme/lv_3... 2024-09-05T12:51:31.716 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-05T12:51:31.973 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T12:51:32.225 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:32 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:32.225 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:32 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:32.225 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:32 smithi073 ceph-mon[30883]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:32 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:32 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:32 smithi162 ceph-mon[34220]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:32 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:32 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:32 smithi169 ceph-mon[34823]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:33.257 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:33 smithi162 ceph-mon[34220]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T12:51:33.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:33 smithi073 ceph-mon[30883]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T12:51:33.263 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 12:51:33 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3[51160]: 2024-09-05T12:51:33.011+0000 7f0d33d60640 -1 osd.3 0 log_to_monitors true 2024-09-05T12:51:33.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:33 smithi169 ceph-mon[34823]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T12:51:34.262 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:34 smithi073 ceph-mon[30883]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-05T12:51:34.262 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:34 smithi073 ceph-mon[30883]: osdmap e21: 4 total, 3 up, 4 in 2024-09-05T12:51:34.262 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:34 smithi073 ceph-mon[30883]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:51:34.262 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:34.262 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:34 smithi073 ceph-mon[30883]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:34.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:34 smithi162 ceph-mon[34220]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-05T12:51:34.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:34 smithi162 ceph-mon[34220]: osdmap e21: 4 total, 3 up, 4 in 2024-09-05T12:51:34.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:34 smithi162 ceph-mon[34220]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:51:34.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:34.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:34 smithi162 ceph-mon[34220]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:34.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:34 smithi169 ceph-mon[34823]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-05T12:51:34.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:34 smithi169 ceph-mon[34823]: osdmap e21: 4 total, 3 up, 4 in 2024-09-05T12:51:34.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:34 smithi169 ceph-mon[34823]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:51:34.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:34.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:34 smithi169 ceph-mon[34823]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-05T12:51:34.506 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:51:34.513 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 12:51:34 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3[51160]: 2024-09-05T12:51:34.453+0000 7f0d2fce3640 -1 osd.3 0 waiting for initial osdmap 2024-09-05T12:51:34.513 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 12:51:34 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3[51160]: 2024-09-05T12:51:34.459+0000 7f0d27b03640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:51:34.534 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-09-05T12:51:34.797 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T12:51:35.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:51:35.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: osdmap e22: 4 total, 3 up, 4 in 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi073 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi073 to 8544M 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:35.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:35.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:35.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:35.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:35.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:35 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.283+0000 7f98ab7d5640 1 -- 172.21.15.162:0/2261079910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a4102df0 msgr2=0x7f98a4103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:35.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.283+0000 7f98ab7d5640 1 --2- 172.21.15.162:0/2261079910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a4102df0 0x7f98a4103270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9894009900 tx=0x7f989402a410 comp rx=0 tx=0).stop 2024-09-05T12:51:35.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.283+0000 7f98ab7d5640 1 -- 172.21.15.162:0/2261079910 shutdown_connections 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.283+0000 7f98ab7d5640 1 --2- 172.21.15.162:0/2261079910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a41037b0 0x7f98a410a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.283+0000 7f98ab7d5640 1 --2- 172.21.15.162:0/2261079910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a4102df0 0x7f98a4103270 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.283+0000 7f98ab7d5640 1 --2- 172.21.15.162:0/2261079910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98a4101bf0 0x7f98a4101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.283+0000 7f98ab7d5640 1 -- 172.21.15.162:0/2261079910 >> 172.21.15.162:0/2261079910 conn(0x7f98a40fd3c0 msgr2=0x7f98a40ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.283+0000 7f98ab7d5640 1 -- 172.21.15.162:0/2261079910 shutdown_connections 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.283+0000 7f98ab7d5640 1 -- 172.21.15.162:0/2261079910 wait complete. 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98ab7d5640 1 Processor -- start 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98ab7d5640 1 -- start start 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98ab7d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a4101bf0 0x7f98a4197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98ab7d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a4102df0 0x7f98a41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98ab7d5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98a41037b0 0x7f98a419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:35.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98ab7d5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98a410d870 con 0x7f98a4101bf0 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98ab7d5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98a410d6f0 con 0x7f98a4102df0 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98ab7d5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f98a410d9f0 con 0x7f98a41037b0 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a8d70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a4102df0 0x7f98a41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a8d70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a4102df0 0x7f98a41983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:33826/0 (socket says 172.21.15.162:33826) 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a8d70640 1 -- 172.21.15.162:0/1272616398 learned_addr learned my addr 172.21.15.162:0/1272616398 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a9571640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a4101bf0 0x7f98a4197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a9d72640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98a41037b0 0x7f98a419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a9571640 1 -- 172.21.15.162:0/1272616398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98a41037b0 msgr2=0x7f98a419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a9571640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98a41037b0 0x7f98a419f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a9571640 1 -- 172.21.15.162:0/1272616398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a4102df0 msgr2=0x7f98a41983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:35.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a9571640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a4102df0 0x7f98a41983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a9571640 1 -- 172.21.15.162:0/1272616398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a419fad0 con 0x7f98a4101bf0 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a8d70640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a4102df0 0x7f98a41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.284+0000 7f98a9d72640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98a41037b0 0x7f98a419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.285+0000 7f98a9571640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a4101bf0 0x7f98a4197ea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f98a4102c50 tx=0x7f98a000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.285+0000 7f989a7fc640 1 -- 172.21.15.162:0/1272616398 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0017070 con 0x7f98a4101bf0 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.285+0000 7f989a7fc640 1 -- 172.21.15.162:0/1272616398 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a0010460 con 0x7f98a4101bf0 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.285+0000 7f98ab7d5640 1 -- 172.21.15.162:0/1272616398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a419fdc0 con 0x7f98a4101bf0 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.285+0000 7f989a7fc640 1 -- 172.21.15.162:0/1272616398 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a000f620 con 0x7f98a4101bf0 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.285+0000 7f98ab7d5640 1 -- 172.21.15.162:0/1272616398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a41a01c0 con 0x7f98a4101bf0 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.286+0000 7f98ab7d5640 1 -- 172.21.15.162:0/1272616398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a4108fa0 con 0x7f98a4101bf0 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.287+0000 7f989a7fc640 1 -- 172.21.15.162:0/1272616398 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f98a001a070 con 0x7f98a4101bf0 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.287+0000 7f989a7fc640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f98900a2bb0 0x7f98900a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:35.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.288+0000 7f989a7fc640 1 -- 172.21.15.162:0/1272616398 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3702+0+0 (secure 0 0 0) 0x7f98a00cd810 con 0x7f98a4101bf0 2024-09-05T12:51:35.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.288+0000 7f98a8d70640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f98900a2bb0 0x7f98900a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:35.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.288+0000 7f98a8d70640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f98900a2bb0 0x7f98900a5070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9894031440 tx=0x7f98940315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:51:35.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.291+0000 7f989a7fc640 1 -- 172.21.15.162:0/1272616398 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98a009b8d0 con 0x7f98a4101bf0 2024-09-05T12:51:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:51:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: osdmap e22: 4 total, 3 up, 4 in 2024-09-05T12:51:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' 2024-09-05T12:51:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi073 2024-09-05T12:51:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:51:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:51:35.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi073 to 8544M 2024-09-05T12:51:35.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:35.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:35.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:35.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:35.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:35.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:35 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:51:35.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: osdmap e22: 4 total, 3 up, 4 in 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076]' entity='osd.3' 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi073 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi073 to 8544M 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:35.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:35.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:35.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:35 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:35.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:35.476+0000 7f98ab7d5640 1 -- 172.21.15.162:0/1272616398 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f98a4062630 con 0x7f98900a2bb0 2024-09-05T12:51:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:36 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:51:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:36 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:51:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:36 smithi162 ceph-mon[34220]: osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] boot 2024-09-05T12:51:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:36 smithi162 ceph-mon[34220]: osdmap e23: 4 total, 4 up, 4 in 2024-09-05T12:51:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:36 smithi162 ceph-mon[34220]: from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:51:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:51:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:51:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:36 smithi162 ceph-mon[34220]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:36.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:36 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:51:36.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:36 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:51:36.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:36 smithi169 ceph-mon[34823]: osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] boot 2024-09-05T12:51:36.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:36 smithi169 ceph-mon[34823]: osdmap e23: 4 total, 4 up, 4 in 2024-09-05T12:51:36.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:36.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:36 smithi169 ceph-mon[34823]: from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:51:36.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:51:36.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:51:36.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:36.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:36 smithi169 ceph-mon[34823]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:36.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:36 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:51:36.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:36 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:51:36.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:36 smithi073 ceph-mon[30883]: osd.3 [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] boot 2024-09-05T12:51:36.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:36 smithi073 ceph-mon[30883]: osdmap e23: 4 total, 4 up, 4 in 2024-09-05T12:51:36.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T12:51:36.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:36 smithi073 ceph-mon[30883]: from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:51:36.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:51:36.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:51:36.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:36.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:36 smithi073 ceph-mon[30883]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:37 smithi162 ceph-mon[34220]: osdmap e24: 4 total, 4 up, 4 in 2024-09-05T12:51:37.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:37 smithi169 ceph-mon[34823]: osdmap e24: 4 total, 4 up, 4 in 2024-09-05T12:51:37.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:37 smithi073 ceph-mon[30883]: osdmap e24: 4 total, 4 up, 4 in 2024-09-05T12:51:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:38 smithi162 ceph-mon[34220]: osdmap e25: 4 total, 4 up, 4 in 2024-09-05T12:51:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:38 smithi162 ceph-mon[34220]: from='client.? 172.21.15.162:0/2272851848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80300180-a992-4ec2-b072-5d87d9df1e07"}]: dispatch 2024-09-05T12:51:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:38 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80300180-a992-4ec2-b072-5d87d9df1e07"}]: dispatch 2024-09-05T12:51:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:38 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80300180-a992-4ec2-b072-5d87d9df1e07"}]': finished 2024-09-05T12:51:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:38 smithi162 ceph-mon[34220]: osdmap e26: 5 total, 4 up, 5 in 2024-09-05T12:51:38.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:51:38.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:38 smithi162 ceph-mon[34220]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:38 smithi169 ceph-mon[34823]: osdmap e25: 4 total, 4 up, 4 in 2024-09-05T12:51:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:38 smithi169 ceph-mon[34823]: from='client.? 172.21.15.162:0/2272851848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80300180-a992-4ec2-b072-5d87d9df1e07"}]: dispatch 2024-09-05T12:51:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:38 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80300180-a992-4ec2-b072-5d87d9df1e07"}]: dispatch 2024-09-05T12:51:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:38 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80300180-a992-4ec2-b072-5d87d9df1e07"}]': finished 2024-09-05T12:51:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:38 smithi169 ceph-mon[34823]: osdmap e26: 5 total, 4 up, 5 in 2024-09-05T12:51:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:51:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:38 smithi169 ceph-mon[34823]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:38.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:38 smithi073 ceph-mon[30883]: osdmap e25: 4 total, 4 up, 4 in 2024-09-05T12:51:38.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:38 smithi073 ceph-mon[30883]: from='client.? 172.21.15.162:0/2272851848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80300180-a992-4ec2-b072-5d87d9df1e07"}]: dispatch 2024-09-05T12:51:38.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:38 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80300180-a992-4ec2-b072-5d87d9df1e07"}]: dispatch 2024-09-05T12:51:38.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:38 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80300180-a992-4ec2-b072-5d87d9df1e07"}]': finished 2024-09-05T12:51:38.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:38 smithi073 ceph-mon[30883]: osdmap e26: 5 total, 4 up, 5 in 2024-09-05T12:51:38.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:51:38.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:38 smithi073 ceph-mon[30883]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:39 smithi162 ceph-mon[34220]: from='client.? 172.21.15.162:0/3811137425' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:51:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:39 smithi162 ceph-mon[34220]: osdmap e27: 5 total, 4 up, 5 in 2024-09-05T12:51:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:51:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:39 smithi169 ceph-mon[34823]: from='client.? 172.21.15.162:0/3811137425' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:51:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:39 smithi169 ceph-mon[34823]: osdmap e27: 5 total, 4 up, 5 in 2024-09-05T12:51:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:51:39.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:39 smithi073 ceph-mon[30883]: from='client.? 172.21.15.162:0/3811137425' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:51:39.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:39 smithi073 ceph-mon[30883]: osdmap e27: 5 total, 4 up, 5 in 2024-09-05T12:51:39.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:51:40.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:40 smithi169 ceph-mon[34823]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T12:51:40.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:40 smithi073 ceph-mon[30883]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T12:51:40.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:40 smithi162 ceph-mon[34220]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T12:51:43.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:42 smithi073 ceph-mon[30883]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-05T12:51:43.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:42 smithi162 ceph-mon[34220]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-05T12:51:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:42 smithi169 ceph-mon[34823]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-05T12:51:45.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:44 smithi162 ceph-mon[34220]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-05T12:51:45.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:44 smithi073 ceph-mon[30883]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-05T12:51:45.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:44 smithi169 ceph-mon[34823]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-05T12:51:47.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:46 smithi073 ceph-mon[30883]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-05T12:51:47.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:46 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-05T12:51:47.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:46 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:47.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:46 smithi162 ceph-mon[34220]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-05T12:51:47.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:46 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-05T12:51:47.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:46 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:46 smithi169 ceph-mon[34823]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-05T12:51:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:46 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-05T12:51:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:46 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:48.244 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:47 smithi162 ceph-mon[34220]: Deploying daemon osd.4 on smithi162 2024-09-05T12:51:48.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:47 smithi073 ceph-mon[30883]: Deploying daemon osd.4 on smithi162 2024-09-05T12:51:48.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:47 smithi169 ceph-mon[34823]: Deploying daemon osd.4 on smithi162 2024-09-05T12:51:49.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:48 smithi162 ceph-mon[34220]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T12:51:49.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:48 smithi073 ceph-mon[30883]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T12:51:49.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:48 smithi169 ceph-mon[34823]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T12:51:51.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:50 smithi073 ceph-mon[30883]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-05T12:51:51.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:50 smithi162 ceph-mon[34220]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-05T12:51:51.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:50 smithi169 ceph-mon[34823]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-05T12:51:52.254 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:51 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:52.254 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:51 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:52.254 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:51 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:51 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:51 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:51 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:52.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:51 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:52.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:51 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:52.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:51 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:53.251 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:53 smithi162 ceph-mon[34220]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:53.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:52 smithi073 ceph-mon[30883]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:53.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:53 smithi169 ceph-mon[34823]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:55.217 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:55 smithi162 ceph-mon[34220]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:55.217 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:55.217 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:55.217 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:55.217 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:55.217 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:55.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:55 smithi073 ceph-mon[30883]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:55.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:55.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:55.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:55.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:55.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:55 smithi169 ceph-mon[34823]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:51:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:51:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:55.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.573+0000 7f989a7fc640 1 -- 172.21.15.162:0/1272616398 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f98a4062630 con 0x7f98900a2bb0 2024-09-05T12:51:55.575 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 4 on host 'smithi162' 2024-09-05T12:51:55.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 -- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f98900a2bb0 msgr2=0x7f98900a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:55.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f98900a2bb0 0x7f98900a5070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9894031440 tx=0x7f98940315b0 comp rx=0 tx=0).stop 2024-09-05T12:51:55.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 -- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a4101bf0 msgr2=0x7f98a4197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:55.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a4101bf0 0x7f98a4197ea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f98a4102c50 tx=0x7f98a000dbb0 comp rx=0 tx=0).stop 2024-09-05T12:51:55.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 -- 172.21.15.162:0/1272616398 shutdown_connections 2024-09-05T12:51:55.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f98900a2bb0 0x7f98900a5070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:55.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98a41037b0 0x7f98a419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:55.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a4102df0 0x7f98a41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:55.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 --2- 172.21.15.162:0/1272616398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a4101bf0 0x7f98a4197ea0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:55.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 -- 172.21.15.162:0/1272616398 >> 172.21.15.162:0/1272616398 conn(0x7f98a40fd3c0 msgr2=0x7f98a4106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:51:55.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 -- 172.21.15.162:0/1272616398 shutdown_connections 2024-09-05T12:51:55.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:51:55.576+0000 7f98ab7d5640 1 -- 172.21.15.162:0/1272616398 wait complete. 2024-09-05T12:51:56.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:56.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:56.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:56.237 DEBUG:teuthology.orchestra.run.smithi162:osd.4> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.4.service 2024-09-05T12:51:56.239 INFO:tasks.cephadm:Deploying osd.5 on smithi169 with /dev/vg_nvme/lv_3... 2024-09-05T12:51:56.240 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-05T12:51:56.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:56.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:56.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:56.268 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:51:56.268 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:56.268 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:51:56.495 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:51:57.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:57 smithi073 ceph-mon[30883]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:57.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:57 smithi162 ceph-mon[34220]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:57.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 12:51:57 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4[45430]: 2024-09-05T12:51:57.196+0000 7f054ec80640 -1 osd.4 0 log_to_monitors true 2024-09-05T12:51:57.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:57 smithi169 ceph-mon[34823]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:58.262 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:58 smithi169 ceph-mon[34823]: from='osd.4 [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T12:51:58.263 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:58 smithi169 ceph-mon[34823]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T12:51:58.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:58 smithi073 ceph-mon[30883]: from='osd.4 [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T12:51:58.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:58 smithi073 ceph-mon[30883]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T12:51:58.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:58 smithi162 ceph-mon[34220]: from='osd.4 [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T12:51:58.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:58 smithi162 ceph-mon[34220]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T12:51:58.992 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:51:59.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_3 2024-09-05T12:51:59.311 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:51:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:59 smithi162 ceph-mon[34220]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:59 smithi162 ceph-mon[34220]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-05T12:51:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:59 smithi162 ceph-mon[34220]: osdmap e28: 5 total, 4 up, 5 in 2024-09-05T12:51:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:59 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:51:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:59 smithi162 ceph-mon[34220]: from='osd.4 [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:51:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:51:59 smithi162 ceph-mon[34220]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:51:59.361 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 12:51:59 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4[45430]: 2024-09-05T12:51:59.022+0000 7f054ac03640 -1 osd.4 0 waiting for initial osdmap 2024-09-05T12:51:59.361 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 12:51:59 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4[45430]: 2024-09-05T12:51:59.027+0000 7f0546a2b640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:51:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:59 smithi169 ceph-mon[34823]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:59 smithi169 ceph-mon[34823]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-05T12:51:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:59 smithi169 ceph-mon[34823]: osdmap e28: 5 total, 4 up, 5 in 2024-09-05T12:51:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:59 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:51:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:59 smithi169 ceph-mon[34823]: from='osd.4 [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:51:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:51:59 smithi169 ceph-mon[34823]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:51:59.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:59 smithi073 ceph-mon[30883]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:51:59.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:59 smithi073 ceph-mon[30883]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-05T12:51:59.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:59 smithi073 ceph-mon[30883]: osdmap e28: 5 total, 4 up, 5 in 2024-09-05T12:51:59.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:59 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:51:59.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:59 smithi073 ceph-mon[30883]: from='osd.4 [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:51:59.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:51:59 smithi073 ceph-mon[30883]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:51:59.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.777+0000 7f26c9005640 1 -- 172.21.15.169:0/1203870383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c4100b10 msgr2=0x7f26c4100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:59.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.777+0000 7f26c9005640 1 --2- 172.21.15.169:0/1203870383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c4100b10 0x7f26c4100f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009900 tx=0x7f26ac02a410 comp rx=0 tx=0).stop 2024-09-05T12:51:59.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.778+0000 7f26c9005640 1 -- 172.21.15.169:0/1203870383 shutdown_connections 2024-09-05T12:51:59.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.778+0000 7f26c9005640 1 --2- 172.21.15.169:0/1203870383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26c41026d0 0x7f26c4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:59.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.778+0000 7f26c9005640 1 --2- 172.21.15.169:0/1203870383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c4101d10 0x7f26c4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:59.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.778+0000 7f26c9005640 1 --2- 172.21.15.169:0/1203870383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c4100b10 0x7f26c4100f10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:59.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.778+0000 7f26c9005640 1 -- 172.21.15.169:0/1203870383 >> 172.21.15.169:0/1203870383 conn(0x7f26c40fc2a0 msgr2=0x7f26c40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:51:59.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.778+0000 7f26c9005640 1 -- 172.21.15.169:0/1203870383 shutdown_connections 2024-09-05T12:51:59.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.778+0000 7f26c9005640 1 -- 172.21.15.169:0/1203870383 wait complete. 2024-09-05T12:51:59.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.778+0000 7f26c9005640 1 Processor -- start 2024-09-05T12:51:59.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c9005640 1 -- start start 2024-09-05T12:51:59.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c9005640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26c4100b10 0x7f26c4196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:59.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c9005640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c4101d10 0x7f26c4197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:59.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c9005640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c41026d0 0x7f26c419e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:59.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c9005640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f26c410c790 con 0x7f26c4100b10 2024-09-05T12:51:59.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c9005640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26c410c610 con 0x7f26c4101d10 2024-09-05T12:51:59.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c9005640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26c410c910 con 0x7f26c41026d0 2024-09-05T12:51:59.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c359e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c41026d0 0x7f26c419e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:59.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26c4100b10 0x7f26c4196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:59.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c359e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c41026d0 0x7f26c419e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:56556/0 (socket says 172.21.15.169:56556) 2024-09-05T12:51:59.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c359e640 1 -- 172.21.15.169:0/3924150890 learned_addr learned my addr 172.21.15.169:0/3924150890 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:51:59.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c259c640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c4101d10 0x7f26c4197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:59.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c359e640 1 -- 172.21.15.169:0/3924150890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c4101d10 msgr2=0x7f26c4197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:59.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c359e640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c4101d10 0x7f26c4197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:59.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c359e640 1 -- 172.21.15.169:0/3924150890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26c4100b10 msgr2=0x7f26c4196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:51:59.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c359e640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26c4100b10 0x7f26c4196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:51:59.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c359e640 1 -- 172.21.15.169:0/3924150890 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c406a810 con 0x7f26c41026d0 2024-09-05T12:51:59.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c2d9d640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26c4100b10 0x7f26c4196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:51:59.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.779+0000 7f26c359e640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c41026d0 0x7f26c419e3e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00eb10 tx=0x7f26bc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:51:59.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.780+0000 7f26bbfff640 1 -- 172.21.15.169:0/3924150890 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc004b20 con 0x7f26c41026d0 2024-09-05T12:51:59.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.780+0000 7f26c9005640 1 -- 172.21.15.169:0/3924150890 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c406ab00 con 0x7f26c41026d0 2024-09-05T12:51:59.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.780+0000 7f26bbfff640 1 -- 172.21.15.169:0/3924150890 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26bc004cc0 con 0x7f26c41026d0 2024-09-05T12:51:59.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.780+0000 7f26bbfff640 1 -- 172.21.15.169:0/3924150890 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc010760 con 0x7f26c41026d0 2024-09-05T12:51:59.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.780+0000 7f26c9005640 1 -- 172.21.15.169:0/3924150890 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c406b040 con 0x7f26c41026d0 2024-09-05T12:51:59.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.781+0000 7f26c9005640 1 -- 172.21.15.169:0/3924150890 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c4107f80 con 0x7f26c41026d0 2024-09-05T12:51:59.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.782+0000 7f26bbfff640 1 -- 172.21.15.169:0/3924150890 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f26bc005020 con 0x7f26c41026d0 2024-09-05T12:51:59.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.783+0000 7f26bbfff640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26b00a2bb0 0x7f26b00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:51:59.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.783+0000 7f26bbfff640 1 -- 172.21.15.169:0/3924150890 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f26bc0ce430 con 0x7f26c41026d0 2024-09-05T12:51:59.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.783+0000 7f26c2d9d640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26b00a2bb0 0x7f26b00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:51:59.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.783+0000 7f26c2d9d640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26b00a2bb0 0x7f26b00a5070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f26ac005ab0 tx=0x7f26ac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:51:59.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.787+0000 7f26bbfff640 1 -- 172.21.15.169:0/3924150890 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26bc09c520 con 0x7f26c41026d0 2024-09-05T12:51:59.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:51:59.963+0000 7f26c9005640 1 -- 172.21.15.169:0/3924150890 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f26c406b300 con 0x7f26b00a2bb0 2024-09-05T12:52:00.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:52:00.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: osdmap e29: 5 total, 4 up, 5 in 2024-09-05T12:52:00.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:52:00.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:52:00.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:00.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:00.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:00.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:00.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:52:00.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:52:00.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:00.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:52:00.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: osdmap e29: 5 total, 4 up, 5 in 2024-09-05T12:52:00.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:52:00.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:52:00.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:00.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:00.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:00.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:00.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:52:00.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:52:00.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:00.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:52:00.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: osdmap e29: 5 total, 4 up, 5 in 2024-09-05T12:52:00.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:52:00.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:52:00.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:01.343 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:01 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:52:01.343 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:01 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:52:01.343 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:01 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi162 2024-09-05T12:52:01.343 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:01 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-05T12:52:01.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:01 smithi169 ceph-mon[34823]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:52:01.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:01 smithi169 ceph-mon[34823]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:52:01.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:01 smithi169 ceph-mon[34823]: osd.4 [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] boot 2024-09-05T12:52:01.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:01 smithi169 ceph-mon[34823]: osdmap e30: 5 total, 5 up, 5 in 2024-09-05T12:52:01.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:01 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:52:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:01 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:52:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:01 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:52:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:01 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi162 2024-09-05T12:52:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:01 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-05T12:52:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:01 smithi162 ceph-mon[34220]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:52:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:01 smithi162 ceph-mon[34220]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:52:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:01 smithi162 ceph-mon[34220]: osd.4 [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] boot 2024-09-05T12:52:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:01 smithi162 ceph-mon[34220]: osdmap e30: 5 total, 5 up, 5 in 2024-09-05T12:52:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:01 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:52:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:01 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:52:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:01 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:52:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:01 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi162 2024-09-05T12:52:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:01 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-05T12:52:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:01 smithi073 ceph-mon[30883]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-05T12:52:01.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:01 smithi073 ceph-mon[30883]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:52:01.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:01 smithi073 ceph-mon[30883]: osd.4 [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] boot 2024-09-05T12:52:01.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:01 smithi073 ceph-mon[30883]: osdmap e30: 5 total, 5 up, 5 in 2024-09-05T12:52:01.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:01 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T12:52:02.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:02 smithi162 ceph-mon[34220]: osdmap e31: 5 total, 5 up, 5 in 2024-09-05T12:52:02.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:02 smithi169 ceph-mon[34823]: osdmap e31: 5 total, 5 up, 5 in 2024-09-05T12:52:02.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:02 smithi073 ceph-mon[30883]: osdmap e31: 5 total, 5 up, 5 in 2024-09-05T12:52:03.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:03 smithi162 ceph-mon[34220]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:03.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:03 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/3761499893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbfe5aa2-e557-4217-9a26-1bfb6c75e659"}]: dispatch 2024-09-05T12:52:03.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:03 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbfe5aa2-e557-4217-9a26-1bfb6c75e659"}]: dispatch 2024-09-05T12:52:03.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:03 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbfe5aa2-e557-4217-9a26-1bfb6c75e659"}]': finished 2024-09-05T12:52:03.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:03 smithi162 ceph-mon[34220]: osdmap e32: 6 total, 5 up, 6 in 2024-09-05T12:52:03.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:03.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:03 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/1493162438' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:52:03.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:03 smithi169 ceph-mon[34823]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:03.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:03 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/3761499893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbfe5aa2-e557-4217-9a26-1bfb6c75e659"}]: dispatch 2024-09-05T12:52:03.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:03 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbfe5aa2-e557-4217-9a26-1bfb6c75e659"}]: dispatch 2024-09-05T12:52:03.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:03 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbfe5aa2-e557-4217-9a26-1bfb6c75e659"}]': finished 2024-09-05T12:52:03.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:03 smithi169 ceph-mon[34823]: osdmap e32: 6 total, 5 up, 6 in 2024-09-05T12:52:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:03 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/1493162438' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:52:03.415 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:03 smithi073 ceph-mon[30883]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:03.415 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:03 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/3761499893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbfe5aa2-e557-4217-9a26-1bfb6c75e659"}]: dispatch 2024-09-05T12:52:03.415 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:03 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbfe5aa2-e557-4217-9a26-1bfb6c75e659"}]: dispatch 2024-09-05T12:52:03.415 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:03 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbfe5aa2-e557-4217-9a26-1bfb6c75e659"}]': finished 2024-09-05T12:52:03.415 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:03 smithi073 ceph-mon[30883]: osdmap e32: 6 total, 5 up, 6 in 2024-09-05T12:52:03.415 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:03.415 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:03 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/1493162438' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:52:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:05 smithi162 ceph-mon[34220]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:05 smithi169 ceph-mon[34823]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:05 smithi073 ceph-mon[30883]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:07.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:07 smithi162 ceph-mon[34220]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:07 smithi169 ceph-mon[34823]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:07.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:07 smithi073 ceph-mon[30883]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:09.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:09 smithi162 ceph-mon[34220]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:09 smithi169 ceph-mon[34823]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:09 smithi073 ceph-mon[30883]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:11.360 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:11 smithi169 ceph-mon[34823]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:11.360 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-05T12:52:11.360 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:11.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:11 smithi162 ceph-mon[34220]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-05T12:52:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:11 smithi073 ceph-mon[30883]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-05T12:52:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:12.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:12 smithi162 ceph-mon[34220]: Deploying daemon osd.5 on smithi169 2024-09-05T12:52:12.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:12 smithi169 ceph-mon[34823]: Deploying daemon osd.5 on smithi169 2024-09-05T12:52:12.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:12 smithi073 ceph-mon[30883]: Deploying daemon osd.5 on smithi169 2024-09-05T12:52:13.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:13 smithi162 ceph-mon[34220]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:13.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:13 smithi169 ceph-mon[34823]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:13.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:13 smithi073 ceph-mon[30883]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:14.342 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:14 smithi169 ceph-mon[34823]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:14.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:14 smithi162 ceph-mon[34220]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:14.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:14 smithi073 ceph-mon[30883]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:16 smithi169 ceph-mon[34823]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:17.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:17.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:16 smithi073 ceph-mon[30883]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:17.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:17.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:17.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:16 smithi162 ceph-mon[34220]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:19.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:18 smithi073 ceph-mon[30883]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:19.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:19.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:19.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:19.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:19.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:18 smithi162 ceph-mon[34220]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:18 smithi169 ceph-mon[34823]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:19.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:19.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:19.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.008+0000 7f26bbfff640 1 -- 172.21.15.169:0/3924150890 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f26c406b300 con 0x7f26b00a2bb0 2024-09-05T12:52:20.011 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 5 on host 'smithi169' 2024-09-05T12:52:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 -- 172.21.15.169:0/3924150890 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26b00a2bb0 msgr2=0x7f26b00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:52:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26b00a2bb0 0x7f26b00a5070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f26ac005ab0 tx=0x7f26ac000bc0 comp rx=0 tx=0).stop 2024-09-05T12:52:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 -- 172.21.15.169:0/3924150890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c41026d0 msgr2=0x7f26c419e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:52:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c41026d0 0x7f26c419e3e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00eb10 tx=0x7f26bc00c2d0 comp rx=0 tx=0).stop 2024-09-05T12:52:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 -- 172.21.15.169:0/3924150890 shutdown_connections 2024-09-05T12:52:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26b00a2bb0 0x7f26b00a5070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c41026d0 0x7f26c419e3e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c4101d10 0x7f26c4197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 --2- 172.21.15.169:0/3924150890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26c4100b10 0x7f26c4196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 -- 172.21.15.169:0/3924150890 >> 172.21.15.169:0/3924150890 conn(0x7f26c40fc2a0 msgr2=0x7f26c4105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:52:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 -- 172.21.15.169:0/3924150890 shutdown_connections 2024-09-05T12:52:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:52:20.011+0000 7f26c9005640 1 -- 172.21.15.169:0/3924150890 wait complete. 2024-09-05T12:52:20.633 DEBUG:teuthology.orchestra.run.smithi169:osd.5> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.5.service 2024-09-05T12:52:20.636 INFO:tasks.cephadm:Deploying osd.6 on smithi073 with /dev/vg_nvme/lv_2... 2024-09-05T12:52:20.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-05T12:52:20.896 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:52:21.246 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:20 smithi073 ceph-mon[30883]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:21.246 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:21.246 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:21.246 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:21.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:20 smithi162 ceph-mon[34220]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:20 smithi169 ceph-mon[34823]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:22.368 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 12:52:22 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5[46645]: 2024-09-05T12:52:22.171+0000 7f11284cb640 -1 osd.5 0 log_to_monitors true 2024-09-05T12:52:23.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:23 smithi169 ceph-mon[34823]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:23.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:23 smithi169 ceph-mon[34823]: from='osd.5 [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T12:52:23.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:23 smithi169 ceph-mon[34823]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T12:52:23.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:23 smithi073 ceph-mon[30883]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:23.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:23 smithi073 ceph-mon[30883]: from='osd.5 [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T12:52:23.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:23 smithi073 ceph-mon[30883]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T12:52:23.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:23 smithi162 ceph-mon[34220]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:23.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:23 smithi162 ceph-mon[34220]: from='osd.5 [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T12:52:23.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:23 smithi162 ceph-mon[34220]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T12:52:23.369 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:52:23.395 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_2 2024-09-05T12:52:23.654 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:52:24.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.170+0000 7f71dca1b640 1 -- 172.21.15.73:0/1360959943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71d8102690 msgr2=0x7f71d8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:52:24.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.170+0000 7f71dca1b640 1 --2- 172.21.15.73:0/1360959943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71d8102690 0x7f71d8108f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009ca0 tx=0x7f71d002a8c0 comp rx=0 tx=0).stop 2024-09-05T12:52:24.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.171+0000 7f71dca1b640 1 -- 172.21.15.73:0/1360959943 shutdown_connections 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.171+0000 7f71dca1b640 1 --2- 172.21.15.73:0/1360959943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71d8102690 0x7f71d8108f20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.171+0000 7f71dca1b640 1 --2- 172.21.15.73:0/1360959943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d8101cd0 0x7f71d8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.171+0000 7f71dca1b640 1 --2- 172.21.15.73:0/1360959943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71d8100ad0 0x7f71d8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.171+0000 7f71dca1b640 1 -- 172.21.15.73:0/1360959943 >> 172.21.15.73:0/1360959943 conn(0x7f71d80fc280 msgr2=0x7f71d80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.171+0000 7f71dca1b640 1 -- 172.21.15.73:0/1360959943 shutdown_connections 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.171+0000 7f71dca1b640 1 -- 172.21.15.73:0/1360959943 wait complete. 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.171+0000 7f71dca1b640 1 Processor -- start 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.171+0000 7f71dca1b640 1 -- start start 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71dca1b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d8100ad0 0x7f71d806ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71dca1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71d8101cd0 0x7f71d819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71dca1b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71d8102690 0x7f71d819f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:52:24.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71dca1b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f71d810c7d0 con 0x7f71d8101cd0 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71dca1b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71d810c650 con 0x7f71d8100ad0 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71dca1b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71d810c950 con 0x7f71d8102690 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71d8102690 0x7f71d819f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71d8102690 0x7f71d819f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:52270/0 (socket says 172.21.15.73:52270) 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d6d9d640 1 -- 172.21.15.73:0/852330052 learned_addr learned my addr 172.21.15.73:0/852330052 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d5d9b640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71d8101cd0 0x7f71d819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d659c640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d8100ad0 0x7f71d806ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d6d9d640 1 -- 172.21.15.73:0/852330052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d8100ad0 msgr2=0x7f71d806ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d6d9d640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d8100ad0 0x7f71d806ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d6d9d640 1 -- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71d8101cd0 msgr2=0x7f71d819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d6d9d640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71d8101cd0 0x7f71d819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:24.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d6d9d640 1 -- 172.21.15.73:0/852330052 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d819fb20 con 0x7f71d8102690 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d5d9b640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71d8101cd0 0x7f71d819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.172+0000 7f71d6d9d640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71d8102690 0x7f71d819f260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71d0005e30 tx=0x7f71d0031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.173+0000 7f71c77fe640 1 -- 172.21.15.73:0/852330052 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0003b70 con 0x7f71d8102690 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.173+0000 7f71c77fe640 1 -- 172.21.15.73:0/852330052 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71d0003d10 con 0x7f71d8102690 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.173+0000 7f71c77fe640 1 -- 172.21.15.73:0/852330052 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d002fd30 con 0x7f71d8102690 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.173+0000 7f71dca1b640 1 -- 172.21.15.73:0/852330052 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d819fdb0 con 0x7f71d8102690 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.173+0000 7f71dca1b640 1 -- 172.21.15.73:0/852330052 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d81a02e0 con 0x7f71d8102690 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.174+0000 7f71dca1b640 1 -- 172.21.15.73:0/852330052 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d8107ea0 con 0x7f71d8102690 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.175+0000 7f71c77fe640 1 -- 172.21.15.73:0/852330052 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f71d006fae0 con 0x7f71d8102690 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.176+0000 7f71c77fe640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71c00a2b80 0x7f71c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.176+0000 7f71d659c640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71c00a2b80 0x7f71c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.176+0000 7f71c77fe640 1 -- 172.21.15.73:0/852330052 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4253+0+0 (secure 0 0 0) 0x7f71d00ef4a0 con 0x7f71d8102690 2024-09-05T12:52:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.176+0000 7f71d659c640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71c00a2b80 0x7f71c00a5040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71d8101b30 tx=0x7f71cc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:52:24.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.179+0000 7f71c77fe640 1 -- 172.21.15.73:0/852330052 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71d00bd340 con 0x7f71d8102690 2024-09-05T12:52:24.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-05T12:52:24.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: osdmap e33: 6 total, 5 up, 6 in 2024-09-05T12:52:24.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:24.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='osd.5 [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:52:24.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:52:24.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:24.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-05T12:52:24.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: osdmap e33: 6 total, 5 up, 6 in 2024-09-05T12:52:24.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:24.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='osd.5 [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:52:24.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:52:24.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:24.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:24.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:24.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:24.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:24.360+0000 7f71dca1b640 1 -- 172.21.15.73:0/852330052 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f71d8062630 con 0x7f71c00a2b80 2024-09-05T12:52:24.367 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5[46645]: 2024-09-05T12:52:24.011+0000 7f112444e640 -1 osd.5 0 waiting for initial osdmap 2024-09-05T12:52:24.367 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5[46645]: 2024-09-05T12:52:24.017+0000 7f1120276640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:52:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-05T12:52:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: osdmap e33: 6 total, 5 up, 6 in 2024-09-05T12:52:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='osd.5 [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:52:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:52:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:24.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:24.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:24.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:24.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:24.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:25 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi169 2024-09-05T12:52:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:25 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-05T12:52:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:25 smithi073 ceph-mon[30883]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:25 smithi073 ceph-mon[30883]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:52:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:25 smithi073 ceph-mon[30883]: osdmap e34: 6 total, 5 up, 6 in 2024-09-05T12:52:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:52:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:52:25.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:25 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi169 2024-09-05T12:52:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:25 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-05T12:52:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:25 smithi162 ceph-mon[34220]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:25 smithi162 ceph-mon[34220]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:52:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:25 smithi162 ceph-mon[34220]: osdmap e34: 6 total, 5 up, 6 in 2024-09-05T12:52:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:52:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:52:25.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:25 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi169 2024-09-05T12:52:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:25 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-05T12:52:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:25 smithi169 ceph-mon[34823]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:25 smithi169 ceph-mon[34823]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:52:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:25 smithi169 ceph-mon[34823]: osdmap e34: 6 total, 5 up, 6 in 2024-09-05T12:52:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:52:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:52:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:26.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:26 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:52:26.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:26 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:52:26.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:26 smithi073 ceph-mon[30883]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:52:26.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:26 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:26.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:26 smithi073 ceph-mon[30883]: osd.5 [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] boot 2024-09-05T12:52:26.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:26 smithi073 ceph-mon[30883]: osdmap e35: 6 total, 6 up, 6 in 2024-09-05T12:52:26.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:26 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:26 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:52:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:26 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:52:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:26 smithi162 ceph-mon[34220]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:52:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:26 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:26 smithi162 ceph-mon[34220]: osd.5 [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] boot 2024-09-05T12:52:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:26 smithi162 ceph-mon[34220]: osdmap e35: 6 total, 6 up, 6 in 2024-09-05T12:52:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:26 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:26 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:52:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:26 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:52:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:26 smithi169 ceph-mon[34823]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:52:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:26 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:26 smithi169 ceph-mon[34823]: osd.5 [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] boot 2024-09-05T12:52:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:26 smithi169 ceph-mon[34823]: osdmap e35: 6 total, 6 up, 6 in 2024-09-05T12:52:26.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:26 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T12:52:27.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:27 smithi073 ceph-mon[30883]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:27.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:27 smithi073 ceph-mon[30883]: osdmap e36: 6 total, 6 up, 6 in 2024-09-05T12:52:27.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:27 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/166213209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "873c54c3-a55e-4994-b850-56c22cb1d92a"}]: dispatch 2024-09-05T12:52:27.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:27 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/166213209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "873c54c3-a55e-4994-b850-56c22cb1d92a"}]': finished 2024-09-05T12:52:27.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:27 smithi073 ceph-mon[30883]: osdmap e37: 7 total, 6 up, 7 in 2024-09-05T12:52:27.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:27.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:27 smithi073 ceph-mon[30883]: osdmap e38: 7 total, 6 up, 7 in 2024-09-05T12:52:27.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:27 smithi162 ceph-mon[34220]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:27 smithi162 ceph-mon[34220]: osdmap e36: 6 total, 6 up, 6 in 2024-09-05T12:52:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:27 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/166213209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "873c54c3-a55e-4994-b850-56c22cb1d92a"}]: dispatch 2024-09-05T12:52:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:27 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/166213209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "873c54c3-a55e-4994-b850-56c22cb1d92a"}]': finished 2024-09-05T12:52:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:27 smithi162 ceph-mon[34220]: osdmap e37: 7 total, 6 up, 7 in 2024-09-05T12:52:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:27 smithi162 ceph-mon[34220]: osdmap e38: 7 total, 6 up, 7 in 2024-09-05T12:52:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:27 smithi169 ceph-mon[34823]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-05T12:52:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:27 smithi169 ceph-mon[34823]: osdmap e36: 6 total, 6 up, 6 in 2024-09-05T12:52:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:27 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/166213209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "873c54c3-a55e-4994-b850-56c22cb1d92a"}]: dispatch 2024-09-05T12:52:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:27 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/166213209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "873c54c3-a55e-4994-b850-56c22cb1d92a"}]': finished 2024-09-05T12:52:27.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:27 smithi169 ceph-mon[34823]: osdmap e37: 7 total, 6 up, 7 in 2024-09-05T12:52:27.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:27.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:27 smithi169 ceph-mon[34823]: osdmap e38: 7 total, 6 up, 7 in 2024-09-05T12:52:27.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:28.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:28 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/883792651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:52:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:28 smithi162 ceph-mon[34220]: osdmap e39: 7 total, 6 up, 7 in 2024-09-05T12:52:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:28 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:28.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:28 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/883792651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:52:28.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:28 smithi169 ceph-mon[34823]: osdmap e39: 7 total, 6 up, 7 in 2024-09-05T12:52:28.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:28 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:28.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:28 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/883792651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:52:28.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:28 smithi073 ceph-mon[30883]: osdmap e39: 7 total, 6 up, 7 in 2024-09-05T12:52:28.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:28 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:29.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:29 smithi162 ceph-mon[34220]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:29.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:29 smithi169 ceph-mon[34823]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:29.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:29 smithi073 ceph-mon[30883]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:31.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:31 smithi162 ceph-mon[34220]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T12:52:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:31 smithi169 ceph-mon[34823]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T12:52:31.449 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:31 smithi073 ceph-mon[30883]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T12:52:33.120 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:33 smithi073 ceph-mon[30883]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-05T12:52:33.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:33 smithi162 ceph-mon[34220]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-05T12:52:33.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:33 smithi169 ceph-mon[34823]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-05T12:52:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:35 smithi162 ceph-mon[34220]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-05T12:52:35.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:35 smithi169 ceph-mon[34823]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-05T12:52:35.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:35 smithi073 ceph-mon[30883]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-05T12:52:36.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-05T12:52:36.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-05T12:52:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:36.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-05T12:52:36.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:37.167 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:37 smithi073 ceph-mon[30883]: Deploying daemon osd.6 on smithi073 2024-09-05T12:52:37.167 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:37 smithi073 ceph-mon[30883]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-05T12:52:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:37 smithi162 ceph-mon[34220]: Deploying daemon osd.6 on smithi073 2024-09-05T12:52:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:37 smithi162 ceph-mon[34220]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-05T12:52:37.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:37 smithi169 ceph-mon[34823]: Deploying daemon osd.6 on smithi073 2024-09-05T12:52:37.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:37 smithi169 ceph-mon[34823]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-05T12:52:39.243 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:39 smithi073 ceph-mon[30883]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-05T12:52:39.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:39 smithi162 ceph-mon[34220]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-05T12:52:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:39 smithi169 ceph-mon[34823]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-05T12:52:41.196 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:41 smithi073 ceph-mon[30883]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:52:41.197 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:41 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:41.197 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:41 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:41.197 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:41 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:41 smithi162 ceph-mon[34220]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:52:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:41 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:41 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:41 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:41 smithi169 ceph-mon[34823]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:52:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:41 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:41 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:41 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:43.132 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:43 smithi073 ceph-mon[30883]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:43.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:43 smithi162 ceph-mon[34220]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:43.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:43 smithi169 ceph-mon[34823]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:44.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:44 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:44.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:44 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:44.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:44 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:44.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:44 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:44.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:44 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:44.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:44 smithi073 ceph-mon[30883]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:44.436 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 6 on host 'smithi073' 2024-09-05T12:52:44.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.434+0000 7f71c77fe640 1 -- 172.21.15.73:0/852330052 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f71d8062630 con 0x7f71c00a2b80 2024-09-05T12:52:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.436+0000 7f71dca1b640 1 -- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71c00a2b80 msgr2=0x7f71c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:52:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.436+0000 7f71dca1b640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71c00a2b80 0x7f71c00a5040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71d8101b30 tx=0x7f71cc009110 comp rx=0 tx=0).stop 2024-09-05T12:52:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.436+0000 7f71dca1b640 1 -- 172.21.15.73:0/852330052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71d8102690 msgr2=0x7f71d819f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:52:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.436+0000 7f71dca1b640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71d8102690 0x7f71d819f260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71d0005e30 tx=0x7f71d0031ee0 comp rx=0 tx=0).stop 2024-09-05T12:52:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.436+0000 7f71dca1b640 1 -- 172.21.15.73:0/852330052 shutdown_connections 2024-09-05T12:52:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.436+0000 7f71dca1b640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71c00a2b80 0x7f71c00a5040 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.436+0000 7f71dca1b640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71d8102690 0x7f71d819f260 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.436+0000 7f71dca1b640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71d8101cd0 0x7f71d819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.436+0000 7f71dca1b640 1 --2- 172.21.15.73:0/852330052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d8100ad0 0x7f71d806ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.436+0000 7f71dca1b640 1 -- 172.21.15.73:0/852330052 >> 172.21.15.73:0/852330052 conn(0x7f71d80fc280 msgr2=0x7f71d8105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:52:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.437+0000 7f71dca1b640 1 -- 172.21.15.73:0/852330052 shutdown_connections 2024-09-05T12:52:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:52:44.437+0000 7f71dca1b640 1 -- 172.21.15.73:0/852330052 wait complete. 2024-09-05T12:52:44.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:44 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:44.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:44 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:44.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:44 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:44.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:44 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:44.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:44 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:44.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:44 smithi162 ceph-mon[34220]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:44.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:44 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:44.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:44 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:44.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:44 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:44.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:44 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:44.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:44 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:44.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:44 smithi169 ceph-mon[34823]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:45.186 DEBUG:teuthology.orchestra.run.smithi073:osd.6> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.6.service 2024-09-05T12:52:45.188 INFO:tasks.cephadm:Deploying osd.7 on smithi162 with /dev/vg_nvme/lv_2... 2024-09-05T12:52:45.189 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-05T12:52:45.449 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T12:52:45.512 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:45 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:45.512 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:45 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:45.512 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:45 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:45.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:45.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:45.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:45 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:45.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:45 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:52:45.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:45 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:45.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:45 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:46.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:46 smithi162 ceph-mon[34220]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:46.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:46 smithi169 ceph-mon[34823]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:46.621 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:46 smithi073 ceph-mon[30883]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:46.621 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 12:52:46 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6[57642]: 2024-09-05T12:52:46.520+0000 7fcc89671640 -1 osd.6 0 log_to_monitors true 2024-09-05T12:52:47.380 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:47 smithi162 ceph-mon[34220]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-05T12:52:47.616 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:47 smithi073 ceph-mon[30883]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-05T12:52:47.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:47 smithi169 ceph-mon[34823]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-05T12:52:47.996 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:52:48.025 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-09-05T12:52:48.274 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T12:52:48.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-05T12:52:48.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: osdmap e40: 7 total, 6 up, 7 in 2024-09-05T12:52:48.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:52:48.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:48.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:48.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi073 2024-09-05T12:52:48.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:48.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:48.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:48.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi073 to 5696M 2024-09-05T12:52:48.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:48.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:48.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:48 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: osdmap e40: 7 total, 6 up, 7 in 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi073 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi073 to 5696M 2024-09-05T12:52:48.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:48.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:48.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:48 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.763 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6[57642]: 2024-09-05T12:52:48.315+0000 7fcc855f4640 -1 osd.6 0 waiting for initial osdmap 2024-09-05T12:52:48.763 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6[57642]: 2024-09-05T12:52:48.326+0000 7fcc8141c640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:52:48.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-05T12:52:48.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: osdmap e40: 7 total, 6 up, 7 in 2024-09-05T12:52:48.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi073 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi073 to 5696M 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:52:48.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:48 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:52:48.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.779+0000 7f114cc99640 1 -- 172.21.15.162:0/605556726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1148102e00 msgr2=0x7f1148103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:52:48.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.779+0000 7f114cc99640 1 --2- 172.21.15.162:0/605556726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1148102e00 0x7f1148103280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1138009900 tx=0x7f113802a410 comp rx=0 tx=0).stop 2024-09-05T12:52:48.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.779+0000 7f114cc99640 1 -- 172.21.15.162:0/605556726 shutdown_connections 2024-09-05T12:52:48.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.779+0000 7f114cc99640 1 --2- 172.21.15.162:0/605556726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11481037c0 0x7f114810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:48.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.779+0000 7f114cc99640 1 --2- 172.21.15.162:0/605556726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1148102e00 0x7f1148103280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:48.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.779+0000 7f114cc99640 1 --2- 172.21.15.162:0/605556726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1148101c00 0x7f1148102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:48.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.779+0000 7f114cc99640 1 -- 172.21.15.162:0/605556726 >> 172.21.15.162:0/605556726 conn(0x7f11480fd390 msgr2=0x7f11480ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:52:48.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.779+0000 7f114cc99640 1 -- 172.21.15.162:0/605556726 shutdown_connections 2024-09-05T12:52:48.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.779+0000 7f114cc99640 1 -- 172.21.15.162:0/605556726 wait complete. 2024-09-05T12:52:48.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.779+0000 7f114cc99640 1 Processor -- start 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f114cc99640 1 -- start start 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f114cc99640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1148101c00 0x7f1148075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f114cc99640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1148102e00 0x7f11480745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f114cc99640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11481037c0 0x7f1148074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f114cc99640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f114810d860 con 0x7f11481037c0 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f114cc99640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f114810d6e0 con 0x7f1148102e00 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f114cc99640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f114810d9e0 con 0x7f1148101c00 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f1145d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1148102e00 0x7f11480745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f1145d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1148102e00 0x7f11480745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54080/0 (socket says 172.21.15.162:54080) 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f1145d9b640 1 -- 172.21.15.162:0/501931937 learned_addr learned my addr 172.21.15.162:0/501931937 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f114659c640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1148101c00 0x7f1148075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f1146d9d640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11481037c0 0x7f1148074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:52:48.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f1145d9b640 1 -- 172.21.15.162:0/501931937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1148101c00 msgr2=0x7f1148075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f1145d9b640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1148101c00 0x7f1148075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f1145d9b640 1 -- 172.21.15.162:0/501931937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11481037c0 msgr2=0x7f1148074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f1145d9b640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11481037c0 0x7f1148074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f1145d9b640 1 -- 172.21.15.162:0/501931937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11480753e0 con 0x7f1148102e00 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.780+0000 7f1145d9b640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1148102e00 0x7f11480745e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1138009230 tx=0x7f1138004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.781+0000 7f113f7fe640 1 -- 172.21.15.162:0/501931937 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113803f030 con 0x7f1148102e00 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.781+0000 7f113f7fe640 1 -- 172.21.15.162:0/501931937 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1138003ce0 con 0x7f1148102e00 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.781+0000 7f113f7fe640 1 -- 172.21.15.162:0/501931937 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138035070 con 0x7f1148102e00 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.781+0000 7f114cc99640 1 -- 172.21.15.162:0/501931937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11481a2010 con 0x7f1148102e00 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.781+0000 7f114cc99640 1 -- 172.21.15.162:0/501931937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11481a2470 con 0x7f1148102e00 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.782+0000 7f114cc99640 1 -- 172.21.15.162:0/501931937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1148109050 con 0x7f1148102e00 2024-09-05T12:52:48.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.783+0000 7f113f7fe640 1 -- 172.21.15.162:0/501931937 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1138042030 con 0x7f1148102e00 2024-09-05T12:52:48.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.783+0000 7f113f7fe640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f11340a2b80 0x7f11340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:52:48.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.784+0000 7f113f7fe640 1 -- 172.21.15.162:0/501931937 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7f11380eec20 con 0x7f1148102e00 2024-09-05T12:52:48.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.784+0000 7f114659c640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f11340a2b80 0x7f11340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:52:48.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.784+0000 7f114659c640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f11340a2b80 0x7f11340a5040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1148102c60 tx=0x7f113000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:52:48.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.787+0000 7f113f7fe640 1 -- 172.21.15.162:0/501931937 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11380bc9b0 con 0x7f1148102e00 2024-09-05T12:52:48.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:52:48.961+0000 7f114cc99640 1 -- 172.21.15.162:0/501931937 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1148062630 con 0x7f11340a2b80 2024-09-05T12:52:49.600 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:49 smithi162 ceph-mon[34220]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:52:49.600 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:49 smithi162 ceph-mon[34220]: osdmap e41: 7 total, 6 up, 7 in 2024-09-05T12:52:49.600 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:49 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:49.600 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:49 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:49.600 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:49 smithi162 ceph-mon[34220]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:52:49.600 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:49 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:52:49.601 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:49 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:52:49.601 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:49 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:49.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:49 smithi169 ceph-mon[34823]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:52:49.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:49 smithi169 ceph-mon[34823]: osdmap e41: 7 total, 6 up, 7 in 2024-09-05T12:52:49.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:49 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:49.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:49 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:49.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:49 smithi169 ceph-mon[34823]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:52:49.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:49 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:52:49.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:49 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:52:49.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:49 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:49.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:49 smithi073 ceph-mon[30883]: from='osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:52:49.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:49 smithi073 ceph-mon[30883]: osdmap e41: 7 total, 6 up, 7 in 2024-09-05T12:52:49.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:49 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:49.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:49 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:49.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:49 smithi073 ceph-mon[30883]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:52:49.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:49 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:52:49.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:49 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:52:49.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:49 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:52:50.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:50 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:52:50.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:50 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:52:50.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:50.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:50 smithi162 ceph-mon[34220]: osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] boot 2024-09-05T12:52:50.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:50 smithi162 ceph-mon[34220]: osdmap e42: 7 total, 7 up, 7 in 2024-09-05T12:52:50.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:50.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:50 smithi162 ceph-mon[34220]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:50.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:50 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:52:50.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:50 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:52:50.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:50.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:50 smithi169 ceph-mon[34823]: osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] boot 2024-09-05T12:52:50.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:50 smithi169 ceph-mon[34823]: osdmap e42: 7 total, 7 up, 7 in 2024-09-05T12:52:50.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:50.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:50 smithi169 ceph-mon[34823]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:50.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:50 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:52:50.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:50 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:52:50.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:50.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:50 smithi073 ceph-mon[30883]: osd.6 [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] boot 2024-09-05T12:52:50.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:50 smithi073 ceph-mon[30883]: osdmap e42: 7 total, 7 up, 7 in 2024-09-05T12:52:50.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T12:52:50.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:50 smithi073 ceph-mon[30883]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-05T12:52:51.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:51 smithi162 ceph-mon[34220]: osdmap e43: 7 total, 7 up, 7 in 2024-09-05T12:52:51.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:51 smithi169 ceph-mon[34823]: osdmap e43: 7 total, 7 up, 7 in 2024-09-05T12:52:51.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:51 smithi073 ceph-mon[30883]: osdmap e43: 7 total, 7 up, 7 in 2024-09-05T12:52:52.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:52 smithi162 ceph-mon[34220]: from='client.? 172.21.15.162:0/2222226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec604cbe-a213-4979-99bb-959531e665d6"}]: dispatch 2024-09-05T12:52:52.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:52 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec604cbe-a213-4979-99bb-959531e665d6"}]: dispatch 2024-09-05T12:52:52.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:52 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec604cbe-a213-4979-99bb-959531e665d6"}]': finished 2024-09-05T12:52:52.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:52 smithi162 ceph-mon[34220]: osdmap e44: 8 total, 7 up, 8 in 2024-09-05T12:52:52.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:52:52.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:52 smithi162 ceph-mon[34220]: from='client.? 172.21.15.162:0/378460486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:52:52.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:52 smithi162 ceph-mon[34220]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:52.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:52 smithi169 ceph-mon[34823]: from='client.? 172.21.15.162:0/2222226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec604cbe-a213-4979-99bb-959531e665d6"}]: dispatch 2024-09-05T12:52:52.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:52 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec604cbe-a213-4979-99bb-959531e665d6"}]: dispatch 2024-09-05T12:52:52.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:52 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec604cbe-a213-4979-99bb-959531e665d6"}]': finished 2024-09-05T12:52:52.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:52 smithi169 ceph-mon[34823]: osdmap e44: 8 total, 7 up, 8 in 2024-09-05T12:52:52.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:52:52.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:52 smithi169 ceph-mon[34823]: from='client.? 172.21.15.162:0/378460486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:52:52.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:52 smithi169 ceph-mon[34823]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:52.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:52 smithi073 ceph-mon[30883]: from='client.? 172.21.15.162:0/2222226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec604cbe-a213-4979-99bb-959531e665d6"}]: dispatch 2024-09-05T12:52:52.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:52 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec604cbe-a213-4979-99bb-959531e665d6"}]: dispatch 2024-09-05T12:52:52.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:52 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec604cbe-a213-4979-99bb-959531e665d6"}]': finished 2024-09-05T12:52:52.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:52 smithi073 ceph-mon[30883]: osdmap e44: 8 total, 7 up, 8 in 2024-09-05T12:52:52.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:52:52.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:52 smithi073 ceph-mon[30883]: from='client.? 172.21.15.162:0/378460486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:52:52.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:52 smithi073 ceph-mon[30883]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:55.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:54 smithi073 ceph-mon[30883]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:55.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:54 smithi162 ceph-mon[34220]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:54 smithi169 ceph-mon[34823]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:57.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:56 smithi073 ceph-mon[30883]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:57.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:56 smithi162 ceph-mon[34220]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:57.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:56 smithi169 ceph-mon[34823]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:59.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:52:58 smithi073 ceph-mon[30883]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:59.292 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:52:58 smithi162 ceph-mon[34220]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:52:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:52:58 smithi169 ceph-mon[34823]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:00.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-05T12:53:00.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:00 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:00.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-05T12:53:00.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:00 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:00.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-05T12:53:00.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:00 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:01.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:01 smithi073 ceph-mon[30883]: Deploying daemon osd.7 on smithi162 2024-09-05T12:53:01.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:01 smithi073 ceph-mon[30883]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:01.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:01 smithi162 ceph-mon[34220]: Deploying daemon osd.7 on smithi162 2024-09-05T12:53:01.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:01 smithi162 ceph-mon[34220]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:01.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:01 smithi169 ceph-mon[34823]: Deploying daemon osd.7 on smithi162 2024-09-05T12:53:01.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:01 smithi169 ceph-mon[34823]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:03.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:03 smithi073 ceph-mon[30883]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:03.305 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:03 smithi162 ceph-mon[34220]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:03.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:03 smithi169 ceph-mon[34823]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:05.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:05 smithi073 ceph-mon[30883]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:05.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:05 smithi162 ceph-mon[34220]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:05 smithi169 ceph-mon[34823]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:06.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:06 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:06.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:06 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:06.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:06 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:06.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:06 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:06.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:06 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:06.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:06 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:07.047 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:07 smithi162 ceph-mon[34220]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:07.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:07 smithi073 ceph-mon[30883]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:07 smithi169 ceph-mon[34823]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:08.683 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 7 on host 'smithi162' 2024-09-05T12:53:08.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.682+0000 7f113f7fe640 1 -- 172.21.15.162:0/501931937 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1148062630 con 0x7f11340a2b80 2024-09-05T12:53:08.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.685+0000 7f114cc99640 1 -- 172.21.15.162:0/501931937 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f11340a2b80 msgr2=0x7f11340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:08.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.685+0000 7f114cc99640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f11340a2b80 0x7f11340a5040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1148102c60 tx=0x7f113000b390 comp rx=0 tx=0).stop 2024-09-05T12:53:08.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.685+0000 7f114cc99640 1 -- 172.21.15.162:0/501931937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1148102e00 msgr2=0x7f11480745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:08.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.685+0000 7f114cc99640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1148102e00 0x7f11480745e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1138009230 tx=0x7f1138004360 comp rx=0 tx=0).stop 2024-09-05T12:53:08.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.686+0000 7f114cc99640 1 -- 172.21.15.162:0/501931937 shutdown_connections 2024-09-05T12:53:08.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.686+0000 7f114cc99640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f11340a2b80 0x7f11340a5040 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:08.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.686+0000 7f114cc99640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11481037c0 0x7f1148074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:08.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.686+0000 7f114cc99640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1148102e00 0x7f11480745e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:08.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.686+0000 7f114cc99640 1 --2- 172.21.15.162:0/501931937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1148101c00 0x7f1148075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:08.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.686+0000 7f114cc99640 1 -- 172.21.15.162:0/501931937 >> 172.21.15.162:0/501931937 conn(0x7f11480fd390 msgr2=0x7f1148106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:53:08.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.686+0000 7f114cc99640 1 -- 172.21.15.162:0/501931937 shutdown_connections 2024-09-05T12:53:08.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:53:08.686+0000 7f114cc99640 1 -- 172.21.15.162:0/501931937 wait complete. 2024-09-05T12:53:09.291 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:09 smithi162 ceph-mon[34220]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:09.291 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:09 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.291 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:09 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.291 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:09 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.291 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:09 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.324 DEBUG:teuthology.orchestra.run.smithi162:osd.7> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.7.service 2024-09-05T12:53:09.326 INFO:tasks.cephadm:Deploying osd.8 on smithi169 with /dev/vg_nvme/lv_2... 2024-09-05T12:53:09.327 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-05T12:53:09.355 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:09 smithi169 ceph-mon[34823]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:09.357 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:09 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.357 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:09 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.357 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:09 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.357 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:09 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:09 smithi073 ceph-mon[30883]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:09 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:09 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:09 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:09 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:09.582 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:53:11.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:11 smithi162 ceph-mon[34220]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:11.261 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:11 smithi169 ceph-mon[34823]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:11 smithi073 ceph-mon[30883]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:11.861 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 12:53:11 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7[52339]: 2024-09-05T12:53:11.516+0000 7f20e91ea640 -1 osd.7 0 log_to_monitors true 2024-09-05T12:53:12.223 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:12 smithi162 ceph-mon[34220]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T12:53:12.307 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:12 smithi169 ceph-mon[34823]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T12:53:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:53:12.337 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_2 2024-09-05T12:53:12.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:12 smithi073 ceph-mon[30883]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T12:53:12.628 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:53:13.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.113+0000 7f38a52fa640 1 -- 172.21.15.169:0/923623075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a0102e00 msgr2=0x7f38a0103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:13.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.113+0000 7f38a52fa640 1 --2- 172.21.15.169:0/923623075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a0102e00 0x7f38a0103280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3894009900 tx=0x7f389402a410 comp rx=0 tx=0).stop 2024-09-05T12:53:13.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.113+0000 7f38a52fa640 1 -- 172.21.15.169:0/923623075 shutdown_connections 2024-09-05T12:53:13.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.113+0000 7f38a52fa640 1 --2- 172.21.15.169:0/923623075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a01037c0 0x7f38a010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:13.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.113+0000 7f38a52fa640 1 --2- 172.21.15.169:0/923623075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a0102e00 0x7f38a0103280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:13.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.113+0000 7f38a52fa640 1 --2- 172.21.15.169:0/923623075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0101c00 0x7f38a0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.113+0000 7f38a52fa640 1 -- 172.21.15.169:0/923623075 >> 172.21.15.169:0/923623075 conn(0x7f38a00fd390 msgr2=0x7f38a00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.113+0000 7f38a52fa640 1 -- 172.21.15.169:0/923623075 shutdown_connections 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.113+0000 7f38a52fa640 1 -- 172.21.15.169:0/923623075 wait complete. 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f38a52fa640 1 Processor -- start 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f38a52fa640 1 -- start start 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f38a52fa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101c00 0x7f38a0197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f38a52fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0102e00 0x7f38a0198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f38a52fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01037c0 0x7f38a019f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f38a52fa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f38a010d860 con 0x7f38a0101c00 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f38a52fa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38a010d6e0 con 0x7f38a0102e00 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f38a52fa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f38a010d9e0 con 0x7f38a01037c0 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01037c0 0x7f38a019f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:53:13.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01037c0 0x7f38a019f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:57100/0 (socket says 172.21.15.169:57100) 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f389f7fe640 1 -- 172.21.15.169:0/3177376155 learned_addr learned my addr 172.21.15.169:0/3177376155 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f389e7fc640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0102e00 0x7f38a0198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f389effd640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101c00 0x7f38a0197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f389f7fe640 1 -- 172.21.15.169:0/3177376155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0102e00 msgr2=0x7f38a0198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f389f7fe640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0102e00 0x7f38a0198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f389f7fe640 1 -- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101c00 msgr2=0x7f38a0197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.114+0000 7f389f7fe640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101c00 0x7f38a0197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.115+0000 7f389f7fe640 1 -- 172.21.15.169:0/3177376155 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a019fa30 con 0x7f38a01037c0 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.115+0000 7f389effd640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101c00 0x7f38a0197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.115+0000 7f389f7fe640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01037c0 0x7f38a019f3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f389800eaa0 tx=0x7f389800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.115+0000 7f3887fff640 1 -- 172.21.15.169:0/3177376155 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389800cdb0 con 0x7f38a01037c0 2024-09-05T12:53:13.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.115+0000 7f38a52fa640 1 -- 172.21.15.169:0/3177376155 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a019fd20 con 0x7f38a01037c0 2024-09-05T12:53:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.115+0000 7f3887fff640 1 -- 172.21.15.169:0/3177376155 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3898005020 con 0x7f38a01037c0 2024-09-05T12:53:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.115+0000 7f3887fff640 1 -- 172.21.15.169:0/3177376155 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38980116b0 con 0x7f38a01037c0 2024-09-05T12:53:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.115+0000 7f38a52fa640 1 -- 172.21.15.169:0/3177376155 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a01a01d0 con 0x7f38a01037c0 2024-09-05T12:53:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.116+0000 7f38a52fa640 1 -- 172.21.15.169:0/3177376155 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a0108f80 con 0x7f38a01037c0 2024-09-05T12:53:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.118+0000 7f3887fff640 1 -- 172.21.15.169:0/3177376155 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3898005560 con 0x7f38a01037c0 2024-09-05T12:53:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.118+0000 7f3887fff640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38880a2bb0 0x7f38880a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:53:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.119+0000 7f3887fff640 1 -- 172.21.15.169:0/3177376155 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7f38980cea10 con 0x7f38a01037c0 2024-09-05T12:53:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.119+0000 7f389effd640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38880a2bb0 0x7f38880a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:53:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.119+0000 7f389effd640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38880a2bb0 0x7f38880a5070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38a0102c60 tx=0x7f389000a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:53:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.122+0000 7f3887fff640 1 -- 172.21.15.169:0/3177376155 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3898016030 con 0x7f38a01037c0 2024-09-05T12:53:13.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:13.295+0000 7f38a52fa640 1 -- 172.21.15.169:0/3177376155 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f38a0062630 con 0x7f38880a2bb0 2024-09-05T12:53:13.297 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:13.297 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-05T12:53:13.297 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: osdmap e45: 8 total, 7 up, 8 in 2024-09-05T12:53:13.297 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:53:13.297 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:13.297 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.297 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.297 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:13.297 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:13.298 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:13.298 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.298 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:13.298 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:13.298 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.298 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:13.298 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:13.298 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:13.298 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.361 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7[52339]: 2024-09-05T12:53:13.037+0000 7f20e516d640 -1 osd.7 0 waiting for initial osdmap 2024-09-05T12:53:13.361 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7[52339]: 2024-09-05T12:53:13.048+0000 7f20e0f95640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:53:13.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:13.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-05T12:53:13.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: osdmap e45: 8 total, 7 up, 8 in 2024-09-05T12:53:13.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:13.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:13.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-05T12:53:13.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: osdmap e45: 8 total, 7 up, 8 in 2024-09-05T12:53:13.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:13.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:13.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:14.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi162 2024-09-05T12:53:14.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-05T12:53:14.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:53:14.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: osdmap e46: 8 total, 7 up, 8 in 2024-09-05T12:53:14.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:14.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:14.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:53:14.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:53:14.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:14.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] boot 2024-09-05T12:53:14.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: osdmap e47: 8 total, 8 up, 8 in 2024-09-05T12:53:14.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:14.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi162 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: osdmap e46: 8 total, 7 up, 8 in 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] boot 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: osdmap e47: 8 total, 8 up, 8 in 2024-09-05T12:53:14.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:14.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi162 2024-09-05T12:53:14.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-05T12:53:14.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: from='osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:53:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: osdmap e46: 8 total, 7 up, 8 in 2024-09-05T12:53:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:53:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:53:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: osd.7 [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] boot 2024-09-05T12:53:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: osdmap e47: 8 total, 8 up, 8 in 2024-09-05T12:53:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T12:53:15.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:15 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:53:15.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:15 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:53:15.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:15 smithi073 ceph-mon[30883]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:53:15.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:15 smithi073 ceph-mon[30883]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:15.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:15 smithi073 ceph-mon[30883]: osdmap e48: 8 total, 8 up, 8 in 2024-09-05T12:53:15.330 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:15 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:53:15.331 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:15 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:53:15.331 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:15 smithi169 ceph-mon[34823]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:53:15.331 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:15 smithi169 ceph-mon[34823]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:15.331 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:15 smithi169 ceph-mon[34823]: osdmap e48: 8 total, 8 up, 8 in 2024-09-05T12:53:15.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:15 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:53:15.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:15 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:53:15.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:15 smithi162 ceph-mon[34220]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:53:15.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:15 smithi162 ceph-mon[34220]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-05T12:53:15.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:15 smithi162 ceph-mon[34220]: osdmap e48: 8 total, 8 up, 8 in 2024-09-05T12:53:16.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:16 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/212982566' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b840a9a-9ed0-497a-a83a-43fc27f0323f"}]: dispatch 2024-09-05T12:53:16.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:16 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b840a9a-9ed0-497a-a83a-43fc27f0323f"}]: dispatch 2024-09-05T12:53:16.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:16 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b840a9a-9ed0-497a-a83a-43fc27f0323f"}]': finished 2024-09-05T12:53:16.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:16 smithi162 ceph-mon[34220]: osdmap e49: 9 total, 8 up, 9 in 2024-09-05T12:53:16.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:16 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:16.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:16 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/212982566' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b840a9a-9ed0-497a-a83a-43fc27f0323f"}]: dispatch 2024-09-05T12:53:16.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:16 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b840a9a-9ed0-497a-a83a-43fc27f0323f"}]: dispatch 2024-09-05T12:53:16.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:16 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b840a9a-9ed0-497a-a83a-43fc27f0323f"}]': finished 2024-09-05T12:53:16.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:16 smithi169 ceph-mon[34823]: osdmap e49: 9 total, 8 up, 9 in 2024-09-05T12:53:16.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:16 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:16.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:16 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/212982566' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b840a9a-9ed0-497a-a83a-43fc27f0323f"}]: dispatch 2024-09-05T12:53:16.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:16 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b840a9a-9ed0-497a-a83a-43fc27f0323f"}]: dispatch 2024-09-05T12:53:16.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:16 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b840a9a-9ed0-497a-a83a-43fc27f0323f"}]': finished 2024-09-05T12:53:16.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:16 smithi073 ceph-mon[30883]: osdmap e49: 9 total, 8 up, 9 in 2024-09-05T12:53:16.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:16 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:17 smithi162 ceph-mon[34220]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:17 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/849099666' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:53:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:17 smithi162 ceph-mon[34220]: osdmap e50: 9 total, 8 up, 9 in 2024-09-05T12:53:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:17 smithi169 ceph-mon[34823]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:17 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/849099666' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:53:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:17 smithi169 ceph-mon[34823]: osdmap e50: 9 total, 8 up, 9 in 2024-09-05T12:53:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:17 smithi073 ceph-mon[30883]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:17 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/849099666' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:53:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:17 smithi073 ceph-mon[30883]: osdmap e50: 9 total, 8 up, 9 in 2024-09-05T12:53:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:19.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:18 smithi073 ceph-mon[30883]: osdmap e51: 9 total, 8 up, 9 in 2024-09-05T12:53:19.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:19.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:18 smithi073 ceph-mon[30883]: pgmap v168: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-05T12:53:19.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:18 smithi162 ceph-mon[34220]: osdmap e51: 9 total, 8 up, 9 in 2024-09-05T12:53:19.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:19.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:18 smithi162 ceph-mon[34220]: pgmap v168: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-05T12:53:19.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:18 smithi169 ceph-mon[34823]: osdmap e51: 9 total, 8 up, 9 in 2024-09-05T12:53:19.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:19.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:18 smithi169 ceph-mon[34823]: pgmap v168: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-05T12:53:20.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:19 smithi073 ceph-mon[30883]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-05T12:53:20.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:19 smithi162 ceph-mon[34220]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-05T12:53:20.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:19 smithi169 ceph-mon[34823]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-05T12:53:20.977 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:20 smithi169 ceph-mon[34823]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:21.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:20 smithi073 ceph-mon[30883]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:21.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:20 smithi162 ceph-mon[34220]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:21.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:21 smithi169 ceph-mon[34823]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-05T12:53:21.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:21 smithi169 ceph-mon[34823]: Cluster is now healthy 2024-09-05T12:53:22.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:21 smithi073 ceph-mon[30883]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-05T12:53:22.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:21 smithi073 ceph-mon[30883]: Cluster is now healthy 2024-09-05T12:53:22.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:21 smithi162 ceph-mon[34220]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-05T12:53:22.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:21 smithi162 ceph-mon[34220]: Cluster is now healthy 2024-09-05T12:53:23.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:22 smithi073 ceph-mon[30883]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:23.068 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:22 smithi169 ceph-mon[34823]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:23.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:22 smithi162 ceph-mon[34220]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:24 smithi073 ceph-mon[30883]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-05T12:53:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:24 smithi162 ceph-mon[34220]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-05T12:53:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:24 smithi169 ceph-mon[34823]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-05T12:53:25.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:26.236 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:26 smithi169 ceph-mon[34823]: Deploying daemon osd.8 on smithi169 2024-09-05T12:53:26.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:26 smithi073 ceph-mon[30883]: Deploying daemon osd.8 on smithi169 2024-09-05T12:53:26.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:26 smithi162 ceph-mon[34220]: Deploying daemon osd.8 on smithi169 2024-09-05T12:53:27.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:27 smithi073 ceph-mon[30883]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:27.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:27 smithi162 ceph-mon[34220]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:27.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:27 smithi169 ceph-mon[34823]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:29.076 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:29 smithi169 ceph-mon[34823]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:29.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:29 smithi073 ceph-mon[30883]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:29.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:29 smithi162 ceph-mon[34220]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:30.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:30.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:30.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:30.280 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:30 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:30.280 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:30 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:30.280 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:30 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:30.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:30 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:30.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:30 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:30.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:30 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:31.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:31 smithi162 ceph-mon[34220]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:31 smithi169 ceph-mon[34823]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:31.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:31 smithi073 ceph-mon[30883]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:33.017 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:33 smithi169 ceph-mon[34823]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:33.017 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:33 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:33.017 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:33 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:33.017 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:33 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:33.017 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:33 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:33.018 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:33 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:33.315 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:33 smithi073 ceph-mon[30883]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:33.315 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:33 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:33.315 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:33 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:33.315 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:33 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:33.316 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:33 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:33.316 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:33 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:33.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:33 smithi162 ceph-mon[34220]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:33.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:33 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:33.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:33 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:33.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:33 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:33.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:33 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:33.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:33 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:33.475 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 8 on host 'smithi169' 2024-09-05T12:53:33.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.473+0000 7f3887fff640 1 -- 172.21.15.169:0/3177376155 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f38a0062630 con 0x7f38880a2bb0 2024-09-05T12:53:33.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 -- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38880a2bb0 msgr2=0x7f38880a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:33.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38880a2bb0 0x7f38880a5070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38a0102c60 tx=0x7f389000a5e0 comp rx=0 tx=0).stop 2024-09-05T12:53:33.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 -- 172.21.15.169:0/3177376155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01037c0 msgr2=0x7f38a019f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:33.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01037c0 0x7f38a019f3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f389800eaa0 tx=0x7f389800ef60 comp rx=0 tx=0).stop 2024-09-05T12:53:33.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 -- 172.21.15.169:0/3177376155 shutdown_connections 2024-09-05T12:53:33.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38880a2bb0 0x7f38880a5070 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:33.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01037c0 0x7f38a019f3c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:33.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0102e00 0x7f38a0198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:33.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 --2- 172.21.15.169:0/3177376155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101c00 0x7f38a0197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:33.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 -- 172.21.15.169:0/3177376155 >> 172.21.15.169:0/3177376155 conn(0x7f38a00fd390 msgr2=0x7f38a0106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:53:33.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 -- 172.21.15.169:0/3177376155 shutdown_connections 2024-09-05T12:53:33.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:53:33.476+0000 7f38a52fa640 1 -- 172.21.15.169:0/3177376155 wait complete. 2024-09-05T12:53:34.105 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:34.105 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:34.105 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:34.133 DEBUG:teuthology.orchestra.run.smithi169:osd.8> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.8.service 2024-09-05T12:53:34.135 INFO:tasks.cephadm:Deploying osd.9 on smithi073 with /dev/vg_nvme/lv_1... 2024-09-05T12:53:34.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-05T12:53:34.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:34.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:34.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:34.394 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:53:34.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:34.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:34.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:35.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:35 smithi169 ceph-mon[34823]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:35.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:35 smithi073 ceph-mon[30883]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:35.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:35 smithi162 ceph-mon[34220]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:35.429 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 12:53:35 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8[53392]: 2024-09-05T12:53:35.204+0000 7f1cffc9e640 -1 osd.8 0 log_to_monitors true 2024-09-05T12:53:36.129 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:36 smithi073 ceph-mon[30883]: from='osd.8 [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T12:53:36.130 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:36 smithi073 ceph-mon[30883]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T12:53:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:36 smithi162 ceph-mon[34220]: from='osd.8 [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T12:53:36.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:36 smithi162 ceph-mon[34220]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T12:53:36.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:36 smithi169 ceph-mon[34823]: from='osd.8 [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T12:53:36.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:36 smithi169 ceph-mon[34823]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T12:53:37.117 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 12:53:37 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8[53392]: 2024-09-05T12:53:37.041+0000 7f1cfbc21640 -1 osd.8 0 waiting for initial osdmap 2024-09-05T12:53:37.118 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 12:53:37 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8[53392]: 2024-09-05T12:53:37.051+0000 7f1cf7a49640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:53:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:37 smithi169 ceph-mon[34823]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:37 smithi169 ceph-mon[34823]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-05T12:53:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:37 smithi169 ceph-mon[34823]: osdmap e52: 9 total, 8 up, 9 in 2024-09-05T12:53:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:37 smithi169 ceph-mon[34823]: from='osd.8 [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:53:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:37 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:37 smithi169 ceph-mon[34823]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:53:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:37 smithi162 ceph-mon[34220]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:37 smithi162 ceph-mon[34220]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-05T12:53:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:37 smithi162 ceph-mon[34220]: osdmap e52: 9 total, 8 up, 9 in 2024-09-05T12:53:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:37 smithi162 ceph-mon[34220]: from='osd.8 [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:53:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:37 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:37 smithi162 ceph-mon[34220]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:53:37.445 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:37 smithi073 ceph-mon[30883]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:37.445 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:37 smithi073 ceph-mon[30883]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-05T12:53:37.446 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:37 smithi073 ceph-mon[30883]: osdmap e52: 9 total, 8 up, 9 in 2024-09-05T12:53:37.446 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:37 smithi073 ceph-mon[30883]: from='osd.8 [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:53:37.446 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:37 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:37.446 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:37 smithi073 ceph-mon[30883]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:53:37.546 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:53:37.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_1 2024-09-05T12:53:37.834 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:53:38.257 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:53:38.257 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: osdmap e53: 9 total, 8 up, 9 in 2024-09-05T12:53:38.257 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:38.257 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:38.257 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.257 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.257 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:38.258 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:38.258 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:38.258 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.258 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:38.258 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:38.258 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.341+0000 7fa8c3724640 1 -- 172.21.15.73:0/2492595789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8bc101cd0 msgr2=0x7fa8bc102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:38.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.341+0000 7fa8c3724640 1 --2- 172.21.15.73:0/2492595789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8bc101cd0 0x7fa8bc102150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009900 tx=0x7fa8ac02a410 comp rx=0 tx=0).stop 2024-09-05T12:53:38.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.341+0000 7fa8c3724640 1 -- 172.21.15.73:0/2492595789 shutdown_connections 2024-09-05T12:53:38.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.341+0000 7fa8c3724640 1 --2- 172.21.15.73:0/2492595789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8bc102690 0x7fa8bc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:38.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.341+0000 7fa8c3724640 1 --2- 172.21.15.73:0/2492595789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8bc101cd0 0x7fa8bc102150 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:38.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.341+0000 7fa8c3724640 1 --2- 172.21.15.73:0/2492595789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8bc100ad0 0x7fa8bc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:38.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.341+0000 7fa8c3724640 1 -- 172.21.15.73:0/2492595789 >> 172.21.15.73:0/2492595789 conn(0x7fa8bc0fc280 msgr2=0x7fa8bc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.341+0000 7fa8c3724640 1 -- 172.21.15.73:0/2492595789 shutdown_connections 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.341+0000 7fa8c3724640 1 -- 172.21.15.73:0/2492595789 wait complete. 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c3724640 1 Processor -- start 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c3724640 1 -- start start 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c3724640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8bc100ad0 0x7fa8bc06ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c3724640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8bc101cd0 0x7fa8bc19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c3724640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8bc102690 0x7fa8bc19f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c3724640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc10c750 con 0x7fa8bc101cd0 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c3724640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc10c5d0 con 0x7fa8bc100ad0 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c3724640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc10c8d0 con 0x7fa8bc102690 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c0cbf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8bc101cd0 0x7fa8bc19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:53:38.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c0cbf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8bc101cd0 0x7fa8bc19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47902/0 (socket says 172.21.15.73:47902) 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c0cbf640 1 -- 172.21.15.73:0/3732578740 learned_addr learned my addr 172.21.15.73:0/3732578740 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c1cc1640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8bc102690 0x7fa8bc19f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c14c0640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8bc100ad0 0x7fa8bc06ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c0cbf640 1 -- 172.21.15.73:0/3732578740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8bc102690 msgr2=0x7fa8bc19f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c0cbf640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8bc102690 0x7fa8bc19f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c0cbf640 1 -- 172.21.15.73:0/3732578740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8bc100ad0 msgr2=0x7fa8bc06ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c0cbf640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8bc100ad0 0x7fa8bc06ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c0cbf640 1 -- 172.21.15.73:0/3732578740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc19fb00 con 0x7fa8bc101cd0 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c14c0640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8bc100ad0 0x7fa8bc06ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.342+0000 7fa8c0cbf640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8bc101cd0 0x7fa8bc19cbd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009230 tx=0x7fa8ac004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.343+0000 7fa8b27fc640 1 -- 172.21.15.73:0/3732578740 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac03f030 con 0x7fa8bc101cd0 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.343+0000 7fa8b27fc640 1 -- 172.21.15.73:0/3732578740 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8ac003ce0 con 0x7fa8bc101cd0 2024-09-05T12:53:38.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.343+0000 7fa8c3724640 1 -- 172.21.15.73:0/3732578740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8bc19fd90 con 0x7fa8bc101cd0 2024-09-05T12:53:38.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.343+0000 7fa8b27fc640 1 -- 172.21.15.73:0/3732578740 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac035070 con 0x7fa8bc101cd0 2024-09-05T12:53:38.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.343+0000 7fa8c3724640 1 -- 172.21.15.73:0/3732578740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8bc1a0260 con 0x7fa8bc101cd0 2024-09-05T12:53:38.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.344+0000 7fa8c3724640 1 -- 172.21.15.73:0/3732578740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8bc107ed0 con 0x7fa8bc101cd0 2024-09-05T12:53:38.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.345+0000 7fa8b27fc640 1 -- 172.21.15.73:0/3732578740 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa8ac042030 con 0x7fa8bc101cd0 2024-09-05T12:53:38.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.345+0000 7fa8b27fc640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa8a80a2c00 0x7fa8a80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:53:38.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.346+0000 7fa8b27fc640 1 -- 172.21.15.73:0/3732578740 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5862+0+0 (secure 0 0 0) 0x7fa8ac0ef160 con 0x7fa8bc101cd0 2024-09-05T12:53:38.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.346+0000 7fa8c14c0640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa8a80a2c00 0x7fa8a80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:53:38.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.346+0000 7fa8c14c0640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa8a80a2c00 0x7fa8a80a50c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc101b30 tx=0x7fa8b8005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:53:38.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.349+0000 7fa8b27fc640 1 -- 172.21.15.73:0/3732578740 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8ac0bca50 con 0x7fa8bc101cd0 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: osdmap e53: 9 total, 8 up, 9 in 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:38.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:38.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:53:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: osdmap e53: 9 total, 8 up, 9 in 2024-09-05T12:53:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:53:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:38.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:38.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:38.529+0000 7fa8c3724640 1 -- 172.21.15.73:0/3732578740 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa8bc062630 con 0x7fa8a80a2c00 2024-09-05T12:53:39.193 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:53:39.193 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:53:39.193 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi169 2024-09-05T12:53:39.193 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-05T12:53:39.193 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:39.194 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:39.194 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: osd.8 [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] boot 2024-09-05T12:53:39.194 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: osdmap e54: 9 total, 9 up, 9 in 2024-09-05T12:53:39.194 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:39.194 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:53:39.194 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:53:39.194 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:53:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:53:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi169 2024-09-05T12:53:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-05T12:53:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: osd.8 [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] boot 2024-09-05T12:53:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: osdmap e54: 9 total, 9 up, 9 in 2024-09-05T12:53:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:53:39.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:53:39.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:53:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:53:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi169 2024-09-05T12:53:39.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-05T12:53:39.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-05T12:53:39.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:39.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: osd.8 [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] boot 2024-09-05T12:53:39.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: osdmap e54: 9 total, 9 up, 9 in 2024-09-05T12:53:39.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T12:53:39.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:53:39.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:53:39.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:40.215 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:40 smithi073 ceph-mon[30883]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:53:40.216 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:40 smithi073 ceph-mon[30883]: osdmap e55: 9 total, 9 up, 9 in 2024-09-05T12:53:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:40 smithi162 ceph-mon[34220]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:53:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:40 smithi162 ceph-mon[34220]: osdmap e55: 9 total, 9 up, 9 in 2024-09-05T12:53:40.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:40 smithi169 ceph-mon[34823]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:53:40.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:40 smithi169 ceph-mon[34823]: osdmap e55: 9 total, 9 up, 9 in 2024-09-05T12:53:41.354 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:41 smithi073 ceph-mon[30883]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:41.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:41 smithi073 ceph-mon[30883]: osdmap e56: 9 total, 9 up, 9 in 2024-09-05T12:53:41.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:41 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/193558404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "249077c2-cf03-4aa8-83fd-0325ca397e07"}]: dispatch 2024-09-05T12:53:41.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:41 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/193558404' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "249077c2-cf03-4aa8-83fd-0325ca397e07"}]': finished 2024-09-05T12:53:41.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:41 smithi073 ceph-mon[30883]: osdmap e57: 10 total, 9 up, 10 in 2024-09-05T12:53:41.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:41 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:53:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:41 smithi162 ceph-mon[34220]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:41 smithi162 ceph-mon[34220]: osdmap e56: 9 total, 9 up, 9 in 2024-09-05T12:53:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:41 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/193558404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "249077c2-cf03-4aa8-83fd-0325ca397e07"}]: dispatch 2024-09-05T12:53:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:41 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/193558404' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "249077c2-cf03-4aa8-83fd-0325ca397e07"}]': finished 2024-09-05T12:53:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:41 smithi162 ceph-mon[34220]: osdmap e57: 10 total, 9 up, 10 in 2024-09-05T12:53:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:41 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:53:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:41 smithi169 ceph-mon[34823]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:41 smithi169 ceph-mon[34823]: osdmap e56: 9 total, 9 up, 9 in 2024-09-05T12:53:41.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:41 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/193558404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "249077c2-cf03-4aa8-83fd-0325ca397e07"}]: dispatch 2024-09-05T12:53:41.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:41 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/193558404' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "249077c2-cf03-4aa8-83fd-0325ca397e07"}]': finished 2024-09-05T12:53:41.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:41 smithi169 ceph-mon[34823]: osdmap e57: 10 total, 9 up, 10 in 2024-09-05T12:53:41.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:41 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:53:42.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:42 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2386427608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:53:42.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:42 smithi162 ceph-mon[34220]: osdmap e58: 10 total, 9 up, 10 in 2024-09-05T12:53:42.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:53:42.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:42 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2386427608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:53:42.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:42 smithi169 ceph-mon[34823]: osdmap e58: 10 total, 9 up, 10 in 2024-09-05T12:53:42.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:53:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:42 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2386427608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:53:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:42 smithi073 ceph-mon[30883]: osdmap e58: 10 total, 9 up, 10 in 2024-09-05T12:53:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:53:43.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:43 smithi162 ceph-mon[34220]: pgmap v186: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:43 smithi169 ceph-mon[34823]: pgmap v186: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:43.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:43 smithi073 ceph-mon[30883]: pgmap v186: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:45.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:45 smithi162 ceph-mon[34220]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:45.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:45 smithi169 ceph-mon[34823]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:45.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:45 smithi073 ceph-mon[30883]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:47.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:47 smithi073 ceph-mon[30883]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T12:53:47.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:47 smithi162 ceph-mon[34220]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T12:53:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:47 smithi169 ceph-mon[34823]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T12:53:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:49 smithi162 ceph-mon[34220]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-05T12:53:49.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:49 smithi169 ceph-mon[34823]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-05T12:53:49.384 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:49 smithi073 ceph-mon[30883]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-05T12:53:50.075 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-05T12:53:50.075 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:50.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-05T12:53:50.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:50.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-05T12:53:50.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:51.156 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:51 smithi073 ceph-mon[30883]: Deploying daemon osd.9 on smithi073 2024-09-05T12:53:51.156 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:51 smithi073 ceph-mon[30883]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-05T12:53:51.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:51 smithi162 ceph-mon[34220]: Deploying daemon osd.9 on smithi073 2024-09-05T12:53:51.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:51 smithi162 ceph-mon[34220]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-05T12:53:51.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:51 smithi169 ceph-mon[34823]: Deploying daemon osd.9 on smithi073 2024-09-05T12:53:51.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:51 smithi169 ceph-mon[34823]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-05T12:53:52.119 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:52 smithi073 ceph-mon[30883]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T12:53:52.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:52 smithi162 ceph-mon[34220]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T12:53:52.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:52 smithi169 ceph-mon[34823]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T12:53:55.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:55 smithi073 ceph-mon[30883]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:53:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:55 smithi162 ceph-mon[34220]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:53:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:55 smithi169 ceph-mon[34823]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:53:56.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:56.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:56.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:56.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:56.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:56.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:56.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:56.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:56.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:57.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:57 smithi073 ceph-mon[30883]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:53:57.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:57 smithi162 ceph-mon[34220]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:53:57.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:57 smithi169 ceph-mon[34823]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:53:58.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.808+0000 7fa8b27fc640 1 -- 172.21.15.73:0/3732578740 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa8bc062630 con 0x7fa8a80a2c00 2024-09-05T12:53:58.809 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 9 on host 'smithi073' 2024-09-05T12:53:58.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 -- 172.21.15.73:0/3732578740 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa8a80a2c00 msgr2=0x7fa8a80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:58.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa8a80a2c00 0x7fa8a80a50c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc101b30 tx=0x7fa8b8005e70 comp rx=0 tx=0).stop 2024-09-05T12:53:58.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 -- 172.21.15.73:0/3732578740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8bc101cd0 msgr2=0x7fa8bc19cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:53:58.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8bc101cd0 0x7fa8bc19cbd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009230 tx=0x7fa8ac004360 comp rx=0 tx=0).stop 2024-09-05T12:53:58.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 -- 172.21.15.73:0/3732578740 shutdown_connections 2024-09-05T12:53:58.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa8a80a2c00 0x7fa8a80a50c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:58.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8bc102690 0x7fa8bc19f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:58.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8bc101cd0 0x7fa8bc19cbd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:58.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 --2- 172.21.15.73:0/3732578740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8bc100ad0 0x7fa8bc06ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:53:58.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 -- 172.21.15.73:0/3732578740 >> 172.21.15.73:0/3732578740 conn(0x7fa8bc0fc280 msgr2=0x7fa8bc1050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:53:58.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 -- 172.21.15.73:0/3732578740 shutdown_connections 2024-09-05T12:53:58.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:53:58.810+0000 7fa8c3724640 1 -- 172.21.15.73:0/3732578740 wait complete. 2024-09-05T12:53:59.185 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.185 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.185 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:58 smithi073 ceph-mon[30883]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:59.185 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:59.185 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:59.185 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:59.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:53:58 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:58 smithi162 ceph-mon[34220]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:59.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:53:58 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:58 smithi169 ceph-mon[34823]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:53:59.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:53:59.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:53:59.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:53:59.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:53:58 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:53:59.623 DEBUG:teuthology.orchestra.run.smithi073:osd.9> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.9.service 2024-09-05T12:53:59.625 INFO:tasks.cephadm:Deploying osd.10 on smithi162 with /dev/vg_nvme/lv_1... 2024-09-05T12:53:59.625 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-05T12:53:59.886 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T12:54:01.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:01 smithi073 ceph-mon[30883]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:54:01.264 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 12:54:01 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T12:54:01.158+0000 7fc6fa3cc640 -1 osd.9 0 log_to_monitors true 2024-09-05T12:54:01.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:01 smithi162 ceph-mon[34220]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:54:01.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:01 smithi169 ceph-mon[34823]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:54:02.254 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:02 smithi073 ceph-mon[30883]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-05T12:54:02.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:02 smithi162 ceph-mon[34220]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-05T12:54:02.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:02 smithi169 ceph-mon[34823]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-05T12:54:02.467 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-05T12:54:02.495 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-09-05T12:54:02.758 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T12:54:03.043 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:54:03.043 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-05T12:54:03.043 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: osdmap e59: 10 total, 9 up, 10 in 2024-09-05T12:54:03.043 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:54:03.043 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:03.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:03.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:03.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:03 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 -- 172.21.15.162:0/500155887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c041026c0 msgr2=0x7f7c04108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:03.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 --2- 172.21.15.162:0/500155887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c041026c0 0x7f7c04108f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009ca0 tx=0x7f7bfc02a8c0 comp rx=0 tx=0).stop 2024-09-05T12:54:03.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 -- 172.21.15.162:0/500155887 shutdown_connections 2024-09-05T12:54:03.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 --2- 172.21.15.162:0/500155887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c041026c0 0x7f7c04108f50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:03.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 --2- 172.21.15.162:0/500155887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c04101d00 0x7f7c04102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 --2- 172.21.15.162:0/500155887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04100b00 0x7f7c04100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 -- 172.21.15.162:0/500155887 >> 172.21.15.162:0/500155887 conn(0x7f7c040fc270 msgr2=0x7f7c040fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 -- 172.21.15.162:0/500155887 shutdown_connections 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 -- 172.21.15.162:0/500155887 wait complete. 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 Processor -- start 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.269+0000 7f7c0bdad640 1 -- start start 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0bdad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c04100b00 0x7f7c04104a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0bdad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04101d00 0x7f7c041030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0bdad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c041026c0 0x7f7c04103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0bdad640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0410c780 con 0x7f7c04101d00 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0bdad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0410c600 con 0x7f7c041026c0 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0bdad640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0410c900 con 0x7f7c04100b00 2024-09-05T12:54:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0a34a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c041026c0 0x7f7c04103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c09348640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04101d00 0x7f7c041030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0a34a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c041026c0 0x7f7c04103620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:56046/0 (socket says 172.21.15.162:56046) 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0a34a640 1 -- 172.21.15.162:0/1215267698 learned_addr learned my addr 172.21.15.162:0/1215267698 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c09b49640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c04100b00 0x7f7c04104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0a34a640 1 -- 172.21.15.162:0/1215267698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c04100b00 msgr2=0x7f7c04104a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0a34a640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c04100b00 0x7f7c04104a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0a34a640 1 -- 172.21.15.162:0/1215267698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04101d00 msgr2=0x7f7c041030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0a34a640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04101d00 0x7f7c041030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0a34a640 1 -- 172.21.15.162:0/1215267698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c04103ee0 con 0x7f7c041026c0 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c09348640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04101d00 0x7f7c041030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7c0a34a640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c041026c0 0x7f7c04103620 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc005e30 tx=0x7f7bfc004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7bfaffd640 1 -- 172.21.15.162:0/1215267698 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc003b70 con 0x7f7c041026c0 2024-09-05T12:54:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.270+0000 7f7bfaffd640 1 -- 172.21.15.162:0/1215267698 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bfc003d10 con 0x7f7c041026c0 2024-09-05T12:54:03.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.271+0000 7f7c0bdad640 1 -- 172.21.15.162:0/1215267698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c041a2050 con 0x7f7c041026c0 2024-09-05T12:54:03.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.271+0000 7f7bfaffd640 1 -- 172.21.15.162:0/1215267698 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc02fbd0 con 0x7f7c041026c0 2024-09-05T12:54:03.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.271+0000 7f7c0bdad640 1 -- 172.21.15.162:0/1215267698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c041a25b0 con 0x7f7c041026c0 2024-09-05T12:54:03.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.272+0000 7f7c0bdad640 1 -- 172.21.15.162:0/1215267698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c041a27e0 con 0x7f7c041026c0 2024-09-05T12:54:03.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.274+0000 7f7bfaffd640 1 -- 172.21.15.162:0/1215267698 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7bfc02fd70 con 0x7f7c041026c0 2024-09-05T12:54:03.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.274+0000 7f7bfaffd640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7bf00a2c00 0x7f7bf00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:03.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.274+0000 7f7bfaffd640 1 -- 172.21.15.162:0/1215267698 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5981+0+0 (secure 0 0 0) 0x7f7bfc0ef860 con 0x7f7c041026c0 2024-09-05T12:54:03.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.274+0000 7f7c09b49640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7bf00a2c00 0x7f7bf00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:03.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.275+0000 7f7c09b49640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7bf00a2c00 0x7f7bf00a50c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7c04101b60 tx=0x7f7bf4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:03.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.277+0000 7f7bfaffd640 1 -- 172.21.15.162:0/1215267698 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bfc0bd0e0 con 0x7f7c041026c0 2024-09-05T12:54:03.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: osdmap e59: 10 total, 9 up, 10 in 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:03.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:03.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:03 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:54:03.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-05T12:54:03.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: osdmap e59: 10 total, 9 up, 10 in 2024-09-05T12:54:03.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-05T12:54:03.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:03.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.396 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.397 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.397 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:03.397 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.397 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:03.397 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:03.397 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:03.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:03.462+0000 7f7c0bdad640 1 -- 172.21.15.162:0/1215267698 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7c041a29b0 con 0x7f7bf00a2c00 2024-09-05T12:54:03.763 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T12:54:03.397+0000 7fc6f634f640 -1 osd.9 0 waiting for initial osdmap 2024-09-05T12:54:03.763 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 12:54:03 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T12:54:03.407+0000 7fc6ee16f640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:54:04.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:04 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi073 2024-09-05T12:54:04.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:04 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi073 to 4272M 2024-09-05T12:54:04.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:04 smithi162 ceph-mon[34220]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:54:04.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:04 smithi162 ceph-mon[34220]: osdmap e60: 10 total, 9 up, 10 in 2024-09-05T12:54:04.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:04.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:04.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:04 smithi162 ceph-mon[34220]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' 2024-09-05T12:54:04.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:54:04.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:54:04.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:04.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:04 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi073 2024-09-05T12:54:04.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:04 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi073 to 4272M 2024-09-05T12:54:04.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:04 smithi073 ceph-mon[30883]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:54:04.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:04 smithi073 ceph-mon[30883]: osdmap e60: 10 total, 9 up, 10 in 2024-09-05T12:54:04.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:04.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:04.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:04 smithi073 ceph-mon[30883]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' 2024-09-05T12:54:04.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:54:04.356 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:54:04.356 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:04.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:04 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi073 2024-09-05T12:54:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:04 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi073 to 4272M 2024-09-05T12:54:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:04 smithi169 ceph-mon[34823]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-05T12:54:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:04 smithi169 ceph-mon[34823]: osdmap e60: 10 total, 9 up, 10 in 2024-09-05T12:54:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:04 smithi169 ceph-mon[34823]: from='osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338]' entity='osd.9' 2024-09-05T12:54:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:54:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:54:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:05.144 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:05 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:54:05.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:05 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:54:05.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:05 smithi162 ceph-mon[34220]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:54:05.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:05 smithi162 ceph-mon[34220]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:54:05.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:05 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:05.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:05 smithi162 ceph-mon[34220]: osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] boot 2024-09-05T12:54:05.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:05 smithi162 ceph-mon[34220]: osdmap e61: 10 total, 10 up, 10 in 2024-09-05T12:54:05.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:05 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:05 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:54:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:05 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:54:05.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:05 smithi169 ceph-mon[34823]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:54:05.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:05 smithi169 ceph-mon[34823]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:54:05.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:05 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:05.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:05 smithi169 ceph-mon[34823]: osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] boot 2024-09-05T12:54:05.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:05 smithi169 ceph-mon[34823]: osdmap e61: 10 total, 10 up, 10 in 2024-09-05T12:54:05.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:05 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:05 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:54:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:05 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:54:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:05 smithi073 ceph-mon[30883]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:54:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:05 smithi073 ceph-mon[30883]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-05T12:54:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:05 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:05.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:05 smithi073 ceph-mon[30883]: osd.9 [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] boot 2024-09-05T12:54:05.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:05 smithi073 ceph-mon[30883]: osdmap e61: 10 total, 10 up, 10 in 2024-09-05T12:54:05.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:05 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T12:54:06.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:06 smithi162 ceph-mon[34220]: from='client.? 172.21.15.162:0/2859718943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f745b0aa-839f-430b-a4af-a0f05f393cc6"}]: dispatch 2024-09-05T12:54:06.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:06 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f745b0aa-839f-430b-a4af-a0f05f393cc6"}]: dispatch 2024-09-05T12:54:06.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:06 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f745b0aa-839f-430b-a4af-a0f05f393cc6"}]': finished 2024-09-05T12:54:06.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:06 smithi162 ceph-mon[34220]: osdmap e62: 11 total, 10 up, 11 in 2024-09-05T12:54:06.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:06 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:06.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:06 smithi169 ceph-mon[34823]: from='client.? 172.21.15.162:0/2859718943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f745b0aa-839f-430b-a4af-a0f05f393cc6"}]: dispatch 2024-09-05T12:54:06.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:06 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f745b0aa-839f-430b-a4af-a0f05f393cc6"}]: dispatch 2024-09-05T12:54:06.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:06 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f745b0aa-839f-430b-a4af-a0f05f393cc6"}]': finished 2024-09-05T12:54:06.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:06 smithi169 ceph-mon[34823]: osdmap e62: 11 total, 10 up, 11 in 2024-09-05T12:54:06.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:06 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:06.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:06 smithi073 ceph-mon[30883]: from='client.? 172.21.15.162:0/2859718943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f745b0aa-839f-430b-a4af-a0f05f393cc6"}]: dispatch 2024-09-05T12:54:06.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:06 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f745b0aa-839f-430b-a4af-a0f05f393cc6"}]: dispatch 2024-09-05T12:54:06.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:06 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f745b0aa-839f-430b-a4af-a0f05f393cc6"}]': finished 2024-09-05T12:54:06.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:06 smithi073 ceph-mon[30883]: osdmap e62: 11 total, 10 up, 11 in 2024-09-05T12:54:06.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:06 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:07.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:07 smithi162 ceph-mon[34220]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:07.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:07 smithi162 ceph-mon[34220]: from='client.? 172.21.15.162:0/259390350' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:54:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:07 smithi169 ceph-mon[34823]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:07 smithi169 ceph-mon[34823]: from='client.? 172.21.15.162:0/259390350' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:54:07.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:07 smithi073 ceph-mon[30883]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:07.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:07 smithi073 ceph-mon[30883]: from='client.? 172.21.15.162:0/259390350' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:54:09.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:09 smithi162 ceph-mon[34220]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:09 smithi169 ceph-mon[34823]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:09 smithi073 ceph-mon[30883]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:11.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:11 smithi162 ceph-mon[34220]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:11.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:11 smithi169 ceph-mon[34823]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:11 smithi073 ceph-mon[30883]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:13.319 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:13 smithi162 ceph-mon[34220]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:13.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:13 smithi169 ceph-mon[34823]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:13.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:13 smithi073 ceph-mon[30883]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:15 smithi162 ceph-mon[34220]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-05T12:54:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:15.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:15 smithi169 ceph-mon[34823]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:15.469 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-05T12:54:15.469 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:15.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:15 smithi073 ceph-mon[30883]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:15.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-05T12:54:15.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:16.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:16 smithi162 ceph-mon[34220]: Deploying daemon osd.10 on smithi162 2024-09-05T12:54:16.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:16 smithi169 ceph-mon[34823]: Deploying daemon osd.10 on smithi162 2024-09-05T12:54:16.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:16 smithi073 ceph-mon[30883]: Deploying daemon osd.10 on smithi162 2024-09-05T12:54:17.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:17 smithi162 ceph-mon[34220]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:17 smithi169 ceph-mon[34823]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:17 smithi073 ceph-mon[30883]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:19.242 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:19 smithi162 ceph-mon[34220]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:19 smithi169 ceph-mon[34823]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:19.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:19 smithi073 ceph-mon[30883]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:20.307 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:20.307 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:20.307 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:20.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:20.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:20.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:20.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:20.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:20.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:21.324 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:21 smithi162 ceph-mon[34220]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:21 smithi169 ceph-mon[34823]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:21.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:21 smithi073 ceph-mon[30883]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:23.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:23 smithi162 ceph-mon[34220]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:23.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:23 smithi169 ceph-mon[34823]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:23.371 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 10 on host 'smithi162' 2024-09-05T12:54:23.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.369+0000 7f7bfaffd640 1 -- 172.21.15.162:0/1215267698 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f7c041a29b0 con 0x7f7bf00a2c00 2024-09-05T12:54:23.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.371+0000 7f7c0bdad640 1 -- 172.21.15.162:0/1215267698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7bf00a2c00 msgr2=0x7f7bf00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:23.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.371+0000 7f7c0bdad640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7bf00a2c00 0x7f7bf00a50c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7c04101b60 tx=0x7f7bf4005f90 comp rx=0 tx=0).stop 2024-09-05T12:54:23.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.372+0000 7f7c0bdad640 1 -- 172.21.15.162:0/1215267698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c041026c0 msgr2=0x7f7c04103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:23.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.372+0000 7f7c0bdad640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c041026c0 0x7f7c04103620 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc005e30 tx=0x7f7bfc004ab0 comp rx=0 tx=0).stop 2024-09-05T12:54:23.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.372+0000 7f7c0bdad640 1 -- 172.21.15.162:0/1215267698 shutdown_connections 2024-09-05T12:54:23.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.372+0000 7f7c0bdad640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7bf00a2c00 0x7f7bf00a50c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:23.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.372+0000 7f7c0bdad640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c041026c0 0x7f7c04103620 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:23.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.372+0000 7f7c0bdad640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04101d00 0x7f7c041030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:23.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.372+0000 7f7c0bdad640 1 --2- 172.21.15.162:0/1215267698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c04100b00 0x7f7c04104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:23.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.372+0000 7f7c0bdad640 1 -- 172.21.15.162:0/1215267698 >> 172.21.15.162:0/1215267698 conn(0x7f7c040fc270 msgr2=0x7f7c0406a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:23.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.372+0000 7f7c0bdad640 1 -- 172.21.15.162:0/1215267698 shutdown_connections 2024-09-05T12:54:23.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-05T12:54:23.372+0000 7f7c0bdad640 1 -- 172.21.15.162:0/1215267698 wait complete. 2024-09-05T12:54:23.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:23 smithi073 ceph-mon[30883]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:24.045 DEBUG:teuthology.orchestra.run.smithi162:osd.10> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.10.service 2024-09-05T12:54:24.047 INFO:tasks.cephadm:Deploying osd.11 on smithi169 with /dev/vg_nvme/lv_1... 2024-09-05T12:54:24.047 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-05T12:54:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:54:24.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:24 smithi169 ceph-mon[34823]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:24.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:24 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:24 smithi073 ceph-mon[30883]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:24.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:24 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.821 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.821 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.821 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:24 smithi162 ceph-mon[34220]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:24.821 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:24.821 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:24 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:26.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:25 smithi162 ceph-mon[34220]: from='osd.10 [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T12:54:26.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:25 smithi162 ceph-mon[34220]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T12:54:26.111 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 12:54:25 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T12:54:25.891+0000 7f6d39ae5640 -1 osd.10 0 log_to_monitors true 2024-09-05T12:54:26.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:25 smithi169 ceph-mon[34823]: from='osd.10 [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T12:54:26.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:25 smithi169 ceph-mon[34823]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T12:54:26.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:25 smithi073 ceph-mon[30883]: from='osd.10 [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T12:54:26.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:25 smithi073 ceph-mon[30883]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T12:54:26.946 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-05T12:54:26.974 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_1 2024-09-05T12:54:27.234 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:54:27.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:26 smithi073 ceph-mon[30883]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-05T12:54:27.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:26 smithi073 ceph-mon[30883]: osdmap e63: 11 total, 10 up, 11 in 2024-09-05T12:54:27.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:26 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:27.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:26 smithi073 ceph-mon[30883]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:27.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:26 smithi073 ceph-mon[30883]: from='osd.10 [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:54:27.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:26 smithi073 ceph-mon[30883]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:54:27.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:26 smithi162 ceph-mon[34220]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-05T12:54:27.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:26 smithi162 ceph-mon[34220]: osdmap e63: 11 total, 10 up, 11 in 2024-09-05T12:54:27.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:26 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:27.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:26 smithi162 ceph-mon[34220]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:27.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:26 smithi162 ceph-mon[34220]: from='osd.10 [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:54:27.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:26 smithi162 ceph-mon[34220]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:54:27.359 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:26 smithi169 ceph-mon[34823]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-05T12:54:27.359 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:26 smithi169 ceph-mon[34823]: osdmap e63: 11 total, 10 up, 11 in 2024-09-05T12:54:27.359 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:26 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:27.359 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:26 smithi169 ceph-mon[34823]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:27.359 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:26 smithi169 ceph-mon[34823]: from='osd.10 [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:54:27.359 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:26 smithi169 ceph-mon[34823]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-05T12:54:27.613 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T12:54:27.331+0000 7f6d35a68640 -1 osd.10 0 waiting for initial osdmap 2024-09-05T12:54:27.613 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T12:54:27.341+0000 7f6d2d888640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:54:27.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.697+0000 7f5decf65640 1 -- 172.21.15.169:0/3165748817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5de8101cd0 msgr2=0x7f5de8102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:27.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.697+0000 7f5decf65640 1 --2- 172.21.15.169:0/3165748817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5de8101cd0 0x7f5de8102150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009900 tx=0x7f5dd802a410 comp rx=0 tx=0).stop 2024-09-05T12:54:27.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.697+0000 7f5decf65640 1 -- 172.21.15.169:0/3165748817 shutdown_connections 2024-09-05T12:54:27.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.697+0000 7f5decf65640 1 --2- 172.21.15.169:0/3165748817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de8102690 0x7f5de8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:27.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.697+0000 7f5decf65640 1 --2- 172.21.15.169:0/3165748817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5de8101cd0 0x7f5de8102150 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:27.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.697+0000 7f5decf65640 1 --2- 172.21.15.169:0/3165748817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5de8100ad0 0x7f5de8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:27.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.697+0000 7f5decf65640 1 -- 172.21.15.169:0/3165748817 >> 172.21.15.169:0/3165748817 conn(0x7f5de80fc280 msgr2=0x7f5de80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:27.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.697+0000 7f5decf65640 1 -- 172.21.15.169:0/3165748817 shutdown_connections 2024-09-05T12:54:27.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.697+0000 7f5decf65640 1 -- 172.21.15.169:0/3165748817 wait complete. 2024-09-05T12:54:27.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.698+0000 7f5decf65640 1 Processor -- start 2024-09-05T12:54:27.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.698+0000 7f5decf65640 1 -- start start 2024-09-05T12:54:27.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.698+0000 7f5decf65640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5de8100ad0 0x7f5de819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:27.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.698+0000 7f5decf65640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5de8101cd0 0x7f5de819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:27.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.698+0000 7f5decf65640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de8102690 0x7f5de81a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:27.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.698+0000 7f5decf65640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5de810c7b0 con 0x7f5de8100ad0 2024-09-05T12:54:27.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.698+0000 7f5decf65640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5de810c630 con 0x7f5de8102690 2024-09-05T12:54:27.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.698+0000 7f5decf65640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5de810c930 con 0x7f5de8101cd0 2024-09-05T12:54:27.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.698+0000 7f5de5d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5de8101cd0 0x7f5de819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:27.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de5d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5de8101cd0 0x7f5de819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:42972/0 (socket says 172.21.15.169:42972) 2024-09-05T12:54:27.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de5d9b640 1 -- 172.21.15.169:0/1221044229 learned_addr learned my addr 172.21.15.169:0/1221044229 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:54:27.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de6d9d640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de8102690 0x7f5de81a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:27.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de659c640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5de8100ad0 0x7f5de819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:27.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de5d9b640 1 -- 172.21.15.169:0/1221044229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de8102690 msgr2=0x7f5de81a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:27.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de5d9b640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de8102690 0x7f5de81a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:27.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de5d9b640 1 -- 172.21.15.169:0/1221044229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5de8100ad0 msgr2=0x7f5de819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:27.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de5d9b640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5de8100ad0 0x7f5de819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:27.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de5d9b640 1 -- 172.21.15.169:0/1221044229 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de81a1df0 con 0x7f5de8101cd0 2024-09-05T12:54:27.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de6d9d640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de8102690 0x7f5de81a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.699+0000 7f5de5d9b640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5de8101cd0 0x7f5de819a700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8006010 tx=0x7f5dd8004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.700+0000 7f5dd77fe640 1 -- 172.21.15.169:0/1221044229 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd803f030 con 0x7f5de8101cd0 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.700+0000 7f5dd77fe640 1 -- 172.21.15.169:0/1221044229 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd8003ce0 con 0x7f5de8101cd0 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.700+0000 7f5dd77fe640 1 -- 172.21.15.169:0/1221044229 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8035070 con 0x7f5de8101cd0 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.700+0000 7f5decf65640 1 -- 172.21.15.169:0/1221044229 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de81a2080 con 0x7f5de8101cd0 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.700+0000 7f5decf65640 1 -- 172.21.15.169:0/1221044229 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de81a25b0 con 0x7f5de8101cd0 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.701+0000 7f5decf65640 1 -- 172.21.15.169:0/1221044229 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de81a2810 con 0x7f5de8101cd0 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.702+0000 7f5dd77fe640 1 -- 172.21.15.169:0/1221044229 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5dd8042030 con 0x7f5de8101cd0 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.702+0000 7f5dd77fe640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5dd00a2c30 0x7f5dd00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.703+0000 7f5dd77fe640 1 -- 172.21.15.169:0/1221044229 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6414+0+0 (secure 0 0 0) 0x7f5dd80eed10 con 0x7f5de8101cd0 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.703+0000 7f5de659c640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5dd00a2c30 0x7f5dd00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:27.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.703+0000 7f5de659c640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5dd00a2c30 0x7f5dd00a50f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc005fd0 tx=0x7f5ddc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:27.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.707+0000 7f5dd77fe640 1 -- 172.21.15.169:0/1221044229 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5dd80bbd90 con 0x7f5de8101cd0 2024-09-05T12:54:27.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:27.890+0000 7f5decf65640 1 -- 172.21.15.169:0/1221044229 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5de806a710 con 0x7f5dd00a2c30 2024-09-05T12:54:28.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:54:28.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: osdmap e64: 11 total, 10 up, 11 in 2024-09-05T12:54:28.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='osd.10 ' entity='osd.10' 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:28.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:28.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:28.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:54:28.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:54:28.265 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:27 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:28.303 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: osdmap e64: 11 total, 10 up, 11 in 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='osd.10 ' entity='osd.10' 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:28.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:28.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:28.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:28.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:28.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:54:28.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:54:28.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:27 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-05T12:54:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: osdmap e64: 11 total, 10 up, 11 in 2024-09-05T12:54:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='osd.10 ' entity='osd.10' 2024-09-05T12:54:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T12:54:28.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:27 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:29.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:28 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:54:29.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:28 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:54:29.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:28 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi162 2024-09-05T12:54:29.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:28 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-05T12:54:29.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:28 smithi073 ceph-mon[30883]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:54:29.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:28 smithi073 ceph-mon[30883]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:29.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:28 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:29.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:28 smithi073 ceph-mon[30883]: osd.10 [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] boot 2024-09-05T12:54:29.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:28 smithi073 ceph-mon[30883]: osdmap e65: 11 total, 11 up, 11 in 2024-09-05T12:54:29.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:28 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:29.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:28 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:54:29.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:28 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:54:29.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:28 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi162 2024-09-05T12:54:29.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:28 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-05T12:54:29.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:28 smithi162 ceph-mon[34220]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:54:29.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:28 smithi162 ceph-mon[34220]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:29.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:28 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:29.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:28 smithi162 ceph-mon[34220]: osd.10 [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] boot 2024-09-05T12:54:29.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:28 smithi162 ceph-mon[34220]: osdmap e65: 11 total, 11 up, 11 in 2024-09-05T12:54:29.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:28 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:29.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:28 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:54:29.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:28 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:54:29.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:28 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi162 2024-09-05T12:54:29.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:28 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-05T12:54:29.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:28 smithi169 ceph-mon[34823]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:54:29.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:28 smithi169 ceph-mon[34823]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-05T12:54:29.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:28 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:29.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:28 smithi169 ceph-mon[34823]: osd.10 [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] boot 2024-09-05T12:54:29.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:28 smithi169 ceph-mon[34823]: osdmap e65: 11 total, 11 up, 11 in 2024-09-05T12:54:29.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:28 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T12:54:30.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:29 smithi169 ceph-mon[34823]: osdmap e66: 11 total, 11 up, 11 in 2024-09-05T12:54:30.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:29 smithi073 ceph-mon[30883]: osdmap e66: 11 total, 11 up, 11 in 2024-09-05T12:54:30.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:29 smithi162 ceph-mon[34220]: osdmap e66: 11 total, 11 up, 11 in 2024-09-05T12:54:31.106 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:30 smithi169 ceph-mon[34823]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:31.107 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:30 smithi169 ceph-mon[34823]: osdmap e67: 11 total, 11 up, 11 in 2024-09-05T12:54:31.107 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:30 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/1131288128' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f508768-c586-4e4d-8ac6-0c2ffccd05a8"}]: dispatch 2024-09-05T12:54:31.107 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:30 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f508768-c586-4e4d-8ac6-0c2ffccd05a8"}]: dispatch 2024-09-05T12:54:31.107 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:30 smithi169 ceph-mon[34823]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f508768-c586-4e4d-8ac6-0c2ffccd05a8"}]': finished 2024-09-05T12:54:31.107 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:30 smithi169 ceph-mon[34823]: osdmap e68: 12 total, 11 up, 12 in 2024-09-05T12:54:31.107 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:30 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:30 smithi073 ceph-mon[30883]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:30 smithi073 ceph-mon[30883]: osdmap e67: 11 total, 11 up, 11 in 2024-09-05T12:54:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:30 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/1131288128' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f508768-c586-4e4d-8ac6-0c2ffccd05a8"}]: dispatch 2024-09-05T12:54:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:30 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f508768-c586-4e4d-8ac6-0c2ffccd05a8"}]: dispatch 2024-09-05T12:54:31.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:30 smithi073 ceph-mon[30883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f508768-c586-4e4d-8ac6-0c2ffccd05a8"}]': finished 2024-09-05T12:54:31.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:30 smithi073 ceph-mon[30883]: osdmap e68: 12 total, 11 up, 12 in 2024-09-05T12:54:31.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:30 smithi162 ceph-mon[34220]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:30 smithi162 ceph-mon[34220]: osdmap e67: 11 total, 11 up, 11 in 2024-09-05T12:54:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:30 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/1131288128' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f508768-c586-4e4d-8ac6-0c2ffccd05a8"}]: dispatch 2024-09-05T12:54:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:30 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f508768-c586-4e4d-8ac6-0c2ffccd05a8"}]: dispatch 2024-09-05T12:54:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:30 smithi162 ceph-mon[34220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f508768-c586-4e4d-8ac6-0c2ffccd05a8"}]': finished 2024-09-05T12:54:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:30 smithi162 ceph-mon[34220]: osdmap e68: 12 total, 11 up, 12 in 2024-09-05T12:54:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:30 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:32.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:31 smithi073 ceph-mon[30883]: from='client.? 172.21.15.169:0/2784880628' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:54:32.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:31 smithi073 ceph-mon[30883]: osdmap e69: 12 total, 11 up, 12 in 2024-09-05T12:54:32.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:31 smithi162 ceph-mon[34220]: from='client.? 172.21.15.169:0/2784880628' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:54:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:31 smithi162 ceph-mon[34220]: osdmap e69: 12 total, 11 up, 12 in 2024-09-05T12:54:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:31 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:32.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:31 smithi169 ceph-mon[34823]: from='client.? 172.21.15.169:0/2784880628' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T12:54:32.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:31 smithi169 ceph-mon[34823]: osdmap e69: 12 total, 11 up, 12 in 2024-09-05T12:54:32.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:31 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:33.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:32 smithi073 ceph-mon[30883]: pgmap v223: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:33.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:32 smithi162 ceph-mon[34220]: pgmap v223: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:33.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:32 smithi169 ceph-mon[34823]: pgmap v223: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:35.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:34 smithi073 ceph-mon[30883]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:35.330 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:34 smithi169 ceph-mon[34823]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:34 smithi162 ceph-mon[34220]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:37.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:36 smithi169 ceph-mon[34823]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T12:54:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:36 smithi073 ceph-mon[30883]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T12:54:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:36 smithi162 ceph-mon[34220]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T12:54:39.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:38 smithi073 ceph-mon[30883]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T12:54:39.308 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:38 smithi169 ceph-mon[34823]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T12:54:39.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:38 smithi162 ceph-mon[34220]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T12:54:40.102 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-05T12:54:40.103 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:40.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-05T12:54:40.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:40 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-05T12:54:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:40 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:41.259 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:41 smithi169 ceph-mon[34823]: Deploying daemon osd.11 on smithi169 2024-09-05T12:54:41.259 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:41 smithi169 ceph-mon[34823]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-05T12:54:41.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:41 smithi073 ceph-mon[30883]: Deploying daemon osd.11 on smithi169 2024-09-05T12:54:41.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:41 smithi073 ceph-mon[30883]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-05T12:54:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:41 smithi162 ceph-mon[34220]: Deploying daemon osd.11 on smithi169 2024-09-05T12:54:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:41 smithi162 ceph-mon[34220]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-05T12:54:43.258 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:43 smithi169 ceph-mon[34823]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-05T12:54:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:43 smithi073 ceph-mon[30883]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-05T12:54:43.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:43 smithi162 ceph-mon[34220]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-05T12:54:45.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:45 smithi169 ceph-mon[34823]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:54:45.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:45 smithi073 ceph-mon[30883]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:54:45.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:45 smithi162 ceph-mon[34220]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:54:46.231 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:46 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:46.231 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:46 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:46.231 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:46 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:46.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:46 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:46.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:46 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:46.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:46 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:46.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:46 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:46.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:46 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:46.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:46 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:47.291 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:47 smithi169 ceph-mon[34823]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:54:47.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:47 smithi162 ceph-mon[34220]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:54:47.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:47 smithi073 ceph-mon[30883]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T12:54:49.081 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:49 smithi169 ceph-mon[34823]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:49.081 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:49 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:49.081 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:49 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:49.081 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:49 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:49.081 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:49 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:49.082 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:49 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:49.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.080+0000 7f5dd77fe640 1 -- 172.21.15.169:0/1221044229 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5de806a710 con 0x7f5dd00a2c30 2024-09-05T12:54:49.082 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 11 on host 'smithi169' 2024-09-05T12:54:49.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 -- 172.21.15.169:0/1221044229 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5dd00a2c30 msgr2=0x7f5dd00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:49.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5dd00a2c30 0x7f5dd00a50f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc005fd0 tx=0x7f5ddc00b410 comp rx=0 tx=0).stop 2024-09-05T12:54:49.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 -- 172.21.15.169:0/1221044229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5de8101cd0 msgr2=0x7f5de819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:49.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5de8101cd0 0x7f5de819a700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8006010 tx=0x7f5dd8004360 comp rx=0 tx=0).stop 2024-09-05T12:54:49.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 -- 172.21.15.169:0/1221044229 shutdown_connections 2024-09-05T12:54:49.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5dd00a2c30 0x7f5dd00a50f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:49.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de8102690 0x7f5de81a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:49.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5de8101cd0 0x7f5de819a700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:49.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 --2- 172.21.15.169:0/1221044229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5de8100ad0 0x7f5de819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:49.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 -- 172.21.15.169:0/1221044229 >> 172.21.15.169:0/1221044229 conn(0x7f5de80fc280 msgr2=0x7f5de806a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:49.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 -- 172.21.15.169:0/1221044229 shutdown_connections 2024-09-05T12:54:49.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:54:49.083+0000 7f5decf65640 1 -- 172.21.15.169:0/1221044229 wait complete. 2024-09-05T12:54:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:49 smithi162 ceph-mon[34220]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:49 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:49 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:49 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:49 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:49 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:49 smithi073 ceph-mon[30883]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:49 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:49 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:49 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:49 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:49 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:49.850 DEBUG:teuthology.orchestra.run.smithi169:osd.11> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.11.service 2024-09-05T12:54:49.852 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-05T12:54:49.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-05T12:54:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:54:50.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:50.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:50.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:50 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:50.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:50.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:50.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:50 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:50.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:54:50.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:50.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:50 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:50.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.606+0000 7f03e3431640 1 -- 172.21.15.73:0/949570078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc102690 msgr2=0x7f03dc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:50.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.606+0000 7f03e3431640 1 --2- 172.21.15.73:0/949570078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc102690 0x7f03dc108f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009ca0 tx=0x7f03d402a8c0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.606+0000 7f03e3431640 1 -- 172.21.15.73:0/949570078 shutdown_connections 2024-09-05T12:54:50.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.606+0000 7f03e3431640 1 --2- 172.21.15.73:0/949570078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc102690 0x7f03dc108f20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.606+0000 7f03e3431640 1 --2- 172.21.15.73:0/949570078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03dc101cd0 0x7f03dc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.606+0000 7f03e3431640 1 --2- 172.21.15.73:0/949570078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03dc100ad0 0x7f03dc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.606+0000 7f03e3431640 1 -- 172.21.15.73:0/949570078 >> 172.21.15.73:0/949570078 conn(0x7f03dc0fc280 msgr2=0x7f03dc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.606+0000 7f03e3431640 1 -- 172.21.15.73:0/949570078 shutdown_connections 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.606+0000 7f03e3431640 1 -- 172.21.15.73:0/949570078 wait complete. 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e3431640 1 Processor -- start 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e3431640 1 -- start start 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e3431640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03dc100ad0 0x7f03dc104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e3431640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc101cd0 0x7f03dc1030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e3431640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03dc102690 0x7f03dc1035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e3431640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc10c750 con 0x7f03dc101cd0 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e3431640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc10c5d0 con 0x7f03dc102690 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e3431640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc10c8d0 con 0x7f03dc100ad0 2024-09-05T12:54:50.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e09cc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc101cd0 0x7f03dc1030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e09cc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc101cd0 0x7f03dc1030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46580/0 (socket says 172.21.15.73:46580) 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e09cc640 1 -- 172.21.15.73:0/2529520163 learned_addr learned my addr 172.21.15.73:0/2529520163 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e11cd640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03dc100ad0 0x7f03dc104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e09cc640 1 -- 172.21.15.73:0/2529520163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03dc100ad0 msgr2=0x7f03dc104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e09cc640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03dc100ad0 0x7f03dc104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e19ce640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03dc102690 0x7f03dc1035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e09cc640 1 -- 172.21.15.73:0/2529520163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03dc102690 msgr2=0x7f03dc1035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e09cc640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03dc102690 0x7f03dc1035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e09cc640 1 -- 172.21.15.73:0/2529520163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc103eb0 con 0x7f03dc101cd0 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.607+0000 7f03e09cc640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc101cd0 0x7f03dc1030b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e9f0 tx=0x7f03d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.608+0000 7f03d27fc640 1 -- 172.21.15.73:0/2529520163 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d800cd80 con 0x7f03dc101cd0 2024-09-05T12:54:50.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.608+0000 7f03d27fc640 1 -- 172.21.15.73:0/2529520163 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03d8005500 con 0x7f03dc101cd0 2024-09-05T12:54:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.608+0000 7f03e3431640 1 -- 172.21.15.73:0/2529520163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03dc1a1ff0 con 0x7f03dc101cd0 2024-09-05T12:54:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.608+0000 7f03d27fc640 1 -- 172.21.15.73:0/2529520163 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8010690 con 0x7f03dc101cd0 2024-09-05T12:54:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.608+0000 7f03e3431640 1 -- 172.21.15.73:0/2529520163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03dc1a2450 con 0x7f03dc101cd0 2024-09-05T12:54:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.609+0000 7f03e3431640 1 -- 172.21.15.73:0/2529520163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03dc1a26e0 con 0x7f03dc101cd0 2024-09-05T12:54:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.611+0000 7f03d27fc640 1 -- 172.21.15.73:0/2529520163 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f03d80046c0 con 0x7f03dc101cd0 2024-09-05T12:54:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.611+0000 7f03d27fc640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f03c80a2c00 0x7f03c80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.611+0000 7f03e11cd640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f03c80a2c00 0x7f03c80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.611+0000 7f03d27fc640 1 -- 172.21.15.73:0/2529520163 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6809+0+0 (secure 0 0 0) 0x7f03d80cf050 con 0x7f03dc101cd0 2024-09-05T12:54:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.612+0000 7f03e11cd640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f03c80a2c00 0x7f03c80a50c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f03dc101b30 tx=0x7f03cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.615+0000 7f03d27fc640 1 -- 172.21.15.73:0/2529520163 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03d80541b0 con 0x7f03dc101cd0 2024-09-05T12:54:50.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.788+0000 7f03e3431640 1 -- 172.21.15.73:0/2529520163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f03dc1a29d0 con 0x7f03dc101cd0 2024-09-05T12:54:50.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.789+0000 7f03d27fc640 1 -- 172.21.15.73:0/2529520163 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f03d809c590 con 0x7f03dc101cd0 2024-09-05T12:54:50.790 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:54:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 -- 172.21.15.73:0/2529520163 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f03c80a2c00 msgr2=0x7f03c80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f03c80a2c00 0x7f03c80a50c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f03dc101b30 tx=0x7f03cc005f90 comp rx=0 tx=0).stop 2024-09-05T12:54:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 -- 172.21.15.73:0/2529520163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc101cd0 msgr2=0x7f03dc1030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc101cd0 0x7f03dc1030b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e9f0 tx=0x7f03d800edf0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 -- 172.21.15.73:0/2529520163 shutdown_connections 2024-09-05T12:54:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f03c80a2c00 0x7f03c80a50c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03dc102690 0x7f03dc1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc101cd0 0x7f03dc1030b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 --2- 172.21.15.73:0/2529520163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03dc100ad0 0x7f03dc104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:50.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 -- 172.21.15.73:0/2529520163 >> 172.21.15.73:0/2529520163 conn(0x7f03dc0fc280 msgr2=0x7f03dc0fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:50.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 -- 172.21.15.73:0/2529520163 shutdown_connections 2024-09-05T12:54:50.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:50.791+0000 7f03e3431640 1 -- 172.21.15.73:0/2529520163 wait complete. 2024-09-05T12:54:51.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:51 smithi162 ceph-mon[34220]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:51.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:51 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2529520163' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T12:54:51.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:51 smithi169 ceph-mon[34823]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:51.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:51 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2529520163' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T12:54:51.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:51 smithi073 ceph-mon[30883]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:51.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:51 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2529520163' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T12:54:51.608 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1725540867,"num_in_osds":12,"osd_in_since":1725540870,"num_remapped_pgs":0} 2024-09-05T12:54:51.617 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 12:54:51 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T12:54:51.532+0000 7f8471438640 -1 osd.11 0 log_to_monitors true 2024-09-05T12:54:52.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:52 smithi162 ceph-mon[34220]: from='osd.11 [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T12:54:52.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:52 smithi162 ceph-mon[34220]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T12:54:52.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:52 smithi162 ceph-mon[34220]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:52.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:52 smithi169 ceph-mon[34823]: from='osd.11 [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T12:54:52.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:52 smithi169 ceph-mon[34823]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T12:54:52.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:52 smithi169 ceph-mon[34823]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:52.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:52 smithi073 ceph-mon[30883]: from='osd.11 [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T12:54:52.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:52 smithi073 ceph-mon[30883]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T12:54:52.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:52 smithi073 ceph-mon[30883]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:52.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-05T12:54:52.857 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:54:53.100 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-05T12:54:53.100 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: osdmap e70: 12 total, 11 up, 12 in 2024-09-05T12:54:53.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:53.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='osd.11 [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:54:53.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:54:53.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: Detected new or changed devices on smithi169 2024-09-05T12:54:53.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.102 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-05T12:54:53.102 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.102 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:53.102 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:53.102 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.234 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-05T12:54:53.234 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: osdmap e70: 12 total, 11 up, 12 in 2024-09-05T12:54:53.234 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:53.234 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='osd.11 [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:54:53.234 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: Detected new or changed devices on smithi169 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:53.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:53.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:53 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-05T12:54:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: osdmap e70: 12 total, 11 up, 12 in 2024-09-05T12:54:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='osd.11 [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:54:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-05T12:54:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: Detected new or changed devices on smithi169 2024-09-05T12:54:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T12:54:53.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-05T12:54:53.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:54:53.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:54:53.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:53 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:54:53.367 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T12:54:53.098+0000 7f846d3bb640 -1 osd.11 0 waiting for initial osdmap 2024-09-05T12:54:53.367 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 12:54:53 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T12:54:53.109+0000 7f84691e3640 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T12:54:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 -- 172.21.15.73:0/2671944555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3564100ad0 msgr2=0x7f3564100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 --2- 172.21.15.73:0/2671944555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3564100ad0 0x7f3564100ed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3558009900 tx=0x7f355802a410 comp rx=0 tx=0).stop 2024-09-05T12:54:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 -- 172.21.15.73:0/2671944555 shutdown_connections 2024-09-05T12:54:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 --2- 172.21.15.73:0/2671944555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3564102690 0x7f3564108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 --2- 172.21.15.73:0/2671944555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3564101cd0 0x7f3564102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 --2- 172.21.15.73:0/2671944555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3564100ad0 0x7f3564100ed0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 -- 172.21.15.73:0/2671944555 >> 172.21.15.73:0/2671944555 conn(0x7f35640fc280 msgr2=0x7f35640fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 -- 172.21.15.73:0/2671944555 shutdown_connections 2024-09-05T12:54:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 -- 172.21.15.73:0/2671944555 wait complete. 2024-09-05T12:54:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 Processor -- start 2024-09-05T12:54:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.356+0000 7f356aec5640 1 -- start start 2024-09-05T12:54:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f356aec5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3564100ad0 0x7f356406aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f356aec5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3564101cd0 0x7f356419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f356aec5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3564102690 0x7f356419f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f356aec5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f356410c7d0 con 0x7f3564101cd0 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f356aec5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f356410c650 con 0x7f3564100ad0 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f356aec5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f356410c950 con 0x7f3564102690 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3563fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3564101cd0 0x7f356419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3563fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3564101cd0 0x7f356419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45870/0 (socket says 172.21.15.73:45870) 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3563fff640 1 -- 172.21.15.73:0/72928216 learned_addr learned my addr 172.21.15.73:0/72928216 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3569462640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3564102690 0x7f356419f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3568c61640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3564100ad0 0x7f356406aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3563fff640 1 -- 172.21.15.73:0/72928216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3564102690 msgr2=0x7f356419f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3563fff640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3564102690 0x7f356419f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3563fff640 1 -- 172.21.15.73:0/72928216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3564100ad0 msgr2=0x7f356406aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3563fff640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3564100ad0 0x7f356406aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3563fff640 1 -- 172.21.15.73:0/72928216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356419fb90 con 0x7f3564101cd0 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3568c61640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3564100ad0 0x7f356406aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3563fff640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3564101cd0 0x7f356419cc90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f355000b4a0 tx=0x7f355000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3561ffb640 1 -- 172.21.15.73:0/72928216 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550014070 con 0x7f3564101cd0 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3561ffb640 1 -- 172.21.15.73:0/72928216 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3550010af0 con 0x7f3564101cd0 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f356aec5640 1 -- 172.21.15.73:0/72928216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356419fe80 con 0x7f3564101cd0 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f3561ffb640 1 -- 172.21.15.73:0/72928216 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550017d10 con 0x7f3564101cd0 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.357+0000 7f356aec5640 1 -- 172.21.15.73:0/72928216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35641a03b0 con 0x7f3564101cd0 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.358+0000 7f356aec5640 1 -- 172.21.15.73:0/72928216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3564107e70 con 0x7f3564101cd0 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.359+0000 7f3561ffb640 1 -- 172.21.15.73:0/72928216 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3550017070 con 0x7f3564101cd0 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.360+0000 7f3561ffb640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f35540a2b80 0x7f35540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.360+0000 7f3568c61640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f35540a2b80 0x7f35540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:53.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.360+0000 7f3561ffb640 1 -- 172.21.15.73:0/72928216 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6847+0+0 (secure 0 0 0) 0x7f35500cde00 con 0x7f3564101cd0 2024-09-05T12:54:53.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.360+0000 7f3568c61640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f35540a2b80 0x7f35540a5040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3558000c00 tx=0x7f3558031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:53.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.364+0000 7f3561ffb640 1 -- 172.21.15.73:0/72928216 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f355009b300 con 0x7f3564101cd0 2024-09-05T12:54:53.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.532+0000 7f356aec5640 1 -- 172.21.15.73:0/72928216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f356402d970 con 0x7f3564101cd0 2024-09-05T12:54:53.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.533+0000 7f3561ffb640 1 -- 172.21.15.73:0/72928216 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f355009ac00 con 0x7f3564101cd0 2024-09-05T12:54:53.534 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:54:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 -- 172.21.15.73:0/72928216 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f35540a2b80 msgr2=0x7f35540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f35540a2b80 0x7f35540a5040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3558000c00 tx=0x7f3558031400 comp rx=0 tx=0).stop 2024-09-05T12:54:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 -- 172.21.15.73:0/72928216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3564101cd0 msgr2=0x7f356419cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3564101cd0 0x7f356419cc90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f355000b4a0 tx=0x7f355000b960 comp rx=0 tx=0).stop 2024-09-05T12:54:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 -- 172.21.15.73:0/72928216 shutdown_connections 2024-09-05T12:54:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f35540a2b80 0x7f35540a5040 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3564102690 0x7f356419f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3564101cd0 0x7f356419cc90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 --2- 172.21.15.73:0/72928216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3564100ad0 0x7f356406aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 -- 172.21.15.73:0/72928216 >> 172.21.15.73:0/72928216 conn(0x7f35640fc280 msgr2=0x7f3564105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 -- 172.21.15.73:0/72928216 shutdown_connections 2024-09-05T12:54:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:53.535+0000 7f356aec5640 1 -- 172.21.15.73:0/72928216 wait complete. 2024-09-05T12:54:54.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:54 smithi073 ceph-mon[30883]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:54:54.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:54 smithi073 ceph-mon[30883]: osdmap e71: 12 total, 11 up, 12 in 2024-09-05T12:54:54.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:54.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:54.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:54 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/72928216' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T12:54:54.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:54 smithi073 ceph-mon[30883]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:54.359 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1725540867,"num_in_osds":12,"osd_in_since":1725540870,"num_remapped_pgs":0} 2024-09-05T12:54:54.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:54 smithi162 ceph-mon[34220]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:54:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:54 smithi162 ceph-mon[34220]: osdmap e71: 12 total, 11 up, 12 in 2024-09-05T12:54:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:54 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/72928216' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T12:54:54.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:54 smithi162 ceph-mon[34220]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:54.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:54 smithi169 ceph-mon[34823]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-05T12:54:54.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:54 smithi169 ceph-mon[34823]: osdmap e71: 12 total, 11 up, 12 in 2024-09-05T12:54:54.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:54.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:54.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:54 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/72928216' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T12:54:54.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:54 smithi169 ceph-mon[34823]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-05T12:54:55.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-05T12:54:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:55 smithi162 ceph-mon[34220]: purged_snaps scrub starts 2024-09-05T12:54:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:55 smithi162 ceph-mon[34220]: purged_snaps scrub ok 2024-09-05T12:54:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:55 smithi162 ceph-mon[34220]: osd.11 [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] boot 2024-09-05T12:54:55.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:55 smithi162 ceph-mon[34220]: osdmap e72: 12 total, 12 up, 12 in 2024-09-05T12:54:55.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:55 smithi169 ceph-mon[34823]: purged_snaps scrub starts 2024-09-05T12:54:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:55 smithi169 ceph-mon[34823]: purged_snaps scrub ok 2024-09-05T12:54:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:55 smithi169 ceph-mon[34823]: osd.11 [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] boot 2024-09-05T12:54:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:55 smithi169 ceph-mon[34823]: osdmap e72: 12 total, 12 up, 12 in 2024-09-05T12:54:55.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:55.389 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:55 smithi073 ceph-mon[30883]: purged_snaps scrub starts 2024-09-05T12:54:55.389 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:55 smithi073 ceph-mon[30883]: purged_snaps scrub ok 2024-09-05T12:54:55.389 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:55.389 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:55 smithi073 ceph-mon[30883]: osd.11 [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] boot 2024-09-05T12:54:55.389 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:55 smithi073 ceph-mon[30883]: osdmap e72: 12 total, 12 up, 12 in 2024-09-05T12:54:55.389 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T12:54:55.615 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:54:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.096+0000 7ff599b27640 1 -- 172.21.15.73:0/82177303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594102700 msgr2=0x7ff594104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.096+0000 7ff599b27640 1 --2- 172.21.15.73:0/82177303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594102700 0x7ff594104af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff584009900 tx=0x7ff58402a410 comp rx=0 tx=0).stop 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.096+0000 7ff599b27640 1 -- 172.21.15.73:0/82177303 shutdown_connections 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.096+0000 7ff599b27640 1 --2- 172.21.15.73:0/82177303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff594107960 0x7ff594109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.096+0000 7ff599b27640 1 --2- 172.21.15.73:0/82177303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff594105030 0x7ff594107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.096+0000 7ff599b27640 1 --2- 172.21.15.73:0/82177303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594102700 0x7ff594104af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.096+0000 7ff599b27640 1 -- 172.21.15.73:0/82177303 >> 172.21.15.73:0/82177303 conn(0x7ff5940fc2a0 msgr2=0x7ff5940fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.096+0000 7ff599b27640 1 -- 172.21.15.73:0/82177303 shutdown_connections 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.096+0000 7ff599b27640 1 -- 172.21.15.73:0/82177303 wait complete. 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.096+0000 7ff599b27640 1 Processor -- start 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff599b27640 1 -- start start 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff599b27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff594102700 0x7ff5941980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff599b27640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594105030 0x7ff5941985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff599b27640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff594107960 0x7ff59419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff599b27640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff59410d990 con 0x7ff594105030 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff599b27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff59410d810 con 0x7ff594102700 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff599b27640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff59410db10 con 0x7ff594107960 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff592ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594105030 0x7ff5941985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff592ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594105030 0x7ff5941985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45888/0 (socket says 172.21.15.73:45888) 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff592ffd640 1 -- 172.21.15.73:0/2049516851 learned_addr learned my addr 172.21.15.73:0/2049516851 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff5937fe640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff594102700 0x7ff5941980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff593fff640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff594107960 0x7ff59419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff592ffd640 1 -- 172.21.15.73:0/2049516851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff594107960 msgr2=0x7ff59419f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff592ffd640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff594107960 0x7ff59419f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff592ffd640 1 -- 172.21.15.73:0/2049516851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff594102700 msgr2=0x7ff5941980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff592ffd640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff594102700 0x7ff5941980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff592ffd640 1 -- 172.21.15.73:0/2049516851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59419fcd0 con 0x7ff594105030 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff593fff640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff594107960 0x7ff59419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.097+0000 7ff592ffd640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594105030 0x7ff5941985e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff58800b450 tx=0x7ff58800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.098+0000 7ff590ff9640 1 -- 172.21.15.73:0/2049516851 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588015020 con 0x7ff594105030 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.098+0000 7ff590ff9640 1 -- 172.21.15.73:0/2049516851 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff588011d70 con 0x7ff594105030 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.098+0000 7ff599b27640 1 -- 172.21.15.73:0/2049516851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59419ffc0 con 0x7ff594105030 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.098+0000 7ff590ff9640 1 -- 172.21.15.73:0/2049516851 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58800f340 con 0x7ff594105030 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.098+0000 7ff599b27640 1 -- 172.21.15.73:0/2049516851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5941a0540 con 0x7ff594105030 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.099+0000 7ff599b27640 1 -- 172.21.15.73:0/2049516851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5940fdd90 con 0x7ff594105030 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.100+0000 7ff590ff9640 1 -- 172.21.15.73:0/2049516851 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff588018020 con 0x7ff594105030 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.100+0000 7ff590ff9640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff57c0a2c30 0x7ff57c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.100+0000 7ff5937fe640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff57c0a2c30 0x7ff57c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.100+0000 7ff590ff9640 1 -- 172.21.15.73:0/2049516851 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff5880ce570 con 0x7ff594105030 2024-09-05T12:54:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.101+0000 7ff5937fe640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff57c0a2c30 0x7ff57c0a50f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff5840314e0 tx=0x7ff584000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:56.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.105+0000 7ff590ff9640 1 -- 172.21.15.73:0/2049516851 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff58801f020 con 0x7ff594105030 2024-09-05T12:54:56.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.274+0000 7ff599b27640 1 -- 172.21.15.73:0/2049516851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff59402d970 con 0x7ff594105030 2024-09-05T12:54:56.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:56 smithi073 ceph-mon[30883]: osdmap e73: 12 total, 12 up, 12 in 2024-09-05T12:54:56.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:56 smithi073 ceph-mon[30883]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:54:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.274+0000 7ff590ff9640 1 -- 172.21.15.73:0/2049516851 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7ff58800d040 con 0x7ff594105030 2024-09-05T12:54:56.276 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:54:56.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 -- 172.21.15.73:0/2049516851 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff57c0a2c30 msgr2=0x7ff57c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:56.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff57c0a2c30 0x7ff57c0a50f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff5840314e0 tx=0x7ff584000bc0 comp rx=0 tx=0).stop 2024-09-05T12:54:56.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 -- 172.21.15.73:0/2049516851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594105030 msgr2=0x7ff5941985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594105030 0x7ff5941985e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff58800b450 tx=0x7ff58800b910 comp rx=0 tx=0).stop 2024-09-05T12:54:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 -- 172.21.15.73:0/2049516851 shutdown_connections 2024-09-05T12:54:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff57c0a2c30 0x7ff57c0a50f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff594107960 0x7ff59419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594105030 0x7ff5941985e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 --2- 172.21.15.73:0/2049516851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff594102700 0x7ff5941980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 -- 172.21.15.73:0/2049516851 >> 172.21.15.73:0/2049516851 conn(0x7ff5940fc2a0 msgr2=0x7ff5941030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 -- 172.21.15.73:0/2049516851 shutdown_connections 2024-09-05T12:54:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:56.276+0000 7ff599b27640 1 -- 172.21.15.73:0/2049516851 wait complete. 2024-09-05T12:54:56.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:56 smithi162 ceph-mon[34220]: osdmap e73: 12 total, 12 up, 12 in 2024-09-05T12:54:56.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:56 smithi162 ceph-mon[34220]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:54:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:56 smithi169 ceph-mon[34823]: osdmap e73: 12 total, 12 up, 12 in 2024-09-05T12:54:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:56 smithi169 ceph-mon[34823]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:54:57.052 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1725540894,"num_in_osds":12,"osd_in_since":1725540870,"num_remapped_pgs":0} 2024-09-05T12:54:57.053 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T12:54:57.337 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:54:57.458 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:57 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2049516851' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T12:54:57.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:57 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2049516851' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T12:54:57.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:57 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2049516851' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T12:54:57.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.789+0000 7f6b77b75640 1 -- 172.21.15.73:0/2527299861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b701009d0 msgr2=0x7f6b70100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:57.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.789+0000 7f6b77b75640 1 --2- 172.21.15.73:0/2527299861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b701009d0 0x7f6b70100db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009900 tx=0x7f6b6002a410 comp rx=0 tx=0).stop 2024-09-05T12:54:57.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.789+0000 7f6b77b75640 1 -- 172.21.15.73:0/2527299861 shutdown_connections 2024-09-05T12:54:57.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.789+0000 7f6b77b75640 1 --2- 172.21.15.73:0/2527299861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7010e4f0 0x7f6b70110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.789+0000 7f6b77b75640 1 --2- 172.21.15.73:0/2527299861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b70101380 0x7f6b7010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.789+0000 7f6b77b75640 1 --2- 172.21.15.73:0/2527299861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b701009d0 0x7f6b70100db0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.789+0000 7f6b77b75640 1 -- 172.21.15.73:0/2527299861 >> 172.21.15.73:0/2527299861 conn(0x7f6b700fc7d0 msgr2=0x7f6b700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.789+0000 7f6b77b75640 1 -- 172.21.15.73:0/2527299861 shutdown_connections 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.789+0000 7f6b77b75640 1 -- 172.21.15.73:0/2527299861 wait complete. 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b77b75640 1 Processor -- start 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b77b75640 1 -- start start 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b77b75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b701009d0 0x7f6b701a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b77b75640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b70101380 0x7f6b701a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b77b75640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7010e4f0 0x7f6b7019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b77b75640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6b70114270 con 0x7f6b701009d0 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b77b75640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6b701140f0 con 0x7f6b7010e4f0 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b77b75640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6b701143f0 con 0x7f6b70101380 2024-09-05T12:54:57.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b75911640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b701009d0 0x7f6b701a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b75911640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b701009d0 0x7f6b701a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45914/0 (socket says 172.21.15.73:45914) 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b75911640 1 -- 172.21.15.73:0/2525211380 learned_addr learned my addr 172.21.15.73:0/2525211380 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b76112640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7010e4f0 0x7f6b7019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b75911640 1 -- 172.21.15.73:0/2525211380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b70101380 msgr2=0x7f6b701a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b75911640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b70101380 0x7f6b701a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b75911640 1 -- 172.21.15.73:0/2525211380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7010e4f0 msgr2=0x7f6b7019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b75911640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7010e4f0 0x7f6b7019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.790+0000 7f6b75911640 1 -- 172.21.15.73:0/2525211380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7019ace0 con 0x7f6b701009d0 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.791+0000 7f6b75911640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b701009d0 0x7f6b701a03f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6b60005ab0 tx=0x7f6b600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.791+0000 7f6b6effd640 1 -- 172.21.15.73:0/2525211380 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6003f030 con 0x7f6b701009d0 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.791+0000 7f6b6effd640 1 -- 172.21.15.73:0/2525211380 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b60003ce0 con 0x7f6b701009d0 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.791+0000 7f6b77b75640 1 -- 172.21.15.73:0/2525211380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7019af70 con 0x7f6b701009d0 2024-09-05T12:54:57.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.791+0000 7f6b6effd640 1 -- 172.21.15.73:0/2525211380 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60035070 con 0x7f6b701009d0 2024-09-05T12:54:57.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.791+0000 7f6b77b75640 1 -- 172.21.15.73:0/2525211380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b701a72c0 con 0x7f6b701009d0 2024-09-05T12:54:57.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.792+0000 7f6b77b75640 1 -- 172.21.15.73:0/2525211380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b7006a7d0 con 0x7f6b701009d0 2024-09-05T12:54:57.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.793+0000 7f6b6effd640 1 -- 172.21.15.73:0/2525211380 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6b60042030 con 0x7f6b701009d0 2024-09-05T12:54:57.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.794+0000 7f6b6effd640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6b580a2b80 0x7f6b580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:57.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.794+0000 7f6b6effd640 1 -- 172.21.15.73:0/2525211380 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f6b600ef7b0 con 0x7f6b701009d0 2024-09-05T12:54:57.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.794+0000 7f6b75110640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6b580a2b80 0x7f6b580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:57.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.795+0000 7f6b75110640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6b580a2b80 0x7f6b580a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6b7010e980 tx=0x7f6b64005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:57.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.797+0000 7f6b6effd640 1 -- 172.21.15.73:0/2525211380 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b600bcb90 con 0x7f6b701009d0 2024-09-05T12:54:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.965+0000 7f6b77b75640 1 -- 172.21.15.73:0/2525211380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b70109680 con 0x7f6b701009d0 2024-09-05T12:54:57.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.966+0000 7f6b6effd640 1 -- 172.21.15.73:0/2525211380 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18504 (secure 0 0 0) 0x7f6b600bc490 con 0x7f6b701009d0 2024-09-05T12:54:57.968 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:54:57.969 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":73,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T12:54:55.101278+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T12:54:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.968+0000 7f6b77b75640 1 -- 172.21.15.73:0/2525211380 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6b580a2b80 msgr2=0x7f6b580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.968+0000 7f6b77b75640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6b580a2b80 0x7f6b580a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6b7010e980 tx=0x7f6b64005bf0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.968+0000 7f6b77b75640 1 -- 172.21.15.73:0/2525211380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b701009d0 msgr2=0x7f6b701a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.968+0000 7f6b77b75640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b701009d0 0x7f6b701a03f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6b60005ab0 tx=0x7f6b600042f0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.969+0000 7f6b77b75640 1 -- 172.21.15.73:0/2525211380 shutdown_connections 2024-09-05T12:54:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.969+0000 7f6b77b75640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6b580a2b80 0x7f6b580a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.969+0000 7f6b77b75640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7010e4f0 0x7f6b7019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.969+0000 7f6b77b75640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b70101380 0x7f6b701a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.969+0000 7f6b77b75640 1 --2- 172.21.15.73:0/2525211380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b701009d0 0x7f6b701a03f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:57.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.969+0000 7f6b77b75640 1 -- 172.21.15.73:0/2525211380 >> 172.21.15.73:0/2525211380 conn(0x7f6b700fc7d0 msgr2=0x7f6b700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:57.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.969+0000 7f6b77b75640 1 -- 172.21.15.73:0/2525211380 shutdown_connections 2024-09-05T12:54:57.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:57.969+0000 7f6b77b75640 1 -- 172.21.15.73:0/2525211380 wait complete. 2024-09-05T12:54:58.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:58 smithi073 ceph-mon[30883]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:54:58.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:58 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2525211380' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:54:58.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:58 smithi162 ceph-mon[34220]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:54:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:58 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2525211380' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:54:58.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:58 smithi169 ceph-mon[34823]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:54:58.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:58 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2525211380' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:54:58.796 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T12:51:12.204701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-05T12:54:58.796 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-05T12:54:59.040 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:54:59.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.535+0000 7f2b9e268640 1 -- 172.21.15.73:0/864773263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b98101420 msgr2=0x7f2b9810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:59.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.535+0000 7f2b9e268640 1 --2- 172.21.15.73:0/864773263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b98101420 0x7f2b9810d950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009cd0 tx=0x7f2b9002a8e0 comp rx=0 tx=0).stop 2024-09-05T12:54:59.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.535+0000 7f2b9e268640 1 -- 172.21.15.73:0/864773263 shutdown_connections 2024-09-05T12:54:59.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.535+0000 7f2b9e268640 1 --2- 172.21.15.73:0/864773263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b98101420 0x7f2b9810d950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:59.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.535+0000 7f2b9e268640 1 --2- 172.21.15.73:0/864773263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b98100a80 0x7f2b98100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:59.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.535+0000 7f2b9e268640 1 --2- 172.21.15.73:0/864773263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b98106a80 0x7f2b98106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:59.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.535+0000 7f2b9e268640 1 -- 172.21.15.73:0/864773263 >> 172.21.15.73:0/864773263 conn(0x7f2b980fc7a0 msgr2=0x7f2b980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:59.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.535+0000 7f2b9e268640 1 -- 172.21.15.73:0/864773263 shutdown_connections 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.535+0000 7f2b9e268640 1 -- 172.21.15.73:0/864773263 wait complete. 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b9e268640 1 Processor -- start 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b9e268640 1 -- start start 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b9e268640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b98100a80 0x7f2b98197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b9e268640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b98101420 0x7f2b98197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b9e268640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b98106a80 0x7f2b9819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b9e268640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98110e80 con 0x7f2b98101420 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b9e268640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98110d00 con 0x7f2b98100a80 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b9e268640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98111000 con 0x7f2b98106a80 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b977fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b98101420 0x7f2b98197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b977fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b98101420 0x7f2b98197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45926/0 (socket says 172.21.15.73:45926) 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b977fe640 1 -- 172.21.15.73:0/1081375188 learned_addr learned my addr 172.21.15.73:0/1081375188 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:54:59.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b9c805640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b98106a80 0x7f2b9819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b97fff640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b98100a80 0x7f2b98197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b977fe640 1 -- 172.21.15.73:0/1081375188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b98106a80 msgr2=0x7f2b9819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b977fe640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b98106a80 0x7f2b9819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b977fe640 1 -- 172.21.15.73:0/1081375188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b98100a80 msgr2=0x7f2b98197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b977fe640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b98100a80 0x7f2b98197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b977fe640 1 -- 172.21.15.73:0/1081375188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9819c2d0 con 0x7f2b98101420 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b97fff640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b98100a80 0x7f2b98197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.536+0000 7f2b9c805640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b98106a80 0x7f2b9819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.537+0000 7f2b977fe640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b98101420 0x7f2b98197860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00d770 tx=0x7f2b8c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.537+0000 7f2b957fa640 1 -- 172.21.15.73:0/1081375188 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c017070 con 0x7f2b98101420 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.537+0000 7f2b9e268640 1 -- 172.21.15.73:0/1081375188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9819c5c0 con 0x7f2b98101420 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.537+0000 7f2b957fa640 1 -- 172.21.15.73:0/1081375188 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b8c005500 con 0x7f2b98101420 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.537+0000 7f2b957fa640 1 -- 172.21.15.73:0/1081375188 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c004e00 con 0x7f2b98101420 2024-09-05T12:54:59.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.537+0000 7f2b9e268640 1 -- 172.21.15.73:0/1081375188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b981a3ea0 con 0x7f2b98101420 2024-09-05T12:54:59.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.538+0000 7f2b9e268640 1 -- 172.21.15.73:0/1081375188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b98100ee0 con 0x7f2b98101420 2024-09-05T12:54:59.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.539+0000 7f2b957fa640 1 -- 172.21.15.73:0/1081375188 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2b8c004fa0 con 0x7f2b98101420 2024-09-05T12:54:59.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.540+0000 7f2b957fa640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2b800a2b80 0x7f2b800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:54:59.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.540+0000 7f2b957fa640 1 -- 172.21.15.73:0/1081375188 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f2b8c0ceb00 con 0x7f2b98101420 2024-09-05T12:54:59.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.540+0000 7f2b97fff640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2b800a2b80 0x7f2b800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:54:59.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.540+0000 7f2b97fff640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2b800a2b80 0x7f2b800a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2b88005fd0 tx=0x7f2b88005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:54:59.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.543+0000 7f2b957fa640 1 -- 172.21.15.73:0/1081375188 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b8c09bf00 con 0x7f2b98101420 2024-09-05T12:54:59.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.707+0000 7f2b9e268640 1 -- 172.21.15.73:0/1081375188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2b98109040 con 0x7f2b98101420 2024-09-05T12:54:59.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.708+0000 7f2b957fa640 1 -- 172.21.15.73:0/1081375188 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f2b8c09b800 con 0x7f2b98101420 2024-09-05T12:54:59.710 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-05T12:54:59.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 -- 172.21.15.73:0/1081375188 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2b800a2b80 msgr2=0x7f2b800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:59.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2b800a2b80 0x7f2b800a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2b88005fd0 tx=0x7f2b88005850 comp rx=0 tx=0).stop 2024-09-05T12:54:59.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 -- 172.21.15.73:0/1081375188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b98101420 msgr2=0x7f2b98197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:54:59.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b98101420 0x7f2b98197860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00d770 tx=0x7f2b8c00dc30 comp rx=0 tx=0).stop 2024-09-05T12:54:59.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 -- 172.21.15.73:0/1081375188 shutdown_connections 2024-09-05T12:54:59.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2b800a2b80 0x7f2b800a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:59.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b98106a80 0x7f2b9819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:59.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b98101420 0x7f2b98197860 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:59.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 --2- 172.21.15.73:0/1081375188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b98100a80 0x7f2b98197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:54:59.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 -- 172.21.15.73:0/1081375188 >> 172.21.15.73:0/1081375188 conn(0x7f2b980fc7a0 msgr2=0x7f2b980fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:54:59.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 -- 172.21.15.73:0/1081375188 shutdown_connections 2024-09-05T12:54:59.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:54:59.710+0000 7f2b9e268640 1 -- 172.21.15.73:0/1081375188 wait complete. 2024-09-05T12:55:00.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:54:59 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1081375188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T12:55:00.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:54:59 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1081375188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T12:55:00.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:54:59 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1081375188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T12:55:00.481 INFO:tasks.cephadm:Adding mds.a on smithi073 2024-09-05T12:55:00.481 INFO:tasks.cephadm:Adding mds.d on smithi073 2024-09-05T12:55:00.481 INFO:tasks.cephadm:Adding mds.g on smithi073 2024-09-05T12:55:00.481 INFO:tasks.cephadm:Adding mds.j on smithi073 2024-09-05T12:55:00.482 INFO:tasks.cephadm:Adding mds.b on smithi162 2024-09-05T12:55:00.482 INFO:tasks.cephadm:Adding mds.e on smithi162 2024-09-05T12:55:00.482 INFO:tasks.cephadm:Adding mds.h on smithi162 2024-09-05T12:55:00.482 INFO:tasks.cephadm:Adding mds.k on smithi162 2024-09-05T12:55:00.482 INFO:tasks.cephadm:Adding mds.c on smithi169 2024-09-05T12:55:00.482 INFO:tasks.cephadm:Adding mds.f on smithi169 2024-09-05T12:55:00.482 INFO:tasks.cephadm:Adding mds.i on smithi169 2024-09-05T12:55:00.482 INFO:tasks.cephadm:Adding mds.l on smithi169 2024-09-05T12:55:00.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph orch apply mds all '12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l' 2024-09-05T12:55:00.743 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T12:55:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:00 smithi162 ceph-mon[34220]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:01.120 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:00 smithi169 ceph-mon[34823]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:01.257 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:00 smithi073 ceph-mon[30883]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:01.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.235+0000 7f3ceed9d640 1 -- 172.21.15.169:0/3833683872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ce8100950 msgr2=0x7f3ce8100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:01.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.235+0000 7f3ceed9d640 1 --2- 172.21.15.169:0/3833683872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ce8100950 0x7f3ce8100d50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009900 tx=0x7f3ce402a410 comp rx=0 tx=0).stop 2024-09-05T12:55:01.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.235+0000 7f3ceed9d640 1 -- 172.21.15.169:0/3833683872 shutdown_connections 2024-09-05T12:55:01.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.235+0000 7f3ceed9d640 1 --2- 172.21.15.169:0/3833683872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce8102510 0x7f3ce8108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:01.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.235+0000 7f3ceed9d640 1 --2- 172.21.15.169:0/3833683872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce8101b50 0x7f3ce8101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:01.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.235+0000 7f3ceed9d640 1 --2- 172.21.15.169:0/3833683872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ce8100950 0x7f3ce8100d50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:01.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.235+0000 7f3ceed9d640 1 -- 172.21.15.169:0/3833683872 >> 172.21.15.169:0/3833683872 conn(0x7f3ce80fc0e0 msgr2=0x7f3ce80fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.235+0000 7f3ceed9d640 1 -- 172.21.15.169:0/3833683872 shutdown_connections 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.235+0000 7f3ceed9d640 1 -- 172.21.15.169:0/3833683872 wait complete. 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3ceed9d640 1 Processor -- start 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3ceed9d640 1 -- start start 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3ceed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce8100950 0x7f3ce8196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3ceed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce8101b50 0x7f3ce8197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3ceed9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ce8102510 0x7f3ce819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3ceed9d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce810c5d0 con 0x7f3ce8100950 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3ceed9d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce810c450 con 0x7f3ce8101b50 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3ceed9d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce810c750 con 0x7f3ce8102510 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cee59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ce8102510 0x7f3ce819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cee59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ce8102510 0x7f3ce819e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:52464/0 (socket says 172.21.15.169:52464) 2024-09-05T12:55:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cee59c640 1 -- 172.21.15.169:0/63665506 learned_addr learned my addr 172.21.15.169:0/63665506 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cedd9b640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce8100950 0x7f3ce8196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3ced59a640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce8101b50 0x7f3ce8197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cee59c640 1 -- 172.21.15.169:0/63665506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce8101b50 msgr2=0x7f3ce8197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cee59c640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce8101b50 0x7f3ce8197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cee59c640 1 -- 172.21.15.169:0/63665506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce8100950 msgr2=0x7f3ce8196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cee59c640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce8100950 0x7f3ce8196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cee59c640 1 -- 172.21.15.169:0/63665506 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce819e860 con 0x7f3ce8102510 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3ced59a640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce8101b50 0x7f3ce8197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cee59c640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ce8102510 0x7f3ce819e1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000eaa0 tx=0x7f3ce000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.236+0000 7f3cdaffd640 1 -- 172.21.15.169:0/63665506 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000cdb0 con 0x7f3ce8102510 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.237+0000 7f3ceed9d640 1 -- 172.21.15.169:0/63665506 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce819eb50 con 0x7f3ce8102510 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.237+0000 7f3cdaffd640 1 -- 172.21.15.169:0/63665506 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ce0005020 con 0x7f3ce8102510 2024-09-05T12:55:01.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.237+0000 7f3cdaffd640 1 -- 172.21.15.169:0/63665506 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00116b0 con 0x7f3ce8102510 2024-09-05T12:55:01.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.237+0000 7f3ceed9d640 1 -- 172.21.15.169:0/63665506 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce819f010 con 0x7f3ce8102510 2024-09-05T12:55:01.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.238+0000 7f3ceed9d640 1 -- 172.21.15.169:0/63665506 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce8107d70 con 0x7f3ce8102510 2024-09-05T12:55:01.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.239+0000 7f3cdaffd640 1 -- 172.21.15.169:0/63665506 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3ce0005560 con 0x7f3ce8102510 2024-09-05T12:55:01.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.239+0000 7f3cdaffd640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cd40a2b80 0x7f3cd40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:01.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.240+0000 7f3cdaffd640 1 -- 172.21.15.169:0/63665506 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f3ce00cee20 con 0x7f3ce8102510 2024-09-05T12:55:01.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.240+0000 7f3cedd9b640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cd40a2b80 0x7f3cd40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:01.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.240+0000 7f3cedd9b640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cd40a2b80 0x7f3cd40a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4005ab0 tx=0x7f3ce4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:01.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.244+0000 7f3cdaffd640 1 -- 172.21.15.169:0/63665506 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ce0016030 con 0x7f3ce8102510 2024-09-05T12:55:01.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.421+0000 7f3ceed9d640 1 -- 172.21.15.169:0/63665506 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}) -- 0x7f3ce8062730 con 0x7f3cd40a2b80 2024-09-05T12:55:01.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.429+0000 7f3cdaffd640 1 -- 172.21.15.169:0/63665506 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3ce8062730 con 0x7f3cd40a2b80 2024-09-05T12:55:01.430 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mds.all update... 2024-09-05T12:55:01.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 -- 172.21.15.169:0/63665506 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cd40a2b80 msgr2=0x7f3cd40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:01.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cd40a2b80 0x7f3cd40a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4005ab0 tx=0x7f3ce4000bc0 comp rx=0 tx=0).stop 2024-09-05T12:55:01.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 -- 172.21.15.169:0/63665506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ce8102510 msgr2=0x7f3ce819e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:01.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ce8102510 0x7f3ce819e1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000eaa0 tx=0x7f3ce000ef60 comp rx=0 tx=0).stop 2024-09-05T12:55:01.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 -- 172.21.15.169:0/63665506 shutdown_connections 2024-09-05T12:55:01.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cd40a2b80 0x7f3cd40a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:01.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ce8102510 0x7f3ce819e1c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:01.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce8101b50 0x7f3ce8197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:01.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 --2- 172.21.15.169:0/63665506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce8100950 0x7f3ce8196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:01.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 -- 172.21.15.169:0/63665506 >> 172.21.15.169:0/63665506 conn(0x7f3ce80fc0e0 msgr2=0x7f3ce8104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:01.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 -- 172.21.15.169:0/63665506 shutdown_connections 2024-09-05T12:55:01.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-05T12:55:01.431+0000 7f3ceed9d640 1 -- 172.21.15.169:0/63665506 wait complete. 2024-09-05T12:55:02.244 DEBUG:teuthology.orchestra.run.smithi073:mds.a> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.a.service 2024-09-05T12:55:02.247 DEBUG:teuthology.orchestra.run.smithi073:mds.d> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.d.service 2024-09-05T12:55:02.290 DEBUG:teuthology.orchestra.run.smithi073:mds.g> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.g.service 2024-09-05T12:55:02.333 DEBUG:teuthology.orchestra.run.smithi073:mds.j> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.j.service 2024-09-05T12:55:02.376 DEBUG:teuthology.orchestra.run.smithi162:mds.b> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.b.service 2024-09-05T12:55:02.379 DEBUG:teuthology.orchestra.run.smithi162:mds.e> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.e.service 2024-09-05T12:55:02.424 DEBUG:teuthology.orchestra.run.smithi162:mds.h> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.h.service 2024-09-05T12:55:02.468 DEBUG:teuthology.orchestra.run.smithi162:mds.k> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.k.service 2024-09-05T12:55:02.468 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:55:02.468 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: Saving service mds.all spec with placement smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-05T12:55:02.468 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:02.468 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:55:02.468 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:02.469 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:55:02.469 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:02.469 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:02.469 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:02.469 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:02.469 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: Deploying daemon mds.l on smithi169 2024-09-05T12:55:02.469 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:02 smithi169 ceph-mon[34823]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:02.512 DEBUG:teuthology.orchestra.run.smithi169:mds.c> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.c.service 2024-09-05T12:55:02.515 DEBUG:teuthology.orchestra.run.smithi169:mds.f> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.f.service 2024-09-05T12:55:02.557 DEBUG:teuthology.orchestra.run.smithi169:mds.i> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.i.service 2024-09-05T12:55:02.600 DEBUG:teuthology.orchestra.run.smithi169:mds.l> sudo journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.l.service 2024-09-05T12:55:02.643 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-05T12:55:02.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:55:02.666 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:55:02.666 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: Saving service mds.all spec with placement smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-05T12:55:02.666 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:02.666 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:55:02.666 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:02.666 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:55:02.666 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:02.666 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:02.666 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:02.667 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:02.667 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: Deploying daemon mds.l on smithi169 2024-09-05T12:55:02.667 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:02 smithi073 ceph-mon[30883]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:02.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:55:02.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: Saving service mds.all spec with placement smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-05T12:55:02.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:02.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:55:02.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:02.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:55:02.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:02.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:02.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:02.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:02.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: Deploying daemon mds.l on smithi169 2024-09-05T12:55:02.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:02 smithi162 ceph-mon[34220]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:02.888 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:03.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.378+0000 7f154e2d5640 1 -- 172.21.15.73:0/1793237762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1548102570 msgr2=0x7f15481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.378+0000 7f154e2d5640 1 --2- 172.21.15.73:0/1793237762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1548102570 0x7f15481029b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f153c009900 tx=0x7f153c02a480 comp rx=0 tx=0).stop 2024-09-05T12:55:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.378+0000 7f154e2d5640 1 -- 172.21.15.73:0/1793237762 shutdown_connections 2024-09-05T12:55:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.378+0000 7f154e2d5640 1 --2- 172.21.15.73:0/1793237762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1548102ef0 0x7f154810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.378+0000 7f154e2d5640 1 --2- 172.21.15.73:0/1793237762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1548102570 0x7f15481029b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.378+0000 7f154e2d5640 1 --2- 172.21.15.73:0/1793237762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1548100e20 0x7f1548101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.378+0000 7f154e2d5640 1 -- 172.21.15.73:0/1793237762 >> 172.21.15.73:0/1793237762 conn(0x7f15480fc7d0 msgr2=0x7f15480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.378+0000 7f154e2d5640 1 -- 172.21.15.73:0/1793237762 shutdown_connections 2024-09-05T12:55:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.378+0000 7f154e2d5640 1 -- 172.21.15.73:0/1793237762 wait complete. 2024-09-05T12:55:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.379+0000 7f154e2d5640 1 Processor -- start 2024-09-05T12:55:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.379+0000 7f154e2d5640 1 -- start start 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.379+0000 7f154e2d5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1548100e20 0x7f15480fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.379+0000 7f154e2d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1548102570 0x7f15480fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.379+0000 7f154e2d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1548102ef0 0x7f15480fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.379+0000 7f154e2d5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1548110f80 con 0x7f1548102570 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.379+0000 7f154e2d5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1548110e00 con 0x7f1548102ef0 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.379+0000 7f154e2d5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1548111100 con 0x7f1548100e20 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15477fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1548102570 0x7f15480fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15477fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1548102570 0x7f15480fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37268/0 (socket says 172.21.15.73:37268) 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15477fe640 1 -- 172.21.15.73:0/1324249602 learned_addr learned my addr 172.21.15.73:0/1324249602 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f1547fff640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1548100e20 0x7f15480fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f154c872640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1548102ef0 0x7f15480fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15477fe640 1 -- 172.21.15.73:0/1324249602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1548100e20 msgr2=0x7f15480fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15477fe640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1548100e20 0x7f15480fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15477fe640 1 -- 172.21.15.73:0/1324249602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1548102ef0 msgr2=0x7f15480fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15477fe640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1548102ef0 0x7f15480fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15477fe640 1 -- 172.21.15.73:0/1324249602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15481a6990 con 0x7f1548102570 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f154c872640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1548102ef0 0x7f15480fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15477fe640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1548102570 0x7f15480fd1c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f153c006010 tx=0x7f153c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15457fa640 1 -- 172.21.15.73:0/1324249602 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c03f070 con 0x7f1548102570 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f154e2d5640 1 -- 172.21.15.73:0/1324249602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15481a6c20 con 0x7f1548102570 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15457fa640 1 -- 172.21.15.73:0/1324249602 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f153c031c30 con 0x7f1548102570 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f15457fa640 1 -- 172.21.15.73:0/1324249602 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c035030 con 0x7f1548102570 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.380+0000 7f154e2d5640 1 -- 172.21.15.73:0/1324249602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15481a7100 con 0x7f1548102570 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.382+0000 7f154e2d5640 1 -- 172.21.15.73:0/1324249602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1548101200 con 0x7f1548102570 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.382+0000 7f15457fa640 1 -- 172.21.15.73:0/1324249602 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f153c042070 con 0x7f1548102570 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.383+0000 7f15457fa640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15300a2b80 0x7f15300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.383+0000 7f1547fff640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15300a2b80 0x7f15300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:03.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.383+0000 7f15457fa640 1 -- 172.21.15.73:0/1324249602 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f153c0ef280 con 0x7f1548102570 2024-09-05T12:55:03.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.384+0000 7f1547fff640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15300a2b80 0x7f15300a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1538009bd0 tx=0x7f1538005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:03.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.388+0000 7f15457fa640 1 -- 172.21.15.73:0/1324249602 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f153c0bc680 con 0x7f1548102570 2024-09-05T12:55:03.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.600+0000 7f154e2d5640 1 -- 172.21.15.73:0/1324249602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f154810a0a0 con 0x7f1548102570 2024-09-05T12:55:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.601+0000 7f15457fa640 1 -- 172.21.15.73:0/1324249602 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f153c0bbf80 con 0x7f1548102570 2024-09-05T12:55:03.603 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:03.603 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"btime":"2024-09-05T12:48:11:856233+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-05T12:55:03.604 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 1 2024-09-05T12:55:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.604+0000 7f154e2d5640 1 -- 172.21.15.73:0/1324249602 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15300a2b80 msgr2=0x7f15300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.604+0000 7f154e2d5640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15300a2b80 0x7f15300a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1538009bd0 tx=0x7f1538005f90 comp rx=0 tx=0).stop 2024-09-05T12:55:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.604+0000 7f154e2d5640 1 -- 172.21.15.73:0/1324249602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1548102570 msgr2=0x7f15480fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.604+0000 7f154e2d5640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1548102570 0x7f15480fd1c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f153c006010 tx=0x7f153c003c10 comp rx=0 tx=0).stop 2024-09-05T12:55:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.604+0000 7f154e2d5640 1 -- 172.21.15.73:0/1324249602 shutdown_connections 2024-09-05T12:55:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.605+0000 7f154e2d5640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15300a2b80 0x7f15300a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.605+0000 7f154e2d5640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1548102ef0 0x7f15480fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.605+0000 7f154e2d5640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1548102570 0x7f15480fd1c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.605+0000 7f154e2d5640 1 --2- 172.21.15.73:0/1324249602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1548100e20 0x7f15480fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.605+0000 7f154e2d5640 1 -- 172.21.15.73:0/1324249602 >> 172.21.15.73:0/1324249602 conn(0x7f15480fc7d0 msgr2=0x7f154806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.605+0000 7f154e2d5640 1 -- 172.21.15.73:0/1324249602 shutdown_connections 2024-09-05T12:55:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:03.605+0000 7f154e2d5640 1 -- 172.21.15.73:0/1324249602 wait complete. 2024-09-05T12:55:03.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:03 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1324249602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:04.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:03 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1324249602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:04.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:03 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1324249602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:04.304 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 12:55:04 smithi169 systemd[1]: Starting Ceph mds.l for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:04.564 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 12:55:04 smithi169 podman[64573]: 2024-09-05 12:55:04.205583535 +0000 UTC m=+0.016337524 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:04.564 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 12:55:04 smithi169 podman[64573]: 2024-09-05 12:55:04.318353407 +0000 UTC m=+0.129107359 container create 285eb183f55aac5d10404de3ee7e7a046703f4427ca06427a2cb040e43a8ce81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-05T12:55:04.565 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 12:55:04 smithi169 podman[64573]: 2024-09-05 12:55:04.562990644 +0000 UTC m=+0.373744596 container init 285eb183f55aac5d10404de3ee7e7a046703f4427ca06427a2cb040e43a8ce81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-05T12:55:04.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mon[34823]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:04.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.169:6832/1381090054,v1:172.21.15.169:6833/1381090054] up:boot 2024-09-05T12:55:04.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mon[34823]: fsmap 1 up:standby 2024-09-05T12:55:04.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T12:55:04.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:04.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:04.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:04.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:04.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:04.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:04.869 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 12:55:04 smithi169 podman[64573]: 2024-09-05 12:55:04.565895103 +0000 UTC m=+0.376649064 container start 285eb183f55aac5d10404de3ee7e7a046703f4427ca06427a2cb040e43a8ce81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T12:55:04.869 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-mds[64592]: -- 172.21.15.169:0/3794422687 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fe9cb5860 con 0x563fe9c93000 2024-09-05T12:55:04.869 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 12:55:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-l[64588]: starting mds.l at 2024-09-05T12:55:04.869 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 12:55:04 smithi169 bash[64573]: 285eb183f55aac5d10404de3ee7e7a046703f4427ca06427a2cb040e43a8ce81 2024-09-05T12:55:04.869 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 12:55:04 smithi169 systemd[1]: Started Ceph mds.l for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:05.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:04 smithi162 ceph-mon[34220]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:05.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:04 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.169:6832/1381090054,v1:172.21.15.169:6833/1381090054] up:boot 2024-09-05T12:55:05.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:04 smithi162 ceph-mon[34220]: fsmap 1 up:standby 2024-09-05T12:55:05.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T12:55:05.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:05.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:05.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:05.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:05.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:05.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:05.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:04 smithi073 ceph-mon[30883]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:04 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.169:6832/1381090054,v1:172.21.15.169:6833/1381090054] up:boot 2024-09-05T12:55:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:04 smithi073 ceph-mon[30883]: fsmap 1 up:standby 2024-09-05T12:55:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T12:55:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:05.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:06.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:05 smithi162 ceph-mon[34220]: Deploying daemon mds.k on smithi162 2024-09-05T12:55:06.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:05 smithi169 ceph-mon[34823]: Deploying daemon mds.k on smithi162 2024-09-05T12:55:06.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:05 smithi073 ceph-mon[30883]: Deploying daemon mds.k on smithi162 2024-09-05T12:55:06.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:55:06.673 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:07.093 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:06 smithi073 ceph-mon[30883]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:07.103 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:06 smithi162 ceph-mon[34220]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:07.103 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 12:55:06 smithi162 systemd[1]: Starting Ceph mds.k for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:07.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:06 smithi169 ceph-mon[34823]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:07.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 -- 172.21.15.73:0/1110957400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe154101de0 msgr2=0x7fe1541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:07.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 --2- 172.21.15.73:0/1110957400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe154101de0 0x7fe1541021c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009900 tx=0x7fe14c02a410 comp rx=0 tx=0).stop 2024-09-05T12:55:07.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 -- 172.21.15.73:0/1110957400 shutdown_connections 2024-09-05T12:55:07.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 --2- 172.21.15.73:0/1110957400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe154106f10 0x7fe15410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 --2- 172.21.15.73:0/1110957400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe154102790 0x7fe1541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 --2- 172.21.15.73:0/1110957400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe154101de0 0x7fe1541021c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 -- 172.21.15.73:0/1110957400 >> 172.21.15.73:0/1110957400 conn(0x7fe1540fd8c0 msgr2=0x7fe1540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 -- 172.21.15.73:0/1110957400 shutdown_connections 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 -- 172.21.15.73:0/1110957400 wait complete. 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 Processor -- start 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.171+0000 7fe15c0d7640 1 -- start start 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15c0d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe154101de0 0x7fe1541983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15c0d7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe154102790 0x7fe154198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15c0d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe154106f10 0x7fe15419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15c0d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe154111f90 con 0x7fe154106f10 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15c0d7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe154111e10 con 0x7fe154101de0 2024-09-05T12:55:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15c0d7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe154112110 con 0x7fe154102790 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15a674640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe154106f10 0x7fe15419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15a674640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe154106f10 0x7fe15419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37286/0 (socket says 172.21.15.73:37286) 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15a674640 1 -- 172.21.15.73:0/4091257953 learned_addr learned my addr 172.21.15.73:0/4091257953 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe159e73640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe154101de0 0x7fe1541983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe159672640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe154102790 0x7fe154198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15a674640 1 -- 172.21.15.73:0/4091257953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe154102790 msgr2=0x7fe154198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15a674640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe154102790 0x7fe154198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15a674640 1 -- 172.21.15.73:0/4091257953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe154101de0 msgr2=0x7fe1541983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15a674640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe154101de0 0x7fe1541983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15a674640 1 -- 172.21.15.73:0/4091257953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15419d380 con 0x7fe154106f10 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe159672640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe154102790 0x7fe154198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15a674640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe154106f10 0x7fe15419cca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe144009fd0 tx=0x7fe14400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:07.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe152ffd640 1 -- 172.21.15.73:0/4091257953 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144011830 con 0x7fe154106f10 2024-09-05T12:55:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15c0d7640 1 -- 172.21.15.73:0/4091257953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15419d670 con 0x7fe154106f10 2024-09-05T12:55:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe152ffd640 1 -- 172.21.15.73:0/4091257953 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe144016070 con 0x7fe154106f10 2024-09-05T12:55:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe152ffd640 1 -- 172.21.15.73:0/4091257953 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14400f2e0 con 0x7fe154106f10 2024-09-05T12:55:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.172+0000 7fe15c0d7640 1 -- 172.21.15.73:0/4091257953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1541a4f50 con 0x7fe154106f10 2024-09-05T12:55:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.173+0000 7fe15c0d7640 1 -- 172.21.15.73:0/4091257953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1541021c0 con 0x7fe154106f10 2024-09-05T12:55:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.175+0000 7fe152ffd640 1 -- 172.21.15.73:0/4091257953 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe1440119d0 con 0x7fe154106f10 2024-09-05T12:55:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.175+0000 7fe152ffd640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe13c0a2b80 0x7fe13c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.175+0000 7fe159e73640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe13c0a2b80 0x7fe13c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:07.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.175+0000 7fe152ffd640 1 -- 172.21.15.73:0/4091257953 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe1440ce980 con 0x7fe154106f10 2024-09-05T12:55:07.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.176+0000 7fe159e73640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe13c0a2b80 0x7fe13c0a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0096c0 tx=0x7fe14c031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:07.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.178+0000 7fe152ffd640 1 -- 172.21.15.73:0/4091257953 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe14409bd80 con 0x7fe154106f10 2024-09-05T12:55:07.361 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 12:55:07 smithi162 podman[63872]: 2024-09-05 12:55:07.005162017 +0000 UTC m=+0.015913625 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:07.361 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 12:55:07 smithi162 podman[63872]: 2024-09-05 12:55:07.133494145 +0000 UTC m=+0.144245785 container create d3470ab6bf8e9a61e8ab2de77c023345f2a1ad059444fec629a6459256359f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-05T12:55:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.378+0000 7fe15c0d7640 1 -- 172.21.15.73:0/4091257953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe15410a150 con 0x7fe154106f10 2024-09-05T12:55:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.379+0000 7fe152ffd640 1 -- 172.21.15.73:0/4091257953 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fe14409b680 con 0x7fe154106f10 2024-09-05T12:55:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:07.381 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"btime":"2024-09-05T12:55:04:594328+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-05T12:55:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-09-05T12:55:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 -- 172.21.15.73:0/4091257953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe13c0a2b80 msgr2=0x7fe13c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe13c0a2b80 0x7fe13c0a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0096c0 tx=0x7fe14c031490 comp rx=0 tx=0).stop 2024-09-05T12:55:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 -- 172.21.15.73:0/4091257953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe154106f10 msgr2=0x7fe15419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe154106f10 0x7fe15419cca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe144009fd0 tx=0x7fe14400b8e0 comp rx=0 tx=0).stop 2024-09-05T12:55:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 -- 172.21.15.73:0/4091257953 shutdown_connections 2024-09-05T12:55:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe13c0a2b80 0x7fe13c0a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe154106f10 0x7fe15419cca0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe154102790 0x7fe154198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 --2- 172.21.15.73:0/4091257953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe154101de0 0x7fe1541983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 -- 172.21.15.73:0/4091257953 >> 172.21.15.73:0/4091257953 conn(0x7fe1540fd8c0 msgr2=0x7fe1540fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 -- 172.21.15.73:0/4091257953 shutdown_connections 2024-09-05T12:55:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:07.381+0000 7fe15c0d7640 1 -- 172.21.15.73:0/4091257953 wait complete. 2024-09-05T12:55:07.810 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 12:55:07 smithi162 podman[63872]: 2024-09-05 12:55:07.38607849 +0000 UTC m=+0.396830085 container init d3470ab6bf8e9a61e8ab2de77c023345f2a1ad059444fec629a6459256359f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-k, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-05T12:55:07.810 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 12:55:07 smithi162 podman[63872]: 2024-09-05 12:55:07.389097612 +0000 UTC m=+0.399849216 container start d3470ab6bf8e9a61e8ab2de77c023345f2a1ad059444fec629a6459256359f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2) 2024-09-05T12:55:07.810 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 12:55:07 smithi162 ceph-mds[63891]: -- 172.21.15.162:0/3023539854 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c556b83860 con 0x55c556b61000 2024-09-05T12:55:07.810 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 12:55:07 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-k[63887]: starting mds.k at 2024-09-05T12:55:07.810 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 12:55:07 smithi162 bash[63872]: d3470ab6bf8e9a61e8ab2de77c023345f2a1ad059444fec629a6459256359f10 2024-09-05T12:55:07.811 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 12:55:07 smithi162 systemd[1]: Started Ceph mds.k for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:08.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:07 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/4091257953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:08.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:07 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:08.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:07 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:08.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:07 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:08.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:07 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:08.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:07 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:08.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:07 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:08.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:07 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/4091257953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:08.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:07 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:08.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:07 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:08.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:07 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:08.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:07 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:08.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:07 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:08.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:07 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:08.221 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:07 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/4091257953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:08.221 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:07 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:08.221 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:07 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:08.221 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:07 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:08.221 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:07 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:08.221 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:07 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:08.221 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:07 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:09.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:08 smithi162 ceph-mon[34220]: Deploying daemon mds.j on smithi073 2024-09-05T12:55:09.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:08 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.162:6832/1135530165,v1:172.21.15.162:6833/1135530165] up:boot 2024-09-05T12:55:09.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:08 smithi162 ceph-mon[34220]: fsmap 2 up:standby 2024-09-05T12:55:09.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:08 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T12:55:09.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:08 smithi162 ceph-mon[34220]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:09.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:08 smithi169 ceph-mon[34823]: Deploying daemon mds.j on smithi073 2024-09-05T12:55:09.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:08 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.162:6832/1135530165,v1:172.21.15.162:6833/1135530165] up:boot 2024-09-05T12:55:09.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:08 smithi169 ceph-mon[34823]: fsmap 2 up:standby 2024-09-05T12:55:09.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:08 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T12:55:09.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:08 smithi169 ceph-mon[34823]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:09.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:08 smithi073 ceph-mon[30883]: Deploying daemon mds.j on smithi073 2024-09-05T12:55:09.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:08 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.162:6832/1135530165,v1:172.21.15.162:6833/1135530165] up:boot 2024-09-05T12:55:09.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:08 smithi073 ceph-mon[30883]: fsmap 2 up:standby 2024-09-05T12:55:09.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:08 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T12:55:09.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:08 smithi073 ceph-mon[30883]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:09.948 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 12:55:09 smithi073 systemd[1]: Starting Ceph mds.j for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:10.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:55:10.230 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 12:55:09 smithi073 podman[69841]: 2024-09-05 12:55:09.850558421 +0000 UTC m=+0.015906318 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:10.230 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 12:55:09 smithi073 podman[69841]: 2024-09-05 12:55:09.984940315 +0000 UTC m=+0.150288204 container create eb660a2617c2afe72e777d5d421e5f70268fb34daeee17b8f6ab275149550a7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-05T12:55:10.230 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 12:55:10 smithi073 podman[69841]: 2024-09-05 12:55:10.229538324 +0000 UTC m=+0.394886225 container init eb660a2617c2afe72e777d5d421e5f70268fb34daeee17b8f6ab275149550a7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-j, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-05T12:55:10.422 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:10.513 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 12:55:10 smithi073 podman[69841]: 2024-09-05 12:55:10.232691698 +0000 UTC m=+0.398039603 container start eb660a2617c2afe72e777d5d421e5f70268fb34daeee17b8f6ab275149550a7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-05T12:55:10.513 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 12:55:10 smithi073 ceph-mds[69890]: -- 172.21.15.73:0/3764329757 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601bffa5860 con 0x5601bff83400 2024-09-05T12:55:10.513 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 12:55:10 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-j[69874]: starting mds.j at 2024-09-05T12:55:10.514 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 12:55:10 smithi073 bash[69841]: eb660a2617c2afe72e777d5d421e5f70268fb34daeee17b8f6ab275149550a7e 2024-09-05T12:55:10.514 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 12:55:10 smithi073 systemd[1]: Started Ceph mds.j for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:10.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.913+0000 7fac60ff4640 1 -- 172.21.15.73:0/1339945097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c106ba0 msgr2=0x7fac5c106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:10.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.913+0000 7fac60ff4640 1 --2- 172.21.15.73:0/1339945097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c106ba0 0x7fac5c106f80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009900 tx=0x7fac4c02a410 comp rx=0 tx=0).stop 2024-09-05T12:55:10.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.913+0000 7fac60ff4640 1 -- 172.21.15.73:0/1339945097 shutdown_connections 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.913+0000 7fac60ff4640 1 --2- 172.21.15.73:0/1339945097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c100a70 0x7fac5c10ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.913+0000 7fac60ff4640 1 --2- 172.21.15.73:0/1339945097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac5c1000d0 0x7fac5c100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.913+0000 7fac60ff4640 1 --2- 172.21.15.73:0/1339945097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c106ba0 0x7fac5c106f80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.913+0000 7fac60ff4640 1 -- 172.21.15.73:0/1339945097 >> 172.21.15.73:0/1339945097 conn(0x7fac5c077210 msgr2=0x7fac5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.913+0000 7fac60ff4640 1 -- 172.21.15.73:0/1339945097 shutdown_connections 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.913+0000 7fac60ff4640 1 -- 172.21.15.73:0/1339945097 wait complete. 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.914+0000 7fac60ff4640 1 Processor -- start 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.914+0000 7fac60ff4640 1 -- start start 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.914+0000 7fac60ff4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c1000d0 0x7fac5c1012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.914+0000 7fac60ff4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac5c100a70 0x7fac5c1017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac60ff4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c106ba0 0x7fac5c101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac60ff4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c1120b0 con 0x7fac5c1000d0 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac60ff4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c111f30 con 0x7fac5c100a70 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac60ff4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c112230 con 0x7fac5c106ba0 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c1000d0 0x7fac5c1012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c1000d0 0x7fac5c1012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37302/0 (socket says 172.21.15.73:37302) 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5a59c640 1 -- 172.21.15.73:0/3040982223 learned_addr learned my addr 172.21.15.73:0/3040982223 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5ad9d640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c106ba0 0x7fac5c101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac51d9b640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac5c100a70 0x7fac5c1017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5a59c640 1 -- 172.21.15.73:0/3040982223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c106ba0 msgr2=0x7fac5c101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5a59c640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c106ba0 0x7fac5c101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5a59c640 1 -- 172.21.15.73:0/3040982223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac5c100a70 msgr2=0x7fac5c1017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5a59c640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac5c100a70 0x7fac5c1017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:10.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5a59c640 1 -- 172.21.15.73:0/3040982223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c1a69b0 con 0x7fac5c1000d0 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5ad9d640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c106ba0 0x7fac5c101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac51d9b640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac5c100a70 0x7fac5c1017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac5a59c640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c1000d0 0x7fac5c1012b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fac4c006010 tx=0x7fac4c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac53fff640 1 -- 172.21.15.73:0/3040982223 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c03f070 con 0x7fac5c1000d0 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac60ff4640 1 -- 172.21.15.73:0/3040982223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c1a6c40 con 0x7fac5c1000d0 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac53fff640 1 -- 172.21.15.73:0/3040982223 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac4c031e30 con 0x7fac5c1000d0 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac53fff640 1 -- 172.21.15.73:0/3040982223 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c035030 con 0x7fac5c1000d0 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.915+0000 7fac60ff4640 1 -- 172.21.15.73:0/3040982223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c1a7170 con 0x7fac5c1000d0 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.916+0000 7fac60ff4640 1 -- 172.21.15.73:0/3040982223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c100530 con 0x7fac5c1000d0 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.918+0000 7fac53fff640 1 -- 172.21.15.73:0/3040982223 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fac4c042070 con 0x7fac5c1000d0 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.918+0000 7fac53fff640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac480a2b80 0x7fac480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.918+0000 7fac53fff640 1 -- 172.21.15.73:0/3040982223 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fac4c0efb40 con 0x7fac5c1000d0 2024-09-05T12:55:10.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.918+0000 7fac51d9b640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac480a2b80 0x7fac480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:10.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.919+0000 7fac51d9b640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac480a2b80 0x7fac480a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac44006fd0 tx=0x7fac44008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:10.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:10.921+0000 7fac53fff640 1 -- 172.21.15.73:0/3040982223 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac4c0bcfd0 con 0x7fac5c1000d0 2024-09-05T12:55:11.113 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:11 smithi073 ceph-mon[30883]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:11.114 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:11.114 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:11.114 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:11.114 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:11.114 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:11.114 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:11 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.137+0000 7fac60ff4640 1 -- 172.21.15.73:0/3040982223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac5c1a7400 con 0x7fac5c1000d0 2024-09-05T12:55:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.137+0000 7fac53fff640 1 -- 172.21.15.73:0/3040982223 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7fac4c0bc8d0 con 0x7fac5c1000d0 2024-09-05T12:55:11.139 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:11.139 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":4,"btime":"2024-09-05T12:55:11:017970+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-05T12:55:11.139 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 4 2024-09-05T12:55:11.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 -- 172.21.15.73:0/3040982223 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac480a2b80 msgr2=0x7fac480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:11.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac480a2b80 0x7fac480a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac44006fd0 tx=0x7fac44008040 comp rx=0 tx=0).stop 2024-09-05T12:55:11.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 -- 172.21.15.73:0/3040982223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c1000d0 msgr2=0x7fac5c1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:11.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c1000d0 0x7fac5c1012b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fac4c006010 tx=0x7fac4c003c80 comp rx=0 tx=0).stop 2024-09-05T12:55:11.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 -- 172.21.15.73:0/3040982223 shutdown_connections 2024-09-05T12:55:11.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac480a2b80 0x7fac480a5040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:11.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c106ba0 0x7fac5c101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:11.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac5c100a70 0x7fac5c1017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:11.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 --2- 172.21.15.73:0/3040982223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c1000d0 0x7fac5c1012b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:11.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 -- 172.21.15.73:0/3040982223 >> 172.21.15.73:0/3040982223 conn(0x7fac5c077210 msgr2=0x7fac5c104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:11.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 -- 172.21.15.73:0/3040982223 shutdown_connections 2024-09-05T12:55:11.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:11.140+0000 7fac60ff4640 1 -- 172.21.15.73:0/3040982223 wait complete. 2024-09-05T12:55:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:11 smithi162 ceph-mon[34220]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:11 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:11.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:11 smithi169 ceph-mon[34823]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:11.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:11.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:11.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:11.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:11.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:11.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:11 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:12 smithi073 ceph-mon[30883]: Deploying daemon mds.d on smithi073 2024-09-05T12:55:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:12 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.73:6834/3381594379,v1:172.21.15.73:6835/3381594379] up:boot 2024-09-05T12:55:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:12 smithi073 ceph-mon[30883]: fsmap 3 up:standby 2024-09-05T12:55:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:12 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T12:55:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:12 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3040982223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:12.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:12 smithi162 ceph-mon[34220]: Deploying daemon mds.d on smithi073 2024-09-05T12:55:12.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:12 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.73:6834/3381594379,v1:172.21.15.73:6835/3381594379] up:boot 2024-09-05T12:55:12.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:12 smithi162 ceph-mon[34220]: fsmap 3 up:standby 2024-09-05T12:55:12.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:12 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T12:55:12.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:12 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3040982223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:12.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:12 smithi169 ceph-mon[34823]: Deploying daemon mds.d on smithi073 2024-09-05T12:55:12.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:12 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.73:6834/3381594379,v1:172.21.15.73:6835/3381594379] up:boot 2024-09-05T12:55:12.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:12 smithi169 ceph-mon[34823]: fsmap 3 up:standby 2024-09-05T12:55:12.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:12 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T12:55:12.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:12 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3040982223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:13.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:13 smithi073 ceph-mon[30883]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:13.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:13 smithi162 ceph-mon[34220]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:13.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:13 smithi169 ceph-mon[34823]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:13.697 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 12:55:13 smithi073 systemd[1]: Starting Ceph mds.d for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:13.982 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 12:55:13 smithi073 podman[70260]: 2024-09-05 12:55:13.599147778 +0000 UTC m=+0.015692194 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:13.982 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 12:55:13 smithi073 podman[70260]: 2024-09-05 12:55:13.719465817 +0000 UTC m=+0.136010227 container create 3e778f6db72d7972ed823deb9b1a0a3e5815f53918cb3e99c0d28a3a20db1d38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-05T12:55:13.983 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 12:55:13 smithi073 podman[70260]: 2024-09-05 12:55:13.980799992 +0000 UTC m=+0.397344406 container init 3e778f6db72d7972ed823deb9b1a0a3e5815f53918cb3e99c0d28a3a20db1d38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-05T12:55:13.991 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:55:14.263 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 12:55:13 smithi073 podman[70260]: 2024-09-05 12:55:13.983572604 +0000 UTC m=+0.400117023 container start 3e778f6db72d7972ed823deb9b1a0a3e5815f53918cb3e99c0d28a3a20db1d38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-05T12:55:14.263 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 12:55:14 smithi073 ceph-mds[70279]: -- 172.21.15.73:0/3753151114 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ab81a1860 con 0x560ab817f400 2024-09-05T12:55:14.263 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 12:55:14 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-d[70275]: starting mds.d at 2024-09-05T12:55:14.263 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 12:55:14 smithi073 bash[70260]: 3e778f6db72d7972ed823deb9b1a0a3e5815f53918cb3e99c0d28a3a20db1d38 2024-09-05T12:55:14.263 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 12:55:14 smithi073 systemd[1]: Started Ceph mds.d for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:14.265 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:14.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 -- 172.21.15.73:0/3525855120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb81055b0 msgr2=0x7fbbb810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:14.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 --2- 172.21.15.73:0/3525855120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb81055b0 0x7fbbb810d130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009ca0 tx=0x7fbbb002a8c0 comp rx=0 tx=0).stop 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 -- 172.21.15.73:0/3525855120 shutdown_connections 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 --2- 172.21.15.73:0/3525855120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb81055b0 0x7fbbb810d130 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 --2- 172.21.15.73:0/3525855120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbb8100e30 0x7fbbb8104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 --2- 172.21.15.73:0/3525855120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb8100480 0x7fbbb8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 -- 172.21.15.73:0/3525855120 >> 172.21.15.73:0/3525855120 conn(0x7fbbb8077210 msgr2=0x7fbbb80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 -- 172.21.15.73:0/3525855120 shutdown_connections 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 -- 172.21.15.73:0/3525855120 wait complete. 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 Processor -- start 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.707+0000 7fbbbef81640 1 -- start start 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbbef81640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbb8100480 0x7fbbb81972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbbef81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb8100e30 0x7fbbb8197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:14.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbbef81640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb81055b0 0x7fbbb819bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:14.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbbef81640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8110e90 con 0x7fbbb8100e30 2024-09-05T12:55:14.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbbef81640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8110d10 con 0x7fbbb8100480 2024-09-05T12:55:14.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbbef81640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8111010 con 0x7fbbb81055b0 2024-09-05T12:55:14.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb8100e30 0x7fbbb8197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:14.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb8100e30 0x7fbbb8197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35846/0 (socket says 172.21.15.73:35846) 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb7fff640 1 -- 172.21.15.73:0/4114073941 learned_addr learned my addr 172.21.15.73:0/4114073941 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbbd51e640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb81055b0 0x7fbbb819bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbbcd1d640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbb8100480 0x7fbbb81972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb7fff640 1 -- 172.21.15.73:0/4114073941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb81055b0 msgr2=0x7fbbb819bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb7fff640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb81055b0 0x7fbbb819bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb7fff640 1 -- 172.21.15.73:0/4114073941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbb8100480 msgr2=0x7fbbb81972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb7fff640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbb8100480 0x7fbbb81972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb7fff640 1 -- 172.21.15.73:0/4114073941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb819c280 con 0x7fbbb8100e30 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbbcd1d640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbb8100480 0x7fbbb81972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb7fff640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb8100e30 0x7fbbb8197810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009970 tx=0x7fbba4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb5ffb640 1 -- 172.21.15.73:0/4114073941 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba400d020 con 0x7fbbb8100e30 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbb5ffb640 1 -- 172.21.15.73:0/4114073941 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba4007d40 con 0x7fbbb8100e30 2024-09-05T12:55:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.708+0000 7fbbbef81640 1 -- 172.21.15.73:0/4114073941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb819c570 con 0x7fbbb8100e30 2024-09-05T12:55:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.709+0000 7fbbb5ffb640 1 -- 172.21.15.73:0/4114073941 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba400ccc0 con 0x7fbbb8100e30 2024-09-05T12:55:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.709+0000 7fbbbef81640 1 -- 172.21.15.73:0/4114073941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb810d9f0 con 0x7fbbb8100e30 2024-09-05T12:55:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.710+0000 7fbbbef81640 1 -- 172.21.15.73:0/4114073941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb8100860 con 0x7fbbb8100e30 2024-09-05T12:55:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.711+0000 7fbbb5ffb640 1 -- 172.21.15.73:0/4114073941 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbba400c460 con 0x7fbbb8100e30 2024-09-05T12:55:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.711+0000 7fbbb5ffb640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbba80a2b80 0x7fbba80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.711+0000 7fbbbcd1d640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbba80a2b80 0x7fbba80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.712+0000 7fbbb5ffb640 1 -- 172.21.15.73:0/4114073941 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fbba40cff60 con 0x7fbbb8100e30 2024-09-05T12:55:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.712+0000 7fbbbcd1d640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbba80a2b80 0x7fbba80a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0058c0 tx=0x7fbbac005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.716+0000 7fbbb5ffb640 1 -- 172.21.15.73:0/4114073941 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbba409d360 con 0x7fbbb8100e30 2024-09-05T12:55:14.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.917+0000 7fbbbef81640 1 -- 172.21.15.73:0/4114073941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbb810e410 con 0x7fbbb8100e30 2024-09-05T12:55:14.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.917+0000 7fbbb5ffb640 1 -- 172.21.15.73:0/4114073941 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7fbba409cc60 con 0x7fbbb8100e30 2024-09-05T12:55:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:14.919 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"btime":"2024-09-05T12:55:14:038254+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-05T12:55:14.919 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-09-05T12:55:14.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 -- 172.21.15.73:0/4114073941 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbba80a2b80 msgr2=0x7fbba80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbba80a2b80 0x7fbba80a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0058c0 tx=0x7fbbac005850 comp rx=0 tx=0).stop 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 -- 172.21.15.73:0/4114073941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb8100e30 msgr2=0x7fbbb8197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb8100e30 0x7fbbb8197810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009970 tx=0x7fbba4009e30 comp rx=0 tx=0).stop 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 -- 172.21.15.73:0/4114073941 shutdown_connections 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fbba80a2b80 0x7fbba80a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb81055b0 0x7fbbb819bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb8100e30 0x7fbbb8197810 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 --2- 172.21.15.73:0/4114073941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbb8100480 0x7fbbb81972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 -- 172.21.15.73:0/4114073941 >> 172.21.15.73:0/4114073941 conn(0x7fbbb8077210 msgr2=0x7fbbb8103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 -- 172.21.15.73:0/4114073941 shutdown_connections 2024-09-05T12:55:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:14.919+0000 7fbbbef81640 1 -- 172.21.15.73:0/4114073941 wait complete. 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.73:6836/3164965523,v1:172.21.15.73:6837/3164965523] up:boot 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: fsmap 4 up:standby 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:15.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:15 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/4114073941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:15.306 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:15.306 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.73:6836/3164965523,v1:172.21.15.73:6837/3164965523] up:boot 2024-09-05T12:55:15.306 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: fsmap 4 up:standby 2024-09-05T12:55:15.306 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T12:55:15.306 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:15.306 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:15.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:15.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:15.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:15.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:15.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:15 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/4114073941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:15.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:15.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.73:6836/3164965523,v1:172.21.15.73:6837/3164965523] up:boot 2024-09-05T12:55:15.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: fsmap 4 up:standby 2024-09-05T12:55:15.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T12:55:15.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:15.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:15.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:15.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:15.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:15.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:15.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:15 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/4114073941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:16.330 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:16 smithi162 ceph-mon[34220]: Deploying daemon mds.e on smithi162 2024-09-05T12:55:16.330 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 12:55:16 smithi162 systemd[1]: Starting Ceph mds.e for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:16.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:16 smithi169 ceph-mon[34823]: Deploying daemon mds.e on smithi162 2024-09-05T12:55:16.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:16 smithi073 ceph-mon[30883]: Deploying daemon mds.e on smithi162 2024-09-05T12:55:16.611 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 12:55:16 smithi162 podman[64188]: 2024-09-05 12:55:16.231953229 +0000 UTC m=+0.015866192 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:16.611 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 12:55:16 smithi162 podman[64188]: 2024-09-05 12:55:16.346239175 +0000 UTC m=+0.130152125 container create b83cd90ef665b87376fbf2bdae0f43a64ae24033a372dcdaaee5b359e3884e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T12:55:16.611 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 12:55:16 smithi162 podman[64188]: 2024-09-05 12:55:16.54048557 +0000 UTC m=+0.324398519 container init b83cd90ef665b87376fbf2bdae0f43a64ae24033a372dcdaaee5b359e3884e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-05T12:55:16.611 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 12:55:16 smithi162 podman[64188]: 2024-09-05 12:55:16.543488887 +0000 UTC m=+0.327401841 container start b83cd90ef665b87376fbf2bdae0f43a64ae24033a372dcdaaee5b359e3884e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-05T12:55:16.611 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 12:55:16 smithi162 ceph-mds[64207]: -- 172.21.15.162:0/3642044170 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55afaea39860 con 0x55afaea17000 2024-09-05T12:55:16.611 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 12:55:16 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e[64203]: starting mds.e at 2024-09-05T12:55:17.061 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 12:55:16 smithi162 bash[64188]: b83cd90ef665b87376fbf2bdae0f43a64ae24033a372dcdaaee5b359e3884e0b 2024-09-05T12:55:17.061 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 12:55:16 smithi162 systemd[1]: Started Ceph mds.e for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:17 smithi162 ceph-mon[34220]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:17 smithi169 ceph-mon[34823]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:17.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:17.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:17.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:17.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:17.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:17.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:17 smithi073 ceph-mon[30883]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:17.736 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:55:17.997 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:18.314 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:18 smithi169 ceph-mon[34823]: Deploying daemon mds.f on smithi169 2024-09-05T12:55:18.315 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:18 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.162:6834/3122717185,v1:172.21.15.162:6835/3122717185] up:boot 2024-09-05T12:55:18.315 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:18 smithi169 ceph-mon[34823]: fsmap 5 up:standby 2024-09-05T12:55:18.315 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T12:55:18.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:18 smithi162 ceph-mon[34220]: Deploying daemon mds.f on smithi169 2024-09-05T12:55:18.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:18 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.162:6834/3122717185,v1:172.21.15.162:6835/3122717185] up:boot 2024-09-05T12:55:18.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:18 smithi162 ceph-mon[34220]: fsmap 5 up:standby 2024-09-05T12:55:18.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T12:55:18.398 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:18 smithi073 ceph-mon[30883]: Deploying daemon mds.f on smithi169 2024-09-05T12:55:18.398 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:18 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.162:6834/3122717185,v1:172.21.15.162:6835/3122717185] up:boot 2024-09-05T12:55:18.398 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:18 smithi073 ceph-mon[30883]: fsmap 5 up:standby 2024-09-05T12:55:18.398 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T12:55:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 -- 172.21.15.73:0/3183880932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ac4102d50 msgr2=0x7f0ac4103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 --2- 172.21.15.73:0/3183880932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ac4102d50 0x7f0ac4103130 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009ca0 tx=0x7f0ab402a950 comp rx=0 tx=0).stop 2024-09-05T12:55:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 -- 172.21.15.73:0/3183880932 shutdown_connections 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 --2- 172.21.15.73:0/3183880932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac410c180 0x7f0ac410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 --2- 172.21.15.73:0/3183880932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ac4103670 0x7f0ac410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 --2- 172.21.15.73:0/3183880932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ac4102d50 0x7f0ac4103130 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 -- 172.21.15.73:0/3183880932 >> 172.21.15.73:0/3183880932 conn(0x7f0ac40fc7d0 msgr2=0x7f0ac40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 -- 172.21.15.73:0/3183880932 shutdown_connections 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 -- 172.21.15.73:0/3183880932 wait complete. 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 Processor -- start 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.476+0000 7f0acb0aa640 1 -- start start 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0acb0aa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac4102d50 0x7f0ac41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0acb0aa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ac4103670 0x7f0ac4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0acb0aa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ac410c180 0x7f0ac419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0acb0aa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac4111f80 con 0x7f0ac410c180 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0acb0aa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac4111e00 con 0x7f0ac4102d50 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0acb0aa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac4112100 con 0x7f0ac4103670 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac9647640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ac410c180 0x7f0ac419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac9647640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ac410c180 0x7f0ac419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35866/0 (socket says 172.21.15.73:35866) 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac9647640 1 -- 172.21.15.73:0/810517354 learned_addr learned my addr 172.21.15.73:0/810517354 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac3fff640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ac4103670 0x7f0ac4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac8e46640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac4102d50 0x7f0ac41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac9647640 1 -- 172.21.15.73:0/810517354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ac4103670 msgr2=0x7f0ac4198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac9647640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ac4103670 0x7f0ac4198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac9647640 1 -- 172.21.15.73:0/810517354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac4102d50 msgr2=0x7f0ac41983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac9647640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac4102d50 0x7f0ac41983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:18.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac9647640 1 -- 172.21.15.73:0/810517354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac419d390 con 0x7f0ac410c180 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac9647640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ac410c180 0x7f0ac419ccb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00d950 tx=0x7f0abc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac1ffb640 1 -- 172.21.15.73:0/810517354 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc017030 con 0x7f0ac410c180 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0acb0aa640 1 -- 172.21.15.73:0/810517354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac419d680 con 0x7f0ac410c180 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac1ffb640 1 -- 172.21.15.73:0/810517354 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0abc004020 con 0x7f0ac410c180 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.477+0000 7f0ac1ffb640 1 -- 172.21.15.73:0/810517354 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc003c00 con 0x7f0ac410c180 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.478+0000 7f0acb0aa640 1 -- 172.21.15.73:0/810517354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac41a4f60 con 0x7f0ac410c180 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.479+0000 7f0acb0aa640 1 -- 172.21.15.73:0/810517354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac4103130 con 0x7f0ac410c180 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.479+0000 7f0ac1ffb640 1 -- 172.21.15.73:0/810517354 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0abc01a070 con 0x7f0ac410c180 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.480+0000 7f0ac1ffb640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ab00a2b80 0x7f0ab00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.480+0000 7f0ac8e46640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ab00a2b80 0x7f0ab00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.481+0000 7f0ac1ffb640 1 -- 172.21.15.73:0/810517354 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f0abc0ce340 con 0x7f0ac410c180 2024-09-05T12:55:18.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.481+0000 7f0ac8e46640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ab00a2b80 0x7f0ab00a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4004ad0 tx=0x7f0ab4004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:18.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.485+0000 7f0ac1ffb640 1 -- 172.21.15.73:0/810517354 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0abc021070 con 0x7f0ac410c180 2024-09-05T12:55:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.683+0000 7f0acb0aa640 1 -- 172.21.15.73:0/810517354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ac4107250 con 0x7f0ac410c180 2024-09-05T12:55:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.684+0000 7f0ac1ffb640 1 -- 172.21.15.73:0/810517354 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7f0abc09b740 con 0x7f0ac410c180 2024-09-05T12:55:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"btime":"2024-09-05T12:55:17:051596+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-05T12:55:18.686 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-09-05T12:55:18.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 -- 172.21.15.73:0/810517354 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ab00a2b80 msgr2=0x7f0ab00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:18.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ab00a2b80 0x7f0ab00a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4004ad0 tx=0x7f0ab4004a60 comp rx=0 tx=0).stop 2024-09-05T12:55:18.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 -- 172.21.15.73:0/810517354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ac410c180 msgr2=0x7f0ac419ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:18.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ac410c180 0x7f0ac419ccb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00d950 tx=0x7f0abc00de10 comp rx=0 tx=0).stop 2024-09-05T12:55:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 -- 172.21.15.73:0/810517354 shutdown_connections 2024-09-05T12:55:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ab00a2b80 0x7f0ab00a5040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ac410c180 0x7f0ac419ccb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ac4103670 0x7f0ac4198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 --2- 172.21.15.73:0/810517354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac4102d50 0x7f0ac41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 -- 172.21.15.73:0/810517354 >> 172.21.15.73:0/810517354 conn(0x7f0ac40fc7d0 msgr2=0x7f0ac40fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 -- 172.21.15.73:0/810517354 shutdown_connections 2024-09-05T12:55:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:18.686+0000 7f0acb0aa640 1 -- 172.21.15.73:0/810517354 wait complete. 2024-09-05T12:55:19.066 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 12:55:18 smithi169 podman[64889]: 2024-09-05 12:55:18.948215218 +0000 UTC m=+0.142293060 container create 35c37a324c2d3708b1fda85462781f161cfb78f17283a6bb5cebbc5a48c09992 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-05T12:55:19.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:19 smithi162 ceph-mon[34220]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:19 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/810517354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:19 smithi169 ceph-mon[34823]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:19 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/810517354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:19.368 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 12:55:19 smithi169 podman[64889]: 2024-09-05 12:55:19.200916145 +0000 UTC m=+0.394993986 container init 35c37a324c2d3708b1fda85462781f161cfb78f17283a6bb5cebbc5a48c09992 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-05T12:55:19.368 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 12:55:19 smithi169 podman[64889]: 2024-09-05 12:55:19.203606065 +0000 UTC m=+0.397683918 container start 35c37a324c2d3708b1fda85462781f161cfb78f17283a6bb5cebbc5a48c09992 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-05T12:55:19.368 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 12:55:19 smithi169 ceph-mds[64909]: -- 172.21.15.169:0/86631279 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fee0c3860 con 0x563fee0a1400 2024-09-05T12:55:19.368 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 12:55:19 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f[64905]: starting mds.f at 2024-09-05T12:55:19.368 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 12:55:19 smithi169 bash[64889]: 35c37a324c2d3708b1fda85462781f161cfb78f17283a6bb5cebbc5a48c09992 2024-09-05T12:55:19.368 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 12:55:19 smithi169 systemd[1]: Started Ceph mds.f for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:19.487 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:19 smithi073 ceph-mon[30883]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:19.487 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:19 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/810517354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:20.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:20.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:20.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:20.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:20.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:20.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:20.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: Deploying daemon mds.c on smithi169 2024-09-05T12:55:20.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:20.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.169:6834/4085562536,v1:172.21.15.169:6835/4085562536] up:boot 2024-09-05T12:55:20.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: fsmap 6 up:standby 2024-09-05T12:55:20.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:20 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T12:55:20.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:20.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:20.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:20.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:20.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:20.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:20.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: Deploying daemon mds.c on smithi169 2024-09-05T12:55:20.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:20.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.169:6834/4085562536,v1:172.21.15.169:6835/4085562536] up:boot 2024-09-05T12:55:20.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: fsmap 6 up:standby 2024-09-05T12:55:20.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:20 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T12:55:20.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:20.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:20.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:20.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:20.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:20.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:20.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: Deploying daemon mds.c on smithi169 2024-09-05T12:55:20.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:20.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.169:6834/4085562536,v1:172.21.15.169:6835/4085562536] up:boot 2024-09-05T12:55:20.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: fsmap 6 up:standby 2024-09-05T12:55:20.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:20 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T12:55:21.518 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:55:21.543 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:55:21 smithi169 systemd[1]: Starting Ceph mds.c for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:21.776 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:21.832 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:55:21 smithi169 podman[65188]: 2024-09-05 12:55:21.444264263 +0000 UTC m=+0.015744949 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:21.832 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:55:21 smithi169 podman[65188]: 2024-09-05 12:55:21.57901753 +0000 UTC m=+0.150498205 container create 7a9c6082eb02037fdd4caabaceabc58506b8d45fa8c8478a447a5cf3f2b02c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_CLEAN=True) 2024-09-05T12:55:21.832 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:55:21 smithi169 podman[65188]: 2024-09-05 12:55:21.831716312 +0000 UTC m=+0.403196987 container init 7a9c6082eb02037fdd4caabaceabc58506b8d45fa8c8478a447a5cf3f2b02c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-05T12:55:22.117 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:55:21 smithi169 podman[65188]: 2024-09-05 12:55:21.834538006 +0000 UTC m=+0.406018680 container start 7a9c6082eb02037fdd4caabaceabc58506b8d45fa8c8478a447a5cf3f2b02c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T12:55:22.117 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:55:21 smithi169 ceph-mds[65207]: -- 172.21.15.169:0/126347798 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556772069860 con 0x556772047000 2024-09-05T12:55:22.118 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:55:21 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: starting mds.c at 2024-09-05T12:55:22.118 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:55:21 smithi169 bash[65188]: 7a9c6082eb02037fdd4caabaceabc58506b8d45fa8c8478a447a5cf3f2b02c77 2024-09-05T12:55:22.118 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:55:21 smithi169 systemd[1]: Started Ceph mds.c for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:22.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.246+0000 7f90e2556640 1 -- 172.21.15.73:0/2556648424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90dc1027c0 msgr2=0x7f90dc106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:22.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.246+0000 7f90e2556640 1 --2- 172.21.15.73:0/2556648424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90dc1027c0 0x7f90dc106810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009900 tx=0x7f90c402a410 comp rx=0 tx=0).stop 2024-09-05T12:55:22.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 -- 172.21.15.73:0/2556648424 shutdown_connections 2024-09-05T12:55:22.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 --2- 172.21.15.73:0/2556648424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90dc106f40 0x7f90dc10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:22.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 --2- 172.21.15.73:0/2556648424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90dc1027c0 0x7f90dc106810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:22.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 --2- 172.21.15.73:0/2556648424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90dc101e10 0x7f90dc1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:22.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 -- 172.21.15.73:0/2556648424 >> 172.21.15.73:0/2556648424 conn(0x7f90dc0fd8d0 msgr2=0x7f90dc0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:22.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 -- 172.21.15.73:0/2556648424 shutdown_connections 2024-09-05T12:55:22.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 -- 172.21.15.73:0/2556648424 wait complete. 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 Processor -- start 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 -- start start 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90dc101e10 0x7f90dc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90dc1027c0 0x7f90dc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90dc106f40 0x7f90dc19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc111fe0 con 0x7f90dc1027c0 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc111e60 con 0x7f90dc101e10 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.247+0000 7f90e2556640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc112160 con 0x7f90dc106f40 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90dc1027c0 0x7f90dc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90dc1027c0 0x7f90dc1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35874/0 (socket says 172.21.15.73:35874) 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d3fff640 1 -- 172.21.15.73:0/3483888466 learned_addr learned my addr 172.21.15.73:0/3483888466 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90dbfff640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90dc101e10 0x7f90dc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90e0af3640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90dc106f40 0x7f90dc19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d3fff640 1 -- 172.21.15.73:0/3483888466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90dc106f40 msgr2=0x7f90dc19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d3fff640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90dc106f40 0x7f90dc19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d3fff640 1 -- 172.21.15.73:0/3483888466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90dc101e10 msgr2=0x7f90dc198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d3fff640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90dc101e10 0x7f90dc198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d3fff640 1 -- 172.21.15.73:0/3483888466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc19d440 con 0x7f90dc1027c0 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d3fff640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90dc1027c0 0x7f90dc1989d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f90c4006010 tx=0x7f90c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d9ffb640 1 -- 172.21.15.73:0/3483888466 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c403f030 con 0x7f90dc1027c0 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90e2556640 1 -- 172.21.15.73:0/3483888466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90dc19d6d0 con 0x7f90dc1027c0 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d9ffb640 1 -- 172.21.15.73:0/3483888466 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90c4003ce0 con 0x7f90dc1027c0 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90d9ffb640 1 -- 172.21.15.73:0/3483888466 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c4035070 con 0x7f90dc1027c0 2024-09-05T12:55:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.248+0000 7f90e2556640 1 -- 172.21.15.73:0/3483888466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90dc1a5010 con 0x7f90dc1027c0 2024-09-05T12:55:22.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.249+0000 7f90e2556640 1 -- 172.21.15.73:0/3483888466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90dc1021f0 con 0x7f90dc1027c0 2024-09-05T12:55:22.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.251+0000 7f90d9ffb640 1 -- 172.21.15.73:0/3483888466 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f90c4042030 con 0x7f90dc1027c0 2024-09-05T12:55:22.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.251+0000 7f90d9ffb640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f90c80a2b80 0x7f90c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:22.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.251+0000 7f90dbfff640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f90c80a2b80 0x7f90c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:22.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.251+0000 7f90d9ffb640 1 -- 172.21.15.73:0/3483888466 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f90c40ef2a0 con 0x7f90dc1027c0 2024-09-05T12:55:22.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.252+0000 7f90dbfff640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f90c80a2b80 0x7f90c80a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009990 tx=0x7f90cc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:22.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.255+0000 7f90d9ffb640 1 -- 172.21.15.73:0/3483888466 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90c40bc6a0 con 0x7f90dc1027c0 2024-09-05T12:55:22.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.464+0000 7f90e2556640 1 -- 172.21.15.73:0/3483888466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90dc1997f0 con 0x7f90dc1027c0 2024-09-05T12:55:22.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.464+0000 7f90d9ffb640 1 -- 172.21.15.73:0/3483888466 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6400 (secure 0 0 0) 0x7f90dc1997f0 con 0x7f90dc1027c0 2024-09-05T12:55:22.467 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-09-05T12:55:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:22.467 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"btime":"2024-09-05T12:55:21:912922+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-05T12:55:22.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 -- 172.21.15.73:0/3483888466 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f90c80a2b80 msgr2=0x7f90c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:22.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f90c80a2b80 0x7f90c80a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009990 tx=0x7f90cc009110 comp rx=0 tx=0).stop 2024-09-05T12:55:22.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 -- 172.21.15.73:0/3483888466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90dc1027c0 msgr2=0x7f90dc1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:22.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90dc1027c0 0x7f90dc1989d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f90c4006010 tx=0x7f90c40042f0 comp rx=0 tx=0).stop 2024-09-05T12:55:22.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 -- 172.21.15.73:0/3483888466 shutdown_connections 2024-09-05T12:55:22.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f90c80a2b80 0x7f90c80a5040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:22.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90dc106f40 0x7f90dc19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:22.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90dc1027c0 0x7f90dc1989d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:22.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 --2- 172.21.15.73:0/3483888466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90dc101e10 0x7f90dc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:22.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 -- 172.21.15.73:0/3483888466 >> 172.21.15.73:0/3483888466 conn(0x7f90dc0fd8d0 msgr2=0x7f90dc0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:22.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 -- 172.21.15.73:0/3483888466 shutdown_connections 2024-09-05T12:55:22.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:22.467+0000 7f90e2556640 1 -- 172.21.15.73:0/3483888466 wait complete. 2024-09-05T12:55:23.106 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.169:6836/2325276065,v1:172.21.15.169:6837/2325276065] up:boot 2024-09-05T12:55:23.106 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: fsmap 7 up:standby 2024-09-05T12:55:23.106 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T12:55:23.106 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:23.106 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:23.106 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:23.106 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:23.106 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:23.107 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:23.107 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:23.107 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: Deploying daemon mds.h on smithi162 2024-09-05T12:55:23.107 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:22 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3483888466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:23.239 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.169:6836/2325276065,v1:172.21.15.169:6837/2325276065] up:boot 2024-09-05T12:55:23.239 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: fsmap 7 up:standby 2024-09-05T12:55:23.239 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T12:55:23.239 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:23.239 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:23.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:23.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:23.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:23.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:23.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:23.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: Deploying daemon mds.h on smithi162 2024-09-05T12:55:23.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:22 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3483888466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.169:6836/2325276065,v1:172.21.15.169:6837/2325276065] up:boot 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: fsmap 7 up:standby 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:23.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: Deploying daemon mds.h on smithi162 2024-09-05T12:55:23.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:22 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3483888466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:24.111 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 12:55:24 smithi162 systemd[1]: Starting Ceph mds.h for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:24.504 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 12:55:24 smithi162 podman[64489]: 2024-09-05 12:55:24.125625394 +0000 UTC m=+0.016116916 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:24.504 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 12:55:24 smithi162 podman[64489]: 2024-09-05 12:55:24.251068572 +0000 UTC m=+0.141560080 container create 23d08294772488295c3aad377042e2423be6ef0977a2e4dd39442e9dae4757db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True) 2024-09-05T12:55:24.505 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 12:55:24 smithi162 podman[64489]: 2024-09-05 12:55:24.503810585 +0000 UTC m=+0.394302099 container init 23d08294772488295c3aad377042e2423be6ef0977a2e4dd39442e9dae4757db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T12:55:24.861 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 12:55:24 smithi162 podman[64489]: 2024-09-05 12:55:24.506744619 +0000 UTC m=+0.397236135 container start 23d08294772488295c3aad377042e2423be6ef0977a2e4dd39442e9dae4757db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-05T12:55:24.861 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 12:55:24 smithi162 ceph-mds[64508]: -- 172.21.15.162:0/470298063 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564650ef7860 con 0x564650ed5400 2024-09-05T12:55:24.861 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 12:55:24 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h[64504]: starting mds.h at 2024-09-05T12:55:24.861 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 12:55:24 smithi162 bash[64489]: 23d08294772488295c3aad377042e2423be6ef0977a2e4dd39442e9dae4757db 2024-09-05T12:55:24.861 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 12:55:24 smithi162 systemd[1]: Started Ceph mds.h for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:25.106 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:25 smithi169 ceph-mon[34823]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:25.106 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:25.106 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:25.106 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:25.106 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:25.106 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:25.106 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:25 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:25.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:55:25.298 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:25 smithi073 ceph-mon[30883]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:25.298 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:25.298 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:25.298 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:25.298 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:25.298 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:25.298 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:25 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:25 smithi162 ceph-mon[34220]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:25 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.023+0000 7f85e441e640 1 -- 172.21.15.73:0/1859823657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85dc102790 msgr2=0x7f85dc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.023+0000 7f85e441e640 1 --2- 172.21.15.73:0/1859823657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85dc102790 0x7f85dc1067e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009900 tx=0x7f85cc02a410 comp rx=0 tx=0).stop 2024-09-05T12:55:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.023+0000 7f85e441e640 1 -- 172.21.15.73:0/1859823657 shutdown_connections 2024-09-05T12:55:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.023+0000 7f85e441e640 1 --2- 172.21.15.73:0/1859823657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85dc106f10 0x7f85dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.023+0000 7f85e441e640 1 --2- 172.21.15.73:0/1859823657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85dc102790 0x7f85dc1067e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.023+0000 7f85e441e640 1 --2- 172.21.15.73:0/1859823657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc101de0 0x7f85dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.023+0000 7f85e441e640 1 -- 172.21.15.73:0/1859823657 >> 172.21.15.73:0/1859823657 conn(0x7f85dc0fd8c0 msgr2=0x7f85dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.023+0000 7f85e441e640 1 -- 172.21.15.73:0/1859823657 shutdown_connections 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.023+0000 7f85e441e640 1 -- 172.21.15.73:0/1859823657 wait complete. 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e441e640 1 Processor -- start 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e441e640 1 -- start start 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e441e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc101de0 0x7f85dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e441e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85dc102790 0x7f85dc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e441e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85dc106f10 0x7f85dc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e441e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc111f70 con 0x7f85dc106f10 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e441e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc111df0 con 0x7f85dc101de0 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e441e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc1120f0 con 0x7f85dc102790 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e29bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85dc106f10 0x7f85dc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e29bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85dc106f10 0x7f85dc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40026/0 (socket says 172.21.15.73:40026) 2024-09-05T12:55:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e29bb640 1 -- 172.21.15.73:0/2232949282 learned_addr learned my addr 172.21.15.73:0/2232949282 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.024+0000 7f85e21ba640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc101de0 0x7f85dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85e19b9640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85dc102790 0x7f85dc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85e29bb640 1 -- 172.21.15.73:0/2232949282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85dc102790 msgr2=0x7f85dc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85e29bb640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85dc102790 0x7f85dc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85e29bb640 1 -- 172.21.15.73:0/2232949282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc101de0 msgr2=0x7f85dc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85e29bb640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc101de0 0x7f85dc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85e29bb640 1 -- 172.21.15.73:0/2232949282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85dc1a6820 con 0x7f85dc106f10 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85e29bb640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85dc106f10 0x7f85dc074f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85d400eaa0 tx=0x7f85d400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85d37fe640 1 -- 172.21.15.73:0/2232949282 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d4004d20 con 0x7f85dc106f10 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85e441e640 1 -- 172.21.15.73:0/2232949282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85dc1a6b10 con 0x7f85dc106f10 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85d37fe640 1 -- 172.21.15.73:0/2232949282 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85d4005020 con 0x7f85dc106f10 2024-09-05T12:55:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85d37fe640 1 -- 172.21.15.73:0/2232949282 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d40116d0 con 0x7f85dc106f10 2024-09-05T12:55:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.025+0000 7f85e441e640 1 -- 172.21.15.73:0/2232949282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85dc1a70a0 con 0x7f85dc106f10 2024-09-05T12:55:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.026+0000 7f85e441e640 1 -- 172.21.15.73:0/2232949282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85dc1021c0 con 0x7f85dc106f10 2024-09-05T12:55:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.028+0000 7f85d37fe640 1 -- 172.21.15.73:0/2232949282 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f85d40051d0 con 0x7f85dc106f10 2024-09-05T12:55:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.029+0000 7f85d37fe640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85c80a2b80 0x7f85c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.029+0000 7f85e21ba640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85c80a2b80 0x7f85c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.029+0000 7f85d37fe640 1 -- 172.21.15.73:0/2232949282 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f85d40cf0b0 con 0x7f85dc106f10 2024-09-05T12:55:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.029+0000 7f85e21ba640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85c80a2b80 0x7f85c80a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f85d800abe0 tx=0x7f85d800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.032+0000 7f85d37fe640 1 -- 172.21.15.73:0/2232949282 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f85d4016030 con 0x7f85dc106f10 2024-09-05T12:55:26.185 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:26 smithi169 ceph-mon[34823]: Deploying daemon mds.i on smithi169 2024-09-05T12:55:26.185 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:26 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] up:boot 2024-09-05T12:55:26.185 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:26 smithi169 ceph-mon[34823]: fsmap 8 up:standby 2024-09-05T12:55:26.185 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:26 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T12:55:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.234+0000 7f85e441e640 1 -- 172.21.15.73:0/2232949282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85dc02d7c0 con 0x7f85dc106f10 2024-09-05T12:55:26.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:26 smithi073 ceph-mon[30883]: Deploying daemon mds.i on smithi169 2024-09-05T12:55:26.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:26 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] up:boot 2024-09-05T12:55:26.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:26 smithi073 ceph-mon[30883]: fsmap 8 up:standby 2024-09-05T12:55:26.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:26 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T12:55:26.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.235+0000 7f85d37fe640 1 -- 172.21.15.73:0/2232949282 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7228 (secure 0 0 0) 0x7f85d409c4b0 con 0x7f85dc106f10 2024-09-05T12:55:26.237 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:26.237 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"btime":"2024-09-05T12:55:25:021368+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24452,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-05T12:55:26.237 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-09-05T12:55:26.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 -- 172.21.15.73:0/2232949282 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85c80a2b80 msgr2=0x7f85c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85c80a2b80 0x7f85c80a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f85d800abe0 tx=0x7f85d800a2d0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 -- 172.21.15.73:0/2232949282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85dc106f10 msgr2=0x7f85dc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85dc106f10 0x7f85dc074f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85d400eaa0 tx=0x7f85d400eea0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 -- 172.21.15.73:0/2232949282 shutdown_connections 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85c80a2b80 0x7f85c80a5040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85dc106f10 0x7f85dc074f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85dc102790 0x7f85dc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 --2- 172.21.15.73:0/2232949282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc101de0 0x7f85dc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 -- 172.21.15.73:0/2232949282 >> 172.21.15.73:0/2232949282 conn(0x7f85dc0fd8c0 msgr2=0x7f85dc0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 -- 172.21.15.73:0/2232949282 shutdown_connections 2024-09-05T12:55:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:26.238+0000 7f85e441e640 1 -- 172.21.15.73:0/2232949282 wait complete. 2024-09-05T12:55:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:26 smithi162 ceph-mon[34220]: Deploying daemon mds.i on smithi169 2024-09-05T12:55:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:26 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] up:boot 2024-09-05T12:55:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:26 smithi162 ceph-mon[34220]: fsmap 8 up:standby 2024-09-05T12:55:26.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:26 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T12:55:26.867 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 12:55:26 smithi169 systemd[1]: Starting Ceph mds.i for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:27.165 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:27 smithi169 ceph-mon[34823]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:27.166 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:27 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2232949282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:27.166 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 12:55:26 smithi169 podman[65493]: 2024-09-05 12:55:26.792369217 +0000 UTC m=+0.015930724 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:27.166 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 12:55:26 smithi169 podman[65493]: 2024-09-05 12:55:26.912490078 +0000 UTC m=+0.136051569 container create e155dbb3f4bb03cc3ee355a8baa073c07e71678726fb35aaa5f7d957ddb4d69d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-05T12:55:27.166 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 12:55:27 smithi169 podman[65493]: 2024-09-05 12:55:27.165319655 +0000 UTC m=+0.388881151 container init e155dbb3f4bb03cc3ee355a8baa073c07e71678726fb35aaa5f7d957ddb4d69d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-05T12:55:27.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:27 smithi073 ceph-mon[30883]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:27.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:27 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2232949282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:27.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:27 smithi162 ceph-mon[34220]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:27 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2232949282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:27.618 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 12:55:27 smithi169 podman[65493]: 2024-09-05 12:55:27.168273219 +0000 UTC m=+0.391834713 container start e155dbb3f4bb03cc3ee355a8baa073c07e71678726fb35aaa5f7d957ddb4d69d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-05T12:55:27.618 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 12:55:27 smithi169 ceph-mds[65512]: -- 172.21.15.169:0/1638799385 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623e4ddf860 con 0x5623e4dbc800 2024-09-05T12:55:27.618 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 12:55:27 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i[65508]: starting mds.i at 2024-09-05T12:55:27.618 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 12:55:27 smithi169 bash[65493]: e155dbb3f4bb03cc3ee355a8baa073c07e71678726fb35aaa5f7d957ddb4d69d 2024-09-05T12:55:27.618 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 12:55:27 smithi169 systemd[1]: Started Ceph mds.i for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:28.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:28.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:28.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:28.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:28.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:28.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:28.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: Deploying daemon mds.g on smithi073 2024-09-05T12:55:28.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:28.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] up:boot 2024-09-05T12:55:28.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: fsmap 9 up:standby 2024-09-05T12:55:28.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:28 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T12:55:28.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:28.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:28.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:28.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:28.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:28.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:28.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: Deploying daemon mds.g on smithi073 2024-09-05T12:55:28.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:28.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] up:boot 2024-09-05T12:55:28.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: fsmap 9 up:standby 2024-09-05T12:55:28.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:28 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T12:55:28.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:28.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:28.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:28.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:28.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:28.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:28.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: Deploying daemon mds.g on smithi073 2024-09-05T12:55:28.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:28.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] up:boot 2024-09-05T12:55:28.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: fsmap 9 up:standby 2024-09-05T12:55:28.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:28 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T12:55:28.937 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:55:29.335 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:29.458 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 12:55:29 smithi073 systemd[1]: Starting Ceph mds.g for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:29.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.875+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1235794268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c04106f10 msgr2=0x7f4c0410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:29.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.875+0000 7f4c09f4e640 1 --2- 172.21.15.73:0/1235794268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c04106f10 0x7f4c0410ea90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009ca0 tx=0x7f4bfc02a8c0 comp rx=0 tx=0).stop 2024-09-05T12:55:29.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.875+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1235794268 shutdown_connections 2024-09-05T12:55:29.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.875+0000 7f4c09f4e640 1 --2- 172.21.15.73:0/1235794268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c04106f10 0x7f4c0410ea90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.875+0000 7f4c09f4e640 1 --2- 172.21.15.73:0/1235794268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c04102790 0x7f4c041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.875+0000 7f4c09f4e640 1 --2- 172.21.15.73:0/1235794268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04101de0 0x7f4c041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.875+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1235794268 >> 172.21.15.73:0/1235794268 conn(0x7f4c040fd8c0 msgr2=0x7f4c040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.875+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1235794268 shutdown_connections 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.875+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1235794268 wait complete. 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c09f4e640 1 Processor -- start 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c09f4e640 1 -- start start 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c09f4e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c04101de0 0x7f4c040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c09f4e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c04102790 0x7f4c04074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c09f4e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04106f10 0x7f4c04074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c09f4e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4c04111f70 con 0x7f4c04102790 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c09f4e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c04111df0 con 0x7f4c04106f10 2024-09-05T12:55:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c09f4e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c041120f0 con 0x7f4c04101de0 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c02ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c04102790 0x7f4c04074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c02ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c04102790 0x7f4c04074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40052/0 (socket says 172.21.15.73:40052) 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c02ffd640 1 -- 172.21.15.73:0/1513622521 learned_addr learned my addr 172.21.15.73:0/1513622521 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.876+0000 7f4c037fe640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c04101de0 0x7f4c040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c03fff640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04106f10 0x7f4c04074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c02ffd640 1 -- 172.21.15.73:0/1513622521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c04101de0 msgr2=0x7f4c040744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c02ffd640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c04101de0 0x7f4c040744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c02ffd640 1 -- 172.21.15.73:0/1513622521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04106f10 msgr2=0x7f4c04074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c02ffd640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04106f10 0x7f4c04074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c02ffd640 1 -- 172.21.15.73:0/1513622521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c041a6920 con 0x7f4c04102790 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c02ffd640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c04102790 0x7f4c04074a30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400d770 tx=0x7f4bf400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c00ff9640 1 -- 172.21.15.73:0/1513622521 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4017070 con 0x7f4c04102790 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c00ff9640 1 -- 172.21.15.73:0/1513622521 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bf4005500 con 0x7f4c04102790 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c00ff9640 1 -- 172.21.15.73:0/1513622521 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4004e00 con 0x7f4c04102790 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1513622521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c041a6c10 con 0x7f4c04102790 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.877+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1513622521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c041a7150 con 0x7f4c04102790 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.878+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1513622521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c041021c0 con 0x7f4c04102790 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.879+0000 7f4c00ff9640 1 -- 172.21.15.73:0/1513622521 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4bf4004fa0 con 0x7f4c04102790 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.880+0000 7f4c00ff9640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bf00a2c00 0x7f4bf00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.880+0000 7f4c037fe640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bf00a2c00 0x7f4bf00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.880+0000 7f4c00ff9640 1 -- 172.21.15.73:0/1513622521 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f4bf40ce500 con 0x7f4c04102790 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.880+0000 7f4c037fe640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bf00a2c00 0x7f4bf00a50c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00bbe0 tx=0x7f4bec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:29.884+0000 7f4c00ff9640 1 -- 172.21.15.73:0/1513622521 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4bf409b900 con 0x7f4c04102790 2024-09-05T12:55:30.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.092+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1513622521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c0410a0f0 con 0x7f4c04102790 2024-09-05T12:55:30.094 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 12:55:30 smithi073 podman[71108]: 2024-09-05 12:55:29.922806079 +0000 UTC m=+0.245086008 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:30.094 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 12:55:30 smithi073 podman[71108]: 2024-09-05 12:55:30.029769019 +0000 UTC m=+0.352048929 container create 71933dfc691fdb58522cac8af8da53443c5443d1499a137a46a7d315c1daf9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-g, maintainer=Guillaume Abrioux , RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T12:55:30.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.093+0000 7f4c00ff9640 1 -- 172.21.15.73:0/1513622521 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8058 (secure 0 0 0) 0x7f4bf409b200 con 0x7f4c04102790 2024-09-05T12:55:30.095 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:30.095 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"btime":"2024-09-05T12:55:28:040563+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24452,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-05T12:55:30.095 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 10 2024-09-05T12:55:30.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1513622521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bf00a2c00 msgr2=0x7f4bf00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:30.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bf00a2c00 0x7f4bf00a50c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00bbe0 tx=0x7f4bec00b390 comp rx=0 tx=0).stop 2024-09-05T12:55:30.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1513622521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c04102790 msgr2=0x7f4c04074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:30.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c04102790 0x7f4c04074a30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400d770 tx=0x7f4bf400dc30 comp rx=0 tx=0).stop 2024-09-05T12:55:30.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1513622521 shutdown_connections 2024-09-05T12:55:30.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bf00a2c00 0x7f4bf00a50c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:30.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04106f10 0x7f4c04074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:30.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c04102790 0x7f4c04074a30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:30.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 --2- 172.21.15.73:0/1513622521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c04101de0 0x7f4c040744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:30.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1513622521 >> 172.21.15.73:0/1513622521 conn(0x7f4c040fd8c0 msgr2=0x7f4c040fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:30.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1513622521 shutdown_connections 2024-09-05T12:55:30.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:30.095+0000 7f4c09f4e640 1 -- 172.21.15.73:0/1513622521 wait complete. 2024-09-05T12:55:30.763 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 12:55:30 smithi073 podman[71108]: 2024-09-05 12:55:30.467948733 +0000 UTC m=+0.790228645 container init 71933dfc691fdb58522cac8af8da53443c5443d1499a137a46a7d315c1daf9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-05T12:55:30.763 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 12:55:30 smithi073 podman[71108]: 2024-09-05 12:55:30.470809689 +0000 UTC m=+0.793089601 container start 71933dfc691fdb58522cac8af8da53443c5443d1499a137a46a7d315c1daf9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T12:55:30.763 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 12:55:30 smithi073 ceph-mds[71161]: -- 172.21.15.73:0/1762808049 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b55d915860 con 0x55b55d8f2800 2024-09-05T12:55:30.763 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 12:55:30 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-g[71157]: starting mds.g at 2024-09-05T12:55:30.764 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 12:55:30 smithi073 bash[71108]: 71933dfc691fdb58522cac8af8da53443c5443d1499a137a46a7d315c1daf9c9 2024-09-05T12:55:30.764 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 12:55:30 smithi073 systemd[1]: Started Ceph mds.g for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:31.230 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:31 smithi073 ceph-mon[30883]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:31.230 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:31 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1513622521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:31.230 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:31.230 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:31.230 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:31.230 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:31.230 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:31.231 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:31 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:31 smithi162 ceph-mon[34220]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:31 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1513622521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:31 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:31 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:31 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:31 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:31.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:31 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:31.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:31 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:31 smithi169 ceph-mon[34823]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:31 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1513622521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:31 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:31 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:31.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:31 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:31.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:31 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:31.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:31 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:31.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:31 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:32.247 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:32 smithi073 ceph-mon[30883]: Deploying daemon mds.a on smithi073 2024-09-05T12:55:32.247 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:32 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.73:6838/3218139737,v1:172.21.15.73:6839/3218139737] up:boot 2024-09-05T12:55:32.247 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:32 smithi073 ceph-mon[30883]: fsmap 10 up:standby 2024-09-05T12:55:32.248 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:32 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T12:55:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:32 smithi162 ceph-mon[34220]: Deploying daemon mds.a on smithi073 2024-09-05T12:55:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:32 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.73:6838/3218139737,v1:172.21.15.73:6839/3218139737] up:boot 2024-09-05T12:55:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:32 smithi162 ceph-mon[34220]: fsmap 10 up:standby 2024-09-05T12:55:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:32 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T12:55:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:32 smithi169 ceph-mon[34823]: Deploying daemon mds.a on smithi073 2024-09-05T12:55:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:32 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.73:6838/3218139737,v1:172.21.15.73:6839/3218139737] up:boot 2024-09-05T12:55:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:32 smithi169 ceph-mon[34823]: fsmap 10 up:standby 2024-09-05T12:55:32.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:32 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T12:55:32.915 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 12:55:32 smithi073 systemd[1]: Starting Ceph mds.a for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:33.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:55:33.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:33 smithi073 ceph-mon[30883]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:33.186 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 12:55:32 smithi073 podman[71444]: 2024-09-05 12:55:32.836803344 +0000 UTC m=+0.015898257 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:33.186 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 12:55:32 smithi073 podman[71444]: 2024-09-05 12:55:32.958006096 +0000 UTC m=+0.137100999 container create ccc4588bae307720ba56be6bf4cfa9b3129f6009cfbde6e78f8dd2f7887eed10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-a, maintainer=Guillaume Abrioux , RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-05T12:55:33.187 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 12:55:33 smithi073 podman[71444]: 2024-09-05 12:55:33.185953173 +0000 UTC m=+0.365048080 container init ccc4588bae307720ba56be6bf4cfa9b3129f6009cfbde6e78f8dd2f7887eed10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-a, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T12:55:33.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:33 smithi162 ceph-mon[34220]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:33.361 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:33.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:33 smithi169 ceph-mon[34823]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:33.482 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 12:55:33 smithi073 podman[71444]: 2024-09-05 12:55:33.18912998 +0000 UTC m=+0.368224885 container start ccc4588bae307720ba56be6bf4cfa9b3129f6009cfbde6e78f8dd2f7887eed10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T12:55:33.482 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 12:55:33 smithi073 ceph-mds[71481]: -- 172.21.15.73:0/805807878 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5615c19b5860 con 0x5615c1992800 2024-09-05T12:55:33.482 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 12:55:33 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-a[71467]: starting mds.a at 2024-09-05T12:55:33.482 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 12:55:33 smithi073 bash[71444]: ccc4588bae307720ba56be6bf4cfa9b3129f6009cfbde6e78f8dd2f7887eed10 2024-09-05T12:55:33.482 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 12:55:33 smithi073 systemd[1]: Started Ceph mds.a for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:33.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.837+0000 7f97c663e640 1 -- 172.21.15.73:0/3332344356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97c010c1a0 msgr2=0x7f97c010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:33.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.837+0000 7f97c663e640 1 --2- 172.21.15.73:0/3332344356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97c010c1a0 0x7f97c010e610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009ca0 tx=0x7f97b802a950 comp rx=0 tx=0).stop 2024-09-05T12:55:33.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.837+0000 7f97c663e640 1 -- 172.21.15.73:0/3332344356 shutdown_connections 2024-09-05T12:55:33.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.837+0000 7f97c663e640 1 --2- 172.21.15.73:0/3332344356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97c010c1a0 0x7f97c010e610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:33.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.837+0000 7f97c663e640 1 --2- 172.21.15.73:0/3332344356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97c01036e0 0x7f97c010bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:33.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.837+0000 7f97c663e640 1 --2- 172.21.15.73:0/3332344356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c0102dc0 0x7f97c01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:33.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.837+0000 7f97c663e640 1 -- 172.21.15.73:0/3332344356 >> 172.21.15.73:0/3332344356 conn(0x7f97c00fc7a0 msgr2=0x7f97c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:33.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.837+0000 7f97c663e640 1 -- 172.21.15.73:0/3332344356 shutdown_connections 2024-09-05T12:55:33.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.837+0000 7f97c663e640 1 -- 172.21.15.73:0/3332344356 wait complete. 2024-09-05T12:55:33.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.838+0000 7f97c663e640 1 Processor -- start 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.838+0000 7f97c663e640 1 -- start start 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97c663e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97c0102dc0 0x7f97c01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97c663e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97c01036e0 0x7f97c0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97c663e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c010c1a0 0x7f97c019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97c663e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0111f50 con 0x7f97c01036e0 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97c663e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0111dd0 con 0x7f97c010c1a0 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97c663e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01120d0 con 0x7f97c0102dc0 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97c01036e0 0x7f97c0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97c01036e0 0x7f97c0198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33016/0 (socket says 172.21.15.73:33016) 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bf7fe640 1 -- 172.21.15.73:0/2263130879 learned_addr learned my addr 172.21.15.73:0/2263130879 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:33.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bffff640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97c0102dc0 0x7f97c01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97c4bdb640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c010c1a0 0x7f97c019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bf7fe640 1 -- 172.21.15.73:0/2263130879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97c0102dc0 msgr2=0x7f97c01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bf7fe640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97c0102dc0 0x7f97c01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bf7fe640 1 -- 172.21.15.73:0/2263130879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c010c1a0 msgr2=0x7f97c019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bf7fe640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c010c1a0 0x7f97c019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bf7fe640 1 -- 172.21.15.73:0/2263130879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c019d3a0 con 0x7f97c01036e0 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97c4bdb640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c010c1a0 0x7f97c019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bf7fe640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97c01036e0 0x7f97c0198930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f97b400d770 tx=0x7f97b400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bd7fa640 1 -- 172.21.15.73:0/2263130879 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4017070 con 0x7f97c01036e0 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bd7fa640 1 -- 172.21.15.73:0/2263130879 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97b4005500 con 0x7f97c01036e0 2024-09-05T12:55:33.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97bd7fa640 1 -- 172.21.15.73:0/2263130879 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4004e00 con 0x7f97c01036e0 2024-09-05T12:55:33.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.839+0000 7f97c663e640 1 -- 172.21.15.73:0/2263130879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c019d690 con 0x7f97c01036e0 2024-09-05T12:55:33.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.840+0000 7f97c663e640 1 -- 172.21.15.73:0/2263130879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c01a4f70 con 0x7f97c01036e0 2024-09-05T12:55:33.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.841+0000 7f97c663e640 1 -- 172.21.15.73:0/2263130879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c01031a0 con 0x7f97c01036e0 2024-09-05T12:55:33.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.842+0000 7f97bd7fa640 1 -- 172.21.15.73:0/2263130879 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f97b4004fa0 con 0x7f97c01036e0 2024-09-05T12:55:33.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.842+0000 7f97bd7fa640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97a80a2b80 0x7f97a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:33.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.843+0000 7f97bffff640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97a80a2b80 0x7f97a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:33.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.843+0000 7f97bd7fa640 1 -- 172.21.15.73:0/2263130879 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f97b40ce5c0 con 0x7f97c01036e0 2024-09-05T12:55:33.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.843+0000 7f97bffff640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97a80a2b80 0x7f97a80a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009bd0 tx=0x7f97b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:33.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:33.847+0000 7f97bd7fa640 1 -- 172.21.15.73:0/2263130879 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97b409b9c0 con 0x7f97c01036e0 2024-09-05T12:55:34.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.052+0000 7f97c663e640 1 -- 172.21.15.73:0/2263130879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97c0107240 con 0x7f97c01036e0 2024-09-05T12:55:34.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.052+0000 7f97bd7fa640 1 -- 172.21.15.73:0/2263130879 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9710 (secure 0 0 0) 0x7f97b409b2c0 con 0x7f97c01036e0 2024-09-05T12:55:34.054 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:34.054 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":12,"btime":"2024-09-05T12:55:34:039135+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24452,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-05T12:55:34.054 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 12 2024-09-05T12:55:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 -- 172.21.15.73:0/2263130879 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97a80a2b80 msgr2=0x7f97a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97a80a2b80 0x7f97a80a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009bd0 tx=0x7f97b0005f90 comp rx=0 tx=0).stop 2024-09-05T12:55:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 -- 172.21.15.73:0/2263130879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97c01036e0 msgr2=0x7f97c0198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97c01036e0 0x7f97c0198930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f97b400d770 tx=0x7f97b400dc30 comp rx=0 tx=0).stop 2024-09-05T12:55:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 -- 172.21.15.73:0/2263130879 shutdown_connections 2024-09-05T12:55:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97a80a2b80 0x7f97a80a5040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c010c1a0 0x7f97c019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97c01036e0 0x7f97c0198930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 --2- 172.21.15.73:0/2263130879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97c0102dc0 0x7f97c01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 -- 172.21.15.73:0/2263130879 >> 172.21.15.73:0/2263130879 conn(0x7f97c00fc7a0 msgr2=0x7f97c00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:34.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 -- 172.21.15.73:0/2263130879 shutdown_connections 2024-09-05T12:55:34.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:34.055+0000 7f97c663e640 1 -- 172.21.15.73:0/2263130879 wait complete. 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: Deploying daemon mds.b on smithi162 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.73:6840/2107729050,v1:172.21.15.73:6841/2107729050] up:boot 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: fsmap 11 up:standby 2024-09-05T12:55:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T12:55:34.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:34 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2263130879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:34.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:34.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:34.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:34.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:34.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:34.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:34.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: Deploying daemon mds.b on smithi162 2024-09-05T12:55:34.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:34.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.73:6840/2107729050,v1:172.21.15.73:6841/2107729050] up:boot 2024-09-05T12:55:34.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: fsmap 11 up:standby 2024-09-05T12:55:34.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T12:55:34.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:34 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2263130879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:34.738 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: Deploying daemon mds.b on smithi162 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.73:6840/2107729050,v1:172.21.15.73:6841/2107729050] up:boot 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: fsmap 11 up:standby 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T12:55:34.739 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:34 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2263130879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:35.611 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:35 smithi162 systemd[1]: Starting Ceph mds.b for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T12:55:35.909 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:35 smithi162 podman[64791]: 2024-09-05 12:55:35.539264601 +0000 UTC m=+0.016324497 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T12:55:35.909 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:35 smithi162 podman[64791]: 2024-09-05 12:55:35.680403249 +0000 UTC m=+0.157463135 container create 68348360e9b946ffc236b6344bf32001651b85152cce7c7a888f71cb3ccd200a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-05T12:55:35.909 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:35 smithi162 podman[64791]: 2024-09-05 12:55:35.908109787 +0000 UTC m=+0.385169679 container init 68348360e9b946ffc236b6344bf32001651b85152cce7c7a888f71cb3ccd200a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T12:55:36.361 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:35 smithi162 podman[64791]: 2024-09-05 12:55:35.911224264 +0000 UTC m=+0.388284155 container start 68348360e9b946ffc236b6344bf32001651b85152cce7c7a888f71cb3ccd200a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-05T12:55:36.361 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:35 smithi162 ceph-mds[64811]: -- 172.21.15.162:0/1060493792 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c77f089860 con 0x55c77f067000 2024-09-05T12:55:36.361 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:35 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b[64807]: starting mds.b at 2024-09-05T12:55:36.361 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:36 smithi162 bash[64791]: 68348360e9b946ffc236b6344bf32001651b85152cce7c7a888f71cb3ccd200a 2024-09-05T12:55:36.361 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:36 smithi162 systemd[1]: Started Ceph mds.b for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T12:55:36.768 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:55:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:36 smithi162 ceph-mon[34220]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:36 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] up:boot 2024-09-05T12:55:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:36 smithi162 ceph-mon[34220]: fsmap 12 up:standby 2024-09-05T12:55:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T12:55:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:36 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:36 smithi169 ceph-mon[34823]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:36 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] up:boot 2024-09-05T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:36 smithi169 ceph-mon[34823]: fsmap 12 up:standby 2024-09-05T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:36 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:55:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:36 smithi073 ceph-mon[30883]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:36 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] up:boot 2024-09-05T12:55:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:36 smithi073 ceph-mon[30883]: fsmap 12 up:standby 2024-09-05T12:55:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T12:55:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:37.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:36 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:55:37.368 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.867+0000 7fe460233640 1 -- 172.21.15.73:0/3136781796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe458105f40 msgr2=0x7fe4581063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.867+0000 7fe460233640 1 --2- 172.21.15.73:0/3136781796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe458105f40 0x7fe4581063d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe450009ca0 tx=0x7fe45002a940 comp rx=0 tx=0).stop 2024-09-05T12:55:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.867+0000 7fe460233640 1 -- 172.21.15.73:0/3136781796 shutdown_connections 2024-09-05T12:55:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.867+0000 7fe460233640 1 --2- 172.21.15.73:0/3136781796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe458105f40 0x7fe4581063d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.867+0000 7fe460233640 1 --2- 172.21.15.73:0/3136781796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe458101450 0x7fe458105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.867+0000 7fe460233640 1 --2- 172.21.15.73:0/3136781796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe458100b30 0x7fe458100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.867+0000 7fe460233640 1 -- 172.21.15.73:0/3136781796 >> 172.21.15.73:0/3136781796 conn(0x7fe4580fc7a0 msgr2=0x7fe4580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe460233640 1 -- 172.21.15.73:0/3136781796 shutdown_connections 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe460233640 1 -- 172.21.15.73:0/3136781796 wait complete. 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe460233640 1 Processor -- start 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe460233640 1 -- start start 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe460233640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe458100b30 0x7fe4581a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe460233640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe458101450 0x7fe4581a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe460233640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe458105f40 0x7fe45819e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe460233640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe458118560 con 0x7fe458105f40 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe460233640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4581183e0 con 0x7fe458101450 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe460233640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4581186e0 con 0x7fe458100b30 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe45e7d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe458105f40 0x7fe45819e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe45e7d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe458105f40 0x7fe45819e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33036/0 (socket says 172.21.15.73:33036) 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe45e7d0640 1 -- 172.21.15.73:0/2814140845 learned_addr learned my addr 172.21.15.73:0/2814140845 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.868+0000 7fe45dfcf640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe458100b30 0x7fe4581a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe45d7ce640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe458101450 0x7fe4581a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe45e7d0640 1 -- 172.21.15.73:0/2814140845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe458100b30 msgr2=0x7fe4581a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe45e7d0640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe458100b30 0x7fe4581a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe45e7d0640 1 -- 172.21.15.73:0/2814140845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe458101450 msgr2=0x7fe4581a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe45e7d0640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe458101450 0x7fe4581a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe45e7d0640 1 -- 172.21.15.73:0/2814140845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45819eff0 con 0x7fe458105f40 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe45e7d0640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe458105f40 0x7fe45819e850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe450006010 tx=0x7fe45002f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe44effd640 1 -- 172.21.15.73:0/2814140845 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe450034040 con 0x7fe458105f40 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe44effd640 1 -- 172.21.15.73:0/2814140845 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe450003e50 con 0x7fe458105f40 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe460233640 1 -- 172.21.15.73:0/2814140845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45819f280 con 0x7fe458105f40 2024-09-05T12:55:37.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe44effd640 1 -- 172.21.15.73:0/2814140845 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe450004800 con 0x7fe458105f40 2024-09-05T12:55:37.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.869+0000 7fe460233640 1 -- 172.21.15.73:0/2814140845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4581ab530 con 0x7fe458105f40 2024-09-05T12:55:37.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.870+0000 7fe460233640 1 -- 172.21.15.73:0/2814140845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe45806b070 con 0x7fe458105f40 2024-09-05T12:55:37.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.872+0000 7fe44effd640 1 -- 172.21.15.73:0/2814140845 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe450037020 con 0x7fe458105f40 2024-09-05T12:55:37.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.872+0000 7fe44effd640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4440a2c00 0x7fe4440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:37.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.872+0000 7fe45dfcf640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4440a2c00 0x7fe4440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:37.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.873+0000 7fe44effd640 1 -- 172.21.15.73:0/2814140845 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe4500efae0 con 0x7fe458105f40 2024-09-05T12:55:37.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.873+0000 7fe45dfcf640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4440a2c00 0x7fe4440a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe45400bbe0 tx=0x7fe45400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:37.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:37.876+0000 7fe44effd640 1 -- 172.21.15.73:0/2814140845 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4500098b0 con 0x7fe458105f40 2024-09-05T12:55:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.099+0000 7fe460233640 1 -- 172.21.15.73:0/2814140845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe458105920 con 0x7fe458105f40 2024-09-05T12:55:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.100+0000 7fe44effd640 1 -- 172.21.15.73:0/2814140845 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10539 (secure 0 0 0) 0x7fe458105920 con 0x7fe458105f40 2024-09-05T12:55:38.102 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:38.102 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":13,"btime":"2024-09-05T12:55:35:990664+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24452,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-05T12:55:38.102 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 13 2024-09-05T12:55:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.102+0000 7fe460233640 1 -- 172.21.15.73:0/2814140845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4440a2c00 msgr2=0x7fe4440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.102+0000 7fe460233640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4440a2c00 0x7fe4440a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe45400bbe0 tx=0x7fe45400b390 comp rx=0 tx=0).stop 2024-09-05T12:55:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.102+0000 7fe460233640 1 -- 172.21.15.73:0/2814140845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe458105f40 msgr2=0x7fe45819e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.102+0000 7fe460233640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe458105f40 0x7fe45819e850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe450006010 tx=0x7fe45002f700 comp rx=0 tx=0).stop 2024-09-05T12:55:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.103+0000 7fe460233640 1 -- 172.21.15.73:0/2814140845 shutdown_connections 2024-09-05T12:55:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.103+0000 7fe460233640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4440a2c00 0x7fe4440a50c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.103+0000 7fe460233640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe458105f40 0x7fe45819e850 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.103+0000 7fe460233640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe458101450 0x7fe4581a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.103+0000 7fe460233640 1 --2- 172.21.15.73:0/2814140845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe458100b30 0x7fe4581a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.103+0000 7fe460233640 1 -- 172.21.15.73:0/2814140845 >> 172.21.15.73:0/2814140845 conn(0x7fe4580fc7a0 msgr2=0x7fe4581038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.103+0000 7fe460233640 1 -- 172.21.15.73:0/2814140845 shutdown_connections 2024-09-05T12:55:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:38.103+0000 7fe460233640 1 -- 172.21.15.73:0/2814140845 wait complete. 2024-09-05T12:55:38.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:38.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2814140845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:38.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:38.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:55:38.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:55:38.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-05T12:55:38.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2814140845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:55:38.932 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.932 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2814140845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:55:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:55:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:55:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:40.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:39 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.205+0000 7fd4362f9640 1 -- 172.21.15.73:0/920685633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd430103660 msgr2=0x7fd43010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.205+0000 7fd4362f9640 1 --2- 172.21.15.73:0/920685633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd430103660 0x7fd43010bb50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd424009900 tx=0x7fd42402a480 comp rx=0 tx=0).stop 2024-09-05T12:55:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.205+0000 7fd4362f9640 1 -- 172.21.15.73:0/920685633 shutdown_connections 2024-09-05T12:55:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.205+0000 7fd4362f9640 1 --2- 172.21.15.73:0/920685633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd43010c170 0x7fd43010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.205+0000 7fd4362f9640 1 --2- 172.21.15.73:0/920685633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd430103660 0x7fd43010bb50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.205+0000 7fd4362f9640 1 --2- 172.21.15.73:0/920685633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd430102d40 0x7fd430103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.205+0000 7fd4362f9640 1 -- 172.21.15.73:0/920685633 >> 172.21.15.73:0/920685633 conn(0x7fd4300fc7a0 msgr2=0x7fd4300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.205+0000 7fd4362f9640 1 -- 172.21.15.73:0/920685633 shutdown_connections 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.205+0000 7fd4362f9640 1 -- 172.21.15.73:0/920685633 wait complete. 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd4362f9640 1 Processor -- start 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd4362f9640 1 -- start start 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd4362f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd430102d40 0x7fd430198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd4362f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd430103660 0x7fd430198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd4362f9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd43010c170 0x7fd43019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd4362f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd430111f70 con 0x7fd430103660 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd4362f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd430111df0 con 0x7fd430102d40 2024-09-05T12:55:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd4362f9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4301120f0 con 0x7fd43010c170 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd42f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd430103660 0x7fd430198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd42f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd430103660 0x7fd430198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33058/0 (socket says 172.21.15.73:33058) 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd42f7fe640 1 -- 172.21.15.73:0/1733555953 learned_addr learned my addr 172.21.15.73:0/1733555953 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd42ffff640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd430102d40 0x7fd430198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.206+0000 7fd434896640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd43010c170 0x7fd43019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd42f7fe640 1 -- 172.21.15.73:0/1733555953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd43010c170 msgr2=0x7fd43019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd42f7fe640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd43010c170 0x7fd43019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd42f7fe640 1 -- 172.21.15.73:0/1733555953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd430102d40 msgr2=0x7fd430198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd42f7fe640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd430102d40 0x7fd430198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd42f7fe640 1 -- 172.21.15.73:0/1733555953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43019d400 con 0x7fd430103660 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd434896640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd43010c170 0x7fd43019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd42f7fe640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd430103660 0x7fd430198990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd424006010 tx=0x7fd4240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd42d7fa640 1 -- 172.21.15.73:0/1733555953 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42403f030 con 0x7fd430103660 2024-09-05T12:55:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd4362f9640 1 -- 172.21.15.73:0/1733555953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43019d690 con 0x7fd430103660 2024-09-05T12:55:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd42d7fa640 1 -- 172.21.15.73:0/1733555953 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd424003ce0 con 0x7fd430103660 2024-09-05T12:55:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd42d7fa640 1 -- 172.21.15.73:0/1733555953 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424035070 con 0x7fd430103660 2024-09-05T12:55:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.207+0000 7fd4362f9640 1 -- 172.21.15.73:0/1733555953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4301a4fd0 con 0x7fd430103660 2024-09-05T12:55:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.208+0000 7fd4362f9640 1 -- 172.21.15.73:0/1733555953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd430103120 con 0x7fd430103660 2024-09-05T12:55:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.209+0000 7fd42d7fa640 1 -- 172.21.15.73:0/1733555953 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd424042030 con 0x7fd430103660 2024-09-05T12:55:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.210+0000 7fd42d7fa640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4180a2b80 0x7fd4180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.210+0000 7fd42ffff640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4180a2b80 0x7fd4180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.210+0000 7fd42d7fa640 1 -- 172.21.15.73:0/1733555953 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd4240ef370 con 0x7fd430103660 2024-09-05T12:55:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.210+0000 7fd42ffff640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4180a2b80 0x7fd4180a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd420005fd0 tx=0x7fd42000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.213+0000 7fd42d7fa640 1 -- 172.21.15.73:0/1733555953 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4240bc810 con 0x7fd430103660 2024-09-05T12:55:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:39 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:39 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.401+0000 7fd4362f9640 1 -- 172.21.15.73:0/1733555953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd4301071e0 con 0x7fd430103660 2024-09-05T12:55:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.401+0000 7fd42d7fa640 1 -- 172.21.15.73:0/1733555953 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7fd4240bc110 con 0x7fd430103660 2024-09-05T12:55:40.403 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:40.403 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-09-05T12:55:40.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T12:55:40.403 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-09-05T12:55:40.403 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-09-05T12:55:40.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T12:55:40.403 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-09-05T12:55:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 -- 172.21.15.73:0/1733555953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4180a2b80 msgr2=0x7fd4180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4180a2b80 0x7fd4180a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd420005fd0 tx=0x7fd42000b390 comp rx=0 tx=0).stop 2024-09-05T12:55:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 -- 172.21.15.73:0/1733555953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd430103660 msgr2=0x7fd430198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd430103660 0x7fd430198990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd424006010 tx=0x7fd4240042f0 comp rx=0 tx=0).stop 2024-09-05T12:55:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 -- 172.21.15.73:0/1733555953 shutdown_connections 2024-09-05T12:55:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4180a2b80 0x7fd4180a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd43010c170 0x7fd43019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd430103660 0x7fd430198990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 --2- 172.21.15.73:0/1733555953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd430102d40 0x7fd430198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:40.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 -- 172.21.15.73:0/1733555953 >> 172.21.15.73:0/1733555953 conn(0x7fd4300fc7a0 msgr2=0x7fd4300fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:40.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 -- 172.21.15.73:0/1733555953 shutdown_connections 2024-09-05T12:55:40.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:40.404+0000 7fd4362f9640 1 -- 172.21.15.73:0/1733555953 wait complete. 2024-09-05T12:55:41.074 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:40 smithi073 ceph-mon[30883]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:41.074 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:40 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1733555953' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-05T12:55:41.100 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-05T12:55:41.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-05T12:55:41.355 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:41.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:40 smithi162 ceph-mon[34220]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:41.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:40 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1733555953' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-05T12:55:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:40 smithi169 ceph-mon[34823]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:40 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1733555953' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-05T12:55:41.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 -- 172.21.15.73:0/3588960268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154c103760 msgr2=0x7f154c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:41.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 --2- 172.21.15.73:0/3588960268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154c103760 0x7f154c107ba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f153c009930 tx=0x7f153c02a420 comp rx=0 tx=0).stop 2024-09-05T12:55:41.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 -- 172.21.15.73:0/3588960268 shutdown_connections 2024-09-05T12:55:41.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 --2- 172.21.15.73:0/3588960268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f154c1082e0 0x7f154c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 --2- 172.21.15.73:0/3588960268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154c103760 0x7f154c107ba0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 --2- 172.21.15.73:0/3588960268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f154c102db0 0x7f154c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 -- 172.21.15.73:0/3588960268 >> 172.21.15.73:0/3588960268 conn(0x7f154c0fc7d0 msgr2=0x7f154c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 -- 172.21.15.73:0/3588960268 shutdown_connections 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 -- 172.21.15.73:0/3588960268 wait complete. 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 Processor -- start 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 -- start start 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f154c102db0 0x7f154c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f154c103760 0x7f154c198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.894+0000 7f15543ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154c1082e0 0x7f154c19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f15543ee640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f154c1120d0 con 0x7f154c1082e0 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f15543ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f154c111f50 con 0x7f154c102db0 2024-09-05T12:55:41.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f15543ee640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f154c112250 con 0x7f154c103760 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f155298b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154c1082e0 0x7f154c19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f155298b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154c1082e0 0x7f154c19cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33076/0 (socket says 172.21.15.73:33076) 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f155298b640 1 -- 172.21.15.73:0/2868295678 learned_addr learned my addr 172.21.15.73:0/2868295678 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f1551989640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f154c103760 0x7f154c198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f155218a640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f154c102db0 0x7f154c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f155298b640 1 -- 172.21.15.73:0/2868295678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f154c103760 msgr2=0x7f154c198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f155298b640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f154c103760 0x7f154c198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f155298b640 1 -- 172.21.15.73:0/2868295678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f154c102db0 msgr2=0x7f154c198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f155298b640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f154c102db0 0x7f154c198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f155298b640 1 -- 172.21.15.73:0/2868295678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154c19d5e0 con 0x7f154c1082e0 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f155298b640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154c1082e0 0x7f154c19cf00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1544009fd0 tx=0x7f154400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f15437fe640 1 -- 172.21.15.73:0/2868295678 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544011830 con 0x7f154c1082e0 2024-09-05T12:55:41.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f15437fe640 1 -- 172.21.15.73:0/2868295678 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1544016070 con 0x7f154c1082e0 2024-09-05T12:55:41.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f15437fe640 1 -- 172.21.15.73:0/2868295678 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154400f2e0 con 0x7f154c1082e0 2024-09-05T12:55:41.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f15543ee640 1 -- 172.21.15.73:0/2868295678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154c19d8d0 con 0x7f154c1082e0 2024-09-05T12:55:41.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.895+0000 7f15543ee640 1 -- 172.21.15.73:0/2868295678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154c1a51b0 con 0x7f154c1082e0 2024-09-05T12:55:41.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.896+0000 7f15543ee640 1 -- 172.21.15.73:0/2868295678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f154c103190 con 0x7f154c1082e0 2024-09-05T12:55:41.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.897+0000 7f15437fe640 1 -- 172.21.15.73:0/2868295678 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f15440119d0 con 0x7f154c1082e0 2024-09-05T12:55:41.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.898+0000 7f15437fe640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15380a2b80 0x7f15380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:41.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.898+0000 7f15437fe640 1 -- 172.21.15.73:0/2868295678 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f15440ce1c0 con 0x7f154c1082e0 2024-09-05T12:55:41.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.898+0000 7f155218a640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15380a2b80 0x7f15380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:41.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.898+0000 7f155218a640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15380a2b80 0x7f15380a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1548005c40 tx=0x7f154800a780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:41.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:41.902+0000 7f15437fe640 1 -- 172.21.15.73:0/2868295678 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f154409b5c0 con 0x7f154c1082e0 2024-09-05T12:55:42.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.068+0000 7f15543ee640 1 -- 172.21.15.73:0/2868295678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f154c10a2c0 con 0x7f154c1082e0 2024-09-05T12:55:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:55:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:42.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:42.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:42.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:42.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:55:42.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:42.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:42.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:42.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:55:42.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:55:42.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:55:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.709+0000 7f15437fe640 1 -- 172.21.15.73:0/2868295678 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7f154409aec0 con 0x7f154c1082e0 2024-09-05T12:55:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-09-05T12:55:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.711+0000 7f15543ee640 1 -- 172.21.15.73:0/2868295678 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15380a2b80 msgr2=0x7f15380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.711+0000 7f15543ee640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15380a2b80 0x7f15380a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1548005c40 tx=0x7f154800a780 comp rx=0 tx=0).stop 2024-09-05T12:55:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.711+0000 7f15543ee640 1 -- 172.21.15.73:0/2868295678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154c1082e0 msgr2=0x7f154c19cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.711+0000 7f15543ee640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154c1082e0 0x7f154c19cf00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1544009fd0 tx=0x7f154400b8e0 comp rx=0 tx=0).stop 2024-09-05T12:55:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.712+0000 7f15543ee640 1 -- 172.21.15.73:0/2868295678 shutdown_connections 2024-09-05T12:55:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.712+0000 7f15543ee640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15380a2b80 0x7f15380a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.712+0000 7f15543ee640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f154c1082e0 0x7f154c19cf00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.712+0000 7f15543ee640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f154c103760 0x7f154c198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.712+0000 7f15543ee640 1 --2- 172.21.15.73:0/2868295678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f154c102db0 0x7f154c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.712+0000 7f15543ee640 1 -- 172.21.15.73:0/2868295678 >> 172.21.15.73:0/2868295678 conn(0x7f154c0fc7d0 msgr2=0x7f154c105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.712+0000 7f15543ee640 1 -- 172.21.15.73:0/2868295678 shutdown_connections 2024-09-05T12:55:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:42.712+0000 7f15543ee640 1 -- 172.21.15.73:0/2868295678 wait complete. 2024-09-05T12:55:43.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:43 smithi073 ceph-mon[30883]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:43.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:43 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2868295678' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-05T12:55:43.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:43 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2868295678' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-05T12:55:43.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:43 smithi073 ceph-mon[30883]: osdmap e74: 12 total, 12 up, 12 in 2024-09-05T12:55:43.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-05T12:55:43.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:43 smithi162 ceph-mon[34220]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:43 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2868295678' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-05T12:55:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:43 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2868295678' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-05T12:55:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:43 smithi162 ceph-mon[34220]: osdmap e74: 12 total, 12 up, 12 in 2024-09-05T12:55:43.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:43 smithi169 ceph-mon[34823]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:43.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:43 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2868295678' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-05T12:55:43.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:43 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2868295678' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-05T12:55:43.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:43 smithi169 ceph-mon[34823]: osdmap e74: 12 total, 12 up, 12 in 2024-09-05T12:55:43.666 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:44.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.139+0000 7f4390b8e640 1 -- 172.21.15.73:0/4293741653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f438c102790 msgr2=0x7f438c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.139+0000 7f4390b8e640 1 --2- 172.21.15.73:0/4293741653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f438c102790 0x7f438c1067e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4374009900 tx=0x7f437402a410 comp rx=0 tx=0).stop 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.139+0000 7f4390b8e640 1 -- 172.21.15.73:0/4293741653 shutdown_connections 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.139+0000 7f4390b8e640 1 --2- 172.21.15.73:0/4293741653 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f438c106f10 0x7f438c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.139+0000 7f4390b8e640 1 --2- 172.21.15.73:0/4293741653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f438c102790 0x7f438c1067e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.139+0000 7f4390b8e640 1 --2- 172.21.15.73:0/4293741653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c101de0 0x7f438c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.139+0000 7f4390b8e640 1 -- 172.21.15.73:0/4293741653 >> 172.21.15.73:0/4293741653 conn(0x7f438c0fd8c0 msgr2=0x7f438c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.139+0000 7f4390b8e640 1 -- 172.21.15.73:0/4293741653 shutdown_connections 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.139+0000 7f4390b8e640 1 -- 172.21.15.73:0/4293741653 wait complete. 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f4390b8e640 1 Processor -- start 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f4390b8e640 1 -- start start 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f4390b8e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c101de0 0x7f438c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f4390b8e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f438c102790 0x7f438c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f4390b8e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f438c106f10 0x7f438c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f4390b8e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f438c111f70 con 0x7f438c106f10 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f4390b8e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f438c111df0 con 0x7f438c101de0 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f4390b8e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f438c1120f0 con 0x7f438c102790 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f438ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f438c106f10 0x7f438c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f438ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f438c106f10 0x7f438c19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33594/0 (socket says 172.21.15.73:33594) 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f438ad9d640 1 -- 172.21.15.73:0/2297884158 learned_addr learned my addr 172.21.15.73:0/2297884158 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.140+0000 7f4383fff640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f438c102790 0x7f438c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f438a59c640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c101de0 0x7f438c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f438ad9d640 1 -- 172.21.15.73:0/2297884158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f438c102790 msgr2=0x7f438c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f438ad9d640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f438c102790 0x7f438c198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f438ad9d640 1 -- 172.21.15.73:0/2297884158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c101de0 msgr2=0x7f438c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:44.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f438ad9d640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c101de0 0x7f438c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f438ad9d640 1 -- 172.21.15.73:0/2297884158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438c19d470 con 0x7f438c106f10 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f438ad9d640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f438c106f10 0x7f438c19cd90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4384009fd0 tx=0x7f438400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f43837fe640 1 -- 172.21.15.73:0/2297884158 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384017070 con 0x7f438c106f10 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f43837fe640 1 -- 172.21.15.73:0/2297884158 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4384003e50 con 0x7f438c106f10 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f4390b8e640 1 -- 172.21.15.73:0/2297884158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438c19d760 con 0x7f438c106f10 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f43837fe640 1 -- 172.21.15.73:0/2297884158 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43840106c0 con 0x7f438c106f10 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.141+0000 7f4390b8e640 1 -- 172.21.15.73:0/2297884158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f438c1a5040 con 0x7f438c106f10 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.142+0000 7f4390b8e640 1 -- 172.21.15.73:0/2297884158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438c1021c0 con 0x7f438c106f10 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.143+0000 7f43837fe640 1 -- 172.21.15.73:0/2297884158 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4384003970 con 0x7f438c106f10 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.144+0000 7f43837fe640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43780a2b80 0x7f43780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.144+0000 7f438a59c640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43780a2b80 0x7f43780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.144+0000 7f43837fe640 1 -- 172.21.15.73:0/2297884158 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7497+0+0 (secure 0 0 0) 0x7f43840cea40 con 0x7f438c106f10 2024-09-05T12:55:44.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.145+0000 7f438a59c640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43780a2b80 0x7f43780a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f437c0058c0 tx=0x7f437c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:44.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.148+0000 7f43837fe640 1 -- 172.21.15.73:0/2297884158 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f438409bcb0 con 0x7f438c106f10 2024-09-05T12:55:44.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.312+0000 7f4390b8e640 1 -- 172.21.15.73:0/2297884158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f438c10a150 con 0x7f438c106f10 2024-09-05T12:55:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.717+0000 7f43837fe640 1 -- 172.21.15.73:0/2297884158 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7f438409b5b0 con 0x7f438c106f10 2024-09-05T12:55:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-09-05T12:55:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.719+0000 7f4390b8e640 1 -- 172.21.15.73:0/2297884158 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43780a2b80 msgr2=0x7f43780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.719+0000 7f4390b8e640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43780a2b80 0x7f43780a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f437c0058c0 tx=0x7f437c00a4c0 comp rx=0 tx=0).stop 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.719+0000 7f4390b8e640 1 -- 172.21.15.73:0/2297884158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f438c106f10 msgr2=0x7f438c19cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.719+0000 7f4390b8e640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f438c106f10 0x7f438c19cd90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4384009fd0 tx=0x7f438400b260 comp rx=0 tx=0).stop 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.719+0000 7f4390b8e640 1 -- 172.21.15.73:0/2297884158 shutdown_connections 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.719+0000 7f4390b8e640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43780a2b80 0x7f43780a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.719+0000 7f4390b8e640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f438c106f10 0x7f438c19cd90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.719+0000 7f4390b8e640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f438c102790 0x7f438c198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.719+0000 7f4390b8e640 1 --2- 172.21.15.73:0/2297884158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c101de0 0x7f438c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.719+0000 7f4390b8e640 1 -- 172.21.15.73:0/2297884158 >> 172.21.15.73:0/2297884158 conn(0x7f438c0fd8c0 msgr2=0x7f438c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.720+0000 7f4390b8e640 1 -- 172.21.15.73:0/2297884158 shutdown_connections 2024-09-05T12:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:44.720+0000 7f4390b8e640 1 -- 172.21.15.73:0/2297884158 wait complete. 2024-09-05T12:55:44.809 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:44 smithi162 ceph-mon[34220]: osdmap e75: 12 total, 12 up, 12 in 2024-09-05T12:55:44.809 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:44 smithi162 ceph-mon[34220]: pgmap v265: 33 pgs: 29 unknown, 4 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:44.809 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:44 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2297884158' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T12:55:45.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:44 smithi073 ceph-mon[30883]: osdmap e75: 12 total, 12 up, 12 in 2024-09-05T12:55:45.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:44 smithi073 ceph-mon[30883]: pgmap v265: 33 pgs: 29 unknown, 4 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:45.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:44 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2297884158' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T12:55:45.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:44 smithi169 ceph-mon[34823]: osdmap e75: 12 total, 12 up, 12 in 2024-09-05T12:55:45.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:44 smithi169 ceph-mon[34823]: pgmap v265: 33 pgs: 29 unknown, 4 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:45.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:44 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2297884158' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T12:55:45.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-05T12:55:45.695 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:45.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:45 smithi073 ceph-mon[30883]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-05T12:55:45.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:45 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2297884158' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-05T12:55:45.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:45 smithi073 ceph-mon[30883]: osdmap e76: 12 total, 12 up, 12 in 2024-09-05T12:55:46.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:45 smithi162 ceph-mon[34220]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-05T12:55:46.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:45 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2297884158' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-05T12:55:46.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:45 smithi162 ceph-mon[34220]: osdmap e76: 12 total, 12 up, 12 in 2024-09-05T12:55:46.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:45 smithi169 ceph-mon[34823]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-05T12:55:46.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:45 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2297884158' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-05T12:55:46.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:45 smithi169 ceph-mon[34823]: osdmap e76: 12 total, 12 up, 12 in 2024-09-05T12:55:46.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 -- 172.21.15.73:0/4163254702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadcc1027a0 msgr2=0x7fadcc1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:46.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 --2- 172.21.15.73:0/4163254702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadcc1027a0 0x7fadcc1067f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009900 tx=0x7fadbc02a410 comp rx=0 tx=0).stop 2024-09-05T12:55:46.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 -- 172.21.15.73:0/4163254702 shutdown_connections 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 --2- 172.21.15.73:0/4163254702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadcc106f20 0x7fadcc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 --2- 172.21.15.73:0/4163254702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadcc1027a0 0x7fadcc1067f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 --2- 172.21.15.73:0/4163254702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc101df0 0x7fadcc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 -- 172.21.15.73:0/4163254702 >> 172.21.15.73:0/4163254702 conn(0x7fadcc0fd8b0 msgr2=0x7fadcc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 -- 172.21.15.73:0/4163254702 shutdown_connections 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 -- 172.21.15.73:0/4163254702 wait complete. 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 Processor -- start 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.159+0000 7fadd3be1640 1 -- start start 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd3be1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadcc101df0 0x7fadcc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd3be1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc1027a0 0x7fadcc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd3be1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadcc106f20 0x7fadcc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd3be1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc112020 con 0x7fadcc101df0 2024-09-05T12:55:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd3be1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc111ea0 con 0x7fadcc1027a0 2024-09-05T12:55:46.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd3be1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1121a0 con 0x7fadcc106f20 2024-09-05T12:55:46.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd197d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadcc101df0 0x7fadcc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:46.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd197d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadcc101df0 0x7fadcc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33602/0 (socket says 172.21.15.73:33602) 2024-09-05T12:55:46.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd197d640 1 -- 172.21.15.73:0/2470931647 learned_addr learned my addr 172.21.15.73:0/2470931647 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:46.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd217e640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadcc106f20 0x7fadcc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:46.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd117c640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc1027a0 0x7fadcc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:46.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd197d640 1 -- 172.21.15.73:0/2470931647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadcc106f20 msgr2=0x7fadcc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:46.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd197d640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadcc106f20 0x7fadcc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:46.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd197d640 1 -- 172.21.15.73:0/2470931647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc1027a0 msgr2=0x7fadcc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd197d640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc1027a0 0x7fadcc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd197d640 1 -- 172.21.15.73:0/2470931647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc1a6a80 con 0x7fadcc101df0 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd217e640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadcc106f20 0x7fadcc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd117c640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc1027a0 0x7fadcc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd197d640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadcc101df0 0x7fadcc0744f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fadc800b4a0 tx=0x7fadc800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadc2ffd640 1 -- 172.21.15.73:0/2470931647 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8014070 con 0x7fadcc101df0 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadd3be1640 1 -- 172.21.15.73:0/2470931647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc1a6d70 con 0x7fadcc101df0 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadc2ffd640 1 -- 172.21.15.73:0/2470931647 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadc8010af0 con 0x7fadcc101df0 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.160+0000 7fadc2ffd640 1 -- 172.21.15.73:0/2470931647 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8017d10 con 0x7fadcc101df0 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.161+0000 7fadd3be1640 1 -- 172.21.15.73:0/2470931647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1a7220 con 0x7fadcc101df0 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.162+0000 7fadd3be1640 1 -- 172.21.15.73:0/2470931647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadcc102250 con 0x7fadcc101df0 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.163+0000 7fadc2ffd640 1 -- 172.21.15.73:0/2470931647 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fadc8017070 con 0x7fadcc101df0 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.163+0000 7fadc2ffd640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fadb80a2b80 0x7fadb80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:46.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.163+0000 7fadd117c640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fadb80a2b80 0x7fadb80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:46.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.163+0000 7fadc2ffd640 1 -- 172.21.15.73:0/2470931647 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7fadc80ce2a0 con 0x7fadcc101df0 2024-09-05T12:55:46.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.164+0000 7fadd117c640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fadb80a2b80 0x7fadb80a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadcc075f80 tx=0x7fadbc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:46.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.168+0000 7fadc2ffd640 1 -- 172.21.15.73:0/2470931647 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadc809b3b0 con 0x7fadcc101df0 2024-09-05T12:55:46.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.369+0000 7fadd3be1640 1 -- 172.21.15.73:0/2470931647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fadcc075a20 con 0x7fadcc101df0 2024-09-05T12:55:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.733+0000 7fadc2ffd640 1 -- 172.21.15.73:0/2470931647 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fadc809acb0 con 0x7fadcc101df0 2024-09-05T12:55:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2024-09-05T12:55:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 -- 172.21.15.73:0/2470931647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fadb80a2b80 msgr2=0x7fadb80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fadb80a2b80 0x7fadb80a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadcc075f80 tx=0x7fadbc005a20 comp rx=0 tx=0).stop 2024-09-05T12:55:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 -- 172.21.15.73:0/2470931647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadcc101df0 msgr2=0x7fadcc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadcc101df0 0x7fadcc0744f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fadc800b4a0 tx=0x7fadc800b960 comp rx=0 tx=0).stop 2024-09-05T12:55:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 -- 172.21.15.73:0/2470931647 shutdown_connections 2024-09-05T12:55:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fadb80a2b80 0x7fadb80a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadcc106f20 0x7fadcc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc1027a0 0x7fadcc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 --2- 172.21.15.73:0/2470931647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadcc101df0 0x7fadcc0744f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 -- 172.21.15.73:0/2470931647 >> 172.21.15.73:0/2470931647 conn(0x7fadcc0fd8b0 msgr2=0x7fadcc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 -- 172.21.15.73:0/2470931647 shutdown_connections 2024-09-05T12:55:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:46.736+0000 7fadd3be1640 1 -- 172.21.15.73:0/2470931647 wait complete. 2024-09-05T12:55:47.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:46 smithi073 ceph-mon[30883]: osdmap e77: 12 total, 12 up, 12 in 2024-09-05T12:55:47.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:46 smithi073 ceph-mon[30883]: pgmap v268: 97 pgs: 23 creating+peering, 52 unknown, 22 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:47.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:46 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2470931647' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T12:55:47.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:46 smithi073 ceph-mon[30883]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-05T12:55:47.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:46 smithi162 ceph-mon[34220]: osdmap e77: 12 total, 12 up, 12 in 2024-09-05T12:55:47.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:46 smithi162 ceph-mon[34220]: pgmap v268: 97 pgs: 23 creating+peering, 52 unknown, 22 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:47.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:46 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2470931647' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T12:55:47.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:46 smithi162 ceph-mon[34220]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-05T12:55:47.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:46 smithi169 ceph-mon[34823]: osdmap e77: 12 total, 12 up, 12 in 2024-09-05T12:55:47.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:46 smithi169 ceph-mon[34823]: pgmap v268: 97 pgs: 23 creating+peering, 52 unknown, 22 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:47.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:46 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2470931647' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T12:55:47.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:46 smithi169 ceph-mon[34823]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-05T12:55:47.425 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T12:55:47.674 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:48.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:47 smithi073 ceph-mon[30883]: osdmap e78: 12 total, 12 up, 12 in 2024-09-05T12:55:48.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:47 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2470931647' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-05T12:55:48.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:47 smithi073 ceph-mon[30883]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-05T12:55:48.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:47 smithi073 ceph-mon[30883]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-05T12:55:48.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:47 smithi162 ceph-mon[34220]: osdmap e78: 12 total, 12 up, 12 in 2024-09-05T12:55:48.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:47 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2470931647' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-05T12:55:48.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:47 smithi162 ceph-mon[34220]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-05T12:55:48.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:47 smithi162 ceph-mon[34220]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-05T12:55:48.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:47 smithi169 ceph-mon[34823]: osdmap e78: 12 total, 12 up, 12 in 2024-09-05T12:55:48.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:47 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2470931647' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-05T12:55:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:47 smithi169 ceph-mon[34823]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-05T12:55:48.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:47 smithi169 ceph-mon[34823]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-05T12:55:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.166+0000 7fcde87c7640 1 -- 172.21.15.73:0/1870294027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0101420 msgr2=0x7fcde010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.166+0000 7fcde87c7640 1 --2- 172.21.15.73:0/1870294027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0101420 0x7fcde010d950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009cd0 tx=0x7fcdd802a8e0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.166+0000 7fcde87c7640 1 -- 172.21.15.73:0/1870294027 shutdown_connections 2024-09-05T12:55:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.166+0000 7fcde87c7640 1 --2- 172.21.15.73:0/1870294027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0101420 0x7fcde010d950 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.166+0000 7fcde87c7640 1 --2- 172.21.15.73:0/1870294027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde0100a80 0x7fcde0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.166+0000 7fcde87c7640 1 --2- 172.21.15.73:0/1870294027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcde0106a80 0x7fcde0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.166+0000 7fcde87c7640 1 -- 172.21.15.73:0/1870294027 >> 172.21.15.73:0/1870294027 conn(0x7fcde00fc7a0 msgr2=0x7fcde00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.166+0000 7fcde87c7640 1 -- 172.21.15.73:0/1870294027 shutdown_connections 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.166+0000 7fcde87c7640 1 -- 172.21.15.73:0/1870294027 wait complete. 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde87c7640 1 Processor -- start 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde87c7640 1 -- start start 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde87c7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde0100a80 0x7fcde01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde87c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0101420 0x7fcde01988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde87c7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcde0106a80 0x7fcde019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde87c7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcde0110e80 con 0x7fcde0101420 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde87c7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcde0110d00 con 0x7fcde0106a80 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde87c7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcde0111000 con 0x7fcde0100a80 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde5d62640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0101420 0x7fcde01988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde5d62640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0101420 0x7fcde01988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33620/0 (socket says 172.21.15.73:33620) 2024-09-05T12:55:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.167+0000 7fcde5d62640 1 -- 172.21.15.73:0/627723784 learned_addr learned my addr 172.21.15.73:0/627723784 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcde6563640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde0100a80 0x7fcde01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcde6d64640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcde0106a80 0x7fcde019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcde5d62640 1 -- 172.21.15.73:0/627723784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde0100a80 msgr2=0x7fcde01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcde5d62640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde0100a80 0x7fcde01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcde5d62640 1 -- 172.21.15.73:0/627723784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcde0106a80 msgr2=0x7fcde019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcde5d62640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcde0106a80 0x7fcde019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcde5d62640 1 -- 172.21.15.73:0/627723784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde019d350 con 0x7fcde0101420 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcde5d62640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0101420 0x7fcde01988e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400d770 tx=0x7fcdd400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcdd37fe640 1 -- 172.21.15.73:0/627723784 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4017070 con 0x7fcde0101420 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcdd37fe640 1 -- 172.21.15.73:0/627723784 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdd4009820 con 0x7fcde0101420 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcdd37fe640 1 -- 172.21.15.73:0/627723784 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4004cd0 con 0x7fcde0101420 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcde87c7640 1 -- 172.21.15.73:0/627723784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde019d640 con 0x7fcde0101420 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.168+0000 7fcde87c7640 1 -- 172.21.15.73:0/627723784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde01a4f20 con 0x7fcde0101420 2024-09-05T12:55:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.169+0000 7fcde87c7640 1 -- 172.21.15.73:0/627723784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde0100ee0 con 0x7fcde0101420 2024-09-05T12:55:48.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.171+0000 7fcdd37fe640 1 -- 172.21.15.73:0/627723784 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcdd40099d0 con 0x7fcde0101420 2024-09-05T12:55:48.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.171+0000 7fcdd37fe640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fcdcc0a2b80 0x7fcdcc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:48.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.171+0000 7fcde6563640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fcdcc0a2b80 0x7fcdcc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:48.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.171+0000 7fcdd37fe640 1 -- 172.21.15.73:0/627723784 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fcdd40ced50 con 0x7fcde0101420 2024-09-05T12:55:48.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.172+0000 7fcde6563640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fcdcc0a2b80 0x7fcdcc0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00ab60 tx=0x7fcddc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:48.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.174+0000 7fcdd37fe640 1 -- 172.21.15.73:0/627723784 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcdd409be00 con 0x7fcde0101420 2024-09-05T12:55:48.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.343+0000 7fcde87c7640 1 -- 172.21.15.73:0/627723784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcde0199700 con 0x7fcde0101420 2024-09-05T12:55:48.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.346+0000 7fcdd37fe640 1 -- 172.21.15.73:0/627723784 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22315 (secure 0 0 0) 0x7fcde0199700 con 0x7fcde0101420 2024-09-05T12:55:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:48.348 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":78,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T12:55:46.371426+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T12:55:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 -- 172.21.15.73:0/627723784 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fcdcc0a2b80 msgr2=0x7fcdcc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fcdcc0a2b80 0x7fcdcc0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00ab60 tx=0x7fcddc00a2d0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 -- 172.21.15.73:0/627723784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0101420 msgr2=0x7fcde01988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0101420 0x7fcde01988e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400d770 tx=0x7fcdd400db70 comp rx=0 tx=0).stop 2024-09-05T12:55:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 -- 172.21.15.73:0/627723784 shutdown_connections 2024-09-05T12:55:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fcdcc0a2b80 0x7fcdcc0a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcde0106a80 0x7fcde019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0101420 0x7fcde01988e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 --2- 172.21.15.73:0/627723784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde0100a80 0x7fcde01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 -- 172.21.15.73:0/627723784 >> 172.21.15.73:0/627723784 conn(0x7fcde00fc7a0 msgr2=0x7fcde006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 -- 172.21.15.73:0/627723784 shutdown_connections 2024-09-05T12:55:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:48.348+0000 7fcde87c7640 1 -- 172.21.15.73:0/627723784 wait complete. 2024-09-05T12:55:48.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:48 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] up:active 2024-09-05T12:55:48.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:48 smithi073 ceph-mon[30883]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:48.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:48 smithi073 ceph-mon[30883]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:48.996 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:48 smithi073 ceph-mon[30883]: pgmap v270: 97 pgs: 23 creating+peering, 22 unknown, 52 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:48.996 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:48 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/627723784' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:55:49.026 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T12:55:49.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:48 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] up:active 2024-09-05T12:55:49.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:48 smithi162 ceph-mon[34220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:49.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:48 smithi162 ceph-mon[34220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:49.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:48 smithi162 ceph-mon[34220]: pgmap v270: 97 pgs: 23 creating+peering, 22 unknown, 52 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:49.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:48 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/627723784' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:55:49.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:48 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] up:active 2024-09-05T12:55:49.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:48 smithi169 ceph-mon[34823]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:49.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:48 smithi169 ceph-mon[34823]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:49.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:48 smithi169 ceph-mon[34823]: pgmap v270: 97 pgs: 23 creating+peering, 22 unknown, 52 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T12:55:49.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:48 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/627723784' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:55:49.274 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.750+0000 7ff5f0292640 1 -- 172.21.15.73:0/3964113787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5e8102ef0 msgr2=0x7ff5e810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.750+0000 7ff5f0292640 1 --2- 172.21.15.73:0/3964113787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5e8102ef0 0x7ff5e810da40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009ca0 tx=0x7ff5e002a950 comp rx=0 tx=0).stop 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 -- 172.21.15.73:0/3964113787 shutdown_connections 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 --2- 172.21.15.73:0/3964113787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5e8102ef0 0x7ff5e810da40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 --2- 172.21.15.73:0/3964113787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5e8102570 0x7ff5e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 --2- 172.21.15.73:0/3964113787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5e8100e20 0x7ff5e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 -- 172.21.15.73:0/3964113787 >> 172.21.15.73:0/3964113787 conn(0x7ff5e80fc7d0 msgr2=0x7ff5e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 -- 172.21.15.73:0/3964113787 shutdown_connections 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 -- 172.21.15.73:0/3964113787 wait complete. 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 Processor -- start 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 -- start start 2024-09-05T12:55:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5e8100e20 0x7ff5e8199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5e8102570 0x7ff5e8199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5e8102ef0 0x7ff5e81a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e8110fd0 con 0x7ff5e8102ef0 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e8110e50 con 0x7ff5e8102570 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5f0292640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e8111150 con 0x7ff5e8100e20 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5ee82f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5e8102ef0 0x7ff5e81a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5ee82f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5e8102ef0 0x7ff5e81a43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33640/0 (socket says 172.21.15.73:33640) 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.751+0000 7ff5ee82f640 1 -- 172.21.15.73:0/1953841805 learned_addr learned my addr 172.21.15.73:0/1953841805 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5ee02e640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5e8100e20 0x7ff5e8199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5ee82f640 1 -- 172.21.15.73:0/1953841805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5e8100e20 msgr2=0x7ff5e8199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5ee82f640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5e8100e20 0x7ff5e8199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:49.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5ee82f640 1 -- 172.21.15.73:0/1953841805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5e8102570 msgr2=0x7ff5e8199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:49.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5ee82f640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5e8102570 0x7ff5e8199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:49.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5ee82f640 1 -- 172.21.15.73:0/1953841805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e81a4900 con 0x7ff5e8102ef0 2024-09-05T12:55:49.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5ee82f640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5e8102ef0 0x7ff5e81a43c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009dc0 tx=0x7ff5e0003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:49.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5df7fe640 1 -- 172.21.15.73:0/1953841805 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0034040 con 0x7ff5e8102ef0 2024-09-05T12:55:49.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5df7fe640 1 -- 172.21.15.73:0/1953841805 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5e002fe10 con 0x7ff5e8102ef0 2024-09-05T12:55:49.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5df7fe640 1 -- 172.21.15.73:0/1953841805 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00047b0 con 0x7ff5e8102ef0 2024-09-05T12:55:49.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5f0292640 1 -- 172.21.15.73:0/1953841805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e81a4ad0 con 0x7ff5e8102ef0 2024-09-05T12:55:49.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.752+0000 7ff5f0292640 1 -- 172.21.15.73:0/1953841805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e81a4f80 con 0x7ff5e8102ef0 2024-09-05T12:55:49.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.753+0000 7ff5f0292640 1 -- 172.21.15.73:0/1953841805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e8101200 con 0x7ff5e8102ef0 2024-09-05T12:55:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.754+0000 7ff5df7fe640 1 -- 172.21.15.73:0/1953841805 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff5e0037020 con 0x7ff5e8102ef0 2024-09-05T12:55:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.755+0000 7ff5df7fe640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff5d40a2c00 0x7ff5d40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.755+0000 7ff5ee02e640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff5d40a2c00 0x7ff5d40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.755+0000 7ff5df7fe640 1 -- 172.21.15.73:0/1953841805 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7ff5e00efed0 con 0x7ff5e8102ef0 2024-09-05T12:55:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.756+0000 7ff5ee02e640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff5d40a2c00 0x7ff5d40a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400bbe0 tx=0x7ff5e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.759+0000 7ff5df7fe640 1 -- 172.21.15.73:0/1953841805 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5e00bcf70 con 0x7ff5e8102ef0 2024-09-05T12:55:49.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.927+0000 7ff5f0292640 1 -- 172.21.15.73:0/1953841805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5e81a51b0 con 0x7ff5e8102ef0 2024-09-05T12:55:49.930 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:49 smithi073 ceph-mon[30883]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-05T12:55:49.930 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:49 smithi073 ceph-mon[30883]: Cluster is now healthy 2024-09-05T12:55:49.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.929+0000 7ff5df7fe640 1 -- 172.21.15.73:0/1953841805 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22315 (secure 0 0 0) 0x7ff5e00bc870 con 0x7ff5e8102ef0 2024-09-05T12:55:49.931 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:55:49.931 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":78,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T12:55:46.371426+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T12:55:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 -- 172.21.15.73:0/1953841805 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff5d40a2c00 msgr2=0x7ff5d40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff5d40a2c00 0x7ff5d40a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400bbe0 tx=0x7ff5e400b390 comp rx=0 tx=0).stop 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 -- 172.21.15.73:0/1953841805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5e8102ef0 msgr2=0x7ff5e81a43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5e8102ef0 0x7ff5e81a43c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009dc0 tx=0x7ff5e0003d00 comp rx=0 tx=0).stop 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 -- 172.21.15.73:0/1953841805 shutdown_connections 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff5d40a2c00 0x7ff5d40a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5e8102ef0 0x7ff5e81a43c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5e8102570 0x7ff5e8199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 --2- 172.21.15.73:0/1953841805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5e8100e20 0x7ff5e8199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 -- 172.21.15.73:0/1953841805 >> 172.21.15.73:0/1953841805 conn(0x7ff5e80fc7d0 msgr2=0x7ff5e8106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 -- 172.21.15.73:0/1953841805 shutdown_connections 2024-09-05T12:55:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:49.931+0000 7ff5f0292640 1 -- 172.21.15.73:0/1953841805 wait complete. 2024-09-05T12:55:50.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:49 smithi162 ceph-mon[34220]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-05T12:55:50.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:49 smithi162 ceph-mon[34220]: Cluster is now healthy 2024-09-05T12:55:50.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:49 smithi169 ceph-mon[34823]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-05T12:55:50.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:49 smithi169 ceph-mon[34823]: Cluster is now healthy 2024-09-05T12:55:50.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-05T12:55:50.854 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:51.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:50 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1953841805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:55:51.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:50 smithi073 ceph-mon[30883]: pgmap v271: 97 pgs: 23 creating+peering, 74 active+clean; 578 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 4 op/s 2024-09-05T12:55:51.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:50 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1953841805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:55:51.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:50 smithi162 ceph-mon[34220]: pgmap v271: 97 pgs: 23 creating+peering, 74 active+clean; 578 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 4 op/s 2024-09-05T12:55:51.111 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:51 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b[64807]: 2024-09-05T12:55:50.999+0000 7f33b300d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-05T12:55:51.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:50 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1953841805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:55:51.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:50 smithi169 ceph-mon[34823]: pgmap v271: 97 pgs: 23 creating+peering, 74 active+clean; 578 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 4 op/s 2024-09-05T12:55:51.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/1383010028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc4101de0 msgr2=0x7f9cc41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 --2- 172.21.15.73:0/1383010028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc4101de0 0x7f9cc41021c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009900 tx=0x7f9cc002a410 comp rx=0 tx=0).stop 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/1383010028 shutdown_connections 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 --2- 172.21.15.73:0/1383010028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cc4106f10 0x7f9cc410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 --2- 172.21.15.73:0/1383010028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cc4102790 0x7f9cc41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 --2- 172.21.15.73:0/1383010028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc4101de0 0x7f9cc41021c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/1383010028 >> 172.21.15.73:0/1383010028 conn(0x7f9cc40fd8c0 msgr2=0x7f9cc40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/1383010028 shutdown_connections 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/1383010028 wait complete. 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 Processor -- start 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 -- start start 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.322+0000 7f9ccb7a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc4101de0 0x7f9cc4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:51.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9ccb7a2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cc4102790 0x7f9cc41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9ccb7a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cc4106f10 0x7f9cc419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9ccb7a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc4111f30 con 0x7f9cc4101de0 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9ccb7a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc4111db0 con 0x7f9cc4106f10 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9ccb7a2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc41120b0 con 0x7f9cc4102790 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cc953e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc4101de0 0x7f9cc4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cc953e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc4101de0 0x7f9cc4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33656/0 (socket says 172.21.15.73:33656) 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cc953e640 1 -- 172.21.15.73:0/3257012584 learned_addr learned my addr 172.21.15.73:0/3257012584 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cc8d3d640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cc4102790 0x7f9cc41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cc953e640 1 -- 172.21.15.73:0/3257012584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cc4102790 msgr2=0x7f9cc41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cc953e640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cc4102790 0x7f9cc41989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cc953e640 1 -- 172.21.15.73:0/3257012584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cc4106f10 msgr2=0x7f9cc419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cc953e640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cc4106f10 0x7f9cc419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cc953e640 1 -- 172.21.15.73:0/3257012584 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc419d440 con 0x7f9cc4101de0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cc953e640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc4101de0 0x7f9cc4198490 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0005ab0 tx=0x7f9cc00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cba7fc640 1 -- 172.21.15.73:0/3257012584 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc003f030 con 0x7f9cc4101de0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/3257012584 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc419d6d0 con 0x7f9cc4101de0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cba7fc640 1 -- 172.21.15.73:0/3257012584 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cc0003ce0 con 0x7f9cc4101de0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9cba7fc640 1 -- 172.21.15.73:0/3257012584 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0035070 con 0x7f9cc4101de0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.323+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/3257012584 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc41a5010 con 0x7f9cc4101de0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.324+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/3257012584 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc41032c0 con 0x7f9cc4101de0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.325+0000 7f9cba7fc640 1 -- 172.21.15.73:0/3257012584 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9cc0042030 con 0x7f9cc4101de0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.326+0000 7f9cba7fc640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9cb00a2b80 0x7f9cb00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.326+0000 7f9cc8d3d640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9cb00a2b80 0x7f9cb00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.326+0000 7f9cba7fc640 1 -- 172.21.15.73:0/3257012584 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f9cc00ef890 con 0x7f9cc4101de0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.326+0000 7f9cc8d3d640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9cb00a2b80 0x7f9cb00a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4005e10 tx=0x7f9cb4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:51.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.330+0000 7f9cba7fc640 1 -- 172.21.15.73:0/3257012584 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9cc00bc940 con 0x7f9cc4101de0 2024-09-05T12:55:51.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.533+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/3257012584 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9cc410a0f0 con 0x7f9cc4101de0 2024-09-05T12:55:51.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.758+0000 7f9cba7fc640 1 -- 172.21.15.73:0/3257012584 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f9cc00bc240 con 0x7f9cc4101de0 2024-09-05T12:55:51.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/3257012584 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9cb00a2b80 msgr2=0x7f9cb00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:51.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9cb00a2b80 0x7f9cb00a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4005e10 tx=0x7f9cb4005da0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/3257012584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc4101de0 msgr2=0x7f9cc4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:51.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc4101de0 0x7f9cc4198490 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0005ab0 tx=0x7f9cc00042f0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/3257012584 shutdown_connections 2024-09-05T12:55:51.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9cb00a2b80 0x7f9cb00a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cc4106f10 0x7f9cc419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cc4102790 0x7f9cc41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 --2- 172.21.15.73:0/3257012584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc4101de0 0x7f9cc4198490 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:51.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/3257012584 >> 172.21.15.73:0/3257012584 conn(0x7f9cc40fd8c0 msgr2=0x7f9cc40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:51.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.760+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/3257012584 shutdown_connections 2024-09-05T12:55:51.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:51.761+0000 7f9ccb7a2640 1 -- 172.21.15.73:0/3257012584 wait complete. 2024-09-05T12:55:52.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:51 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3257012584' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T12:55:52.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:51 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3257012584' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T12:55:52.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:51 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3257012584' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T12:55:52.478 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-05T12:55:52.478 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-05T12:55:52.727 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:53.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:52 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3257012584' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-05T12:55:53.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:52 smithi162 ceph-mon[34220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:53.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:52 smithi162 ceph-mon[34220]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-05T12:55:53.117 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:52 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3257012584' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-05T12:55:53.117 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:52 smithi073 ceph-mon[30883]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:53.117 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:52 smithi073 ceph-mon[30883]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-05T12:55:53.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:52 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3257012584' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-05T12:55:53.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:52 smithi169 ceph-mon[34823]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:53.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:52 smithi169 ceph-mon[34823]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-05T12:55:53.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.196+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1112675186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b4105590 msgr2=0x7fe0b410d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.196+0000 7fe0b92ca640 1 --2- 172.21.15.73:0/1112675186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b4105590 0x7fe0b410d110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009ca0 tx=0x7fe0ac02a8c0 comp rx=0 tx=0).stop 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.196+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1112675186 shutdown_connections 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.196+0000 7fe0b92ca640 1 --2- 172.21.15.73:0/1112675186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b4105590 0x7fe0b410d110 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.196+0000 7fe0b92ca640 1 --2- 172.21.15.73:0/1112675186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0b4100e10 0x7fe0b4104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.196+0000 7fe0b92ca640 1 --2- 172.21.15.73:0/1112675186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b4100460 0x7fe0b4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.196+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1112675186 >> 172.21.15.73:0/1112675186 conn(0x7fe0b40fbee0 msgr2=0x7fe0b40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.196+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1112675186 shutdown_connections 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.196+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1112675186 wait complete. 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.196+0000 7fe0b92ca640 1 Processor -- start 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b92ca640 1 -- start start 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b92ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b4100460 0x7fe0b41983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b92ca640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0b4100e10 0x7fe0b4198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:53.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b92ca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b4105590 0x7fe0b419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b92ca640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b410fd70 con 0x7fe0b4100460 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b92ca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b410fbf0 con 0x7fe0b4105590 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b92ca640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b410fef0 con 0x7fe0b4100e10 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b4100460 0x7fe0b41983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b4100460 0x7fe0b41983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33686/0 (socket says 172.21.15.73:33686) 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b2ffd640 1 -- 172.21.15.73:0/1942909817 learned_addr learned my addr 172.21.15.73:0/1942909817 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b37fe640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b4105590 0x7fe0b419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b2ffd640 1 -- 172.21.15.73:0/1942909817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0b4100e10 msgr2=0x7fe0b4198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b27fc640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0b4100e10 0x7fe0b4198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b2ffd640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0b4100e10 0x7fe0b4198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b2ffd640 1 -- 172.21.15.73:0/1942909817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b4105590 msgr2=0x7fe0b419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b2ffd640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b4105590 0x7fe0b419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b2ffd640 1 -- 172.21.15.73:0/1942909817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b419d370 con 0x7fe0b4100460 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b37fe640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b4105590 0x7fe0b419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b2ffd640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b4100460 0x7fe0b41983c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400c890 tx=0x7fe0a400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe09bfff640 1 -- 172.21.15.73:0/1942909817 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4004220 con 0x7fe0b4100460 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1942909817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b419d660 con 0x7fe0b4100460 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe09bfff640 1 -- 172.21.15.73:0/1942909817 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0a40043c0 con 0x7fe0b4100460 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe09bfff640 1 -- 172.21.15.73:0/1942909817 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a401d060 con 0x7fe0b4100460 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.197+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1942909817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b41a4f40 con 0x7fe0b4100460 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.198+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1942909817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b4100840 con 0x7fe0b4100460 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.200+0000 7fe09bfff640 1 -- 172.21.15.73:0/1942909817 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe0a40079b0 con 0x7fe0b4100460 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.200+0000 7fe09bfff640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe09c0a2b80 0x7fe09c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.200+0000 7fe0b27fc640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe09c0a2b80 0x7fe09c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.200+0000 7fe09bfff640 1 -- 172.21.15.73:0/1942909817 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fe0a40cf090 con 0x7fe0b4100460 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.201+0000 7fe0b27fc640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe09c0a2b80 0x7fe09c0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8005d80 tx=0x7fe0a8005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.204+0000 7fe09bfff640 1 -- 172.21.15.73:0/1942909817 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0a4014030 con 0x7fe0b4100460 2024-09-05T12:55:53.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.406+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1942909817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fe0b402d7c0 con 0x7fe0b4100460 2024-09-05T12:55:53.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.769+0000 7fe09bfff640 1 -- 172.21.15.73:0/1942909817 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fe0a409c140 con 0x7fe0b4100460 2024-09-05T12:55:53.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1942909817 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe09c0a2b80 msgr2=0x7fe09c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe09c0a2b80 0x7fe09c0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8005d80 tx=0x7fe0a8005c90 comp rx=0 tx=0).stop 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1942909817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b4100460 msgr2=0x7fe0b41983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b4100460 0x7fe0b41983c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400c890 tx=0x7fe0a400cd50 comp rx=0 tx=0).stop 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1942909817 shutdown_connections 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe09c0a2b80 0x7fe09c0a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b4105590 0x7fe0b419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0b4100e10 0x7fe0b4198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 --2- 172.21.15.73:0/1942909817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b4100460 0x7fe0b41983c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1942909817 >> 172.21.15.73:0/1942909817 conn(0x7fe0b40fbee0 msgr2=0x7fe0b4104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.771+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1942909817 shutdown_connections 2024-09-05T12:55:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:53.772+0000 7fe0b92ca640 1 -- 172.21.15.73:0/1942909817 wait complete. 2024-09-05T12:55:54.054 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:53 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1942909817' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-05T12:55:54.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:53 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1942909817' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-05T12:55:54.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:53 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1942909817' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-05T12:55:54.495 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-05T12:55:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:55.038 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:54 smithi073 ceph-mon[30883]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-05T12:55:55.039 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:54 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1942909817' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-05T12:55:55.039 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:54 smithi073 ceph-mon[30883]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-05T12:55:55.039 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:54 smithi073 ceph-mon[30883]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:55.039 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:54 smithi073 ceph-mon[30883]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-05T12:55:55.039 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:54 smithi073 ceph-mon[30883]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-05T12:55:55.039 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:54 smithi073 ceph-mon[30883]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-05T12:55:55.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:54 smithi162 ceph-mon[34220]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-05T12:55:55.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:54 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1942909817' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-05T12:55:55.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:54 smithi162 ceph-mon[34220]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-05T12:55:55.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:54 smithi162 ceph-mon[34220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:55.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:54 smithi162 ceph-mon[34220]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-05T12:55:55.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:54 smithi162 ceph-mon[34220]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-05T12:55:55.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:54 smithi162 ceph-mon[34220]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-05T12:55:55.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:54 smithi169 ceph-mon[34823]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-05T12:55:55.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:54 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1942909817' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-05T12:55:55.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:54 smithi169 ceph-mon[34823]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-05T12:55:55.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:54 smithi169 ceph-mon[34823]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T12:55:55.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:54 smithi169 ceph-mon[34823]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-05T12:55:55.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:54 smithi169 ceph-mon[34823]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-05T12:55:55.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:54 smithi169 ceph-mon[34823]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-05T12:55:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.204+0000 7f97ab62d640 1 -- 172.21.15.73:0/1363094647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97a4101df0 msgr2=0x7f97a41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.204+0000 7f97ab62d640 1 --2- 172.21.15.73:0/1363094647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97a4101df0 0x7f97a41021d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009900 tx=0x7f97a002a410 comp rx=0 tx=0).stop 2024-09-05T12:55:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.204+0000 7f97ab62d640 1 -- 172.21.15.73:0/1363094647 shutdown_connections 2024-09-05T12:55:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.204+0000 7f97ab62d640 1 --2- 172.21.15.73:0/1363094647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a4106f20 0x7f97a410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.204+0000 7f97ab62d640 1 --2- 172.21.15.73:0/1363094647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97a41027a0 0x7f97a41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.204+0000 7f97ab62d640 1 --2- 172.21.15.73:0/1363094647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97a4101df0 0x7f97a41021d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.204+0000 7f97ab62d640 1 -- 172.21.15.73:0/1363094647 >> 172.21.15.73:0/1363094647 conn(0x7f97a40fd8b0 msgr2=0x7f97a40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.204+0000 7f97ab62d640 1 -- 172.21.15.73:0/1363094647 shutdown_connections 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.204+0000 7f97ab62d640 1 -- 172.21.15.73:0/1363094647 wait complete. 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.205+0000 7f97ab62d640 1 Processor -- start 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.205+0000 7f97ab62d640 1 -- start start 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.205+0000 7f97ab62d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a4101df0 0x7f97a41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.205+0000 7f97ab62d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97a41027a0 0x7f97a41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.205+0000 7f97ab62d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97a4106f20 0x7f97a419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.205+0000 7f97ab62d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4111fc0 con 0x7f97a4106f20 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.205+0000 7f97ab62d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4111e40 con 0x7f97a4101df0 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.205+0000 7f97ab62d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4112140 con 0x7f97a41027a0 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a9bca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97a4106f20 0x7f97a419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a9bca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97a4106f20 0x7f97a419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52324/0 (socket says 172.21.15.73:52324) 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a9bca640 1 -- 172.21.15.73:0/800381902 learned_addr learned my addr 172.21.15.73:0/800381902 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a8bc8640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97a41027a0 0x7f97a41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a93c9640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a4101df0 0x7f97a41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a9bca640 1 -- 172.21.15.73:0/800381902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97a41027a0 msgr2=0x7f97a41989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a9bca640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97a41027a0 0x7f97a41989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a9bca640 1 -- 172.21.15.73:0/800381902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a4101df0 msgr2=0x7f97a41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a9bca640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a4101df0 0x7f97a41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a9bca640 1 -- 172.21.15.73:0/800381902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a419d460 con 0x7f97a4106f20 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a93c9640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a4101df0 0x7f97a41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97a9bca640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97a4106f20 0x7f97a419cd80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f979c00b970 tx=0x7f979c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f979a7fc640 1 -- 172.21.15.73:0/800381902 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c019070 con 0x7f97a4106f20 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f979a7fc640 1 -- 172.21.15.73:0/800381902 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f979c00cb40 con 0x7f97a4106f20 2024-09-05T12:55:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97ab62d640 1 -- 172.21.15.73:0/800381902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a419d750 con 0x7f97a4106f20 2024-09-05T12:55:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f979a7fc640 1 -- 172.21.15.73:0/800381902 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c007650 con 0x7f97a4106f20 2024-09-05T12:55:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.206+0000 7f97ab62d640 1 -- 172.21.15.73:0/800381902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a41a5030 con 0x7f97a4106f20 2024-09-05T12:55:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.207+0000 7f97ab62d640 1 -- 172.21.15.73:0/800381902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a41021d0 con 0x7f97a4106f20 2024-09-05T12:55:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.208+0000 7f979a7fc640 1 -- 172.21.15.73:0/800381902 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f979c01c070 con 0x7f97a4106f20 2024-09-05T12:55:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.209+0000 7f979a7fc640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97900a2c00 0x7f97900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.209+0000 7f97a93c9640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97900a2c00 0x7f97900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.209+0000 7f979a7fc640 1 -- 172.21.15.73:0/800381902 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f979c0ce470 con 0x7f97a4106f20 2024-09-05T12:55:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.209+0000 7f97a93c9640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97900a2c00 0x7f97900a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97a0000c00 tx=0x7f97a0032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.213+0000 7f979a7fc640 1 -- 172.21.15.73:0/800381902 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f979c09aed0 con 0x7f97a4106f20 2024-09-05T12:55:55.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.416+0000 7f97ab62d640 1 -- 172.21.15.73:0/800381902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f97a402d7c0 con 0x7f97a4106f20 2024-09-05T12:55:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.788+0000 7f979a7fc640 1 -- 172.21.15.73:0/800381902 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f979c09f1d0 con 0x7f97a4106f20 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.791+0000 7f97ab62d640 1 -- 172.21.15.73:0/800381902 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97900a2c00 msgr2=0x7f97900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.791+0000 7f97ab62d640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97900a2c00 0x7f97900a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97a0000c00 tx=0x7f97a0032c70 comp rx=0 tx=0).stop 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.791+0000 7f97ab62d640 1 -- 172.21.15.73:0/800381902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97a4106f20 msgr2=0x7f97a419cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.791+0000 7f97ab62d640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97a4106f20 0x7f97a419cd80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f979c00b970 tx=0x7f979c00be30 comp rx=0 tx=0).stop 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.791+0000 7f97ab62d640 1 -- 172.21.15.73:0/800381902 shutdown_connections 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.791+0000 7f97ab62d640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97900a2c00 0x7f97900a50c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.791+0000 7f97ab62d640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97a4106f20 0x7f97a419cd80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.791+0000 7f97ab62d640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97a41027a0 0x7f97a41989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.791+0000 7f97ab62d640 1 --2- 172.21.15.73:0/800381902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a4101df0 0x7f97a41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.791+0000 7f97ab62d640 1 -- 172.21.15.73:0/800381902 >> 172.21.15.73:0/800381902 conn(0x7f97a40fd8b0 msgr2=0x7f97a40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.792+0000 7f97ab62d640 1 -- 172.21.15.73:0/800381902 shutdown_connections 2024-09-05T12:55:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:55.792+0000 7f97ab62d640 1 -- 172.21.15.73:0/800381902 wait complete. 2024-09-05T12:55:56.108 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:55 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] up:active 2024-09-05T12:55:56.108 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:55 smithi073 ceph-mon[30883]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-05T12:55:56.108 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:55 smithi073 ceph-mon[30883]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-05T12:55:56.108 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:55 smithi073 ceph-mon[30883]: Cluster is now healthy 2024-09-05T12:55:56.109 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:55 smithi073 ceph-mon[30883]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-05T12:55:56.109 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:55 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-05T12:55:56.109 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:55 smithi073 ceph-mon[30883]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-05T12:55:56.109 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:55 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/800381902' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-05T12:55:56.111 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:56 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b[64807]: 2024-09-05T12:55:55.999+0000 7f33b300d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-05T12:55:56.111 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 12:55:56 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b[64807]: 2024-09-05T12:55:55.999+0000 7f33b300d640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-05T12:55:56.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:55 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] up:active 2024-09-05T12:55:56.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:55 smithi162 ceph-mon[34220]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-05T12:55:56.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:55 smithi162 ceph-mon[34220]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-05T12:55:56.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:55 smithi162 ceph-mon[34220]: Cluster is now healthy 2024-09-05T12:55:56.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:55 smithi162 ceph-mon[34220]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-05T12:55:56.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:55 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-05T12:55:56.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:55 smithi162 ceph-mon[34220]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-05T12:55:56.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:55 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/800381902' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-05T12:55:56.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:55 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] up:active 2024-09-05T12:55:56.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:55 smithi169 ceph-mon[34823]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-05T12:55:56.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:55 smithi169 ceph-mon[34823]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-05T12:55:56.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:55 smithi169 ceph-mon[34823]: Cluster is now healthy 2024-09-05T12:55:56.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:55 smithi169 ceph-mon[34823]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-05T12:55:56.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:55 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-05T12:55:56.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:55 smithi169 ceph-mon[34823]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-05T12:55:56.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:55 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/800381902' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-05T12:55:56.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-05T12:55:56.685 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:57.096 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:56 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/800381902' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-05T12:55:57.096 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:56 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] up:active 2024-09-05T12:55:57.096 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:56 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-05T12:55:57.096 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:56 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:55:57.097 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:56 smithi073 ceph-mon[30883]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 8 op/s 2024-09-05T12:55:57.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:56 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/800381902' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-05T12:55:57.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:56 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] up:active 2024-09-05T12:55:57.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:56 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-05T12:55:57.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:56 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:55:57.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:56 smithi162 ceph-mon[34220]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 8 op/s 2024-09-05T12:55:57.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:56 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/800381902' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-05T12:55:57.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:56 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] up:active 2024-09-05T12:55:57.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:56 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-05T12:55:57.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:56 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:55:57.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:56 smithi169 ceph-mon[34823]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 8 op/s 2024-09-05T12:55:57.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.177+0000 7fe8594e4640 1 -- 172.21.15.73:0/3794265567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe854106f10 msgr2=0x7fe85410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:57.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.177+0000 7fe8594e4640 1 --2- 172.21.15.73:0/3794265567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe854106f10 0x7fe85410ea90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe84c009ca0 tx=0x7fe84c02a8c0 comp rx=0 tx=0).stop 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.177+0000 7fe8594e4640 1 -- 172.21.15.73:0/3794265567 shutdown_connections 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.177+0000 7fe8594e4640 1 --2- 172.21.15.73:0/3794265567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe854106f10 0x7fe85410ea90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.177+0000 7fe8594e4640 1 --2- 172.21.15.73:0/3794265567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe854102790 0x7fe8541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.177+0000 7fe8594e4640 1 --2- 172.21.15.73:0/3794265567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe854101de0 0x7fe8541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.177+0000 7fe8594e4640 1 -- 172.21.15.73:0/3794265567 >> 172.21.15.73:0/3794265567 conn(0x7fe8540fd8c0 msgr2=0x7fe8540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.177+0000 7fe8594e4640 1 -- 172.21.15.73:0/3794265567 shutdown_connections 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.177+0000 7fe8594e4640 1 -- 172.21.15.73:0/3794265567 wait complete. 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8594e4640 1 Processor -- start 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8594e4640 1 -- start start 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8594e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe854101de0 0x7fe8540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8594e4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe854102790 0x7fe854074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8594e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe854106f10 0x7fe854074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:57.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8594e4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe854111f90 con 0x7fe854102790 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8594e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe854111e10 con 0x7fe854106f10 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8594e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe854112110 con 0x7fe854101de0 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8527fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe854102790 0x7fe854074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8527fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe854102790 0x7fe854074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52336/0 (socket says 172.21.15.73:52336) 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8527fc640 1 -- 172.21.15.73:0/2163888093 learned_addr learned my addr 172.21.15.73:0/2163888093 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8537fe640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe854106f10 0x7fe854074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8527fc640 1 -- 172.21.15.73:0/2163888093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe854101de0 msgr2=0x7fe8540744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8527fc640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe854101de0 0x7fe8540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8527fc640 1 -- 172.21.15.73:0/2163888093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe854106f10 msgr2=0x7fe854074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8527fc640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe854106f10 0x7fe854074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8527fc640 1 -- 172.21.15.73:0/2163888093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8541a6870 con 0x7fe854102790 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.178+0000 7fe8527fc640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe854102790 0x7fe854074a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00b4a0 tx=0x7fe83c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.179+0000 7fe84bfff640 1 -- 172.21.15.73:0/2163888093 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c014070 con 0x7fe854102790 2024-09-05T12:55:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.179+0000 7fe84bfff640 1 -- 172.21.15.73:0/2163888093 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe83c010af0 con 0x7fe854102790 2024-09-05T12:55:57.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.179+0000 7fe8594e4640 1 -- 172.21.15.73:0/2163888093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8541a6b60 con 0x7fe854102790 2024-09-05T12:55:57.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.179+0000 7fe84bfff640 1 -- 172.21.15.73:0/2163888093 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c017d10 con 0x7fe854102790 2024-09-05T12:55:57.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.179+0000 7fe8594e4640 1 -- 172.21.15.73:0/2163888093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8541a7050 con 0x7fe854102790 2024-09-05T12:55:57.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.180+0000 7fe8594e4640 1 -- 172.21.15.73:0/2163888093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8541021c0 con 0x7fe854102790 2024-09-05T12:55:57.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.181+0000 7fe84bfff640 1 -- 172.21.15.73:0/2163888093 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe83c017070 con 0x7fe854102790 2024-09-05T12:55:57.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.181+0000 7fe84bfff640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8400a2b80 0x7fe8400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:57.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.182+0000 7fe852ffd640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8400a2b80 0x7fe8400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:57.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.182+0000 7fe84bfff640 1 -- 172.21.15.73:0/2163888093 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fe83c0ce780 con 0x7fe854102790 2024-09-05T12:55:57.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.182+0000 7fe852ffd640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8400a2b80 0x7fe8400a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe84400a990 tx=0x7fe844005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:57.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.185+0000 7fe84bfff640 1 -- 172.21.15.73:0/2163888093 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe83c09b830 con 0x7fe854102790 2024-09-05T12:55:57.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.387+0000 7fe8594e4640 1 -- 172.21.15.73:0/2163888093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe854075a20 con 0x7fe854102790 2024-09-05T12:55:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.803+0000 7fe84bfff640 1 -- 172.21.15.73:0/2163888093 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fe83c09b130 con 0x7fe854102790 2024-09-05T12:55:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 -- 172.21.15.73:0/2163888093 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8400a2b80 msgr2=0x7fe8400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8400a2b80 0x7fe8400a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe84400a990 tx=0x7fe844005c70 comp rx=0 tx=0).stop 2024-09-05T12:55:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 -- 172.21.15.73:0/2163888093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe854102790 msgr2=0x7fe854074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe854102790 0x7fe854074a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00b4a0 tx=0x7fe83c00b960 comp rx=0 tx=0).stop 2024-09-05T12:55:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 -- 172.21.15.73:0/2163888093 shutdown_connections 2024-09-05T12:55:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8400a2b80 0x7fe8400a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe854106f10 0x7fe854074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:57.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe854102790 0x7fe854074a30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:57.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 --2- 172.21.15.73:0/2163888093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe854101de0 0x7fe8540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:57.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 -- 172.21.15.73:0/2163888093 >> 172.21.15.73:0/2163888093 conn(0x7fe8540fd8c0 msgr2=0x7fe8540febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:57.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 -- 172.21.15.73:0/2163888093 shutdown_connections 2024-09-05T12:55:57.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:57.806+0000 7fe8594e4640 1 -- 172.21.15.73:0/2163888093 wait complete. 2024-09-05T12:55:58.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:57 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2163888093' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T12:55:58.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:57 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2163888093' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T12:55:58.176 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:57 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2163888093' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T12:55:58.511 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-05T12:55:58.511 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-05T12:55:58.760 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:55:59.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:58 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2163888093' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-05T12:55:59.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:58 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:55:59.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:55:58 smithi162 ceph-mon[34220]: pgmap v275: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-05T12:55:59.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:58 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2163888093' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-05T12:55:59.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:58 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:55:59.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:55:58 smithi169 ceph-mon[34823]: pgmap v275: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-05T12:55:59.156 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:58 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2163888093' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-05T12:55:59.156 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:58 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:55:59.156 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:55:58 smithi073 ceph-mon[30883]: pgmap v275: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-05T12:55:59.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.237+0000 7f6899eff640 1 -- 172.21.15.73:0/225133788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6894100a80 msgr2=0x7f6894100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:59.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.237+0000 7f6899eff640 1 --2- 172.21.15.73:0/225133788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6894100a80 0x7f6894100ee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6888009930 tx=0x7f688802a420 comp rx=0 tx=0).stop 2024-09-05T12:55:59.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.237+0000 7f6899eff640 1 -- 172.21.15.73:0/225133788 shutdown_connections 2024-09-05T12:55:59.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.237+0000 7f6899eff640 1 --2- 172.21.15.73:0/225133788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6894101420 0x7f689410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:59.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.237+0000 7f6899eff640 1 --2- 172.21.15.73:0/225133788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6894100a80 0x7f6894100ee0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:59.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.237+0000 7f6899eff640 1 --2- 172.21.15.73:0/225133788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6894106a80 0x7f6894106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:59.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.237+0000 7f6899eff640 1 -- 172.21.15.73:0/225133788 >> 172.21.15.73:0/225133788 conn(0x7f68940fc7a0 msgr2=0x7f68940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:59.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.237+0000 7f6899eff640 1 -- 172.21.15.73:0/225133788 shutdown_connections 2024-09-05T12:55:59.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.237+0000 7f6899eff640 1 -- 172.21.15.73:0/225133788 wait complete. 2024-09-05T12:55:59.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.237+0000 7f6899eff640 1 Processor -- start 2024-09-05T12:55:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6899eff640 1 -- start start 2024-09-05T12:55:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6899eff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6894100a80 0x7f6894199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6899eff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6894101420 0x7f6894199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6899eff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6894106a80 0x7f68941a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6899eff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6894110e80 con 0x7f6894101420 2024-09-05T12:55:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6899eff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6894110d00 con 0x7f6894106a80 2024-09-05T12:55:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6899eff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6894111000 con 0x7f6894100a80 2024-09-05T12:55:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6892ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6894101420 0x7f6894199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6892ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6894101420 0x7f6894199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52358/0 (socket says 172.21.15.73:52358) 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6892ffd640 1 -- 172.21.15.73:0/1900729998 learned_addr learned my addr 172.21.15.73:0/1900729998 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f68937fe640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6894100a80 0x7f6894199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6893fff640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6894106a80 0x7f68941a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6892ffd640 1 -- 172.21.15.73:0/1900729998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6894100a80 msgr2=0x7f6894199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6892ffd640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6894100a80 0x7f6894199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6892ffd640 1 -- 172.21.15.73:0/1900729998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6894106a80 msgr2=0x7f68941a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6892ffd640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6894106a80 0x7f68941a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6892ffd640 1 -- 172.21.15.73:0/1900729998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68941a48f0 con 0x7f6894101420 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.238+0000 7f6893fff640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6894106a80 0x7f68941a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.239+0000 7f6892ffd640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6894101420 0x7f6894199870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6888009230 tx=0x7f6888004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.239+0000 7f6890ff9640 1 -- 172.21.15.73:0/1900729998 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688803f030 con 0x7f6894101420 2024-09-05T12:55:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.239+0000 7f6890ff9640 1 -- 172.21.15.73:0/1900729998 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6888003ad0 con 0x7f6894101420 2024-09-05T12:55:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.239+0000 7f6890ff9640 1 -- 172.21.15.73:0/1900729998 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888035070 con 0x7f6894101420 2024-09-05T12:55:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.239+0000 7f6899eff640 1 -- 172.21.15.73:0/1900729998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68941a4ac0 con 0x7f6894101420 2024-09-05T12:55:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.239+0000 7f6899eff640 1 -- 172.21.15.73:0/1900729998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68941a4f10 con 0x7f6894101420 2024-09-05T12:55:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.240+0000 7f6899eff640 1 -- 172.21.15.73:0/1900729998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6894100ee0 con 0x7f6894101420 2024-09-05T12:55:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.241+0000 7f6890ff9640 1 -- 172.21.15.73:0/1900729998 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6888042030 con 0x7f6894101420 2024-09-05T12:55:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.241+0000 7f6890ff9640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f687c0a2b80 0x7f687c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:55:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.241+0000 7f68937fe640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f687c0a2b80 0x7f687c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:55:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.242+0000 7f6890ff9640 1 -- 172.21.15.73:0/1900729998 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f68880ef3e0 con 0x7f6894101420 2024-09-05T12:55:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.242+0000 7f68937fe640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f687c0a2b80 0x7f687c0a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6884005fd0 tx=0x7f688400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:55:59.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.245+0000 7f6890ff9640 1 -- 172.21.15.73:0/1900729998 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68880bc490 con 0x7f6894101420 2024-09-05T12:55:59.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.436+0000 7f6899eff640 1 -- 172.21.15.73:0/1900729998 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6894062630 con 0x7f687c0a2b80 2024-09-05T12:55:59.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.460+0000 7f6890ff9640 1 -- 172.21.15.73:0/1900729998 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6894062630 con 0x7f687c0a2b80 2024-09-05T12:55:59.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 -- 172.21.15.73:0/1900729998 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f687c0a2b80 msgr2=0x7f687c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f687c0a2b80 0x7f687c0a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6884005fd0 tx=0x7f688400b390 comp rx=0 tx=0).stop 2024-09-05T12:55:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 -- 172.21.15.73:0/1900729998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6894101420 msgr2=0x7f6894199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:55:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6894101420 0x7f6894199870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6888009230 tx=0x7f6888004270 comp rx=0 tx=0).stop 2024-09-05T12:55:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 -- 172.21.15.73:0/1900729998 shutdown_connections 2024-09-05T12:55:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f687c0a2b80 0x7f687c0a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6894106a80 0x7f68941a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6894101420 0x7f6894199870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 --2- 172.21.15.73:0/1900729998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6894100a80 0x7f6894199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:55:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 -- 172.21.15.73:0/1900729998 >> 172.21.15.73:0/1900729998 conn(0x7f68940fc7a0 msgr2=0x7f68940fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:55:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 -- 172.21.15.73:0/1900729998 shutdown_connections 2024-09-05T12:55:59.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:55:59.462+0000 7f6899eff640 1 -- 172.21.15.73:0/1900729998 wait complete. 2024-09-05T12:55:59.763 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:55:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:55:59.440+0000 7f3369448640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T12:55:59.764 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:55:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:55:59.440+0000 7f3369448640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T12:55:59.764 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:55:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:55:59.440+0000 7f3369448640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T12:55:59.764 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:55:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:55:59.440+0000 7f3369448640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T12:55:59.764 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 12:55:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T12:55:59.440+0000 7f3369448640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T12:56:00.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-05T12:56:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.872+0000 7f73ebc32640 1 -- 172.21.15.73:0/2566873177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73e4106a80 msgr2=0x7f73e4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.872+0000 7f73ebc32640 1 --2- 172.21.15.73:0/2566873177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73e4106a80 0x7f73e4106e60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009930 tx=0x7f73e002a420 comp rx=0 tx=0).stop 2024-09-05T12:56:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.872+0000 7f73ebc32640 1 -- 172.21.15.73:0/2566873177 shutdown_connections 2024-09-05T12:56:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.872+0000 7f73ebc32640 1 --2- 172.21.15.73:0/2566873177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e4101420 0x7f73e410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.872+0000 7f73ebc32640 1 --2- 172.21.15.73:0/2566873177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73e4100a80 0x7f73e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.872+0000 7f73ebc32640 1 --2- 172.21.15.73:0/2566873177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73e4106a80 0x7f73e4106e60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.872+0000 7f73ebc32640 1 -- 172.21.15.73:0/2566873177 >> 172.21.15.73:0/2566873177 conn(0x7f73e40fc7a0 msgr2=0x7f73e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.872+0000 7f73ebc32640 1 -- 172.21.15.73:0/2566873177 shutdown_connections 2024-09-05T12:56:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.872+0000 7f73ebc32640 1 -- 172.21.15.73:0/2566873177 wait complete. 2024-09-05T12:56:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73ebc32640 1 Processor -- start 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73ebc32640 1 -- start start 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73ebc32640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73e4100a80 0x7f73e41992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73ebc32640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73e4101420 0x7f73e4199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73ebc32640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e4106a80 0x7f73e41a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73ebc32640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f73e4110e80 con 0x7f73e4100a80 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73ebc32640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73e4110d00 con 0x7f73e4106a80 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73ebc32640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f73e4111000 con 0x7f73e4101420 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73e99ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73e4100a80 0x7f73e41992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73e99ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73e4100a80 0x7f73e41992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52396/0 (socket says 172.21.15.73:52396) 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73e99ce640 1 -- 172.21.15.73:0/1351228948 learned_addr learned my addr 172.21.15.73:0/1351228948 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73e91cd640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73e4101420 0x7f73e4199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73ea1cf640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e4106a80 0x7f73e41a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73e99ce640 1 -- 172.21.15.73:0/1351228948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73e4101420 msgr2=0x7f73e4199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73e99ce640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73e4101420 0x7f73e4199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73e99ce640 1 -- 172.21.15.73:0/1351228948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e4106a80 msgr2=0x7f73e41a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73e99ce640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e4106a80 0x7f73e41a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73e99ce640 1 -- 172.21.15.73:0/1351228948 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e41a4890 con 0x7f73e4100a80 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.873+0000 7f73e99ce640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73e4100a80 0x7f73e41992d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009a50 tx=0x7f73e0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.874+0000 7f73daffd640 1 -- 172.21.15.73:0/1351228948 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e003f030 con 0x7f73e4100a80 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.874+0000 7f73ebc32640 1 -- 172.21.15.73:0/1351228948 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e41a4a60 con 0x7f73e4100a80 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.874+0000 7f73daffd640 1 -- 172.21.15.73:0/1351228948 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73e0003ce0 con 0x7f73e4100a80 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.874+0000 7f73daffd640 1 -- 172.21.15.73:0/1351228948 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e0035070 con 0x7f73e4100a80 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.874+0000 7f73ebc32640 1 -- 172.21.15.73:0/1351228948 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e41a4ec0 con 0x7f73e4100a80 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.875+0000 7f73ebc32640 1 -- 172.21.15.73:0/1351228948 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e4100ee0 con 0x7f73e4100a80 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.876+0000 7f73daffd640 1 -- 172.21.15.73:0/1351228948 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f73e0042030 con 0x7f73e4100a80 2024-09-05T12:56:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.876+0000 7f73daffd640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f73d00a2b80 0x7f73d00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:00.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.877+0000 7f73e91cd640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f73d00a2b80 0x7f73d00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:00.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.877+0000 7f73daffd640 1 -- 172.21.15.73:0/1351228948 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f73e00ef8e0 con 0x7f73e4100a80 2024-09-05T12:56:00.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.877+0000 7f73e91cd640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f73d00a2b80 0x7f73d00a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f73e406b300 tx=0x7f73d400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:00.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:00.880+0000 7f73daffd640 1 -- 172.21.15.73:0/1351228948 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73e00bc990 con 0x7f73e4100a80 2024-09-05T12:56:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.040+0000 7f73daffd640 1 -- 172.21.15.73:0/1351228948 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f73e003bd00 con 0x7f73e4100a80 2024-09-05T12:56:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.076+0000 7f73ebc32640 1 -- 172.21.15.73:0/1351228948 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f73e4109060 con 0x7f73d00a2b80 2024-09-05T12:56:01.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.098+0000 7f73daffd640 1 -- 172.21.15.73:0/1351228948 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f73d400fb30 con 0x7f73d00a2b80 2024-09-05T12:56:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.099+0000 7f73ebc32640 1 -- 172.21.15.73:0/1351228948 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f73d00a2b80 msgr2=0x7f73d00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f73d00a2b80 0x7f73d00a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f73e406b300 tx=0x7f73d400a250 comp rx=0 tx=0).stop 2024-09-05T12:56:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 -- 172.21.15.73:0/1351228948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73e4100a80 msgr2=0x7f73e41992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73e4100a80 0x7f73e41992d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009a50 tx=0x7f73e0004270 comp rx=0 tx=0).stop 2024-09-05T12:56:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 -- 172.21.15.73:0/1351228948 shutdown_connections 2024-09-05T12:56:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f73d00a2b80 0x7f73d00a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e4106a80 0x7f73e41a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73e4101420 0x7f73e4199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 --2- 172.21.15.73:0/1351228948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73e4100a80 0x7f73e41992d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 -- 172.21.15.73:0/1351228948 >> 172.21.15.73:0/1351228948 conn(0x7f73e40fc7a0 msgr2=0x7f73e40fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 -- 172.21.15.73:0/1351228948 shutdown_connections 2024-09-05T12:56:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:01.100+0000 7f73ebc32640 1 -- 172.21.15.73:0/1351228948 wait complete. 2024-09-05T12:56:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:01 smithi162 ceph-mon[34220]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:01 smithi162 ceph-mon[34220]: pgmap v276: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-09-05T12:56:01.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:01 smithi169 ceph-mon[34823]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:01.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:01 smithi169 ceph-mon[34823]: pgmap v276: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-09-05T12:56:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:01 smithi073 ceph-mon[30883]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:01 smithi073 ceph-mon[30883]: pgmap v276: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-09-05T12:56:01.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-05T12:56:02.069 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:02.306 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:02 smithi073 ceph-mon[30883]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-05T12:56:02.306 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:02 smithi073 ceph-mon[30883]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:02.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:02 smithi162 ceph-mon[34220]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-05T12:56:02.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:02 smithi162 ceph-mon[34220]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:02.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:02 smithi169 ceph-mon[34823]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-05T12:56:02.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:02 smithi169 ceph-mon[34823]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:02.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 -- 172.21.15.73:0/2647096660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7174106f10 msgr2=0x7f717410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:02.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 --2- 172.21.15.73:0/2647096660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7174106f10 0x7f717410ea90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f716c009ca0 tx=0x7f716c02a8c0 comp rx=0 tx=0).stop 2024-09-05T12:56:02.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 -- 172.21.15.73:0/2647096660 shutdown_connections 2024-09-05T12:56:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 --2- 172.21.15.73:0/2647096660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7174106f10 0x7f717410ea90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 --2- 172.21.15.73:0/2647096660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7174102790 0x7f71741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 --2- 172.21.15.73:0/2647096660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7174101de0 0x7f71741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 -- 172.21.15.73:0/2647096660 >> 172.21.15.73:0/2647096660 conn(0x7f71740fd8c0 msgr2=0x7f71740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 -- 172.21.15.73:0/2647096660 shutdown_connections 2024-09-05T12:56:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 -- 172.21.15.73:0/2647096660 wait complete. 2024-09-05T12:56:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 Processor -- start 2024-09-05T12:56:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.515+0000 7f717aee2640 1 -- start start 2024-09-05T12:56:02.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f717aee2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7174101de0 0x7f7174198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:02.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f717aee2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7174102790 0x7f7174198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:02.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f717aee2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7174106f10 0x7f717419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:02.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f717aee2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7174112010 con 0x7f7174101de0 2024-09-05T12:56:02.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f717aee2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7174111e90 con 0x7f7174102790 2024-09-05T12:56:02.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f717aee2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7174112190 con 0x7f7174106f10 2024-09-05T12:56:02.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7178c7e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7174101de0 0x7f7174198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:02.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7178c7e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7174101de0 0x7f7174198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52412/0 (socket says 172.21.15.73:52412) 2024-09-05T12:56:02.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7178c7e640 1 -- 172.21.15.73:0/1274386505 learned_addr learned my addr 172.21.15.73:0/1274386505 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:02.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7173fff640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7174102790 0x7f7174198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7178c7e640 1 -- 172.21.15.73:0/1274386505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7174106f10 msgr2=0x7f717419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7178c7e640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7174106f10 0x7f717419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7178c7e640 1 -- 172.21.15.73:0/1274386505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7174102790 msgr2=0x7f7174198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7178c7e640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7174102790 0x7f7174198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7178c7e640 1 -- 172.21.15.73:0/1274386505 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717419d4f0 con 0x7f7174101de0 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7173fff640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7174102790 0x7f7174198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7178c7e640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7174101de0 0x7f7174198540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f716800b4a0 tx=0x7f716800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7171ffb640 1 -- 172.21.15.73:0/1274386505 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168014070 con 0x7f7174101de0 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7171ffb640 1 -- 172.21.15.73:0/1274386505 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7168010af0 con 0x7f7174101de0 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f717aee2640 1 -- 172.21.15.73:0/1274386505 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717419d7e0 con 0x7f7174101de0 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.516+0000 7f7171ffb640 1 -- 172.21.15.73:0/1274386505 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168017d10 con 0x7f7174101de0 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.517+0000 7f717aee2640 1 -- 172.21.15.73:0/1274386505 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71741a50c0 con 0x7f7174101de0 2024-09-05T12:56:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.518+0000 7f717aee2640 1 -- 172.21.15.73:0/1274386505 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7174102240 con 0x7f7174101de0 2024-09-05T12:56:02.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.518+0000 7f7171ffb640 1 -- 172.21.15.73:0/1274386505 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7168017070 con 0x7f7174101de0 2024-09-05T12:56:02.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.519+0000 7f7171ffb640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71640a2c90 0x7f71640a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:02.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.519+0000 7f7173fff640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71640a2c90 0x7f71640a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:02.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.519+0000 7f7171ffb640 1 -- 172.21.15.73:0/1274386505 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f71680ce2b0 con 0x7f7174101de0 2024-09-05T12:56:02.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.520+0000 7f7173fff640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71640a2c90 0x7f71640a5150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7160006fd0 tx=0x7f7160008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:02.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.523+0000 7f7171ffb640 1 -- 172.21.15.73:0/1274386505 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f716809b370 con 0x7f7174101de0 2024-09-05T12:56:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.715+0000 7f717aee2640 1 -- 172.21.15.73:0/1274386505 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f7174062630 con 0x7f71640a2c90 2024-09-05T12:56:02.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.721+0000 7f7171ffb640 1 -- 172.21.15.73:0/1274386505 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7174062630 con 0x7f71640a2c90 2024-09-05T12:56:02.722 INFO:teuthology.orchestra.run.smithi073.stdout:/volumes/qa/sv_0/0d14c914-af03-4d7a-a922-2ca6b5f07201 2024-09-05T12:56:02.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 -- 172.21.15.73:0/1274386505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71640a2c90 msgr2=0x7f71640a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:02.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71640a2c90 0x7f71640a5150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7160006fd0 tx=0x7f7160008040 comp rx=0 tx=0).stop 2024-09-05T12:56:02.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 -- 172.21.15.73:0/1274386505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7174101de0 msgr2=0x7f7174198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:02.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7174101de0 0x7f7174198540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f716800b4a0 tx=0x7f716800b960 comp rx=0 tx=0).stop 2024-09-05T12:56:02.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 -- 172.21.15.73:0/1274386505 shutdown_connections 2024-09-05T12:56:02.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71640a2c90 0x7f71640a5150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:02.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7174106f10 0x7f717419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:02.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7174102790 0x7f7174198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:02.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 --2- 172.21.15.73:0/1274386505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7174101de0 0x7f7174198540 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:02.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 -- 172.21.15.73:0/1274386505 >> 172.21.15.73:0/1274386505 conn(0x7f71740fd8c0 msgr2=0x7f71740febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:02.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 -- 172.21.15.73:0/1274386505 shutdown_connections 2024-09-05T12:56:02.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:02.723+0000 7f717aee2640 1 -- 172.21.15.73:0/1274386505 wait complete. 2024-09-05T12:56:03.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:03 smithi162 ceph-mon[34220]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-05T12:56:03.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:03 smithi169 ceph-mon[34823]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-05T12:56:03.443 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:03 smithi073 ceph-mon[30883]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-05T12:56:03.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-05T12:56:03.717 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:04.111 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:04 smithi073 ceph-mon[30883]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:04.111 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-05T12:56:04.111 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-05T12:56:04.111 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-09-05T12:56:04.111 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-05T12:56:04.111 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-09-05T12:56:04.112 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-05T12:56:04.112 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:04 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.196+0000 7fd2603af640 1 -- 172.21.15.73:0/695382494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd258102d40 msgr2=0x7fd258103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.196+0000 7fd2603af640 1 --2- 172.21.15.73:0/695382494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd258102d40 0x7fd258103120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd254009900 tx=0x7fd25402a480 comp rx=0 tx=0).stop 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.196+0000 7fd2603af640 1 -- 172.21.15.73:0/695382494 shutdown_connections 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.196+0000 7fd2603af640 1 --2- 172.21.15.73:0/695382494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd25810c170 0x7fd25810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.196+0000 7fd2603af640 1 --2- 172.21.15.73:0/695382494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd258103660 0x7fd25810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.196+0000 7fd2603af640 1 --2- 172.21.15.73:0/695382494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd258102d40 0x7fd258103120 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.196+0000 7fd2603af640 1 -- 172.21.15.73:0/695382494 >> 172.21.15.73:0/695382494 conn(0x7fd2580fc7a0 msgr2=0x7fd2580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.196+0000 7fd2603af640 1 -- 172.21.15.73:0/695382494 shutdown_connections 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.196+0000 7fd2603af640 1 -- 172.21.15.73:0/695382494 wait complete. 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd2603af640 1 Processor -- start 2024-09-05T12:56:04.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd2603af640 1 -- start start 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd2603af640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd258102d40 0x7fd2581009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd2603af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd258103660 0x7fd258100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd2603af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd25810c170 0x7fd258101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd2603af640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd258111fd0 con 0x7fd258102d40 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd2603af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd258111e50 con 0x7fd25810c170 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd2603af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd258112150 con 0x7fd258103660 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd25e14b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd258102d40 0x7fd2581009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd25e14b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd258102d40 0x7fd2581009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41816/0 (socket says 172.21.15.73:41816) 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd25e14b640 1 -- 172.21.15.73:0/3971086509 learned_addr learned my addr 172.21.15.73:0/3971086509 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.197+0000 7fd25d94a640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd258103660 0x7fd258100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd25e94c640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd25810c170 0x7fd258101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd25e14b640 1 -- 172.21.15.73:0/3971086509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd258103660 msgr2=0x7fd258100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd25e14b640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd258103660 0x7fd258100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd25e14b640 1 -- 172.21.15.73:0/3971086509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd25810c170 msgr2=0x7fd258101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd25e14b640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd25810c170 0x7fd258101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd25e14b640 1 -- 172.21.15.73:0/3971086509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2581a6970 con 0x7fd258102d40 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd25e94c640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd25810c170 0x7fd258101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd25e14b640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd258102d40 0x7fd2581009a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd254006010 tx=0x7fd2540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd24f7fe640 1 -- 172.21.15.73:0/3971086509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25403f030 con 0x7fd258102d40 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd2603af640 1 -- 172.21.15.73:0/3971086509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2581a6c00 con 0x7fd258102d40 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd24f7fe640 1 -- 172.21.15.73:0/3971086509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd254003ce0 con 0x7fd258102d40 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd24f7fe640 1 -- 172.21.15.73:0/3971086509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254035070 con 0x7fd258102d40 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.198+0000 7fd2603af640 1 -- 172.21.15.73:0/3971086509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2581a70e0 con 0x7fd258102d40 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.199+0000 7fd2603af640 1 -- 172.21.15.73:0/3971086509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd258103120 con 0x7fd258102d40 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.200+0000 7fd24f7fe640 1 -- 172.21.15.73:0/3971086509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd254042030 con 0x7fd258102d40 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.201+0000 7fd24f7fe640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd2440a2c10 0x7fd2440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.201+0000 7fd25d94a640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd2440a2c10 0x7fd2440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:04.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.201+0000 7fd24f7fe640 1 -- 172.21.15.73:0/3971086509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8182+0+0 (secure 0 0 0) 0x7fd2540efa00 con 0x7fd258102d40 2024-09-05T12:56:04.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.201+0000 7fd25d94a640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd2440a2c10 0x7fd2440a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd258102430 tx=0x7fd24800b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:04.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.204+0000 7fd24f7fe640 1 -- 172.21.15.73:0/3971086509 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd2540bc8f0 con 0x7fd258102d40 2024-09-05T12:56:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:04 smithi162 ceph-mon[34220]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-05T12:56:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-05T12:56:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-09-05T12:56:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-05T12:56:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-09-05T12:56:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-05T12:56:04.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:04 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-05T12:56:04.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:04 smithi169 ceph-mon[34823]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:04.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-05T12:56:04.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-05T12:56:04.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-09-05T12:56:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-05T12:56:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-09-05T12:56:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-05T12:56:04.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:04 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-05T12:56:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.395+0000 7fd2603af640 1 -- 172.21.15.73:0/3971086509 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd258062630 con 0x7fd2440a2c10 2024-09-05T12:56:04.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.422+0000 7fd24f7fe640 1 -- 172.21.15.73:0/3971086509 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd258062630 con 0x7fd2440a2c10 2024-09-05T12:56:04.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 -- 172.21.15.73:0/3971086509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd2440a2c10 msgr2=0x7fd2440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:04.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd2440a2c10 0x7fd2440a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd258102430 tx=0x7fd24800b2e0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 -- 172.21.15.73:0/3971086509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd258102d40 msgr2=0x7fd2581009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:04.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd258102d40 0x7fd2581009a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd254006010 tx=0x7fd2540042f0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 -- 172.21.15.73:0/3971086509 shutdown_connections 2024-09-05T12:56:04.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd2440a2c10 0x7fd2440a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd25810c170 0x7fd258101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd258103660 0x7fd258100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 --2- 172.21.15.73:0/3971086509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd258102d40 0x7fd2581009a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:04.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 -- 172.21.15.73:0/3971086509 >> 172.21.15.73:0/3971086509 conn(0x7fd2580fc7a0 msgr2=0x7fd2580fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:04.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 -- 172.21.15.73:0/3971086509 shutdown_connections 2024-09-05T12:56:04.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:04.424+0000 7fd2603af640 1 -- 172.21.15.73:0/3971086509 wait complete. 2024-09-05T12:56:05.110 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-05T12:56:05.354 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:05 smithi162 ceph-mon[34220]: pgmap v278: 97 pgs: 97 active+clean; 602 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2024-09-05T12:56:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:05 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-05T12:56:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:05 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-05T12:56:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:05 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-05T12:56:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:05 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-05T12:56:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:05 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-09-05T12:56:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:05 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-05T12:56:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:05 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-05T12:56:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:05 smithi162 ceph-mon[34220]: osdmap e79: 12 total, 12 up, 12 in 2024-09-05T12:56:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:05 smithi169 ceph-mon[34823]: pgmap v278: 97 pgs: 97 active+clean; 602 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2024-09-05T12:56:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:05 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-05T12:56:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:05 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-05T12:56:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:05 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-05T12:56:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:05 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-05T12:56:05.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:05 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-09-05T12:56:05.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:05 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-05T12:56:05.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:05 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-05T12:56:05.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:05 smithi169 ceph-mon[34823]: osdmap e79: 12 total, 12 up, 12 in 2024-09-05T12:56:05.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:05 smithi073 ceph-mon[30883]: pgmap v278: 97 pgs: 97 active+clean; 602 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2024-09-05T12:56:05.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:05 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-05T12:56:05.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:05 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-05T12:56:05.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:05 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-05T12:56:05.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:05 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-05T12:56:05.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:05 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-09-05T12:56:05.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:05 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-05T12:56:05.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:05 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-05T12:56:05.476 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:05 smithi073 ceph-mon[30883]: osdmap e79: 12 total, 12 up, 12 in 2024-09-05T12:56:05.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.835+0000 7f2514866640 1 -- 172.21.15.73:0/2197965022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25101082a0 msgr2=0x7f251010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:05.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.835+0000 7f2514866640 1 --2- 172.21.15.73:0/2197965022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25101082a0 0x7f251010ec40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2508009cd0 tx=0x7f250802a910 comp rx=0 tx=0).stop 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.836+0000 7f2514866640 1 -- 172.21.15.73:0/2197965022 shutdown_connections 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.836+0000 7f2514866640 1 --2- 172.21.15.73:0/2197965022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25101082a0 0x7f251010ec40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.836+0000 7f2514866640 1 --2- 172.21.15.73:0/2197965022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25101036e0 0x7f2510107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.836+0000 7f2514866640 1 --2- 172.21.15.73:0/2197965022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2510102d30 0x7f2510103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.836+0000 7f2514866640 1 -- 172.21.15.73:0/2197965022 >> 172.21.15.73:0/2197965022 conn(0x7f25100fc7d0 msgr2=0x7f25100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.836+0000 7f2514866640 1 -- 172.21.15.73:0/2197965022 shutdown_connections 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.836+0000 7f2514866640 1 -- 172.21.15.73:0/2197965022 wait complete. 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.836+0000 7f2514866640 1 Processor -- start 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.836+0000 7f2514866640 1 -- start start 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f2514866640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2510102d30 0x7f25101986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f2514866640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25101036e0 0x7f2510198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f2514866640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25101082a0 0x7f251019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f2514866640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2510112160 con 0x7f2510102d30 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f2514866640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2510111fe0 con 0x7f25101036e0 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f2514866640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f25101122e0 con 0x7f25101082a0 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2510102d30 0x7f25101986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2510102d30 0x7f25101986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41836/0 (socket says 172.21.15.73:41836) 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250e59c640 1 -- 172.21.15.73:0/617709641 learned_addr learned my addr 172.21.15.73:0/617709641 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250e59c640 1 -- 172.21.15.73:0/617709641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25101082a0 msgr2=0x7f251019cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250dd9b640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25101036e0 0x7f2510198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250e59c640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25101082a0 0x7f251019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250e59c640 1 -- 172.21.15.73:0/617709641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25101036e0 msgr2=0x7f2510198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:05.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250e59c640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25101036e0 0x7f2510198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250e59c640 1 -- 172.21.15.73:0/617709641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251019d670 con 0x7f2510102d30 2024-09-05T12:56:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250dd9b640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25101036e0 0x7f2510198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f250e59c640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2510102d30 0x7f25101986c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f250000b4a0 tx=0x7f250000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f24ff7fe640 1 -- 172.21.15.73:0/617709641 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500014070 con 0x7f2510102d30 2024-09-05T12:56:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f24ff7fe640 1 -- 172.21.15.73:0/617709641 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2500010af0 con 0x7f2510102d30 2024-09-05T12:56:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f2514866640 1 -- 172.21.15.73:0/617709641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f251019d960 con 0x7f2510102d30 2024-09-05T12:56:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f24ff7fe640 1 -- 172.21.15.73:0/617709641 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500017d10 con 0x7f2510102d30 2024-09-05T12:56:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.837+0000 7f2514866640 1 -- 172.21.15.73:0/617709641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25101a5240 con 0x7f2510102d30 2024-09-05T12:56:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.838+0000 7f2514866640 1 -- 172.21.15.73:0/617709641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f251006a850 con 0x7f2510102d30 2024-09-05T12:56:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.839+0000 7f24ff7fe640 1 -- 172.21.15.73:0/617709641 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2500017070 con 0x7f2510102d30 2024-09-05T12:56:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.840+0000 7f24ff7fe640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f80a2c90 0x7f24f80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.840+0000 7f250dd9b640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f80a2c90 0x7f24f80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.840+0000 7f24ff7fe640 1 -- 172.21.15.73:0/617709641 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f25000ce4a0 con 0x7f2510102d30 2024-09-05T12:56:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.840+0000 7f250dd9b640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f80a2c90 0x7f24f80a5150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2504006fd0 tx=0x7f2504008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:05.844+0000 7f24ff7fe640 1 -- 172.21.15.73:0/617709641 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f250009b3e0 con 0x7f2510102d30 2024-09-05T12:56:06.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.037+0000 7f2514866640 1 -- 172.21.15.73:0/617709641 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f2510062630 con 0x7f24f80a2c90 2024-09-05T12:56:06.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.041+0000 7f24ff7fe640 1 -- 172.21.15.73:0/617709641 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2510062630 con 0x7f24f80a2c90 2024-09-05T12:56:06.043 INFO:teuthology.orchestra.run.smithi073.stdout:/volumes/qa/sv_1/6289379c-c20e-487a-9bfc-7bd76e17979c 2024-09-05T12:56:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.043+0000 7f2514866640 1 -- 172.21.15.73:0/617709641 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f80a2c90 msgr2=0x7f24f80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.043+0000 7f2514866640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f80a2c90 0x7f24f80a5150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2504006fd0 tx=0x7f2504008040 comp rx=0 tx=0).stop 2024-09-05T12:56:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.043+0000 7f2514866640 1 -- 172.21.15.73:0/617709641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2510102d30 msgr2=0x7f25101986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.043+0000 7f2514866640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2510102d30 0x7f25101986c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f250000b4a0 tx=0x7f250000b960 comp rx=0 tx=0).stop 2024-09-05T12:56:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.043+0000 7f2514866640 1 -- 172.21.15.73:0/617709641 shutdown_connections 2024-09-05T12:56:06.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.043+0000 7f2514866640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f24f80a2c90 0x7f24f80a5150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.043+0000 7f2514866640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25101082a0 0x7f251019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.043+0000 7f2514866640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25101036e0 0x7f2510198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.043+0000 7f2514866640 1 --2- 172.21.15.73:0/617709641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2510102d30 0x7f25101986c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.043+0000 7f2514866640 1 -- 172.21.15.73:0/617709641 >> 172.21.15.73:0/617709641 conn(0x7f25100fc7d0 msgr2=0x7f2510105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.044+0000 7f2514866640 1 -- 172.21.15.73:0/617709641 shutdown_connections 2024-09-05T12:56:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:06.044+0000 7f2514866640 1 -- 172.21.15.73:0/617709641 wait complete. 2024-09-05T12:56:06.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:06 smithi162 ceph-mon[34220]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:06.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:06 smithi162 ceph-mon[34220]: osdmap e80: 12 total, 12 up, 12 in 2024-09-05T12:56:06.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:06 smithi169 ceph-mon[34823]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:06.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:06 smithi169 ceph-mon[34823]: osdmap e80: 12 total, 12 up, 12 in 2024-09-05T12:56:06.486 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:06 smithi073 ceph-mon[30883]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:06.486 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:06 smithi073 ceph-mon[30883]: osdmap e80: 12 total, 12 up, 12 in 2024-09-05T12:56:06.720 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:56:06.964 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:07.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:07 smithi162 ceph-mon[34220]: pgmap v281: 97 pgs: 2 peering, 95 active+clean; 602 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-05T12:56:07.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:07 smithi162 ceph-mon[34220]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:07 smithi169 ceph-mon[34823]: pgmap v281: 97 pgs: 2 peering, 95 active+clean; 602 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-05T12:56:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:07 smithi169 ceph-mon[34823]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:07.370 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:07 smithi073 ceph-mon[30883]: pgmap v281: 97 pgs: 2 peering, 95 active+clean; 602 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-05T12:56:07.370 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:07 smithi073 ceph-mon[30883]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:56:07.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 -- 172.21.15.73:0/3206819325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde0c102d30 msgr2=0x7fde0c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 --2- 172.21.15.73:0/3206819325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde0c102d30 0x7fde0c103110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009930 tx=0x7fddfc02a420 comp rx=0 tx=0).stop 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 -- 172.21.15.73:0/3206819325 shutdown_connections 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 --2- 172.21.15.73:0/3206819325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c1082a0 0x7fde0c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 --2- 172.21.15.73:0/3206819325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde0c1036e0 0x7fde0c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 --2- 172.21.15.73:0/3206819325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde0c102d30 0x7fde0c103110 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 -- 172.21.15.73:0/3206819325 >> 172.21.15.73:0/3206819325 conn(0x7fde0c0fc7d0 msgr2=0x7fde0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 -- 172.21.15.73:0/3206819325 shutdown_connections 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 -- 172.21.15.73:0/3206819325 wait complete. 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 Processor -- start 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.449+0000 7fde11ecf640 1 -- start start 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde11ecf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde0c102d30 0x7fde0c1a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:07.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde11ecf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c1036e0 0x7fde0c1a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde11ecf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde0c1082a0 0x7fde0c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde11ecf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c1120a0 con 0x7fde0c102d30 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde11ecf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c111f20 con 0x7fde0c1036e0 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde11ecf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c112220 con 0x7fde0c1082a0 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde0b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde0c102d30 0x7fde0c1a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde0b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde0c102d30 0x7fde0c1a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41840/0 (socket says 172.21.15.73:41840) 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde0b7fe640 1 -- 172.21.15.73:0/3670928872 learned_addr learned my addr 172.21.15.73:0/3670928872 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde02ffd640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c1036e0 0x7fde0c1a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde0bfff640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde0c1082a0 0x7fde0c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde0b7fe640 1 -- 172.21.15.73:0/3670928872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde0c1082a0 msgr2=0x7fde0c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde0b7fe640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde0c1082a0 0x7fde0c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:07.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde0b7fe640 1 -- 172.21.15.73:0/3670928872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c1036e0 msgr2=0x7fde0c1a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde0b7fe640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c1036e0 0x7fde0c1a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde0b7fe640 1 -- 172.21.15.73:0/3670928872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c19ad40 con 0x7fde0c102d30 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde0b7fe640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde0c102d30 0x7fde0c1a0450 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009230 tx=0x7fddfc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde097fa640 1 -- 172.21.15.73:0/3670928872 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc03f030 con 0x7fde0c102d30 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde097fa640 1 -- 172.21.15.73:0/3670928872 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddfc003ad0 con 0x7fde0c102d30 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde11ecf640 1 -- 172.21.15.73:0/3670928872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0c19afd0 con 0x7fde0c102d30 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.450+0000 7fde097fa640 1 -- 172.21.15.73:0/3670928872 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc035070 con 0x7fde0c102d30 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.451+0000 7fde11ecf640 1 -- 172.21.15.73:0/3670928872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0c1a7320 con 0x7fde0c102d30 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.452+0000 7fde11ecf640 1 -- 172.21.15.73:0/3670928872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0c103110 con 0x7fde0c102d30 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.453+0000 7fde097fa640 1 -- 172.21.15.73:0/3670928872 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fddfc042030 con 0x7fde0c102d30 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.453+0000 7fde097fa640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddf80a2c10 0x7fddf80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.454+0000 7fde02ffd640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddf80a2c10 0x7fddf80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:07.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.454+0000 7fde097fa640 1 -- 172.21.15.73:0/3670928872 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fddfc0ef690 con 0x7fde0c102d30 2024-09-05T12:56:07.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.454+0000 7fde02ffd640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddf80a2c10 0x7fddf80a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0ff060 tx=0x7fddf400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:07.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.458+0000 7fde097fa640 1 -- 172.21.15.73:0/3670928872 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fddfc0bc4c0 con 0x7fde0c102d30 2024-09-05T12:56:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.655+0000 7fde11ecf640 1 -- 172.21.15.73:0/3670928872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde0c10c2c0 con 0x7fde0c102d30 2024-09-05T12:56:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.656+0000 7fde097fa640 1 -- 172.21.15.73:0/3670928872 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11926 (secure 0 0 0) 0x7fddfc0bbdc0 con 0x7fde0c102d30 2024-09-05T12:56:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:07.657 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-05T12:55:57:797257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:55:57.388420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24452,24466,24482]},"id":1}]} 2024-09-05T12:56:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-05T12:56:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 -- 172.21.15.73:0/3670928872 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddf80a2c10 msgr2=0x7fddf80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddf80a2c10 0x7fddf80a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0ff060 tx=0x7fddf400b390 comp rx=0 tx=0).stop 2024-09-05T12:56:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 -- 172.21.15.73:0/3670928872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde0c102d30 msgr2=0x7fde0c1a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde0c102d30 0x7fde0c1a0450 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009230 tx=0x7fddfc004270 comp rx=0 tx=0).stop 2024-09-05T12:56:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 -- 172.21.15.73:0/3670928872 shutdown_connections 2024-09-05T12:56:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddf80a2c10 0x7fddf80a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde0c1082a0 0x7fde0c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c1036e0 0x7fde0c1a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 --2- 172.21.15.73:0/3670928872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde0c102d30 0x7fde0c1a0450 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 -- 172.21.15.73:0/3670928872 >> 172.21.15.73:0/3670928872 conn(0x7fde0c0fc7d0 msgr2=0x7fde0c100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 -- 172.21.15.73:0/3670928872 shutdown_connections 2024-09-05T12:56:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:07.659+0000 7fde11ecf640 1 -- 172.21.15.73:0/3670928872 wait complete. 2024-09-05T12:56:08.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:08 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3670928872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:56:08.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:08 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3670928872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:56:08.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:08 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3670928872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:56:08.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T12:56:08.627 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.085+0000 7f159f5b8640 1 -- 172.21.15.73:0/47559526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1598103660 msgr2=0x7f159810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.085+0000 7f159f5b8640 1 --2- 172.21.15.73:0/47559526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1598103660 0x7f159810bb50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1588009900 tx=0x7f158802a480 comp rx=0 tx=0).stop 2024-09-05T12:56:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.085+0000 7f159f5b8640 1 -- 172.21.15.73:0/47559526 shutdown_connections 2024-09-05T12:56:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.085+0000 7f159f5b8640 1 --2- 172.21.15.73:0/47559526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f159810c170 0x7f159810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.085+0000 7f159f5b8640 1 --2- 172.21.15.73:0/47559526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1598103660 0x7f159810bb50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.085+0000 7f159f5b8640 1 --2- 172.21.15.73:0/47559526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1598102d40 0x7f1598103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.085+0000 7f159f5b8640 1 -- 172.21.15.73:0/47559526 >> 172.21.15.73:0/47559526 conn(0x7f15980fc7a0 msgr2=0x7f15980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.085+0000 7f159f5b8640 1 -- 172.21.15.73:0/47559526 shutdown_connections 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.085+0000 7f159f5b8640 1 -- 172.21.15.73:0/47559526 wait complete. 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159f5b8640 1 Processor -- start 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159f5b8640 1 -- start start 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159f5b8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1598102d40 0x7f1598198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159f5b8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1598103660 0x7f1598198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159f5b8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159810c170 0x7f159819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159f5b8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1598111f70 con 0x7f159810c170 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159f5b8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1598111df0 con 0x7f1598103660 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159f5b8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15981120f0 con 0x7f1598102d40 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159db55640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159810c170 0x7f159819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159d354640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1598102d40 0x7f1598198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159db55640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159810c170 0x7f159819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41864/0 (socket says 172.21.15.73:41864) 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.086+0000 7f159db55640 1 -- 172.21.15.73:0/453264525 learned_addr learned my addr 172.21.15.73:0/453264525 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f159cb53640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1598103660 0x7f1598198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f159db55640 1 -- 172.21.15.73:0/453264525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1598102d40 msgr2=0x7f1598198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f159db55640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1598102d40 0x7f1598198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f159db55640 1 -- 172.21.15.73:0/453264525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1598103660 msgr2=0x7f1598198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f159db55640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1598103660 0x7f1598198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f159db55640 1 -- 172.21.15.73:0/453264525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159819d3e0 con 0x7f159810c170 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f159db55640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159810c170 0x7f159819cd00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f159000eaa0 tx=0x7f159000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f158e7fc640 1 -- 172.21.15.73:0/453264525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159000cdb0 con 0x7f159810c170 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f158e7fc640 1 -- 172.21.15.73:0/453264525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1590005020 con 0x7f159810c170 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f158e7fc640 1 -- 172.21.15.73:0/453264525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15900116b0 con 0x7f159810c170 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f159f5b8640 1 -- 172.21.15.73:0/453264525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159819d6d0 con 0x7f159810c170 2024-09-05T12:56:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.087+0000 7f159f5b8640 1 -- 172.21.15.73:0/453264525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15981a4fb0 con 0x7f159810c170 2024-09-05T12:56:09.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.088+0000 7f159f5b8640 1 -- 172.21.15.73:0/453264525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1598103120 con 0x7f159810c170 2024-09-05T12:56:09.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.089+0000 7f158e7fc640 1 -- 172.21.15.73:0/453264525 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1590005560 con 0x7f159810c170 2024-09-05T12:56:09.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.090+0000 7f158e7fc640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15840a2c90 0x7f15840a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:09.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.090+0000 7f158e7fc640 1 -- 172.21.15.73:0/453264525 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f15900cf6a0 con 0x7f159810c170 2024-09-05T12:56:09.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.090+0000 7f159d354640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15840a2c90 0x7f15840a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:09.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.090+0000 7f159d354640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15840a2c90 0x7f15840a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1594005d00 tx=0x7f159400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:09.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.093+0000 7f158e7fc640 1 -- 172.21.15.73:0/453264525 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1590016030 con 0x7f159810c170 2024-09-05T12:56:09.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.261+0000 7f159f5b8640 1 -- 172.21.15.73:0/453264525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f159802d7c0 con 0x7f159810c170 2024-09-05T12:56:09.262 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:09 smithi073 ceph-mon[30883]: pgmap v282: 97 pgs: 2 peering, 95 active+clean; 602 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-05T12:56:09.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.262+0000 7f158e7fc640 1 -- 172.21.15.73:0/453264525 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22645 (secure 0 0 0) 0x7f159009c550 con 0x7f159810c170 2024-09-05T12:56:09.264 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:09.264 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":80,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T12:56:05.055165+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T12:56:09.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.264+0000 7f159f5b8640 1 -- 172.21.15.73:0/453264525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15840a2c90 msgr2=0x7f15840a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:09.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.264+0000 7f159f5b8640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15840a2c90 0x7f15840a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1594005d00 tx=0x7f159400b410 comp rx=0 tx=0).stop 2024-09-05T12:56:09.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.264+0000 7f159f5b8640 1 -- 172.21.15.73:0/453264525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159810c170 msgr2=0x7f159819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:09.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.264+0000 7f159f5b8640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159810c170 0x7f159819cd00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f159000eaa0 tx=0x7f159000ef60 comp rx=0 tx=0).stop 2024-09-05T12:56:09.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.264+0000 7f159f5b8640 1 -- 172.21.15.73:0/453264525 shutdown_connections 2024-09-05T12:56:09.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.264+0000 7f159f5b8640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15840a2c90 0x7f15840a5150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:09.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.264+0000 7f159f5b8640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159810c170 0x7f159819cd00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:09.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.264+0000 7f159f5b8640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1598103660 0x7f1598198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:09.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.264+0000 7f159f5b8640 1 --2- 172.21.15.73:0/453264525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1598102d40 0x7f1598198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:09.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.264+0000 7f159f5b8640 1 -- 172.21.15.73:0/453264525 >> 172.21.15.73:0/453264525 conn(0x7f15980fc7a0 msgr2=0x7f15980fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:09.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.265+0000 7f159f5b8640 1 -- 172.21.15.73:0/453264525 shutdown_connections 2024-09-05T12:56:09.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:09.265+0000 7f159f5b8640 1 -- 172.21.15.73:0/453264525 wait complete. 2024-09-05T12:56:09.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:09 smithi162 ceph-mon[34220]: pgmap v282: 97 pgs: 2 peering, 95 active+clean; 602 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-05T12:56:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:09 smithi169 ceph-mon[34823]: pgmap v282: 97 pgs: 2 peering, 95 active+clean; 602 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-05T12:56:09.967 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-05T12:56:09.967 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T12:56:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:10.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:10 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/453264525' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:10.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:10 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/453264525' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:10.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:10 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/453264525' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:10.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.695+0000 7fd988289640 1 -- 172.21.15.73:0/2587581708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd980102ef0 msgr2=0x7fd98010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:10.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.695+0000 7fd988289640 1 --2- 172.21.15.73:0/2587581708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd980102ef0 0x7fd98010da40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd970009ca0 tx=0x7fd97002a950 comp rx=0 tx=0).stop 2024-09-05T12:56:10.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.695+0000 7fd988289640 1 -- 172.21.15.73:0/2587581708 shutdown_connections 2024-09-05T12:56:10.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.695+0000 7fd988289640 1 --2- 172.21.15.73:0/2587581708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd980102ef0 0x7fd98010da40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:10.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.695+0000 7fd988289640 1 --2- 172.21.15.73:0/2587581708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd980102570 0x7fd9801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:10.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.695+0000 7fd988289640 1 --2- 172.21.15.73:0/2587581708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd980100e20 0x7fd980101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:10.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.695+0000 7fd988289640 1 -- 172.21.15.73:0/2587581708 >> 172.21.15.73:0/2587581708 conn(0x7fd9800fc7d0 msgr2=0x7fd9800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:10.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd988289640 1 -- 172.21.15.73:0/2587581708 shutdown_connections 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd988289640 1 -- 172.21.15.73:0/2587581708 wait complete. 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd988289640 1 Processor -- start 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd988289640 1 -- start start 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd988289640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd980100e20 0x7fd9801963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd988289640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd980102570 0x7fd980196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd988289640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd980102ef0 0x7fd98019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd988289640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd98010ff20 con 0x7fd980100e20 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd988289640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd98010fda0 con 0x7fd980102ef0 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd988289640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801100a0 con 0x7fd980102570 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd986025640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd980100e20 0x7fd9801963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:10.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd986025640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd980100e20 0x7fd9801963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41892/0 (socket says 172.21.15.73:41892) 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.696+0000 7fd986025640 1 -- 172.21.15.73:0/3437777460 learned_addr learned my addr 172.21.15.73:0/3437777460 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd985824640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd980102570 0x7fd980196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd986826640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd980102ef0 0x7fd98019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd986025640 1 -- 172.21.15.73:0/3437777460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd980102570 msgr2=0x7fd980196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd986025640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd980102570 0x7fd980196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd986025640 1 -- 172.21.15.73:0/3437777460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd980102ef0 msgr2=0x7fd98019acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd986025640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd980102ef0 0x7fd98019acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd986025640 1 -- 172.21.15.73:0/3437777460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98019b390 con 0x7fd980100e20 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd986826640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd980102ef0 0x7fd98019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd985824640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd980102570 0x7fd980196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd986025640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd980100e20 0x7fd9801963e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd97800b4a0 tx=0x7fd97800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd97f7fe640 1 -- 172.21.15.73:0/3437777460 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978014070 con 0x7fd980100e20 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd97f7fe640 1 -- 172.21.15.73:0/3437777460 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd978010af0 con 0x7fd980100e20 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd97f7fe640 1 -- 172.21.15.73:0/3437777460 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978017d10 con 0x7fd980100e20 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd988289640 1 -- 172.21.15.73:0/3437777460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd98019b680 con 0x7fd980100e20 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.697+0000 7fd988289640 1 -- 172.21.15.73:0/3437777460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9801a2f60 con 0x7fd980100e20 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.698+0000 7fd988289640 1 -- 172.21.15.73:0/3437777460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd980101280 con 0x7fd980100e20 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.699+0000 7fd97f7fe640 1 -- 172.21.15.73:0/3437777460 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd978017070 con 0x7fd980100e20 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.700+0000 7fd97f7fe640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd9680a4e20 0x7fd9680a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.700+0000 7fd985824640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd9680a4e20 0x7fd9680a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.700+0000 7fd97f7fe640 1 -- 172.21.15.73:0/3437777460 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd9780ce510 con 0x7fd980100e20 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.701+0000 7fd985824640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd9680a4e20 0x7fd9680a72e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9800ffe50 tx=0x7fd974008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.704+0000 7fd97f7fe640 1 -- 172.21.15.73:0/3437777460 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd97809b450 con 0x7fd980100e20 2024-09-05T12:56:10.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.869+0000 7fd988289640 1 -- 172.21.15.73:0/3437777460 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd980062630 con 0x7fd9680a4e20 2024-09-05T12:56:10.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.876+0000 7fd97f7fe640 1 -- 172.21.15.73:0/3437777460 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258808 (secure 0 0 0) 0x7fd980062630 con 0x7fd9680a4e20 2024-09-05T12:56:10.880 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:10.881 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 -- 172.21.15.73:0/3437777460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd9680a4e20 msgr2=0x7fd9680a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd9680a4e20 0x7fd9680a72e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9800ffe50 tx=0x7fd974008040 comp rx=0 tx=0).stop 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 -- 172.21.15.73:0/3437777460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd980100e20 msgr2=0x7fd9801963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd980100e20 0x7fd9801963e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd97800b4a0 tx=0x7fd97800b960 comp rx=0 tx=0).stop 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 -- 172.21.15.73:0/3437777460 shutdown_connections 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd9680a4e20 0x7fd9680a72e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd980102ef0 0x7fd98019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd980102570 0x7fd980196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 --2- 172.21.15.73:0/3437777460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd980100e20 0x7fd9801963e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 -- 172.21.15.73:0/3437777460 >> 172.21.15.73:0/3437777460 conn(0x7fd9800fc7d0 msgr2=0x7fd9800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:10.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 -- 172.21.15.73:0/3437777460 shutdown_connections 2024-09-05T12:56:10.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:10.879+0000 7fd988289640 1 -- 172.21.15.73:0/3437777460 wait complete. 2024-09-05T12:56:11.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:11 smithi073 ceph-mon[30883]: pgmap v283: 97 pgs: 2 peering, 95 active+clean; 626 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.5 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-05T12:56:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:11 smithi162 ceph-mon[34220]: pgmap v283: 97 pgs: 2 peering, 95 active+clean; 626 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.5 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-05T12:56:11.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:11 smithi169 ceph-mon[34823]: pgmap v283: 97 pgs: 2 peering, 95 active+clean; 626 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.5 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-05T12:56:11.702 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-05T12:56:09.978679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641407,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":225,"num_read_kb":214,"num_write":327,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351576,"kb_used_data":10596,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590248,"statfs":{"total":1151940427776,"available":1151580413952,"internally_reserved":0,"allocated":10850304,"data_stored":6972266,"data_compressed":107439,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45424,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":71,"num_write":18,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001988"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059332+0000","last_change":"2024-09-05T12:55:45.753801+0000","last_active":"2024-09-05T12:56:05.059332+0000","last_peered":"2024-09-05T12:56:05.059332+0000","last_clean":"2024-09-05T12:56:05.059332+0000","last_became_active":"2024-09-05T12:55:45.753480+0000","last_became_peered":"2024-09-05T12:55:45.753480+0000","last_unstale":"2024-09-05T12:56:05.059332+0000","last_undegraded":"2024-09-05T12:56:05.059332+0000","last_fullsized":"2024-09-05T12:56:05.059332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:34.806083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063464+0000","last_change":"2024-09-05T12:55:45.744629+0000","last_active":"2024-09-05T12:56:05.063464+0000","last_peered":"2024-09-05T12:56:05.063464+0000","last_clean":"2024-09-05T12:56:05.063464+0000","last_became_active":"2024-09-05T12:55:45.744311+0000","last_became_peered":"2024-09-05T12:55:45.744311+0000","last_unstale":"2024-09-05T12:56:05.063464+0000","last_undegraded":"2024-09-05T12:56:05.063464+0000","last_fullsized":"2024-09-05T12:56:05.063464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:08:57.032929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063504+0000","last_change":"2024-09-05T12:55:45.745128+0000","last_active":"2024-09-05T12:56:05.063504+0000","last_peered":"2024-09-05T12:56:05.063504+0000","last_clean":"2024-09-05T12:56:05.063504+0000","last_became_active":"2024-09-05T12:55:45.744799+0000","last_became_peered":"2024-09-05T12:55:45.744799+0000","last_unstale":"2024-09-05T12:56:05.063504+0000","last_undegraded":"2024-09-05T12:56:05.063504+0000","last_fullsized":"2024-09-05T12:56:05.063504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:35:48.528336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201949+0000","last_change":"2024-09-05T12:55:45.749471+0000","last_active":"2024-09-05T12:56:05.201949+0000","last_peered":"2024-09-05T12:56:05.201949+0000","last_clean":"2024-09-05T12:56:05.201949+0000","last_became_active":"2024-09-05T12:55:45.749126+0000","last_became_peered":"2024-09-05T12:55:45.749126+0000","last_unstale":"2024-09-05T12:56:05.201949+0000","last_undegraded":"2024-09-05T12:56:05.201949+0000","last_fullsized":"2024-09-05T12:56:05.201949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:36.152934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061325+0000","last_change":"2024-09-05T12:55:45.741243+0000","last_active":"2024-09-05T12:56:05.061325+0000","last_peered":"2024-09-05T12:56:05.061325+0000","last_clean":"2024-09-05T12:56:05.061325+0000","last_became_active":"2024-09-05T12:55:45.740849+0000","last_became_peered":"2024-09-05T12:55:45.740849+0000","last_unstale":"2024-09-05T12:56:05.061325+0000","last_undegraded":"2024-09-05T12:56:05.061325+0000","last_fullsized":"2024-09-05T12:56:05.061325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:01.323875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061912+0000","last_change":"2024-09-05T12:55:45.744599+0000","last_active":"2024-09-05T12:56:05.061912+0000","last_peered":"2024-09-05T12:56:05.061912+0000","last_clean":"2024-09-05T12:56:05.061912+0000","last_became_active":"2024-09-05T12:55:45.744304+0000","last_became_peered":"2024-09-05T12:55:45.744304+0000","last_unstale":"2024-09-05T12:56:05.061912+0000","last_undegraded":"2024-09-05T12:56:05.061912+0000","last_fullsized":"2024-09-05T12:56:05.061912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:15:55.340505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676096+0000","last_change":"2024-09-05T12:55:45.744802+0000","last_active":"2024-09-05T12:56:05.676096+0000","last_peered":"2024-09-05T12:56:05.676096+0000","last_clean":"2024-09-05T12:56:05.676096+0000","last_became_active":"2024-09-05T12:55:45.744525+0000","last_became_peered":"2024-09-05T12:55:45.744525+0000","last_unstale":"2024-09-05T12:56:05.676096+0000","last_undegraded":"2024-09-05T12:56:05.676096+0000","last_fullsized":"2024-09-05T12:56:05.676096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:03:04.047389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060470+0000","last_change":"2024-09-05T12:55:45.742141+0000","last_active":"2024-09-05T12:56:05.060470+0000","last_peered":"2024-09-05T12:56:05.060470+0000","last_clean":"2024-09-05T12:56:05.060470+0000","last_became_active":"2024-09-05T12:55:45.741445+0000","last_became_peered":"2024-09-05T12:55:45.741445+0000","last_unstale":"2024-09-05T12:56:05.060470+0000","last_undegraded":"2024-09-05T12:56:05.060470+0000","last_fullsized":"2024-09-05T12:56:05.060470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:38:28.859589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.852099+0000","last_change":"2024-09-05T12:55:45.747321+0000","last_active":"2024-09-05T12:56:05.852099+0000","last_peered":"2024-09-05T12:56:05.852099+0000","last_clean":"2024-09-05T12:56:05.852099+0000","last_became_active":"2024-09-05T12:55:45.747013+0000","last_became_peered":"2024-09-05T12:55:45.747013+0000","last_unstale":"2024-09-05T12:56:05.852099+0000","last_undegraded":"2024-09-05T12:56:05.852099+0000","last_fullsized":"2024-09-05T12:56:05.852099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:42:00.402789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064498+0000","last_change":"2024-09-05T12:56:05.064498+0000","last_active":"2024-09-05T12:56:05.064498+0000","last_peered":"2024-09-05T12:56:05.064498+0000","last_clean":"2024-09-05T12:56:05.064498+0000","last_became_active":"2024-09-05T12:56:05.064200+0000","last_became_peered":"2024-09-05T12:56:05.064200+0000","last_unstale":"2024-09-05T12:56:05.064498+0000","last_undegraded":"2024-09-05T12:56:05.064498+0000","last_fullsized":"2024-09-05T12:56:05.064498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:37:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676376+0000","last_change":"2024-09-05T12:55:45.748372+0000","last_active":"2024-09-05T12:56:05.676376+0000","last_peered":"2024-09-05T12:56:05.676376+0000","last_clean":"2024-09-05T12:56:05.676376+0000","last_became_active":"2024-09-05T12:55:45.748093+0000","last_became_peered":"2024-09-05T12:55:45.748093+0000","last_unstale":"2024-09-05T12:56:05.676376+0000","last_undegraded":"2024-09-05T12:56:05.676376+0000","last_fullsized":"2024-09-05T12:56:05.676376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:32:25.938128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201978+0000","last_change":"2024-09-05T12:55:45.749433+0000","last_active":"2024-09-05T12:56:05.201978+0000","last_peered":"2024-09-05T12:56:05.201978+0000","last_clean":"2024-09-05T12:56:05.201978+0000","last_became_active":"2024-09-05T12:55:45.748677+0000","last_became_peered":"2024-09-05T12:55:45.748677+0000","last_unstale":"2024-09-05T12:56:05.201978+0000","last_undegraded":"2024-09-05T12:56:05.201978+0000","last_fullsized":"2024-09-05T12:56:05.201978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:27:57.896752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.059356+0000","last_change":"2024-09-05T12:55:45.743212+0000","last_active":"2024-09-05T12:56:04.059356+0000","last_peered":"2024-09-05T12:56:04.059356+0000","last_clean":"2024-09-05T12:56:04.059356+0000","last_became_active":"2024-09-05T12:55:45.742918+0000","last_became_peered":"2024-09-05T12:55:45.742918+0000","last_unstale":"2024-09-05T12:56:04.059356+0000","last_undegraded":"2024-09-05T12:56:04.059356+0000","last_fullsized":"2024-09-05T12:56:04.059356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:21:18.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063680+0000","last_change":"2024-09-05T12:55:45.745058+0000","last_active":"2024-09-05T12:56:05.063680+0000","last_peered":"2024-09-05T12:56:05.063680+0000","last_clean":"2024-09-05T12:56:05.063680+0000","last_became_active":"2024-09-05T12:55:45.744349+0000","last_became_peered":"2024-09-05T12:55:45.744349+0000","last_unstale":"2024-09-05T12:56:05.063680+0000","last_undegraded":"2024-09-05T12:56:05.063680+0000","last_fullsized":"2024-09-05T12:56:05.063680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:26:21.034864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063126+0000","last_change":"2024-09-05T12:55:45.748387+0000","last_active":"2024-09-05T12:56:05.063126+0000","last_peered":"2024-09-05T12:56:05.063126+0000","last_clean":"2024-09-05T12:56:05.063126+0000","last_became_active":"2024-09-05T12:55:45.748082+0000","last_became_peered":"2024-09-05T12:55:45.748082+0000","last_unstale":"2024-09-05T12:56:05.063126+0000","last_undegraded":"2024-09-05T12:56:05.063126+0000","last_fullsized":"2024-09-05T12:56:05.063126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:51:23.835278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851526+0000","last_change":"2024-09-05T12:55:45.742195+0000","last_active":"2024-09-05T12:56:05.851526+0000","last_peered":"2024-09-05T12:56:05.851526+0000","last_clean":"2024-09-05T12:56:05.851526+0000","last_became_active":"2024-09-05T12:55:45.741888+0000","last_became_peered":"2024-09-05T12:55:45.741888+0000","last_unstale":"2024-09-05T12:56:05.851526+0000","last_undegraded":"2024-09-05T12:56:05.851526+0000","last_fullsized":"2024-09-05T12:56:05.851526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:19:17.556164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059394+0000","last_change":"2024-09-05T12:55:45.755255+0000","last_active":"2024-09-05T12:56:05.059394+0000","last_peered":"2024-09-05T12:56:05.059394+0000","last_clean":"2024-09-05T12:56:05.059394+0000","last_became_active":"2024-09-05T12:55:45.754939+0000","last_became_peered":"2024-09-05T12:55:45.754939+0000","last_unstale":"2024-09-05T12:56:05.059394+0000","last_undegraded":"2024-09-05T12:56:05.059394+0000","last_fullsized":"2024-09-05T12:56:05.059394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:48:34.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.061143+0000","last_change":"2024-09-05T12:55:45.745496+0000","last_active":"2024-09-05T12:56:04.061143+0000","last_peered":"2024-09-05T12:56:04.061143+0000","last_clean":"2024-09-05T12:56:04.061143+0000","last_became_active":"2024-09-05T12:55:45.745153+0000","last_became_peered":"2024-09-05T12:55:45.745153+0000","last_unstale":"2024-09-05T12:56:04.061143+0000","last_undegraded":"2024-09-05T12:56:04.061143+0000","last_fullsized":"2024-09-05T12:56:04.061143+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:16:52.255227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062235+0000","last_change":"2024-09-05T12:55:45.747353+0000","last_active":"2024-09-05T12:56:05.062235+0000","last_peered":"2024-09-05T12:56:05.062235+0000","last_clean":"2024-09-05T12:56:05.062235+0000","last_became_active":"2024-09-05T12:55:45.747018+0000","last_became_peered":"2024-09-05T12:55:45.747018+0000","last_unstale":"2024-09-05T12:56:05.062235+0000","last_undegraded":"2024-09-05T12:56:05.062235+0000","last_fullsized":"2024-09-05T12:56:05.062235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:12:25.217057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059013+0000","last_change":"2024-09-05T12:55:45.754023+0000","last_active":"2024-09-05T12:56:05.059013+0000","last_peered":"2024-09-05T12:56:05.059013+0000","last_clean":"2024-09-05T12:56:05.059013+0000","last_became_active":"2024-09-05T12:55:45.753723+0000","last_became_peered":"2024-09-05T12:55:45.753723+0000","last_unstale":"2024-09-05T12:56:05.059013+0000","last_undegraded":"2024-09-05T12:56:05.059013+0000","last_fullsized":"2024-09-05T12:56:05.059013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:16:01.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.059359+0000","last_change":"2024-09-05T12:55:45.742627+0000","last_active":"2024-09-05T12:56:04.059359+0000","last_peered":"2024-09-05T12:56:04.059359+0000","last_clean":"2024-09-05T12:56:04.059359+0000","last_became_active":"2024-09-05T12:55:45.742252+0000","last_became_peered":"2024-09-05T12:55:45.742252+0000","last_unstale":"2024-09-05T12:56:04.059359+0000","last_undegraded":"2024-09-05T12:56:04.059359+0000","last_fullsized":"2024-09-05T12:56:04.059359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:14:34.476156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851781+0000","last_change":"2024-09-05T12:55:45.743587+0000","last_active":"2024-09-05T12:56:05.851781+0000","last_peered":"2024-09-05T12:56:05.851781+0000","last_clean":"2024-09-05T12:56:05.851781+0000","last_became_active":"2024-09-05T12:55:45.742624+0000","last_became_peered":"2024-09-05T12:55:45.742624+0000","last_unstale":"2024-09-05T12:56:05.851781+0000","last_undegraded":"2024-09-05T12:56:05.851781+0000","last_fullsized":"2024-09-05T12:56:05.851781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:15.981929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060563+0000","last_change":"2024-09-05T12:55:45.747430+0000","last_active":"2024-09-05T12:56:05.060563+0000","last_peered":"2024-09-05T12:56:05.060563+0000","last_clean":"2024-09-05T12:56:05.060563+0000","last_became_active":"2024-09-05T12:55:45.747049+0000","last_became_peered":"2024-09-05T12:55:45.747049+0000","last_unstale":"2024-09-05T12:56:05.060563+0000","last_undegraded":"2024-09-05T12:56:05.060563+0000","last_fullsized":"2024-09-05T12:56:05.060563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:31:08.388375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065470+0000","last_change":"2024-09-05T12:55:45.741645+0000","last_active":"2024-09-05T12:56:05.065470+0000","last_peered":"2024-09-05T12:56:05.065470+0000","last_clean":"2024-09-05T12:56:05.065470+0000","last_became_active":"2024-09-05T12:55:45.741341+0000","last_became_peered":"2024-09-05T12:55:45.741341+0000","last_unstale":"2024-09-05T12:56:05.065470+0000","last_undegraded":"2024-09-05T12:56:05.065470+0000","last_fullsized":"2024-09-05T12:56:05.065470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:24:11.896491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061589+0000","last_change":"2024-09-05T12:55:45.747609+0000","last_active":"2024-09-05T12:56:05.061589+0000","last_peered":"2024-09-05T12:56:05.061589+0000","last_clean":"2024-09-05T12:56:05.061589+0000","last_became_active":"2024-09-05T12:55:45.745899+0000","last_became_peered":"2024-09-05T12:55:45.745899+0000","last_unstale":"2024-09-05T12:56:05.061589+0000","last_undegraded":"2024-09-05T12:56:05.061589+0000","last_fullsized":"2024-09-05T12:56:05.061589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:21:42.224663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061958+0000","last_change":"2024-09-05T12:55:45.744974+0000","last_active":"2024-09-05T12:56:05.061958+0000","last_peered":"2024-09-05T12:56:05.061958+0000","last_clean":"2024-09-05T12:56:05.061958+0000","last_became_active":"2024-09-05T12:55:45.744538+0000","last_became_peered":"2024-09-05T12:55:45.744538+0000","last_unstale":"2024-09-05T12:56:05.061958+0000","last_undegraded":"2024-09-05T12:56:05.061958+0000","last_fullsized":"2024-09-05T12:56:05.061958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:48:46.695178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064626+0000","last_change":"2024-09-05T12:56:05.064626+0000","last_active":"2024-09-05T12:56:05.064626+0000","last_peered":"2024-09-05T12:56:05.064626+0000","last_clean":"2024-09-05T12:56:05.064626+0000","last_became_active":"2024-09-05T12:56:05.063972+0000","last_became_peered":"2024-09-05T12:56:05.063972+0000","last_unstale":"2024-09-05T12:56:05.064626+0000","last_undegraded":"2024-09-05T12:56:05.064626+0000","last_fullsized":"2024-09-05T12:56:05.064626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:57.345008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.059361+0000","last_change":"2024-09-05T12:55:45.753630+0000","last_active":"2024-09-05T12:56:04.059361+0000","last_peered":"2024-09-05T12:56:04.059361+0000","last_clean":"2024-09-05T12:56:04.059361+0000","last_became_active":"2024-09-05T12:55:45.753328+0000","last_became_peered":"2024-09-05T12:55:45.753328+0000","last_unstale":"2024-09-05T12:56:04.059361+0000","last_undegraded":"2024-09-05T12:56:04.059361+0000","last_fullsized":"2024-09-05T12:56:04.059361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:55:39.064374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063372+0000","last_change":"2024-09-05T12:55:45.749596+0000","last_active":"2024-09-05T12:56:05.063372+0000","last_peered":"2024-09-05T12:56:05.063372+0000","last_clean":"2024-09-05T12:56:05.063372+0000","last_became_active":"2024-09-05T12:55:45.749150+0000","last_became_peered":"2024-09-05T12:55:45.749150+0000","last_unstale":"2024-09-05T12:56:05.063372+0000","last_undegraded":"2024-09-05T12:56:05.063372+0000","last_fullsized":"2024-09-05T12:56:05.063372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:14:06.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062144+0000","last_change":"2024-09-05T12:55:45.748414+0000","last_active":"2024-09-05T12:56:05.062144+0000","last_peered":"2024-09-05T12:56:05.062144+0000","last_clean":"2024-09-05T12:56:05.062144+0000","last_became_active":"2024-09-05T12:55:45.747952+0000","last_became_peered":"2024-09-05T12:55:45.747952+0000","last_unstale":"2024-09-05T12:56:05.062144+0000","last_undegraded":"2024-09-05T12:56:05.062144+0000","last_fullsized":"2024-09-05T12:56:05.062144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:45:04.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061467+0000","last_change":"2024-09-05T12:55:45.754145+0000","last_active":"2024-09-05T12:56:05.061467+0000","last_peered":"2024-09-05T12:56:05.061467+0000","last_clean":"2024-09-05T12:56:05.061467+0000","last_became_active":"2024-09-05T12:55:45.753833+0000","last_became_peered":"2024-09-05T12:55:45.753833+0000","last_unstale":"2024-09-05T12:56:05.061467+0000","last_undegraded":"2024-09-05T12:56:05.061467+0000","last_fullsized":"2024-09-05T12:56:05.061467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:45:24.606506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.058922+0000","last_change":"2024-09-05T12:55:45.750283+0000","last_active":"2024-09-05T12:56:05.058922+0000","last_peered":"2024-09-05T12:56:05.058922+0000","last_clean":"2024-09-05T12:56:05.058922+0000","last_became_active":"2024-09-05T12:55:45.749901+0000","last_became_peered":"2024-09-05T12:55:45.749901+0000","last_unstale":"2024-09-05T12:56:05.058922+0000","last_undegraded":"2024-09-05T12:56:05.058922+0000","last_fullsized":"2024-09-05T12:56:05.058922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:45:57.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061784+0000","last_change":"2024-09-05T12:55:45.743239+0000","last_active":"2024-09-05T12:56:05.061784+0000","last_peered":"2024-09-05T12:56:05.061784+0000","last_clean":"2024-09-05T12:56:05.061784+0000","last_became_active":"2024-09-05T12:55:45.742926+0000","last_became_peered":"2024-09-05T12:55:45.742926+0000","last_unstale":"2024-09-05T12:56:05.061784+0000","last_undegraded":"2024-09-05T12:56:05.061784+0000","last_fullsized":"2024-09-05T12:56:05.061784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:26:05.559405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066537+0000","last_change":"2024-09-05T12:55:43.727301+0000","last_active":"2024-09-05T12:56:05.066537+0000","last_peered":"2024-09-05T12:56:05.066537+0000","last_clean":"2024-09-05T12:56:05.066537+0000","last_became_active":"2024-09-05T12:55:43.727006+0000","last_became_peered":"2024-09-05T12:55:43.727006+0000","last_unstale":"2024-09-05T12:56:05.066537+0000","last_undegraded":"2024-09-05T12:56:05.066537+0000","last_fullsized":"2024-09-05T12:56:05.066537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:54:32.725098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066620+0000","last_change":"2024-09-05T12:55:45.735835+0000","last_active":"2024-09-05T12:56:05.066620+0000","last_peered":"2024-09-05T12:56:05.066620+0000","last_clean":"2024-09-05T12:56:05.066620+0000","last_became_active":"2024-09-05T12:55:45.735404+0000","last_became_peered":"2024-09-05T12:55:45.735404+0000","last_unstale":"2024-09-05T12:56:05.066620+0000","last_undegraded":"2024-09-05T12:56:05.066620+0000","last_fullsized":"2024-09-05T12:56:05.066620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:06:47.174441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062007+0000","last_change":"2024-09-05T12:55:43.724561+0000","last_active":"2024-09-05T12:56:05.062007+0000","last_peered":"2024-09-05T12:56:05.062007+0000","last_clean":"2024-09-05T12:56:05.062007+0000","last_became_active":"2024-09-05T12:55:43.722704+0000","last_became_peered":"2024-09-05T12:55:43.722704+0000","last_unstale":"2024-09-05T12:56:05.062007+0000","last_undegraded":"2024-09-05T12:56:05.062007+0000","last_fullsized":"2024-09-05T12:56:05.062007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:20:20.692844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.058903+0000","last_change":"2024-09-05T12:55:43.722937+0000","last_active":"2024-09-05T12:56:04.058903+0000","last_peered":"2024-09-05T12:56:04.058903+0000","last_clean":"2024-09-05T12:56:04.058903+0000","last_became_active":"2024-09-05T12:55:43.722606+0000","last_became_peered":"2024-09-05T12:55:43.722606+0000","last_unstale":"2024-09-05T12:56:04.058903+0000","last_undegraded":"2024-09-05T12:56:04.058903+0000","last_fullsized":"2024-09-05T12:56:04.058903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:47:38.448865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":2,"reported_epoch":79,"state":"peering","last_fresh":"2024-09-05T12:55:46.745138+0000","last_change":"2024-09-05T12:56:05.033588+0000","last_active":"2024-09-05T12:56:05.033588+0000","last_peered":"2024-09-05T12:55:46.745138+0000","last_clean":"2024-09-05T12:55:46.745138+0000","last_became_active":"2024-09-05T12:55:45.743026+0000","last_became_peered":"2024-09-05T12:55:45.743026+0000","last_unstale":"2024-09-05T12:55:46.745138+0000","last_undegraded":"2024-09-05T12:55:46.745138+0000","last_fullsized":"2024-09-05T12:55:46.745138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065764+0000","last_change":"2024-09-05T12:55:43.725546+0000","last_active":"2024-09-05T12:56:05.065764+0000","last_peered":"2024-09-05T12:56:05.065764+0000","last_clean":"2024-09-05T12:56:05.065764+0000","last_became_active":"2024-09-05T12:55:43.725252+0000","last_became_peered":"2024-09-05T12:55:43.725252+0000","last_unstale":"2024-09-05T12:56:05.065764+0000","last_undegraded":"2024-09-05T12:56:05.065764+0000","last_fullsized":"2024-09-05T12:56:05.065764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:49:16.085799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.061128+0000","last_change":"2024-09-05T12:55:45.745358+0000","last_active":"2024-09-05T12:56:04.061128+0000","last_peered":"2024-09-05T12:56:04.061128+0000","last_clean":"2024-09-05T12:56:04.061128+0000","last_became_active":"2024-09-05T12:55:45.745040+0000","last_became_peered":"2024-09-05T12:55:45.745040+0000","last_unstale":"2024-09-05T12:56:04.061128+0000","last_undegraded":"2024-09-05T12:56:04.061128+0000","last_fullsized":"2024-09-05T12:56:04.061128+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:42:42.906745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:07.822344+0000","last_change":"2024-09-05T12:55:43.726138+0000","last_active":"2024-09-05T12:56:07.822344+0000","last_peered":"2024-09-05T12:56:07.822344+0000","last_clean":"2024-09-05T12:56:07.822344+0000","last_became_active":"2024-09-05T12:55:43.725815+0000","last_became_peered":"2024-09-05T12:55:43.725815+0000","last_unstale":"2024-09-05T12:56:07.822344+0000","last_undegraded":"2024-09-05T12:56:07.822344+0000","last_fullsized":"2024-09-05T12:56:07.822344+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:35:38.041757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851996+0000","last_change":"2024-09-05T12:55:45.743580+0000","last_active":"2024-09-05T12:56:05.851996+0000","last_peered":"2024-09-05T12:56:05.851996+0000","last_clean":"2024-09-05T12:56:05.851996+0000","last_became_active":"2024-09-05T12:55:45.743307+0000","last_became_peered":"2024-09-05T12:55:45.743307+0000","last_unstale":"2024-09-05T12:56:05.851996+0000","last_undegraded":"2024-09-05T12:56:05.851996+0000","last_fullsized":"2024-09-05T12:56:05.851996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:15:13.898218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676632+0000","last_change":"2024-09-05T12:55:43.725373+0000","last_active":"2024-09-05T12:56:05.676632+0000","last_peered":"2024-09-05T12:56:05.676632+0000","last_clean":"2024-09-05T12:56:05.676632+0000","last_became_active":"2024-09-05T12:55:43.725062+0000","last_became_peered":"2024-09-05T12:55:43.725062+0000","last_unstale":"2024-09-05T12:56:05.676632+0000","last_undegraded":"2024-09-05T12:56:05.676632+0000","last_fullsized":"2024-09-05T12:56:05.676632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:42:27.994499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063879+0000","last_change":"2024-09-05T12:55:45.750265+0000","last_active":"2024-09-05T12:56:05.063879+0000","last_peered":"2024-09-05T12:56:05.063879+0000","last_clean":"2024-09-05T12:56:05.063879+0000","last_became_active":"2024-09-05T12:55:45.749928+0000","last_became_peered":"2024-09-05T12:55:45.749928+0000","last_unstale":"2024-09-05T12:56:05.063879+0000","last_undegraded":"2024-09-05T12:56:05.063879+0000","last_fullsized":"2024-09-05T12:56:05.063879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:56:19.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065937+0000","last_change":"2024-09-05T12:55:43.736248+0000","last_active":"2024-09-05T12:56:05.065937+0000","last_peered":"2024-09-05T12:56:05.065937+0000","last_clean":"2024-09-05T12:56:05.065937+0000","last_became_active":"2024-09-05T12:55:43.735928+0000","last_became_peered":"2024-09-05T12:55:43.735928+0000","last_unstale":"2024-09-05T12:56:05.065937+0000","last_undegraded":"2024-09-05T12:56:05.065937+0000","last_fullsized":"2024-09-05T12:56:05.065937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:04:43.215616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851777+0000","last_change":"2024-09-05T12:55:45.739178+0000","last_active":"2024-09-05T12:56:05.851777+0000","last_peered":"2024-09-05T12:56:05.851777+0000","last_clean":"2024-09-05T12:56:05.851777+0000","last_became_active":"2024-09-05T12:55:45.738863+0000","last_became_peered":"2024-09-05T12:55:45.738863+0000","last_unstale":"2024-09-05T12:56:05.851777+0000","last_undegraded":"2024-09-05T12:56:05.851777+0000","last_fullsized":"2024-09-05T12:56:05.851777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:08.273036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'22","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:08.824330+0000","last_change":"2024-09-05T12:55:43.725380+0000","last_active":"2024-09-05T12:56:08.824330+0000","last_peered":"2024-09-05T12:56:08.824330+0000","last_clean":"2024-09-05T12:56:08.824330+0000","last_became_active":"2024-09-05T12:55:43.725000+0000","last_became_peered":"2024-09-05T12:55:43.725000+0000","last_unstale":"2024-09-05T12:56:08.824330+0000","last_undegraded":"2024-09-05T12:56:08.824330+0000","last_fullsized":"2024-09-05T12:56:08.824330+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:34:13.288894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061405+0000","last_change":"2024-09-05T12:55:45.742269+0000","last_active":"2024-09-05T12:56:05.061405+0000","last_peered":"2024-09-05T12:56:05.061405+0000","last_clean":"2024-09-05T12:56:05.061405+0000","last_became_active":"2024-09-05T12:55:45.741723+0000","last_became_peered":"2024-09-05T12:55:45.741723+0000","last_unstale":"2024-09-05T12:56:05.061405+0000","last_undegraded":"2024-09-05T12:56:05.061405+0000","last_fullsized":"2024-09-05T12:56:05.061405+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:39.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061771+0000","last_change":"2024-09-05T12:55:43.723725+0000","last_active":"2024-09-05T12:56:05.061771+0000","last_peered":"2024-09-05T12:56:05.061771+0000","last_clean":"2024-09-05T12:56:05.061771+0000","last_became_active":"2024-09-05T12:55:43.723351+0000","last_became_peered":"2024-09-05T12:55:43.723351+0000","last_unstale":"2024-09-05T12:56:05.061771+0000","last_undegraded":"2024-09-05T12:56:05.061771+0000","last_fullsized":"2024-09-05T12:56:05.061771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:15:40.485461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.059044+0000","last_change":"2024-09-05T12:55:45.742293+0000","last_active":"2024-09-05T12:56:04.059044+0000","last_peered":"2024-09-05T12:56:04.059044+0000","last_clean":"2024-09-05T12:56:04.059044+0000","last_became_active":"2024-09-05T12:55:45.741998+0000","last_became_peered":"2024-09-05T12:55:45.741998+0000","last_unstale":"2024-09-05T12:56:04.059044+0000","last_undegraded":"2024-09-05T12:56:04.059044+0000","last_fullsized":"2024-09-05T12:56:04.059044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:25:23.731384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065615+0000","last_change":"2024-09-05T12:55:43.726519+0000","last_active":"2024-09-05T12:56:05.065615+0000","last_peered":"2024-09-05T12:56:05.065615+0000","last_clean":"2024-09-05T12:56:05.065615+0000","last_became_active":"2024-09-05T12:55:43.726231+0000","last_became_peered":"2024-09-05T12:55:43.726231+0000","last_unstale":"2024-09-05T12:56:05.065615+0000","last_undegraded":"2024-09-05T12:56:05.065615+0000","last_fullsized":"2024-09-05T12:56:05.065615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:22:55.460814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676243+0000","last_change":"2024-09-05T12:55:45.739359+0000","last_active":"2024-09-05T12:56:05.676243+0000","last_peered":"2024-09-05T12:56:05.676243+0000","last_clean":"2024-09-05T12:56:05.676243+0000","last_became_active":"2024-09-05T12:55:45.738358+0000","last_became_peered":"2024-09-05T12:55:45.738358+0000","last_unstale":"2024-09-05T12:56:05.676243+0000","last_undegraded":"2024-09-05T12:56:05.676243+0000","last_fullsized":"2024-09-05T12:56:05.676243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:11:37.144174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201960+0000","last_change":"2024-09-05T12:55:43.726623+0000","last_active":"2024-09-05T12:56:05.201960+0000","last_peered":"2024-09-05T12:56:05.201960+0000","last_clean":"2024-09-05T12:56:05.201960+0000","last_became_active":"2024-09-05T12:55:43.726281+0000","last_became_peered":"2024-09-05T12:55:43.726281+0000","last_unstale":"2024-09-05T12:56:05.201960+0000","last_undegraded":"2024-09-05T12:56:05.201960+0000","last_fullsized":"2024-09-05T12:56:05.201960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:59:07.503458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676010+0000","last_change":"2024-09-05T12:55:45.745731+0000","last_active":"2024-09-05T12:56:05.676010+0000","last_peered":"2024-09-05T12:56:05.676010+0000","last_clean":"2024-09-05T12:56:05.676010+0000","last_became_active":"2024-09-05T12:55:45.745399+0000","last_became_peered":"2024-09-05T12:55:45.745399+0000","last_unstale":"2024-09-05T12:56:05.676010+0000","last_undegraded":"2024-09-05T12:56:05.676010+0000","last_fullsized":"2024-09-05T12:56:05.676010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:47:44.737335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061012+0000","last_change":"2024-09-05T12:55:43.736527+0000","last_active":"2024-09-05T12:56:05.061012+0000","last_peered":"2024-09-05T12:56:05.061012+0000","last_clean":"2024-09-05T12:56:05.061012+0000","last_became_active":"2024-09-05T12:55:43.736088+0000","last_became_peered":"2024-09-05T12:55:43.736088+0000","last_unstale":"2024-09-05T12:56:05.061012+0000","last_undegraded":"2024-09-05T12:56:05.061012+0000","last_fullsized":"2024-09-05T12:56:05.061012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:14.570503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.853150+0000","last_change":"2024-09-05T12:56:05.853150+0000","last_active":"2024-09-05T12:56:05.853150+0000","last_peered":"2024-09-05T12:56:05.853150+0000","last_clean":"2024-09-05T12:56:05.853150+0000","last_became_active":"2024-09-05T12:56:05.852728+0000","last_became_peered":"2024-09-05T12:56:05.852728+0000","last_unstale":"2024-09-05T12:56:05.853150+0000","last_undegraded":"2024-09-05T12:56:05.853150+0000","last_fullsized":"2024-09-05T12:56:05.853150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:58:49.654402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062050+0000","last_change":"2024-09-05T12:55:43.726989+0000","last_active":"2024-09-05T12:56:05.062050+0000","last_peered":"2024-09-05T12:56:05.062050+0000","last_clean":"2024-09-05T12:56:05.062050+0000","last_became_active":"2024-09-05T12:55:43.726690+0000","last_became_peered":"2024-09-05T12:55:43.726690+0000","last_unstale":"2024-09-05T12:56:05.062050+0000","last_undegraded":"2024-09-05T12:56:05.062050+0000","last_fullsized":"2024-09-05T12:56:05.062050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:15:31.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059176+0000","last_change":"2024-09-05T12:55:45.754849+0000","last_active":"2024-09-05T12:56:05.059176+0000","last_peered":"2024-09-05T12:56:05.059176+0000","last_clean":"2024-09-05T12:56:05.059176+0000","last_became_active":"2024-09-05T12:55:45.754539+0000","last_became_peered":"2024-09-05T12:55:45.754539+0000","last_unstale":"2024-09-05T12:56:05.059176+0000","last_undegraded":"2024-09-05T12:56:05.059176+0000","last_fullsized":"2024-09-05T12:56:05.059176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:14:17.628561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.059170+0000","last_change":"2024-09-05T12:55:43.723140+0000","last_active":"2024-09-05T12:56:04.059170+0000","last_peered":"2024-09-05T12:56:04.059170+0000","last_clean":"2024-09-05T12:56:04.059170+0000","last_became_active":"2024-09-05T12:55:43.722806+0000","last_became_peered":"2024-09-05T12:55:43.722806+0000","last_unstale":"2024-09-05T12:56:04.059170+0000","last_undegraded":"2024-09-05T12:56:04.059170+0000","last_fullsized":"2024-09-05T12:56:04.059170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:00:30.041237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676678+0000","last_change":"2024-09-05T12:55:45.750948+0000","last_active":"2024-09-05T12:56:05.676678+0000","last_peered":"2024-09-05T12:56:05.676678+0000","last_clean":"2024-09-05T12:56:05.676678+0000","last_became_active":"2024-09-05T12:55:45.750642+0000","last_became_peered":"2024-09-05T12:55:45.750642+0000","last_unstale":"2024-09-05T12:56:05.676678+0000","last_undegraded":"2024-09-05T12:56:05.676678+0000","last_fullsized":"2024-09-05T12:56:05.676678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:17:48.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066001+0000","last_change":"2024-09-05T12:55:43.724847+0000","last_active":"2024-09-05T12:56:05.066001+0000","last_peered":"2024-09-05T12:56:05.066001+0000","last_clean":"2024-09-05T12:56:05.066001+0000","last_became_active":"2024-09-05T12:55:43.724538+0000","last_became_peered":"2024-09-05T12:55:43.724538+0000","last_unstale":"2024-09-05T12:56:05.066001+0000","last_undegraded":"2024-09-05T12:56:05.066001+0000","last_fullsized":"2024-09-05T12:56:05.066001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:13:46.011992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676407+0000","last_change":"2024-09-05T12:55:45.742080+0000","last_active":"2024-09-05T12:56:05.676407+0000","last_peered":"2024-09-05T12:56:05.676407+0000","last_clean":"2024-09-05T12:56:05.676407+0000","last_became_active":"2024-09-05T12:55:45.741749+0000","last_became_peered":"2024-09-05T12:55:45.741749+0000","last_unstale":"2024-09-05T12:56:05.676407+0000","last_undegraded":"2024-09-05T12:56:05.676407+0000","last_fullsized":"2024-09-05T12:56:05.676407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:20.597209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061670+0000","last_change":"2024-09-05T12:55:43.736856+0000","last_active":"2024-09-05T12:56:05.061670+0000","last_peered":"2024-09-05T12:56:05.061670+0000","last_clean":"2024-09-05T12:56:05.061670+0000","last_became_active":"2024-09-05T12:55:43.736490+0000","last_became_peered":"2024-09-05T12:55:43.736490+0000","last_unstale":"2024-09-05T12:56:05.061670+0000","last_undegraded":"2024-09-05T12:56:05.061670+0000","last_fullsized":"2024-09-05T12:56:05.061670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:36:55.286932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676384+0000","last_change":"2024-09-05T12:55:45.750667+0000","last_active":"2024-09-05T12:56:05.676384+0000","last_peered":"2024-09-05T12:56:05.676384+0000","last_clean":"2024-09-05T12:56:05.676384+0000","last_became_active":"2024-09-05T12:55:45.750386+0000","last_became_peered":"2024-09-05T12:55:45.750386+0000","last_unstale":"2024-09-05T12:56:05.676384+0000","last_undegraded":"2024-09-05T12:56:05.676384+0000","last_fullsized":"2024-09-05T12:56:05.676384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:32:41.443471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676291+0000","last_change":"2024-09-05T12:54:31.534043+0000","last_active":"2024-09-05T12:56:05.676291+0000","last_peered":"2024-09-05T12:56:05.676291+0000","last_clean":"2024-09-05T12:56:05.676291+0000","last_became_active":"2024-09-05T12:54:31.533610+0000","last_became_peered":"2024-09-05T12:54:31.533610+0000","last_unstale":"2024-09-05T12:56:05.676291+0000","last_undegraded":"2024-09-05T12:56:05.676291+0000","last_fullsized":"2024-09-05T12:56:05.676291+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_clean_scrub_stamp":"2024-09-05T12:51:12.506567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:30:50.399925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201941+0000","last_change":"2024-09-05T12:55:43.727743+0000","last_active":"2024-09-05T12:56:05.201941+0000","last_peered":"2024-09-05T12:56:05.201941+0000","last_clean":"2024-09-05T12:56:05.201941+0000","last_became_active":"2024-09-05T12:55:43.727333+0000","last_became_peered":"2024-09-05T12:55:43.727333+0000","last_unstale":"2024-09-05T12:56:05.201941+0000","last_undegraded":"2024-09-05T12:56:05.201941+0000","last_fullsized":"2024-09-05T12:56:05.201941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:41:21.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061274+0000","last_change":"2024-09-05T12:55:45.744268+0000","last_active":"2024-09-05T12:56:05.061274+0000","last_peered":"2024-09-05T12:56:05.061274+0000","last_clean":"2024-09-05T12:56:05.061274+0000","last_became_active":"2024-09-05T12:55:45.743976+0000","last_became_peered":"2024-09-05T12:55:45.743976+0000","last_unstale":"2024-09-05T12:56:05.061274+0000","last_undegraded":"2024-09-05T12:56:05.061274+0000","last_fullsized":"2024-09-05T12:56:05.061274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:02.568293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676247+0000","last_change":"2024-09-05T12:55:43.728853+0000","last_active":"2024-09-05T12:56:05.676247+0000","last_peered":"2024-09-05T12:56:05.676247+0000","last_clean":"2024-09-05T12:56:05.676247+0000","last_became_active":"2024-09-05T12:55:43.728559+0000","last_became_peered":"2024-09-05T12:55:43.728559+0000","last_unstale":"2024-09-05T12:56:05.676247+0000","last_undegraded":"2024-09-05T12:56:05.676247+0000","last_fullsized":"2024-09-05T12:56:05.676247+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:16:53.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.058892+0000","last_change":"2024-09-05T12:55:45.748445+0000","last_active":"2024-09-05T12:56:04.058892+0000","last_peered":"2024-09-05T12:56:04.058892+0000","last_clean":"2024-09-05T12:56:04.058892+0000","last_became_active":"2024-09-05T12:55:45.748152+0000","last_became_peered":"2024-09-05T12:55:45.748152+0000","last_unstale":"2024-09-05T12:56:04.058892+0000","last_undegraded":"2024-09-05T12:56:04.058892+0000","last_fullsized":"2024-09-05T12:56:04.058892+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:37:35.842555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.059078+0000","last_change":"2024-09-05T12:55:43.734607+0000","last_active":"2024-09-05T12:56:04.059078+0000","last_peered":"2024-09-05T12:56:04.059078+0000","last_clean":"2024-09-05T12:56:04.059078+0000","last_became_active":"2024-09-05T12:55:43.734288+0000","last_became_peered":"2024-09-05T12:55:43.734288+0000","last_unstale":"2024-09-05T12:56:04.059078+0000","last_undegraded":"2024-09-05T12:56:04.059078+0000","last_fullsized":"2024-09-05T12:56:04.059078+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:40:40.350335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065590+0000","last_change":"2024-09-05T12:55:45.745622+0000","last_active":"2024-09-05T12:56:05.065590+0000","last_peered":"2024-09-05T12:56:05.065590+0000","last_clean":"2024-09-05T12:56:05.065590+0000","last_became_active":"2024-09-05T12:55:45.745282+0000","last_became_peered":"2024-09-05T12:55:45.745282+0000","last_unstale":"2024-09-05T12:56:05.065590+0000","last_undegraded":"2024-09-05T12:56:05.065590+0000","last_fullsized":"2024-09-05T12:56:05.065590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:50:19.657275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676337+0000","last_change":"2024-09-05T12:55:43.723985+0000","last_active":"2024-09-05T12:56:05.676337+0000","last_peered":"2024-09-05T12:56:05.676337+0000","last_clean":"2024-09-05T12:56:05.676337+0000","last_became_active":"2024-09-05T12:55:43.723651+0000","last_became_peered":"2024-09-05T12:55:43.723651+0000","last_unstale":"2024-09-05T12:56:05.676337+0000","last_undegraded":"2024-09-05T12:56:05.676337+0000","last_fullsized":"2024-09-05T12:56:05.676337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:10:45.723258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062115+0000","last_change":"2024-09-05T12:55:45.738603+0000","last_active":"2024-09-05T12:56:05.062115+0000","last_peered":"2024-09-05T12:56:05.062115+0000","last_clean":"2024-09-05T12:56:05.062115+0000","last_became_active":"2024-09-05T12:55:45.738299+0000","last_became_peered":"2024-09-05T12:55:45.738299+0000","last_unstale":"2024-09-05T12:56:05.062115+0000","last_undegraded":"2024-09-05T12:56:05.062115+0000","last_fullsized":"2024-09-05T12:56:05.062115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:05:28.174555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.061368+0000","last_change":"2024-09-05T12:55:43.734587+0000","last_active":"2024-09-05T12:56:04.061368+0000","last_peered":"2024-09-05T12:56:04.061368+0000","last_clean":"2024-09-05T12:56:04.061368+0000","last_became_active":"2024-09-05T12:55:43.734260+0000","last_became_peered":"2024-09-05T12:55:43.734260+0000","last_unstale":"2024-09-05T12:56:04.061368+0000","last_undegraded":"2024-09-05T12:56:04.061368+0000","last_fullsized":"2024-09-05T12:56:04.061368+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:37:00.235234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062195+0000","last_change":"2024-09-05T12:55:45.740516+0000","last_active":"2024-09-05T12:56:05.062195+0000","last_peered":"2024-09-05T12:56:05.062195+0000","last_clean":"2024-09-05T12:56:05.062195+0000","last_became_active":"2024-09-05T12:55:45.740227+0000","last_became_peered":"2024-09-05T12:55:45.740227+0000","last_unstale":"2024-09-05T12:56:05.062195+0000","last_undegraded":"2024-09-05T12:56:05.062195+0000","last_fullsized":"2024-09-05T12:56:05.062195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:34:44.922326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061647+0000","last_change":"2024-09-05T12:55:43.734592+0000","last_active":"2024-09-05T12:56:05.061647+0000","last_peered":"2024-09-05T12:56:05.061647+0000","last_clean":"2024-09-05T12:56:05.061647+0000","last_became_active":"2024-09-05T12:55:43.734243+0000","last_became_peered":"2024-09-05T12:55:43.734243+0000","last_unstale":"2024-09-05T12:56:05.061647+0000","last_undegraded":"2024-09-05T12:56:05.061647+0000","last_fullsized":"2024-09-05T12:56:05.061647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:14.368806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.059397+0000","last_change":"2024-09-05T12:55:45.748201+0000","last_active":"2024-09-05T12:56:04.059397+0000","last_peered":"2024-09-05T12:56:04.059397+0000","last_clean":"2024-09-05T12:56:04.059397+0000","last_became_active":"2024-09-05T12:55:45.747906+0000","last_became_peered":"2024-09-05T12:55:45.747906+0000","last_unstale":"2024-09-05T12:56:04.059397+0000","last_undegraded":"2024-09-05T12:56:04.059397+0000","last_fullsized":"2024-09-05T12:56:04.059397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:07.984589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'5","reported_seq":24,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-05T12:56:01.747311+0000","last_change":"2024-09-05T12:56:04.061619+0000","last_active":"2024-09-05T12:56:04.061619+0000","last_peered":"2024-09-05T12:56:01.747311+0000","last_clean":"2024-09-05T12:56:01.747311+0000","last_became_active":"2024-09-05T12:55:43.723349+0000","last_became_peered":"2024-09-05T12:55:43.723349+0000","last_unstale":"2024-09-05T12:56:01.747311+0000","last_undegraded":"2024-09-05T12:56:01.747311+0000","last_fullsized":"2024-09-05T12:56:01.747311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,8,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061601+0000","last_change":"2024-09-05T12:55:45.743225+0000","last_active":"2024-09-05T12:56:05.061601+0000","last_peered":"2024-09-05T12:56:05.061601+0000","last_clean":"2024-09-05T12:56:05.061601+0000","last_became_active":"2024-09-05T12:55:45.742923+0000","last_became_peered":"2024-09-05T12:55:45.742923+0000","last_unstale":"2024-09-05T12:56:05.061601+0000","last_undegraded":"2024-09-05T12:56:05.061601+0000","last_fullsized":"2024-09-05T12:56:05.061601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:50:09.056893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.202275+0000","last_change":"2024-09-05T12:55:43.723420+0000","last_active":"2024-09-05T12:56:05.202275+0000","last_peered":"2024-09-05T12:56:05.202275+0000","last_clean":"2024-09-05T12:56:05.202275+0000","last_became_active":"2024-09-05T12:55:43.723100+0000","last_became_peered":"2024-09-05T12:55:43.723100+0000","last_unstale":"2024-09-05T12:56:05.202275+0000","last_undegraded":"2024-09-05T12:56:05.202275+0000","last_fullsized":"2024-09-05T12:56:05.202275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:21:33.307826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.678039+0000","last_change":"2024-09-05T12:56:05.678039+0000","last_active":"2024-09-05T12:56:05.678039+0000","last_peered":"2024-09-05T12:56:05.678039+0000","last_clean":"2024-09-05T12:56:05.678039+0000","last_became_active":"2024-09-05T12:56:05.677749+0000","last_became_peered":"2024-09-05T12:56:05.677749+0000","last_unstale":"2024-09-05T12:56:05.678039+0000","last_undegraded":"2024-09-05T12:56:05.678039+0000","last_fullsized":"2024-09-05T12:56:05.678039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:47:12.770873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851620+0000","last_change":"2024-09-05T12:55:43.736075+0000","last_active":"2024-09-05T12:56:05.851620+0000","last_peered":"2024-09-05T12:56:05.851620+0000","last_clean":"2024-09-05T12:56:05.851620+0000","last_became_active":"2024-09-05T12:55:43.735808+0000","last_became_peered":"2024-09-05T12:55:43.735808+0000","last_unstale":"2024-09-05T12:56:05.851620+0000","last_undegraded":"2024-09-05T12:56:05.851620+0000","last_fullsized":"2024-09-05T12:56:05.851620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:52:25.842728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061815+0000","last_change":"2024-09-05T12:55:45.747180+0000","last_active":"2024-09-05T12:56:05.061815+0000","last_peered":"2024-09-05T12:56:05.061815+0000","last_clean":"2024-09-05T12:56:05.061815+0000","last_became_active":"2024-09-05T12:55:45.746297+0000","last_became_peered":"2024-09-05T12:55:45.746297+0000","last_unstale":"2024-09-05T12:56:05.061815+0000","last_undegraded":"2024-09-05T12:56:05.061815+0000","last_fullsized":"2024-09-05T12:56:05.061815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:24:33.657861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060711+0000","last_change":"2024-09-05T12:55:43.720054+0000","last_active":"2024-09-05T12:56:05.060711+0000","last_peered":"2024-09-05T12:56:05.060711+0000","last_clean":"2024-09-05T12:56:05.060711+0000","last_became_active":"2024-09-05T12:55:43.719762+0000","last_became_peered":"2024-09-05T12:55:43.719762+0000","last_unstale":"2024-09-05T12:56:05.060711+0000","last_undegraded":"2024-09-05T12:56:05.060711+0000","last_fullsized":"2024-09-05T12:56:05.060711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:07:57.623333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059189+0000","last_change":"2024-09-05T12:55:45.756031+0000","last_active":"2024-09-05T12:56:05.059189+0000","last_peered":"2024-09-05T12:56:05.059189+0000","last_clean":"2024-09-05T12:56:05.059189+0000","last_became_active":"2024-09-05T12:55:45.755723+0000","last_became_peered":"2024-09-05T12:55:45.755723+0000","last_unstale":"2024-09-05T12:56:05.059189+0000","last_undegraded":"2024-09-05T12:56:05.059189+0000","last_fullsized":"2024-09-05T12:56:05.059189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:26.760307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.069746+0000","last_change":"2024-09-05T12:56:05.069208+0000","last_active":"2024-09-05T12:56:05.069746+0000","last_peered":"2024-09-05T12:56:05.069746+0000","last_clean":"2024-09-05T12:56:05.069746+0000","last_became_active":"2024-09-05T12:56:05.063698+0000","last_became_peered":"2024-09-05T12:56:05.063698+0000","last_unstale":"2024-09-05T12:56:05.069746+0000","last_undegraded":"2024-09-05T12:56:05.069746+0000","last_fullsized":"2024-09-05T12:56:05.069746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:55:54.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061163+0000","last_change":"2024-09-05T12:55:45.743108+0000","last_active":"2024-09-05T12:56:05.061163+0000","last_peered":"2024-09-05T12:56:05.061163+0000","last_clean":"2024-09-05T12:56:05.061163+0000","last_became_active":"2024-09-05T12:55:45.742197+0000","last_became_peered":"2024-09-05T12:55:45.742197+0000","last_unstale":"2024-09-05T12:56:05.061163+0000","last_undegraded":"2024-09-05T12:56:05.061163+0000","last_fullsized":"2024-09-05T12:56:05.061163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:13:15.192298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061447+0000","last_change":"2024-09-05T12:55:43.725893+0000","last_active":"2024-09-05T12:56:05.061447+0000","last_peered":"2024-09-05T12:56:05.061447+0000","last_clean":"2024-09-05T12:56:05.061447+0000","last_became_active":"2024-09-05T12:55:43.725578+0000","last_became_peered":"2024-09-05T12:55:43.725578+0000","last_unstale":"2024-09-05T12:56:05.061447+0000","last_undegraded":"2024-09-05T12:56:05.061447+0000","last_fullsized":"2024-09-05T12:56:05.061447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:39.101167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676363+0000","last_change":"2024-09-05T12:55:45.746727+0000","last_active":"2024-09-05T12:56:05.676363+0000","last_peered":"2024-09-05T12:56:05.676363+0000","last_clean":"2024-09-05T12:56:05.676363+0000","last_became_active":"2024-09-05T12:55:45.746446+0000","last_became_peered":"2024-09-05T12:55:45.746446+0000","last_unstale":"2024-09-05T12:56:05.676363+0000","last_undegraded":"2024-09-05T12:56:05.676363+0000","last_fullsized":"2024-09-05T12:56:05.676363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:56:51.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065862+0000","last_change":"2024-09-05T12:55:45.750253+0000","last_active":"2024-09-05T12:56:05.065862+0000","last_peered":"2024-09-05T12:56:05.065862+0000","last_clean":"2024-09-05T12:56:05.065862+0000","last_became_active":"2024-09-05T12:55:45.749911+0000","last_became_peered":"2024-09-05T12:55:45.749911+0000","last_unstale":"2024-09-05T12:56:05.065862+0000","last_undegraded":"2024-09-05T12:56:05.065862+0000","last_fullsized":"2024-09-05T12:56:05.065862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:04:04.164858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061563+0000","last_change":"2024-09-05T12:55:43.728597+0000","last_active":"2024-09-05T12:56:05.061563+0000","last_peered":"2024-09-05T12:56:05.061563+0000","last_clean":"2024-09-05T12:56:05.061563+0000","last_became_active":"2024-09-05T12:55:43.727633+0000","last_became_peered":"2024-09-05T12:55:43.727633+0000","last_unstale":"2024-09-05T12:56:05.061563+0000","last_undegraded":"2024-09-05T12:56:05.061563+0000","last_fullsized":"2024-09-05T12:56:05.061563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:50:04.775603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851671+0000","last_change":"2024-09-05T12:55:45.741539+0000","last_active":"2024-09-05T12:56:05.851671+0000","last_peered":"2024-09-05T12:56:05.851671+0000","last_clean":"2024-09-05T12:56:05.851671+0000","last_became_active":"2024-09-05T12:55:45.741247+0000","last_became_peered":"2024-09-05T12:55:45.741247+0000","last_unstale":"2024-09-05T12:56:05.851671+0000","last_undegraded":"2024-09-05T12:56:05.851671+0000","last_fullsized":"2024-09-05T12:56:05.851671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:57:23.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061516+0000","last_change":"2024-09-05T12:55:43.725085+0000","last_active":"2024-09-05T12:56:05.061516+0000","last_peered":"2024-09-05T12:56:05.061516+0000","last_clean":"2024-09-05T12:56:05.061516+0000","last_became_active":"2024-09-05T12:55:43.724772+0000","last_became_peered":"2024-09-05T12:55:43.724772+0000","last_unstale":"2024-09-05T12:56:05.061516+0000","last_undegraded":"2024-09-05T12:56:05.061516+0000","last_fullsized":"2024-09-05T12:56:05.061516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:48:16.567841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063834+0000","last_change":"2024-09-05T12:55:45.745635+0000","last_active":"2024-09-05T12:56:05.063834+0000","last_peered":"2024-09-05T12:56:05.063834+0000","last_clean":"2024-09-05T12:56:05.063834+0000","last_became_active":"2024-09-05T12:55:45.745331+0000","last_became_peered":"2024-09-05T12:55:45.745331+0000","last_unstale":"2024-09-05T12:56:05.063834+0000","last_undegraded":"2024-09-05T12:56:05.063834+0000","last_fullsized":"2024-09-05T12:56:05.063834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:15:58.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061048+0000","last_change":"2024-09-05T12:55:43.734466+0000","last_active":"2024-09-05T12:56:05.061048+0000","last_peered":"2024-09-05T12:56:05.061048+0000","last_clean":"2024-09-05T12:56:05.061048+0000","last_became_active":"2024-09-05T12:55:43.734147+0000","last_became_peered":"2024-09-05T12:55:43.734147+0000","last_unstale":"2024-09-05T12:56:05.061048+0000","last_undegraded":"2024-09-05T12:56:05.061048+0000","last_fullsized":"2024-09-05T12:56:05.061048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:53:22.588471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060906+0000","last_change":"2024-09-05T12:55:45.746328+0000","last_active":"2024-09-05T12:56:05.060906+0000","last_peered":"2024-09-05T12:56:05.060906+0000","last_clean":"2024-09-05T12:56:05.060906+0000","last_became_active":"2024-09-05T12:55:45.746012+0000","last_became_peered":"2024-09-05T12:55:45.746012+0000","last_unstale":"2024-09-05T12:56:05.060906+0000","last_undegraded":"2024-09-05T12:56:05.060906+0000","last_fullsized":"2024-09-05T12:56:05.060906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:23:12.886759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-05T12:56:04.061493+0000","last_change":"2024-09-05T12:55:43.722519+0000","last_active":"2024-09-05T12:56:04.061493+0000","last_peered":"2024-09-05T12:56:04.061493+0000","last_clean":"2024-09-05T12:56:04.061493+0000","last_became_active":"2024-09-05T12:55:43.722220+0000","last_became_peered":"2024-09-05T12:55:43.722220+0000","last_unstale":"2024-09-05T12:56:04.061493+0000","last_undegraded":"2024-09-05T12:56:04.061493+0000","last_fullsized":"2024-09-05T12:56:04.061493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:15.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50805,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":144,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":152415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281587,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645329,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":417055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874263,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1007616,"data_stored":1063760,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005082,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":860160,"data_stored":408706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234017,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":1017565,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":416680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1017249,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":417117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":876544,"data_stored":416991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":946176,"data_stored":473440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":471697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":426373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T12:56:11.707 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T12:56:11.954 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:12.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:12 smithi073 ceph-mon[30883]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:12.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:12 smithi162 ceph-mon[34220]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:12.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:12 smithi169 ceph-mon[34823]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:12.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.529+0000 7fb97dc54640 1 -- 172.21.15.73:0/2461838376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb978102d70 msgr2=0x7fb978103150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:12.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.529+0000 7fb97dc54640 1 --2- 172.21.15.73:0/2461838376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb978102d70 0x7fb978103150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb968009930 tx=0x7fb96802a440 comp rx=0 tx=0).stop 2024-09-05T12:56:12.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.529+0000 7fb97dc54640 1 -- 172.21.15.73:0/2461838376 shutdown_connections 2024-09-05T12:56:12.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.529+0000 7fb97dc54640 1 --2- 172.21.15.73:0/2461838376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9781082a0 0x7fb97810ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:12.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.529+0000 7fb97dc54640 1 --2- 172.21.15.73:0/2461838376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb978103720 0x7fb978107b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:12.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.529+0000 7fb97dc54640 1 --2- 172.21.15.73:0/2461838376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb978102d70 0x7fb978103150 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.529+0000 7fb97dc54640 1 -- 172.21.15.73:0/2461838376 >> 172.21.15.73:0/2461838376 conn(0x7fb9780fc7d0 msgr2=0x7fb9780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.529+0000 7fb97dc54640 1 -- 172.21.15.73:0/2461838376 shutdown_connections 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.529+0000 7fb97dc54640 1 -- 172.21.15.73:0/2461838376 wait complete. 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb97dc54640 1 Processor -- start 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb97dc54640 1 -- start start 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb97dc54640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb978102d70 0x7fb9781009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb97dc54640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb978103720 0x7fb978100f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb97dc54640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9781082a0 0x7fb978101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb97dc54640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb978112160 con 0x7fb9781082a0 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb97dc54640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb978111fe0 con 0x7fb978103720 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb97dc54640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb9781122e0 con 0x7fb978102d70 2024-09-05T12:56:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb977fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9781082a0 0x7fb978101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb977fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9781082a0 0x7fb978101450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41906/0 (socket says 172.21.15.73:41906) 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb977fff640 1 -- 172.21.15.73:0/730360 learned_addr learned my addr 172.21.15.73:0/730360 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb9777fe640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb978102d70 0x7fb9781009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.530+0000 7fb96ffff640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb978103720 0x7fb978100f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb977fff640 1 -- 172.21.15.73:0/730360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb978102d70 msgr2=0x7fb9781009d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb977fff640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb978102d70 0x7fb9781009d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb977fff640 1 -- 172.21.15.73:0/730360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb978103720 msgr2=0x7fb978100f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb977fff640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb978103720 0x7fb978100f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb977fff640 1 -- 172.21.15.73:0/730360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9781a6be0 con 0x7fb9781082a0 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb977fff640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9781082a0 0x7fb978101450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb97000b970 tx=0x7fb97000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb9757fa640 1 -- 172.21.15.73:0/730360 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970019070 con 0x7fb9781082a0 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb9757fa640 1 -- 172.21.15.73:0/730360 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb97000cb40 con 0x7fb9781082a0 2024-09-05T12:56:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb97dc54640 1 -- 172.21.15.73:0/730360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9781a6ed0 con 0x7fb9781082a0 2024-09-05T12:56:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb9757fa640 1 -- 172.21.15.73:0/730360 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970007650 con 0x7fb9781082a0 2024-09-05T12:56:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.531+0000 7fb97dc54640 1 -- 172.21.15.73:0/730360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9781a7380 con 0x7fb9781082a0 2024-09-05T12:56:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.532+0000 7fb97dc54640 1 -- 172.21.15.73:0/730360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb97806a810 con 0x7fb9781082a0 2024-09-05T12:56:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.533+0000 7fb9757fa640 1 -- 172.21.15.73:0/730360 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb97001c070 con 0x7fb9781082a0 2024-09-05T12:56:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.534+0000 7fb9757fa640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9640a2c10 0x7fb9640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.534+0000 7fb9777fe640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9640a2c10 0x7fb9640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.534+0000 7fb9757fa640 1 -- 172.21.15.73:0/730360 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb9700ce6b0 con 0x7fb9781082a0 2024-09-05T12:56:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.534+0000 7fb9777fe640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9640a2c10 0x7fb9640a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb968000c00 tx=0x7fb968031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.538+0000 7fb9757fa640 1 -- 172.21.15.73:0/730360 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb97009b5f0 con 0x7fb9781082a0 2024-09-05T12:56:12.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.703+0000 7fb97dc54640 1 -- 172.21.15.73:0/730360 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb978062630 con 0x7fb9640a2c10 2024-09-05T12:56:12.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.710+0000 7fb9757fa640 1 -- 172.21.15.73:0/730360 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258868 (secure 0 0 0) 0x7fb978062630 con 0x7fb9640a2c10 2024-09-05T12:56:12.713 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:12.714 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-05T12:56:12.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 -- 172.21.15.73:0/730360 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9640a2c10 msgr2=0x7fb9640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9640a2c10 0x7fb9640a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb968000c00 tx=0x7fb968031490 comp rx=0 tx=0).stop 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 -- 172.21.15.73:0/730360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9781082a0 msgr2=0x7fb978101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9781082a0 0x7fb978101450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb97000b970 tx=0x7fb97000be30 comp rx=0 tx=0).stop 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 -- 172.21.15.73:0/730360 shutdown_connections 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9640a2c10 0x7fb9640a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9781082a0 0x7fb978101450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb978103720 0x7fb978100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 --2- 172.21.15.73:0/730360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb978102d70 0x7fb9781009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 -- 172.21.15.73:0/730360 >> 172.21.15.73:0/730360 conn(0x7fb9780fc7d0 msgr2=0x7fb978105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 -- 172.21.15.73:0/730360 shutdown_connections 2024-09-05T12:56:12.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:12.713+0000 7fb97dc54640 1 -- 172.21.15.73:0/730360 wait complete. 2024-09-05T12:56:13.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:13 smithi162 ceph-mon[34220]: pgmap v284: 97 pgs: 97 active+clean; 626 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.9 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:13.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:13 smithi162 ceph-mon[34220]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:13.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:13 smithi169 ceph-mon[34823]: pgmap v284: 97 pgs: 97 active+clean; 626 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.9 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:13.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:13 smithi169 ceph-mon[34823]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:13.506 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:13 smithi073 ceph-mon[30883]: pgmap v284: 97 pgs: 97 active+clean; 626 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.9 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:13.507 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:13 smithi073 ceph-mon[30883]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:13.534 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-05T12:56:11.979101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641407,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":240,"num_read_kb":219,"num_write":336,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351644,"kb_used_data":10676,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590180,"statfs":{"total":1151940427776,"available":1151580344320,"internally_reserved":0,"allocated":10932224,"data_stored":7031113,"data_compressed":107439,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24587,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":45,"num_write":19,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001940"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059332+0000","last_change":"2024-09-05T12:55:45.753801+0000","last_active":"2024-09-05T12:56:05.059332+0000","last_peered":"2024-09-05T12:56:05.059332+0000","last_clean":"2024-09-05T12:56:05.059332+0000","last_became_active":"2024-09-05T12:55:45.753480+0000","last_became_peered":"2024-09-05T12:55:45.753480+0000","last_unstale":"2024-09-05T12:56:05.059332+0000","last_undegraded":"2024-09-05T12:56:05.059332+0000","last_fullsized":"2024-09-05T12:56:05.059332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:34.806083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063464+0000","last_change":"2024-09-05T12:55:45.744629+0000","last_active":"2024-09-05T12:56:05.063464+0000","last_peered":"2024-09-05T12:56:05.063464+0000","last_clean":"2024-09-05T12:56:05.063464+0000","last_became_active":"2024-09-05T12:55:45.744311+0000","last_became_peered":"2024-09-05T12:55:45.744311+0000","last_unstale":"2024-09-05T12:56:05.063464+0000","last_undegraded":"2024-09-05T12:56:05.063464+0000","last_fullsized":"2024-09-05T12:56:05.063464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:08:57.032929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063504+0000","last_change":"2024-09-05T12:55:45.745128+0000","last_active":"2024-09-05T12:56:05.063504+0000","last_peered":"2024-09-05T12:56:05.063504+0000","last_clean":"2024-09-05T12:56:05.063504+0000","last_became_active":"2024-09-05T12:55:45.744799+0000","last_became_peered":"2024-09-05T12:55:45.744799+0000","last_unstale":"2024-09-05T12:56:05.063504+0000","last_undegraded":"2024-09-05T12:56:05.063504+0000","last_fullsized":"2024-09-05T12:56:05.063504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:35:48.528336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201949+0000","last_change":"2024-09-05T12:55:45.749471+0000","last_active":"2024-09-05T12:56:05.201949+0000","last_peered":"2024-09-05T12:56:05.201949+0000","last_clean":"2024-09-05T12:56:05.201949+0000","last_became_active":"2024-09-05T12:55:45.749126+0000","last_became_peered":"2024-09-05T12:55:45.749126+0000","last_unstale":"2024-09-05T12:56:05.201949+0000","last_undegraded":"2024-09-05T12:56:05.201949+0000","last_fullsized":"2024-09-05T12:56:05.201949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:36.152934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061325+0000","last_change":"2024-09-05T12:55:45.741243+0000","last_active":"2024-09-05T12:56:05.061325+0000","last_peered":"2024-09-05T12:56:05.061325+0000","last_clean":"2024-09-05T12:56:05.061325+0000","last_became_active":"2024-09-05T12:55:45.740849+0000","last_became_peered":"2024-09-05T12:55:45.740849+0000","last_unstale":"2024-09-05T12:56:05.061325+0000","last_undegraded":"2024-09-05T12:56:05.061325+0000","last_fullsized":"2024-09-05T12:56:05.061325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:01.323875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061912+0000","last_change":"2024-09-05T12:55:45.744599+0000","last_active":"2024-09-05T12:56:05.061912+0000","last_peered":"2024-09-05T12:56:05.061912+0000","last_clean":"2024-09-05T12:56:05.061912+0000","last_became_active":"2024-09-05T12:55:45.744304+0000","last_became_peered":"2024-09-05T12:55:45.744304+0000","last_unstale":"2024-09-05T12:56:05.061912+0000","last_undegraded":"2024-09-05T12:56:05.061912+0000","last_fullsized":"2024-09-05T12:56:05.061912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:15:55.340505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676096+0000","last_change":"2024-09-05T12:55:45.744802+0000","last_active":"2024-09-05T12:56:05.676096+0000","last_peered":"2024-09-05T12:56:05.676096+0000","last_clean":"2024-09-05T12:56:05.676096+0000","last_became_active":"2024-09-05T12:55:45.744525+0000","last_became_peered":"2024-09-05T12:55:45.744525+0000","last_unstale":"2024-09-05T12:56:05.676096+0000","last_undegraded":"2024-09-05T12:56:05.676096+0000","last_fullsized":"2024-09-05T12:56:05.676096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:03:04.047389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060470+0000","last_change":"2024-09-05T12:55:45.742141+0000","last_active":"2024-09-05T12:56:05.060470+0000","last_peered":"2024-09-05T12:56:05.060470+0000","last_clean":"2024-09-05T12:56:05.060470+0000","last_became_active":"2024-09-05T12:55:45.741445+0000","last_became_peered":"2024-09-05T12:55:45.741445+0000","last_unstale":"2024-09-05T12:56:05.060470+0000","last_undegraded":"2024-09-05T12:56:05.060470+0000","last_fullsized":"2024-09-05T12:56:05.060470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:38:28.859589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.852099+0000","last_change":"2024-09-05T12:55:45.747321+0000","last_active":"2024-09-05T12:56:05.852099+0000","last_peered":"2024-09-05T12:56:05.852099+0000","last_clean":"2024-09-05T12:56:05.852099+0000","last_became_active":"2024-09-05T12:55:45.747013+0000","last_became_peered":"2024-09-05T12:55:45.747013+0000","last_unstale":"2024-09-05T12:56:05.852099+0000","last_undegraded":"2024-09-05T12:56:05.852099+0000","last_fullsized":"2024-09-05T12:56:05.852099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:42:00.402789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064498+0000","last_change":"2024-09-05T12:56:05.064498+0000","last_active":"2024-09-05T12:56:05.064498+0000","last_peered":"2024-09-05T12:56:05.064498+0000","last_clean":"2024-09-05T12:56:05.064498+0000","last_became_active":"2024-09-05T12:56:05.064200+0000","last_became_peered":"2024-09-05T12:56:05.064200+0000","last_unstale":"2024-09-05T12:56:05.064498+0000","last_undegraded":"2024-09-05T12:56:05.064498+0000","last_fullsized":"2024-09-05T12:56:05.064498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:37:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676376+0000","last_change":"2024-09-05T12:55:45.748372+0000","last_active":"2024-09-05T12:56:05.676376+0000","last_peered":"2024-09-05T12:56:05.676376+0000","last_clean":"2024-09-05T12:56:05.676376+0000","last_became_active":"2024-09-05T12:55:45.748093+0000","last_became_peered":"2024-09-05T12:55:45.748093+0000","last_unstale":"2024-09-05T12:56:05.676376+0000","last_undegraded":"2024-09-05T12:56:05.676376+0000","last_fullsized":"2024-09-05T12:56:05.676376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:32:25.938128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201978+0000","last_change":"2024-09-05T12:55:45.749433+0000","last_active":"2024-09-05T12:56:05.201978+0000","last_peered":"2024-09-05T12:56:05.201978+0000","last_clean":"2024-09-05T12:56:05.201978+0000","last_became_active":"2024-09-05T12:55:45.748677+0000","last_became_peered":"2024-09-05T12:55:45.748677+0000","last_unstale":"2024-09-05T12:56:05.201978+0000","last_undegraded":"2024-09-05T12:56:05.201978+0000","last_fullsized":"2024-09-05T12:56:05.201978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:27:57.896752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819602+0000","last_change":"2024-09-05T12:55:45.743212+0000","last_active":"2024-09-05T12:56:05.819602+0000","last_peered":"2024-09-05T12:56:05.819602+0000","last_clean":"2024-09-05T12:56:05.819602+0000","last_became_active":"2024-09-05T12:55:45.742918+0000","last_became_peered":"2024-09-05T12:55:45.742918+0000","last_unstale":"2024-09-05T12:56:05.819602+0000","last_undegraded":"2024-09-05T12:56:05.819602+0000","last_fullsized":"2024-09-05T12:56:05.819602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:21:18.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063680+0000","last_change":"2024-09-05T12:55:45.745058+0000","last_active":"2024-09-05T12:56:05.063680+0000","last_peered":"2024-09-05T12:56:05.063680+0000","last_clean":"2024-09-05T12:56:05.063680+0000","last_became_active":"2024-09-05T12:55:45.744349+0000","last_became_peered":"2024-09-05T12:55:45.744349+0000","last_unstale":"2024-09-05T12:56:05.063680+0000","last_undegraded":"2024-09-05T12:56:05.063680+0000","last_fullsized":"2024-09-05T12:56:05.063680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:26:21.034864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063126+0000","last_change":"2024-09-05T12:55:45.748387+0000","last_active":"2024-09-05T12:56:05.063126+0000","last_peered":"2024-09-05T12:56:05.063126+0000","last_clean":"2024-09-05T12:56:05.063126+0000","last_became_active":"2024-09-05T12:55:45.748082+0000","last_became_peered":"2024-09-05T12:55:45.748082+0000","last_unstale":"2024-09-05T12:56:05.063126+0000","last_undegraded":"2024-09-05T12:56:05.063126+0000","last_fullsized":"2024-09-05T12:56:05.063126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:51:23.835278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851526+0000","last_change":"2024-09-05T12:55:45.742195+0000","last_active":"2024-09-05T12:56:05.851526+0000","last_peered":"2024-09-05T12:56:05.851526+0000","last_clean":"2024-09-05T12:56:05.851526+0000","last_became_active":"2024-09-05T12:55:45.741888+0000","last_became_peered":"2024-09-05T12:55:45.741888+0000","last_unstale":"2024-09-05T12:56:05.851526+0000","last_undegraded":"2024-09-05T12:56:05.851526+0000","last_fullsized":"2024-09-05T12:56:05.851526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:19:17.556164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059394+0000","last_change":"2024-09-05T12:55:45.755255+0000","last_active":"2024-09-05T12:56:05.059394+0000","last_peered":"2024-09-05T12:56:05.059394+0000","last_clean":"2024-09-05T12:56:05.059394+0000","last_became_active":"2024-09-05T12:55:45.754939+0000","last_became_peered":"2024-09-05T12:55:45.754939+0000","last_unstale":"2024-09-05T12:56:05.059394+0000","last_undegraded":"2024-09-05T12:56:05.059394+0000","last_fullsized":"2024-09-05T12:56:05.059394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:48:34.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061596+0000","last_change":"2024-09-05T12:55:45.745496+0000","last_active":"2024-09-05T12:56:05.061596+0000","last_peered":"2024-09-05T12:56:05.061596+0000","last_clean":"2024-09-05T12:56:05.061596+0000","last_became_active":"2024-09-05T12:55:45.745153+0000","last_became_peered":"2024-09-05T12:55:45.745153+0000","last_unstale":"2024-09-05T12:56:05.061596+0000","last_undegraded":"2024-09-05T12:56:05.061596+0000","last_fullsized":"2024-09-05T12:56:05.061596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:16:52.255227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062235+0000","last_change":"2024-09-05T12:55:45.747353+0000","last_active":"2024-09-05T12:56:05.062235+0000","last_peered":"2024-09-05T12:56:05.062235+0000","last_clean":"2024-09-05T12:56:05.062235+0000","last_became_active":"2024-09-05T12:55:45.747018+0000","last_became_peered":"2024-09-05T12:55:45.747018+0000","last_unstale":"2024-09-05T12:56:05.062235+0000","last_undegraded":"2024-09-05T12:56:05.062235+0000","last_fullsized":"2024-09-05T12:56:05.062235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:12:25.217057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059013+0000","last_change":"2024-09-05T12:55:45.754023+0000","last_active":"2024-09-05T12:56:05.059013+0000","last_peered":"2024-09-05T12:56:05.059013+0000","last_clean":"2024-09-05T12:56:05.059013+0000","last_became_active":"2024-09-05T12:55:45.753723+0000","last_became_peered":"2024-09-05T12:55:45.753723+0000","last_unstale":"2024-09-05T12:56:05.059013+0000","last_undegraded":"2024-09-05T12:56:05.059013+0000","last_fullsized":"2024-09-05T12:56:05.059013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:16:01.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819690+0000","last_change":"2024-09-05T12:55:45.742627+0000","last_active":"2024-09-05T12:56:05.819690+0000","last_peered":"2024-09-05T12:56:05.819690+0000","last_clean":"2024-09-05T12:56:05.819690+0000","last_became_active":"2024-09-05T12:55:45.742252+0000","last_became_peered":"2024-09-05T12:55:45.742252+0000","last_unstale":"2024-09-05T12:56:05.819690+0000","last_undegraded":"2024-09-05T12:56:05.819690+0000","last_fullsized":"2024-09-05T12:56:05.819690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:14:34.476156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851781+0000","last_change":"2024-09-05T12:55:45.743587+0000","last_active":"2024-09-05T12:56:05.851781+0000","last_peered":"2024-09-05T12:56:05.851781+0000","last_clean":"2024-09-05T12:56:05.851781+0000","last_became_active":"2024-09-05T12:55:45.742624+0000","last_became_peered":"2024-09-05T12:55:45.742624+0000","last_unstale":"2024-09-05T12:56:05.851781+0000","last_undegraded":"2024-09-05T12:56:05.851781+0000","last_fullsized":"2024-09-05T12:56:05.851781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:15.981929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060563+0000","last_change":"2024-09-05T12:55:45.747430+0000","last_active":"2024-09-05T12:56:05.060563+0000","last_peered":"2024-09-05T12:56:05.060563+0000","last_clean":"2024-09-05T12:56:05.060563+0000","last_became_active":"2024-09-05T12:55:45.747049+0000","last_became_peered":"2024-09-05T12:55:45.747049+0000","last_unstale":"2024-09-05T12:56:05.060563+0000","last_undegraded":"2024-09-05T12:56:05.060563+0000","last_fullsized":"2024-09-05T12:56:05.060563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:31:08.388375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065470+0000","last_change":"2024-09-05T12:55:45.741645+0000","last_active":"2024-09-05T12:56:05.065470+0000","last_peered":"2024-09-05T12:56:05.065470+0000","last_clean":"2024-09-05T12:56:05.065470+0000","last_became_active":"2024-09-05T12:55:45.741341+0000","last_became_peered":"2024-09-05T12:55:45.741341+0000","last_unstale":"2024-09-05T12:56:05.065470+0000","last_undegraded":"2024-09-05T12:56:05.065470+0000","last_fullsized":"2024-09-05T12:56:05.065470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:24:11.896491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061589+0000","last_change":"2024-09-05T12:55:45.747609+0000","last_active":"2024-09-05T12:56:05.061589+0000","last_peered":"2024-09-05T12:56:05.061589+0000","last_clean":"2024-09-05T12:56:05.061589+0000","last_became_active":"2024-09-05T12:55:45.745899+0000","last_became_peered":"2024-09-05T12:55:45.745899+0000","last_unstale":"2024-09-05T12:56:05.061589+0000","last_undegraded":"2024-09-05T12:56:05.061589+0000","last_fullsized":"2024-09-05T12:56:05.061589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:21:42.224663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061958+0000","last_change":"2024-09-05T12:55:45.744974+0000","last_active":"2024-09-05T12:56:05.061958+0000","last_peered":"2024-09-05T12:56:05.061958+0000","last_clean":"2024-09-05T12:56:05.061958+0000","last_became_active":"2024-09-05T12:55:45.744538+0000","last_became_peered":"2024-09-05T12:55:45.744538+0000","last_unstale":"2024-09-05T12:56:05.061958+0000","last_undegraded":"2024-09-05T12:56:05.061958+0000","last_fullsized":"2024-09-05T12:56:05.061958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:48:46.695178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064626+0000","last_change":"2024-09-05T12:56:05.064626+0000","last_active":"2024-09-05T12:56:05.064626+0000","last_peered":"2024-09-05T12:56:05.064626+0000","last_clean":"2024-09-05T12:56:05.064626+0000","last_became_active":"2024-09-05T12:56:05.063972+0000","last_became_peered":"2024-09-05T12:56:05.063972+0000","last_unstale":"2024-09-05T12:56:05.064626+0000","last_undegraded":"2024-09-05T12:56:05.064626+0000","last_fullsized":"2024-09-05T12:56:05.064626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:57.345008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819769+0000","last_change":"2024-09-05T12:55:45.753630+0000","last_active":"2024-09-05T12:56:05.819769+0000","last_peered":"2024-09-05T12:56:05.819769+0000","last_clean":"2024-09-05T12:56:05.819769+0000","last_became_active":"2024-09-05T12:55:45.753328+0000","last_became_peered":"2024-09-05T12:55:45.753328+0000","last_unstale":"2024-09-05T12:56:05.819769+0000","last_undegraded":"2024-09-05T12:56:05.819769+0000","last_fullsized":"2024-09-05T12:56:05.819769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:55:39.064374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063372+0000","last_change":"2024-09-05T12:55:45.749596+0000","last_active":"2024-09-05T12:56:05.063372+0000","last_peered":"2024-09-05T12:56:05.063372+0000","last_clean":"2024-09-05T12:56:05.063372+0000","last_became_active":"2024-09-05T12:55:45.749150+0000","last_became_peered":"2024-09-05T12:55:45.749150+0000","last_unstale":"2024-09-05T12:56:05.063372+0000","last_undegraded":"2024-09-05T12:56:05.063372+0000","last_fullsized":"2024-09-05T12:56:05.063372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:14:06.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062144+0000","last_change":"2024-09-05T12:55:45.748414+0000","last_active":"2024-09-05T12:56:05.062144+0000","last_peered":"2024-09-05T12:56:05.062144+0000","last_clean":"2024-09-05T12:56:05.062144+0000","last_became_active":"2024-09-05T12:55:45.747952+0000","last_became_peered":"2024-09-05T12:55:45.747952+0000","last_unstale":"2024-09-05T12:56:05.062144+0000","last_undegraded":"2024-09-05T12:56:05.062144+0000","last_fullsized":"2024-09-05T12:56:05.062144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:45:04.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061467+0000","last_change":"2024-09-05T12:55:45.754145+0000","last_active":"2024-09-05T12:56:05.061467+0000","last_peered":"2024-09-05T12:56:05.061467+0000","last_clean":"2024-09-05T12:56:05.061467+0000","last_became_active":"2024-09-05T12:55:45.753833+0000","last_became_peered":"2024-09-05T12:55:45.753833+0000","last_unstale":"2024-09-05T12:56:05.061467+0000","last_undegraded":"2024-09-05T12:56:05.061467+0000","last_fullsized":"2024-09-05T12:56:05.061467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:45:24.606506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.058922+0000","last_change":"2024-09-05T12:55:45.750283+0000","last_active":"2024-09-05T12:56:05.058922+0000","last_peered":"2024-09-05T12:56:05.058922+0000","last_clean":"2024-09-05T12:56:05.058922+0000","last_became_active":"2024-09-05T12:55:45.749901+0000","last_became_peered":"2024-09-05T12:55:45.749901+0000","last_unstale":"2024-09-05T12:56:05.058922+0000","last_undegraded":"2024-09-05T12:56:05.058922+0000","last_fullsized":"2024-09-05T12:56:05.058922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:45:57.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061784+0000","last_change":"2024-09-05T12:55:45.743239+0000","last_active":"2024-09-05T12:56:05.061784+0000","last_peered":"2024-09-05T12:56:05.061784+0000","last_clean":"2024-09-05T12:56:05.061784+0000","last_became_active":"2024-09-05T12:55:45.742926+0000","last_became_peered":"2024-09-05T12:55:45.742926+0000","last_unstale":"2024-09-05T12:56:05.061784+0000","last_undegraded":"2024-09-05T12:56:05.061784+0000","last_fullsized":"2024-09-05T12:56:05.061784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:26:05.559405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:09.826346+0000","last_change":"2024-09-05T12:55:43.727301+0000","last_active":"2024-09-05T12:56:09.826346+0000","last_peered":"2024-09-05T12:56:09.826346+0000","last_clean":"2024-09-05T12:56:09.826346+0000","last_became_active":"2024-09-05T12:55:43.727006+0000","last_became_peered":"2024-09-05T12:55:43.727006+0000","last_unstale":"2024-09-05T12:56:09.826346+0000","last_undegraded":"2024-09-05T12:56:09.826346+0000","last_fullsized":"2024-09-05T12:56:09.826346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:54:32.725098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066620+0000","last_change":"2024-09-05T12:55:45.735835+0000","last_active":"2024-09-05T12:56:05.066620+0000","last_peered":"2024-09-05T12:56:05.066620+0000","last_clean":"2024-09-05T12:56:05.066620+0000","last_became_active":"2024-09-05T12:55:45.735404+0000","last_became_peered":"2024-09-05T12:55:45.735404+0000","last_unstale":"2024-09-05T12:56:05.066620+0000","last_undegraded":"2024-09-05T12:56:05.066620+0000","last_fullsized":"2024-09-05T12:56:05.066620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:06:47.174441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062007+0000","last_change":"2024-09-05T12:55:43.724561+0000","last_active":"2024-09-05T12:56:05.062007+0000","last_peered":"2024-09-05T12:56:05.062007+0000","last_clean":"2024-09-05T12:56:05.062007+0000","last_became_active":"2024-09-05T12:55:43.722704+0000","last_became_peered":"2024-09-05T12:55:43.722704+0000","last_unstale":"2024-09-05T12:56:05.062007+0000","last_undegraded":"2024-09-05T12:56:05.062007+0000","last_fullsized":"2024-09-05T12:56:05.062007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:20:20.692844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819297+0000","last_change":"2024-09-05T12:55:43.722937+0000","last_active":"2024-09-05T12:56:05.819297+0000","last_peered":"2024-09-05T12:56:05.819297+0000","last_clean":"2024-09-05T12:56:05.819297+0000","last_became_active":"2024-09-05T12:55:43.722606+0000","last_became_peered":"2024-09-05T12:55:43.722606+0000","last_unstale":"2024-09-05T12:56:05.819297+0000","last_undegraded":"2024-09-05T12:56:05.819297+0000","last_fullsized":"2024-09-05T12:56:05.819297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:47:38.448865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.820632+0000","last_change":"2024-09-05T12:56:05.820632+0000","last_active":"2024-09-05T12:56:05.820632+0000","last_peered":"2024-09-05T12:56:05.820632+0000","last_clean":"2024-09-05T12:56:05.820632+0000","last_became_active":"2024-09-05T12:56:05.820239+0000","last_became_peered":"2024-09-05T12:56:05.820239+0000","last_unstale":"2024-09-05T12:56:05.820632+0000","last_undegraded":"2024-09-05T12:56:05.820632+0000","last_fullsized":"2024-09-05T12:56:05.820632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:36:59.659783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065764+0000","last_change":"2024-09-05T12:55:43.725546+0000","last_active":"2024-09-05T12:56:05.065764+0000","last_peered":"2024-09-05T12:56:05.065764+0000","last_clean":"2024-09-05T12:56:05.065764+0000","last_became_active":"2024-09-05T12:55:43.725252+0000","last_became_peered":"2024-09-05T12:55:43.725252+0000","last_unstale":"2024-09-05T12:56:05.065764+0000","last_undegraded":"2024-09-05T12:56:05.065764+0000","last_fullsized":"2024-09-05T12:56:05.065764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:49:16.085799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060968+0000","last_change":"2024-09-05T12:55:45.745358+0000","last_active":"2024-09-05T12:56:05.060968+0000","last_peered":"2024-09-05T12:56:05.060968+0000","last_clean":"2024-09-05T12:56:05.060968+0000","last_became_active":"2024-09-05T12:55:45.745040+0000","last_became_peered":"2024-09-05T12:55:45.745040+0000","last_unstale":"2024-09-05T12:56:05.060968+0000","last_undegraded":"2024-09-05T12:56:05.060968+0000","last_fullsized":"2024-09-05T12:56:05.060968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:42:42.906745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:07.822344+0000","last_change":"2024-09-05T12:55:43.726138+0000","last_active":"2024-09-05T12:56:07.822344+0000","last_peered":"2024-09-05T12:56:07.822344+0000","last_clean":"2024-09-05T12:56:07.822344+0000","last_became_active":"2024-09-05T12:55:43.725815+0000","last_became_peered":"2024-09-05T12:55:43.725815+0000","last_unstale":"2024-09-05T12:56:07.822344+0000","last_undegraded":"2024-09-05T12:56:07.822344+0000","last_fullsized":"2024-09-05T12:56:07.822344+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:35:38.041757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851996+0000","last_change":"2024-09-05T12:55:45.743580+0000","last_active":"2024-09-05T12:56:05.851996+0000","last_peered":"2024-09-05T12:56:05.851996+0000","last_clean":"2024-09-05T12:56:05.851996+0000","last_became_active":"2024-09-05T12:55:45.743307+0000","last_became_peered":"2024-09-05T12:55:45.743307+0000","last_unstale":"2024-09-05T12:56:05.851996+0000","last_undegraded":"2024-09-05T12:56:05.851996+0000","last_fullsized":"2024-09-05T12:56:05.851996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:15:13.898218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676632+0000","last_change":"2024-09-05T12:55:43.725373+0000","last_active":"2024-09-05T12:56:05.676632+0000","last_peered":"2024-09-05T12:56:05.676632+0000","last_clean":"2024-09-05T12:56:05.676632+0000","last_became_active":"2024-09-05T12:55:43.725062+0000","last_became_peered":"2024-09-05T12:55:43.725062+0000","last_unstale":"2024-09-05T12:56:05.676632+0000","last_undegraded":"2024-09-05T12:56:05.676632+0000","last_fullsized":"2024-09-05T12:56:05.676632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:42:27.994499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063879+0000","last_change":"2024-09-05T12:55:45.750265+0000","last_active":"2024-09-05T12:56:05.063879+0000","last_peered":"2024-09-05T12:56:05.063879+0000","last_clean":"2024-09-05T12:56:05.063879+0000","last_became_active":"2024-09-05T12:55:45.749928+0000","last_became_peered":"2024-09-05T12:55:45.749928+0000","last_unstale":"2024-09-05T12:56:05.063879+0000","last_undegraded":"2024-09-05T12:56:05.063879+0000","last_fullsized":"2024-09-05T12:56:05.063879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:56:19.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065937+0000","last_change":"2024-09-05T12:55:43.736248+0000","last_active":"2024-09-05T12:56:05.065937+0000","last_peered":"2024-09-05T12:56:05.065937+0000","last_clean":"2024-09-05T12:56:05.065937+0000","last_became_active":"2024-09-05T12:55:43.735928+0000","last_became_peered":"2024-09-05T12:55:43.735928+0000","last_unstale":"2024-09-05T12:56:05.065937+0000","last_undegraded":"2024-09-05T12:56:05.065937+0000","last_fullsized":"2024-09-05T12:56:05.065937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:04:43.215616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851777+0000","last_change":"2024-09-05T12:55:45.739178+0000","last_active":"2024-09-05T12:56:05.851777+0000","last_peered":"2024-09-05T12:56:05.851777+0000","last_clean":"2024-09-05T12:56:05.851777+0000","last_became_active":"2024-09-05T12:55:45.738863+0000","last_became_peered":"2024-09-05T12:55:45.738863+0000","last_unstale":"2024-09-05T12:56:05.851777+0000","last_undegraded":"2024-09-05T12:56:05.851777+0000","last_fullsized":"2024-09-05T12:56:05.851777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:08.273036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'22","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:08.824330+0000","last_change":"2024-09-05T12:55:43.725380+0000","last_active":"2024-09-05T12:56:08.824330+0000","last_peered":"2024-09-05T12:56:08.824330+0000","last_clean":"2024-09-05T12:56:08.824330+0000","last_became_active":"2024-09-05T12:55:43.725000+0000","last_became_peered":"2024-09-05T12:55:43.725000+0000","last_unstale":"2024-09-05T12:56:08.824330+0000","last_undegraded":"2024-09-05T12:56:08.824330+0000","last_fullsized":"2024-09-05T12:56:08.824330+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:34:13.288894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061405+0000","last_change":"2024-09-05T12:55:45.742269+0000","last_active":"2024-09-05T12:56:05.061405+0000","last_peered":"2024-09-05T12:56:05.061405+0000","last_clean":"2024-09-05T12:56:05.061405+0000","last_became_active":"2024-09-05T12:55:45.741723+0000","last_became_peered":"2024-09-05T12:55:45.741723+0000","last_unstale":"2024-09-05T12:56:05.061405+0000","last_undegraded":"2024-09-05T12:56:05.061405+0000","last_fullsized":"2024-09-05T12:56:05.061405+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:39.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061771+0000","last_change":"2024-09-05T12:55:43.723725+0000","last_active":"2024-09-05T12:56:05.061771+0000","last_peered":"2024-09-05T12:56:05.061771+0000","last_clean":"2024-09-05T12:56:05.061771+0000","last_became_active":"2024-09-05T12:55:43.723351+0000","last_became_peered":"2024-09-05T12:55:43.723351+0000","last_unstale":"2024-09-05T12:56:05.061771+0000","last_undegraded":"2024-09-05T12:56:05.061771+0000","last_fullsized":"2024-09-05T12:56:05.061771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:15:40.485461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819355+0000","last_change":"2024-09-05T12:55:45.742293+0000","last_active":"2024-09-05T12:56:05.819355+0000","last_peered":"2024-09-05T12:56:05.819355+0000","last_clean":"2024-09-05T12:56:05.819355+0000","last_became_active":"2024-09-05T12:55:45.741998+0000","last_became_peered":"2024-09-05T12:55:45.741998+0000","last_unstale":"2024-09-05T12:56:05.819355+0000","last_undegraded":"2024-09-05T12:56:05.819355+0000","last_fullsized":"2024-09-05T12:56:05.819355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:25:23.731384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065615+0000","last_change":"2024-09-05T12:55:43.726519+0000","last_active":"2024-09-05T12:56:05.065615+0000","last_peered":"2024-09-05T12:56:05.065615+0000","last_clean":"2024-09-05T12:56:05.065615+0000","last_became_active":"2024-09-05T12:55:43.726231+0000","last_became_peered":"2024-09-05T12:55:43.726231+0000","last_unstale":"2024-09-05T12:56:05.065615+0000","last_undegraded":"2024-09-05T12:56:05.065615+0000","last_fullsized":"2024-09-05T12:56:05.065615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:22:55.460814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676243+0000","last_change":"2024-09-05T12:55:45.739359+0000","last_active":"2024-09-05T12:56:05.676243+0000","last_peered":"2024-09-05T12:56:05.676243+0000","last_clean":"2024-09-05T12:56:05.676243+0000","last_became_active":"2024-09-05T12:55:45.738358+0000","last_became_peered":"2024-09-05T12:55:45.738358+0000","last_unstale":"2024-09-05T12:56:05.676243+0000","last_undegraded":"2024-09-05T12:56:05.676243+0000","last_fullsized":"2024-09-05T12:56:05.676243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:11:37.144174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:09.825672+0000","last_change":"2024-09-05T12:55:43.726623+0000","last_active":"2024-09-05T12:56:09.825672+0000","last_peered":"2024-09-05T12:56:09.825672+0000","last_clean":"2024-09-05T12:56:09.825672+0000","last_became_active":"2024-09-05T12:55:43.726281+0000","last_became_peered":"2024-09-05T12:55:43.726281+0000","last_unstale":"2024-09-05T12:56:09.825672+0000","last_undegraded":"2024-09-05T12:56:09.825672+0000","last_fullsized":"2024-09-05T12:56:09.825672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:59:07.503458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676010+0000","last_change":"2024-09-05T12:55:45.745731+0000","last_active":"2024-09-05T12:56:05.676010+0000","last_peered":"2024-09-05T12:56:05.676010+0000","last_clean":"2024-09-05T12:56:05.676010+0000","last_became_active":"2024-09-05T12:55:45.745399+0000","last_became_peered":"2024-09-05T12:55:45.745399+0000","last_unstale":"2024-09-05T12:56:05.676010+0000","last_undegraded":"2024-09-05T12:56:05.676010+0000","last_fullsized":"2024-09-05T12:56:05.676010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:47:44.737335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061012+0000","last_change":"2024-09-05T12:55:43.736527+0000","last_active":"2024-09-05T12:56:05.061012+0000","last_peered":"2024-09-05T12:56:05.061012+0000","last_clean":"2024-09-05T12:56:05.061012+0000","last_became_active":"2024-09-05T12:55:43.736088+0000","last_became_peered":"2024-09-05T12:55:43.736088+0000","last_unstale":"2024-09-05T12:56:05.061012+0000","last_undegraded":"2024-09-05T12:56:05.061012+0000","last_fullsized":"2024-09-05T12:56:05.061012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:14.570503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.853150+0000","last_change":"2024-09-05T12:56:05.853150+0000","last_active":"2024-09-05T12:56:05.853150+0000","last_peered":"2024-09-05T12:56:05.853150+0000","last_clean":"2024-09-05T12:56:05.853150+0000","last_became_active":"2024-09-05T12:56:05.852728+0000","last_became_peered":"2024-09-05T12:56:05.852728+0000","last_unstale":"2024-09-05T12:56:05.853150+0000","last_undegraded":"2024-09-05T12:56:05.853150+0000","last_fullsized":"2024-09-05T12:56:05.853150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:58:49.654402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062050+0000","last_change":"2024-09-05T12:55:43.726989+0000","last_active":"2024-09-05T12:56:05.062050+0000","last_peered":"2024-09-05T12:56:05.062050+0000","last_clean":"2024-09-05T12:56:05.062050+0000","last_became_active":"2024-09-05T12:55:43.726690+0000","last_became_peered":"2024-09-05T12:55:43.726690+0000","last_unstale":"2024-09-05T12:56:05.062050+0000","last_undegraded":"2024-09-05T12:56:05.062050+0000","last_fullsized":"2024-09-05T12:56:05.062050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:15:31.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059176+0000","last_change":"2024-09-05T12:55:45.754849+0000","last_active":"2024-09-05T12:56:05.059176+0000","last_peered":"2024-09-05T12:56:05.059176+0000","last_clean":"2024-09-05T12:56:05.059176+0000","last_became_active":"2024-09-05T12:55:45.754539+0000","last_became_peered":"2024-09-05T12:55:45.754539+0000","last_unstale":"2024-09-05T12:56:05.059176+0000","last_undegraded":"2024-09-05T12:56:05.059176+0000","last_fullsized":"2024-09-05T12:56:05.059176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:14:17.628561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819674+0000","last_change":"2024-09-05T12:55:43.723140+0000","last_active":"2024-09-05T12:56:05.819674+0000","last_peered":"2024-09-05T12:56:05.819674+0000","last_clean":"2024-09-05T12:56:05.819674+0000","last_became_active":"2024-09-05T12:55:43.722806+0000","last_became_peered":"2024-09-05T12:55:43.722806+0000","last_unstale":"2024-09-05T12:56:05.819674+0000","last_undegraded":"2024-09-05T12:56:05.819674+0000","last_fullsized":"2024-09-05T12:56:05.819674+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:00:30.041237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676678+0000","last_change":"2024-09-05T12:55:45.750948+0000","last_active":"2024-09-05T12:56:05.676678+0000","last_peered":"2024-09-05T12:56:05.676678+0000","last_clean":"2024-09-05T12:56:05.676678+0000","last_became_active":"2024-09-05T12:55:45.750642+0000","last_became_peered":"2024-09-05T12:55:45.750642+0000","last_unstale":"2024-09-05T12:56:05.676678+0000","last_undegraded":"2024-09-05T12:56:05.676678+0000","last_fullsized":"2024-09-05T12:56:05.676678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:17:48.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066001+0000","last_change":"2024-09-05T12:55:43.724847+0000","last_active":"2024-09-05T12:56:05.066001+0000","last_peered":"2024-09-05T12:56:05.066001+0000","last_clean":"2024-09-05T12:56:05.066001+0000","last_became_active":"2024-09-05T12:55:43.724538+0000","last_became_peered":"2024-09-05T12:55:43.724538+0000","last_unstale":"2024-09-05T12:56:05.066001+0000","last_undegraded":"2024-09-05T12:56:05.066001+0000","last_fullsized":"2024-09-05T12:56:05.066001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:13:46.011992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676407+0000","last_change":"2024-09-05T12:55:45.742080+0000","last_active":"2024-09-05T12:56:05.676407+0000","last_peered":"2024-09-05T12:56:05.676407+0000","last_clean":"2024-09-05T12:56:05.676407+0000","last_became_active":"2024-09-05T12:55:45.741749+0000","last_became_peered":"2024-09-05T12:55:45.741749+0000","last_unstale":"2024-09-05T12:56:05.676407+0000","last_undegraded":"2024-09-05T12:56:05.676407+0000","last_fullsized":"2024-09-05T12:56:05.676407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:20.597209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061670+0000","last_change":"2024-09-05T12:55:43.736856+0000","last_active":"2024-09-05T12:56:05.061670+0000","last_peered":"2024-09-05T12:56:05.061670+0000","last_clean":"2024-09-05T12:56:05.061670+0000","last_became_active":"2024-09-05T12:55:43.736490+0000","last_became_peered":"2024-09-05T12:55:43.736490+0000","last_unstale":"2024-09-05T12:56:05.061670+0000","last_undegraded":"2024-09-05T12:56:05.061670+0000","last_fullsized":"2024-09-05T12:56:05.061670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:36:55.286932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676384+0000","last_change":"2024-09-05T12:55:45.750667+0000","last_active":"2024-09-05T12:56:05.676384+0000","last_peered":"2024-09-05T12:56:05.676384+0000","last_clean":"2024-09-05T12:56:05.676384+0000","last_became_active":"2024-09-05T12:55:45.750386+0000","last_became_peered":"2024-09-05T12:55:45.750386+0000","last_unstale":"2024-09-05T12:56:05.676384+0000","last_undegraded":"2024-09-05T12:56:05.676384+0000","last_fullsized":"2024-09-05T12:56:05.676384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:32:41.443471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676291+0000","last_change":"2024-09-05T12:54:31.534043+0000","last_active":"2024-09-05T12:56:05.676291+0000","last_peered":"2024-09-05T12:56:05.676291+0000","last_clean":"2024-09-05T12:56:05.676291+0000","last_became_active":"2024-09-05T12:54:31.533610+0000","last_became_peered":"2024-09-05T12:54:31.533610+0000","last_unstale":"2024-09-05T12:56:05.676291+0000","last_undegraded":"2024-09-05T12:56:05.676291+0000","last_fullsized":"2024-09-05T12:56:05.676291+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_clean_scrub_stamp":"2024-09-05T12:51:12.506567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:30:50.399925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201941+0000","last_change":"2024-09-05T12:55:43.727743+0000","last_active":"2024-09-05T12:56:05.201941+0000","last_peered":"2024-09-05T12:56:05.201941+0000","last_clean":"2024-09-05T12:56:05.201941+0000","last_became_active":"2024-09-05T12:55:43.727333+0000","last_became_peered":"2024-09-05T12:55:43.727333+0000","last_unstale":"2024-09-05T12:56:05.201941+0000","last_undegraded":"2024-09-05T12:56:05.201941+0000","last_fullsized":"2024-09-05T12:56:05.201941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:41:21.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061274+0000","last_change":"2024-09-05T12:55:45.744268+0000","last_active":"2024-09-05T12:56:05.061274+0000","last_peered":"2024-09-05T12:56:05.061274+0000","last_clean":"2024-09-05T12:56:05.061274+0000","last_became_active":"2024-09-05T12:55:45.743976+0000","last_became_peered":"2024-09-05T12:55:45.743976+0000","last_unstale":"2024-09-05T12:56:05.061274+0000","last_undegraded":"2024-09-05T12:56:05.061274+0000","last_fullsized":"2024-09-05T12:56:05.061274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:02.568293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676247+0000","last_change":"2024-09-05T12:55:43.728853+0000","last_active":"2024-09-05T12:56:05.676247+0000","last_peered":"2024-09-05T12:56:05.676247+0000","last_clean":"2024-09-05T12:56:05.676247+0000","last_became_active":"2024-09-05T12:55:43.728559+0000","last_became_peered":"2024-09-05T12:55:43.728559+0000","last_unstale":"2024-09-05T12:56:05.676247+0000","last_undegraded":"2024-09-05T12:56:05.676247+0000","last_fullsized":"2024-09-05T12:56:05.676247+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:16:53.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819290+0000","last_change":"2024-09-05T12:55:45.748445+0000","last_active":"2024-09-05T12:56:05.819290+0000","last_peered":"2024-09-05T12:56:05.819290+0000","last_clean":"2024-09-05T12:56:05.819290+0000","last_became_active":"2024-09-05T12:55:45.748152+0000","last_became_peered":"2024-09-05T12:55:45.748152+0000","last_unstale":"2024-09-05T12:56:05.819290+0000","last_undegraded":"2024-09-05T12:56:05.819290+0000","last_fullsized":"2024-09-05T12:56:05.819290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:37:35.842555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:08.823614+0000","last_change":"2024-09-05T12:55:43.734607+0000","last_active":"2024-09-05T12:56:08.823614+0000","last_peered":"2024-09-05T12:56:08.823614+0000","last_clean":"2024-09-05T12:56:08.823614+0000","last_became_active":"2024-09-05T12:55:43.734288+0000","last_became_peered":"2024-09-05T12:55:43.734288+0000","last_unstale":"2024-09-05T12:56:08.823614+0000","last_undegraded":"2024-09-05T12:56:08.823614+0000","last_fullsized":"2024-09-05T12:56:08.823614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:40:40.350335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065590+0000","last_change":"2024-09-05T12:55:45.745622+0000","last_active":"2024-09-05T12:56:05.065590+0000","last_peered":"2024-09-05T12:56:05.065590+0000","last_clean":"2024-09-05T12:56:05.065590+0000","last_became_active":"2024-09-05T12:55:45.745282+0000","last_became_peered":"2024-09-05T12:55:45.745282+0000","last_unstale":"2024-09-05T12:56:05.065590+0000","last_undegraded":"2024-09-05T12:56:05.065590+0000","last_fullsized":"2024-09-05T12:56:05.065590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:50:19.657275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676337+0000","last_change":"2024-09-05T12:55:43.723985+0000","last_active":"2024-09-05T12:56:05.676337+0000","last_peered":"2024-09-05T12:56:05.676337+0000","last_clean":"2024-09-05T12:56:05.676337+0000","last_became_active":"2024-09-05T12:55:43.723651+0000","last_became_peered":"2024-09-05T12:55:43.723651+0000","last_unstale":"2024-09-05T12:56:05.676337+0000","last_undegraded":"2024-09-05T12:56:05.676337+0000","last_fullsized":"2024-09-05T12:56:05.676337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:10:45.723258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062115+0000","last_change":"2024-09-05T12:55:45.738603+0000","last_active":"2024-09-05T12:56:05.062115+0000","last_peered":"2024-09-05T12:56:05.062115+0000","last_clean":"2024-09-05T12:56:05.062115+0000","last_became_active":"2024-09-05T12:55:45.738299+0000","last_became_peered":"2024-09-05T12:55:45.738299+0000","last_unstale":"2024-09-05T12:56:05.062115+0000","last_undegraded":"2024-09-05T12:56:05.062115+0000","last_fullsized":"2024-09-05T12:56:05.062115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:05:28.174555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061144+0000","last_change":"2024-09-05T12:55:43.734587+0000","last_active":"2024-09-05T12:56:05.061144+0000","last_peered":"2024-09-05T12:56:05.061144+0000","last_clean":"2024-09-05T12:56:05.061144+0000","last_became_active":"2024-09-05T12:55:43.734260+0000","last_became_peered":"2024-09-05T12:55:43.734260+0000","last_unstale":"2024-09-05T12:56:05.061144+0000","last_undegraded":"2024-09-05T12:56:05.061144+0000","last_fullsized":"2024-09-05T12:56:05.061144+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:37:00.235234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062195+0000","last_change":"2024-09-05T12:55:45.740516+0000","last_active":"2024-09-05T12:56:05.062195+0000","last_peered":"2024-09-05T12:56:05.062195+0000","last_clean":"2024-09-05T12:56:05.062195+0000","last_became_active":"2024-09-05T12:55:45.740227+0000","last_became_peered":"2024-09-05T12:55:45.740227+0000","last_unstale":"2024-09-05T12:56:05.062195+0000","last_undegraded":"2024-09-05T12:56:05.062195+0000","last_fullsized":"2024-09-05T12:56:05.062195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:34:44.922326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061647+0000","last_change":"2024-09-05T12:55:43.734592+0000","last_active":"2024-09-05T12:56:05.061647+0000","last_peered":"2024-09-05T12:56:05.061647+0000","last_clean":"2024-09-05T12:56:05.061647+0000","last_became_active":"2024-09-05T12:55:43.734243+0000","last_became_peered":"2024-09-05T12:55:43.734243+0000","last_unstale":"2024-09-05T12:56:05.061647+0000","last_undegraded":"2024-09-05T12:56:05.061647+0000","last_fullsized":"2024-09-05T12:56:05.061647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:14.368806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819567+0000","last_change":"2024-09-05T12:55:45.748201+0000","last_active":"2024-09-05T12:56:05.819567+0000","last_peered":"2024-09-05T12:56:05.819567+0000","last_clean":"2024-09-05T12:56:05.819567+0000","last_became_active":"2024-09-05T12:55:45.747906+0000","last_became_peered":"2024-09-05T12:55:45.747906+0000","last_unstale":"2024-09-05T12:56:05.819567+0000","last_undegraded":"2024-09-05T12:56:05.819567+0000","last_fullsized":"2024-09-05T12:56:05.819567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:07.984589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'9","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:08.748559+0000","last_change":"2024-09-05T12:56:05.071328+0000","last_active":"2024-09-05T12:56:08.748559+0000","last_peered":"2024-09-05T12:56:08.748559+0000","last_clean":"2024-09-05T12:56:08.748559+0000","last_became_active":"2024-09-05T12:56:05.064345+0000","last_became_peered":"2024-09-05T12:56:05.064345+0000","last_unstale":"2024-09-05T12:56:08.748559+0000","last_undegraded":"2024-09-05T12:56:08.748559+0000","last_fullsized":"2024-09-05T12:56:08.748559+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:30:31.850824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061601+0000","last_change":"2024-09-05T12:55:45.743225+0000","last_active":"2024-09-05T12:56:05.061601+0000","last_peered":"2024-09-05T12:56:05.061601+0000","last_clean":"2024-09-05T12:56:05.061601+0000","last_became_active":"2024-09-05T12:55:45.742923+0000","last_became_peered":"2024-09-05T12:55:45.742923+0000","last_unstale":"2024-09-05T12:56:05.061601+0000","last_undegraded":"2024-09-05T12:56:05.061601+0000","last_fullsized":"2024-09-05T12:56:05.061601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:50:09.056893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.202275+0000","last_change":"2024-09-05T12:55:43.723420+0000","last_active":"2024-09-05T12:56:05.202275+0000","last_peered":"2024-09-05T12:56:05.202275+0000","last_clean":"2024-09-05T12:56:05.202275+0000","last_became_active":"2024-09-05T12:55:43.723100+0000","last_became_peered":"2024-09-05T12:55:43.723100+0000","last_unstale":"2024-09-05T12:56:05.202275+0000","last_undegraded":"2024-09-05T12:56:05.202275+0000","last_fullsized":"2024-09-05T12:56:05.202275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:21:33.307826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.678039+0000","last_change":"2024-09-05T12:56:05.678039+0000","last_active":"2024-09-05T12:56:05.678039+0000","last_peered":"2024-09-05T12:56:05.678039+0000","last_clean":"2024-09-05T12:56:05.678039+0000","last_became_active":"2024-09-05T12:56:05.677749+0000","last_became_peered":"2024-09-05T12:56:05.677749+0000","last_unstale":"2024-09-05T12:56:05.678039+0000","last_undegraded":"2024-09-05T12:56:05.678039+0000","last_fullsized":"2024-09-05T12:56:05.678039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:47:12.770873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851620+0000","last_change":"2024-09-05T12:55:43.736075+0000","last_active":"2024-09-05T12:56:05.851620+0000","last_peered":"2024-09-05T12:56:05.851620+0000","last_clean":"2024-09-05T12:56:05.851620+0000","last_became_active":"2024-09-05T12:55:43.735808+0000","last_became_peered":"2024-09-05T12:55:43.735808+0000","last_unstale":"2024-09-05T12:56:05.851620+0000","last_undegraded":"2024-09-05T12:56:05.851620+0000","last_fullsized":"2024-09-05T12:56:05.851620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:52:25.842728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061815+0000","last_change":"2024-09-05T12:55:45.747180+0000","last_active":"2024-09-05T12:56:05.061815+0000","last_peered":"2024-09-05T12:56:05.061815+0000","last_clean":"2024-09-05T12:56:05.061815+0000","last_became_active":"2024-09-05T12:55:45.746297+0000","last_became_peered":"2024-09-05T12:55:45.746297+0000","last_unstale":"2024-09-05T12:56:05.061815+0000","last_undegraded":"2024-09-05T12:56:05.061815+0000","last_fullsized":"2024-09-05T12:56:05.061815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:24:33.657861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060711+0000","last_change":"2024-09-05T12:55:43.720054+0000","last_active":"2024-09-05T12:56:05.060711+0000","last_peered":"2024-09-05T12:56:05.060711+0000","last_clean":"2024-09-05T12:56:05.060711+0000","last_became_active":"2024-09-05T12:55:43.719762+0000","last_became_peered":"2024-09-05T12:55:43.719762+0000","last_unstale":"2024-09-05T12:56:05.060711+0000","last_undegraded":"2024-09-05T12:56:05.060711+0000","last_fullsized":"2024-09-05T12:56:05.060711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:07:57.623333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059189+0000","last_change":"2024-09-05T12:55:45.756031+0000","last_active":"2024-09-05T12:56:05.059189+0000","last_peered":"2024-09-05T12:56:05.059189+0000","last_clean":"2024-09-05T12:56:05.059189+0000","last_became_active":"2024-09-05T12:55:45.755723+0000","last_became_peered":"2024-09-05T12:55:45.755723+0000","last_unstale":"2024-09-05T12:56:05.059189+0000","last_undegraded":"2024-09-05T12:56:05.059189+0000","last_fullsized":"2024-09-05T12:56:05.059189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:26.760307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.069746+0000","last_change":"2024-09-05T12:56:05.069208+0000","last_active":"2024-09-05T12:56:05.069746+0000","last_peered":"2024-09-05T12:56:05.069746+0000","last_clean":"2024-09-05T12:56:05.069746+0000","last_became_active":"2024-09-05T12:56:05.063698+0000","last_became_peered":"2024-09-05T12:56:05.063698+0000","last_unstale":"2024-09-05T12:56:05.069746+0000","last_undegraded":"2024-09-05T12:56:05.069746+0000","last_fullsized":"2024-09-05T12:56:05.069746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:55:54.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061163+0000","last_change":"2024-09-05T12:55:45.743108+0000","last_active":"2024-09-05T12:56:05.061163+0000","last_peered":"2024-09-05T12:56:05.061163+0000","last_clean":"2024-09-05T12:56:05.061163+0000","last_became_active":"2024-09-05T12:55:45.742197+0000","last_became_peered":"2024-09-05T12:55:45.742197+0000","last_unstale":"2024-09-05T12:56:05.061163+0000","last_undegraded":"2024-09-05T12:56:05.061163+0000","last_fullsized":"2024-09-05T12:56:05.061163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:13:15.192298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061447+0000","last_change":"2024-09-05T12:55:43.725893+0000","last_active":"2024-09-05T12:56:05.061447+0000","last_peered":"2024-09-05T12:56:05.061447+0000","last_clean":"2024-09-05T12:56:05.061447+0000","last_became_active":"2024-09-05T12:55:43.725578+0000","last_became_peered":"2024-09-05T12:55:43.725578+0000","last_unstale":"2024-09-05T12:56:05.061447+0000","last_undegraded":"2024-09-05T12:56:05.061447+0000","last_fullsized":"2024-09-05T12:56:05.061447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:39.101167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676363+0000","last_change":"2024-09-05T12:55:45.746727+0000","last_active":"2024-09-05T12:56:05.676363+0000","last_peered":"2024-09-05T12:56:05.676363+0000","last_clean":"2024-09-05T12:56:05.676363+0000","last_became_active":"2024-09-05T12:55:45.746446+0000","last_became_peered":"2024-09-05T12:55:45.746446+0000","last_unstale":"2024-09-05T12:56:05.676363+0000","last_undegraded":"2024-09-05T12:56:05.676363+0000","last_fullsized":"2024-09-05T12:56:05.676363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:56:51.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065862+0000","last_change":"2024-09-05T12:55:45.750253+0000","last_active":"2024-09-05T12:56:05.065862+0000","last_peered":"2024-09-05T12:56:05.065862+0000","last_clean":"2024-09-05T12:56:05.065862+0000","last_became_active":"2024-09-05T12:55:45.749911+0000","last_became_peered":"2024-09-05T12:55:45.749911+0000","last_unstale":"2024-09-05T12:56:05.065862+0000","last_undegraded":"2024-09-05T12:56:05.065862+0000","last_fullsized":"2024-09-05T12:56:05.065862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:04:04.164858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061563+0000","last_change":"2024-09-05T12:55:43.728597+0000","last_active":"2024-09-05T12:56:05.061563+0000","last_peered":"2024-09-05T12:56:05.061563+0000","last_clean":"2024-09-05T12:56:05.061563+0000","last_became_active":"2024-09-05T12:55:43.727633+0000","last_became_peered":"2024-09-05T12:55:43.727633+0000","last_unstale":"2024-09-05T12:56:05.061563+0000","last_undegraded":"2024-09-05T12:56:05.061563+0000","last_fullsized":"2024-09-05T12:56:05.061563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:50:04.775603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851671+0000","last_change":"2024-09-05T12:55:45.741539+0000","last_active":"2024-09-05T12:56:05.851671+0000","last_peered":"2024-09-05T12:56:05.851671+0000","last_clean":"2024-09-05T12:56:05.851671+0000","last_became_active":"2024-09-05T12:55:45.741247+0000","last_became_peered":"2024-09-05T12:55:45.741247+0000","last_unstale":"2024-09-05T12:56:05.851671+0000","last_undegraded":"2024-09-05T12:56:05.851671+0000","last_fullsized":"2024-09-05T12:56:05.851671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:57:23.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061516+0000","last_change":"2024-09-05T12:55:43.725085+0000","last_active":"2024-09-05T12:56:05.061516+0000","last_peered":"2024-09-05T12:56:05.061516+0000","last_clean":"2024-09-05T12:56:05.061516+0000","last_became_active":"2024-09-05T12:55:43.724772+0000","last_became_peered":"2024-09-05T12:55:43.724772+0000","last_unstale":"2024-09-05T12:56:05.061516+0000","last_undegraded":"2024-09-05T12:56:05.061516+0000","last_fullsized":"2024-09-05T12:56:05.061516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:48:16.567841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063834+0000","last_change":"2024-09-05T12:55:45.745635+0000","last_active":"2024-09-05T12:56:05.063834+0000","last_peered":"2024-09-05T12:56:05.063834+0000","last_clean":"2024-09-05T12:56:05.063834+0000","last_became_active":"2024-09-05T12:55:45.745331+0000","last_became_peered":"2024-09-05T12:55:45.745331+0000","last_unstale":"2024-09-05T12:56:05.063834+0000","last_undegraded":"2024-09-05T12:56:05.063834+0000","last_fullsized":"2024-09-05T12:56:05.063834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:15:58.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061048+0000","last_change":"2024-09-05T12:55:43.734466+0000","last_active":"2024-09-05T12:56:05.061048+0000","last_peered":"2024-09-05T12:56:05.061048+0000","last_clean":"2024-09-05T12:56:05.061048+0000","last_became_active":"2024-09-05T12:55:43.734147+0000","last_became_peered":"2024-09-05T12:55:43.734147+0000","last_unstale":"2024-09-05T12:56:05.061048+0000","last_undegraded":"2024-09-05T12:56:05.061048+0000","last_fullsized":"2024-09-05T12:56:05.061048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:53:22.588471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060906+0000","last_change":"2024-09-05T12:55:45.746328+0000","last_active":"2024-09-05T12:56:05.060906+0000","last_peered":"2024-09-05T12:56:05.060906+0000","last_clean":"2024-09-05T12:56:05.060906+0000","last_became_active":"2024-09-05T12:55:45.746012+0000","last_became_peered":"2024-09-05T12:55:45.746012+0000","last_unstale":"2024-09-05T12:56:05.060906+0000","last_undegraded":"2024-09-05T12:56:05.060906+0000","last_fullsized":"2024-09-05T12:56:05.060906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:23:12.886759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061386+0000","last_change":"2024-09-05T12:55:43.722519+0000","last_active":"2024-09-05T12:56:05.061386+0000","last_peered":"2024-09-05T12:56:05.061386+0000","last_clean":"2024-09-05T12:56:05.061386+0000","last_became_active":"2024-09-05T12:55:43.722220+0000","last_became_peered":"2024-09-05T12:55:43.722220+0000","last_unstale":"2024-09-05T12:56:05.061386+0000","last_undegraded":"2024-09-05T12:56:05.061386+0000","last_fullsized":"2024-09-05T12:56:05.061386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:15.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50805,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":114,"num_read_kb":110,"num_write":153,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":160567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281587,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645330,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":425477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874263,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1007616,"data_stored":1063760,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":425713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234017,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":1017565,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626475,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":425102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855408,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1017249,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":425539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":425413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":481592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":471697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":426373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":56697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T12:56:13.538 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-05T12:56:13.538 INFO:tasks.cephadm:Setting up client nodes... 2024-09-05T12:56:13.539 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-05T12:56:13.784 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:14.177 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:14 smithi073 ceph-mon[30883]: pgmap v285: 97 pgs: 97 active+clean; 634 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:14.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 -- 172.21.15.73:0/3605206070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa228101d10 msgr2=0x7fa228102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:14.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 --2- 172.21.15.73:0/3605206070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa228101d10 0x7fa228102190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009900 tx=0x7fa21c02a410 comp rx=0 tx=0).stop 2024-09-05T12:56:14.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 -- 172.21.15.73:0/3605206070 shutdown_connections 2024-09-05T12:56:14.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 --2- 172.21.15.73:0/3605206070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2281026d0 0x7fa228108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:14.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 --2- 172.21.15.73:0/3605206070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa228101d10 0x7fa228102190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 --2- 172.21.15.73:0/3605206070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa228100b10 0x7fa228100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 -- 172.21.15.73:0/3605206070 >> 172.21.15.73:0/3605206070 conn(0x7fa2280fc2a0 msgr2=0x7fa2280fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 -- 172.21.15.73:0/3605206070 shutdown_connections 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 -- 172.21.15.73:0/3605206070 wait complete. 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 Processor -- start 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.265+0000 7fa22e92c640 1 -- start start 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22e92c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa228100b10 0x7fa228197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22e92c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa228101d10 0x7fa228198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22e92c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2281026d0 0x7fa22819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22e92c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa22810d8c0 con 0x7fa2281026d0 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22e92c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa22810d740 con 0x7fa228100b10 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22e92c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa22810da40 con 0x7fa228101d10 2024-09-05T12:56:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22cec9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2281026d0 0x7fa22819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22cec9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2281026d0 0x7fa22819f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43646/0 (socket says 172.21.15.73:43646) 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22cec9640 1 -- 172.21.15.73:0/74250644 learned_addr learned my addr 172.21.15.73:0/74250644 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa2277fe640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa228101d10 0x7fa228198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22cec9640 1 -- 172.21.15.73:0/74250644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa228101d10 msgr2=0x7fa228198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa227fff640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa228100b10 0x7fa228197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22cec9640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa228101d10 0x7fa228198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22cec9640 1 -- 172.21.15.73:0/74250644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa228100b10 msgr2=0x7fa228197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22cec9640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa228100b10 0x7fa228197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22cec9640 1 -- 172.21.15.73:0/74250644 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22819fb30 con 0x7fa2281026d0 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22cec9640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2281026d0 0x7fa22819f4c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa22000cad0 tx=0x7fa22000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa2257fa640 1 -- 172.21.15.73:0/74250644 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22000ae20 con 0x7fa2281026d0 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa2257fa640 1 -- 172.21.15.73:0/74250644 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa220005020 con 0x7fa2281026d0 2024-09-05T12:56:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22e92c640 1 -- 172.21.15.73:0/74250644 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22819fe20 con 0x7fa2281026d0 2024-09-05T12:56:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa2257fa640 1 -- 172.21.15.73:0/74250644 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22000f6f0 con 0x7fa2281026d0 2024-09-05T12:56:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.266+0000 7fa22e92c640 1 -- 172.21.15.73:0/74250644 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2281a0280 con 0x7fa2281026d0 2024-09-05T12:56:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.267+0000 7fa22e92c640 1 -- 172.21.15.73:0/74250644 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa228107f30 con 0x7fa2281026d0 2024-09-05T12:56:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.268+0000 7fa2257fa640 1 -- 172.21.15.73:0/74250644 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa2200051d0 con 0x7fa2281026d0 2024-09-05T12:56:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.269+0000 7fa2257fa640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2100a2c40 0x7fa2100a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.269+0000 7fa227fff640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2100a2c40 0x7fa2100a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.269+0000 7fa2257fa640 1 -- 172.21.15.73:0/74250644 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fa2200cf200 con 0x7fa2281026d0 2024-09-05T12:56:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.269+0000 7fa227fff640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2100a2c40 0x7fa2100a5100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa228101b70 tx=0x7fa218005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.273+0000 7fa2257fa640 1 -- 172.21.15.73:0/74250644 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa220014030 con 0x7fa2281026d0 2024-09-05T12:56:14.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:14 smithi162 ceph-mon[34220]: pgmap v285: 97 pgs: 97 active+clean; 634 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:14.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:14 smithi169 ceph-mon[34823]: pgmap v285: 97 pgs: 97 active+clean; 634 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:14.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.507+0000 7fa22e92c640 1 -- 172.21.15.73:0/74250644 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fa22802d9e0 con 0x7fa2281026d0 2024-09-05T12:56:14.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.509+0000 7fa2257fa640 1 -- 172.21.15.73:0/74250644 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7fa22009c030 con 0x7fa2281026d0 2024-09-05T12:56:14.510 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-05T12:56:14.510 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBuqtlmNTBKHhAAM1k8ACNHzRfNsYWrmxyTQQ== 2024-09-05T12:56:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 -- 172.21.15.73:0/74250644 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2100a2c40 msgr2=0x7fa2100a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2100a2c40 0x7fa2100a5100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa228101b70 tx=0x7fa218005f90 comp rx=0 tx=0).stop 2024-09-05T12:56:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 -- 172.21.15.73:0/74250644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2281026d0 msgr2=0x7fa22819f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2281026d0 0x7fa22819f4c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa22000cad0 tx=0x7fa22000cf90 comp rx=0 tx=0).stop 2024-09-05T12:56:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 -- 172.21.15.73:0/74250644 shutdown_connections 2024-09-05T12:56:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2100a2c40 0x7fa2100a5100 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2281026d0 0x7fa22819f4c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa228101d10 0x7fa228198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 --2- 172.21.15.73:0/74250644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa228100b10 0x7fa228197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 -- 172.21.15.73:0/74250644 >> 172.21.15.73:0/74250644 conn(0x7fa2280fc2a0 msgr2=0x7fa228105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 -- 172.21.15.73:0/74250644 shutdown_connections 2024-09-05T12:56:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:14.511+0000 7fa22e92c640 1 -- 172.21.15.73:0/74250644 wait complete. 2024-09-05T12:56:15.147 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:56:15.147 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-05T12:56:15.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-05T12:56:15.185 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-05T12:56:15.185 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-05T12:56:15.185 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph mgr dump --format=json 2024-09-05T12:56:15.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:15 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/74250644' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T12:56:15.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:15 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/74250644' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-05T12:56:15.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:15 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/74250644' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T12:56:15.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:15 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/74250644' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-05T12:56:15.469 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:15.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:15 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/74250644' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T12:56:15.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:15 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/74250644' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-05T12:56:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.967+0000 7f96dcb76640 1 -- 172.21.15.73:0/3352683591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96d8103660 msgr2=0x7f96d810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.967+0000 7f96dcb76640 1 --2- 172.21.15.73:0/3352683591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96d8103660 0x7f96d810bb50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009860 tx=0x7f96cc02a3d0 comp rx=0 tx=0).stop 2024-09-05T12:56:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.967+0000 7f96dcb76640 1 -- 172.21.15.73:0/3352683591 shutdown_connections 2024-09-05T12:56:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.967+0000 7f96dcb76640 1 --2- 172.21.15.73:0/3352683591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96d810c170 0x7f96d810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.967+0000 7f96dcb76640 1 --2- 172.21.15.73:0/3352683591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96d8103660 0x7f96d810bb50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.967+0000 7f96dcb76640 1 --2- 172.21.15.73:0/3352683591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96d8102d40 0x7f96d8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.967+0000 7f96dcb76640 1 -- 172.21.15.73:0/3352683591 >> 172.21.15.73:0/3352683591 conn(0x7f96d80fc7a0 msgr2=0x7f96d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:15.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.968+0000 7f96dcb76640 1 -- 172.21.15.73:0/3352683591 shutdown_connections 2024-09-05T12:56:15.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.968+0000 7f96dcb76640 1 -- 172.21.15.73:0/3352683591 wait complete. 2024-09-05T12:56:15.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.968+0000 7f96dcb76640 1 Processor -- start 2024-09-05T12:56:15.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.968+0000 7f96dcb76640 1 -- start start 2024-09-05T12:56:15.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.968+0000 7f96dcb76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96d8102d40 0x7f96d81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:15.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.968+0000 7f96dcb76640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96d8103660 0x7f96d8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:15.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.968+0000 7f96dcb76640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96d810c170 0x7f96d8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:15.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.968+0000 7f96dcb76640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f96d8111f70 con 0x7f96d8102d40 2024-09-05T12:56:15.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.968+0000 7f96dcb76640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96d8111df0 con 0x7f96d8103660 2024-09-05T12:56:15.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.968+0000 7f96dcb76640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f96d81120f0 con 0x7f96d810c170 2024-09-05T12:56:15.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96d8102d40 0x7f96d81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:15.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96d8102d40 0x7f96d81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43676/0 (socket says 172.21.15.73:43676) 2024-09-05T12:56:15.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d659c640 1 -- 172.21.15.73:0/1639682344 learned_addr learned my addr 172.21.15.73:0/1639682344 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:15.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d5d9b640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96d8103660 0x7f96d8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:15.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d659c640 1 -- 172.21.15.73:0/1639682344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96d810c170 msgr2=0x7f96d8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:15.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d659c640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96d810c170 0x7f96d8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:15.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d659c640 1 -- 172.21.15.73:0/1639682344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96d8103660 msgr2=0x7f96d8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:15.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d659c640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96d8103660 0x7f96d8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:15.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d659c640 1 -- 172.21.15.73:0/1639682344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d81a6930 con 0x7f96d8102d40 2024-09-05T12:56:15.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d5d9b640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96d8103660 0x7f96d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:15.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96d659c640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96d8102d40 0x7f96d81009a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f96c800e9f0 tx=0x7f96c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:15.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96c77fe640 1 -- 172.21.15.73:0/1639682344 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c800cd80 con 0x7f96d8102d40 2024-09-05T12:56:15.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96c77fe640 1 -- 172.21.15.73:0/1639682344 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96c8005500 con 0x7f96d8102d40 2024-09-05T12:56:15.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96dcb76640 1 -- 172.21.15.73:0/1639682344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d81a6c20 con 0x7f96d8102d40 2024-09-05T12:56:15.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96c77fe640 1 -- 172.21.15.73:0/1639682344 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8010690 con 0x7f96d8102d40 2024-09-05T12:56:15.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.969+0000 7f96dcb76640 1 -- 172.21.15.73:0/1639682344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d81a7110 con 0x7f96d8102d40 2024-09-05T12:56:15.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.970+0000 7f96dcb76640 1 -- 172.21.15.73:0/1639682344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d8103120 con 0x7f96d8102d40 2024-09-05T12:56:15.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.971+0000 7f96c77fe640 1 -- 172.21.15.73:0/1639682344 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f96c80046c0 con 0x7f96d8102d40 2024-09-05T12:56:15.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.972+0000 7f96c77fe640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f96c00a2c10 0x7f96c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:15.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.972+0000 7f96c77fe640 1 -- 172.21.15.73:0/1639682344 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f96c80cf6e0 con 0x7f96d8102d40 2024-09-05T12:56:15.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.972+0000 7f96d5d9b640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f96c00a2c10 0x7f96c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:15.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.972+0000 7f96d5d9b640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f96c00a2c10 0x7f96c00a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f96cc005940 tx=0x7f96cc005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:15.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:15.976+0000 7f96c77fe640 1 -- 172.21.15.73:0/1639682344 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96c809c510 con 0x7f96d8102d40 2024-09-05T12:56:16.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.191+0000 7f96dcb76640 1 -- 172.21.15.73:0/1639682344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f96d8101ed0 con 0x7f96d8102d40 2024-09-05T12:56:16.193 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:16 smithi073 ceph-mon[30883]: pgmap v286: 97 pgs: 97 active+clean; 634 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:16.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.197+0000 7f96c77fe640 1 -- 172.21.15.73:0/1639682344 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263200 (secure 0 0 0) 0x7f96c809be10 con 0x7f96d8102d40 2024-09-05T12:56:16.202 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 -- 172.21.15.73:0/1639682344 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f96c00a2c10 msgr2=0x7f96c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f96c00a2c10 0x7f96c00a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f96cc005940 tx=0x7f96cc005c90 comp rx=0 tx=0).stop 2024-09-05T12:56:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 -- 172.21.15.73:0/1639682344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96d8102d40 msgr2=0x7f96d81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96d8102d40 0x7f96d81009a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f96c800e9f0 tx=0x7f96c800edf0 comp rx=0 tx=0).stop 2024-09-05T12:56:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 -- 172.21.15.73:0/1639682344 shutdown_connections 2024-09-05T12:56:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f96c00a2c10 0x7f96c00a50d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96d810c170 0x7f96d8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96d8103660 0x7f96d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 --2- 172.21.15.73:0/1639682344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96d8102d40 0x7f96d81009a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 -- 172.21.15.73:0/1639682344 >> 172.21.15.73:0/1639682344 conn(0x7f96d80fc7a0 msgr2=0x7f96d80fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 -- 172.21.15.73:0/1639682344 shutdown_connections 2024-09-05T12:56:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:16.201+0000 7f96dcb76640 1 -- 172.21.15.73:0/1639682344 wait complete. 2024-09-05T12:56:16.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:16 smithi162 ceph-mon[34220]: pgmap v286: 97 pgs: 97 active+clean; 634 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:16.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:16 smithi169 ceph-mon[34823]: pgmap v286: 97 pgs: 97 active+clean; 634 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:16.920 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3294068694},{"type":"v1","addr":"172.21.15.73:6801","nonce":3294068694}]},"active_addr":"172.21.15.73:6801/3294068694","active_change":"2024-09-05T12:49:03.895149+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.73:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1429723404}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":559438885}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":4016443502}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3964851659}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3632569623}]}]} 2024-09-05T12:56:16.925 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-05T12:56:16.925 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-05T12:56:16.926 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T12:56:17.170 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:17.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:17 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1639682344' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-05T12:56:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:17 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1639682344' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-05T12:56:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:17 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1639682344' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-05T12:56:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.651+0000 7f84b889c640 1 -- 172.21.15.73:0/4050423710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b4102dd0 msgr2=0x7f84b41031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.651+0000 7f84b889c640 1 --2- 172.21.15.73:0/4050423710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b4102dd0 0x7f84b41031b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009930 tx=0x7f84ac02a420 comp rx=0 tx=0).stop 2024-09-05T12:56:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.652+0000 7f84b889c640 1 -- 172.21.15.73:0/4050423710 shutdown_connections 2024-09-05T12:56:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.652+0000 7f84b889c640 1 --2- 172.21.15.73:0/4050423710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b4108300 0x7f84b410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.652+0000 7f84b889c640 1 --2- 172.21.15.73:0/4050423710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84b4103780 0x7f84b4107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.652+0000 7f84b889c640 1 --2- 172.21.15.73:0/4050423710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b4102dd0 0x7f84b41031b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.652+0000 7f84b889c640 1 -- 172.21.15.73:0/4050423710 >> 172.21.15.73:0/4050423710 conn(0x7f84b40fc7d0 msgr2=0x7f84b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.652+0000 7f84b889c640 1 -- 172.21.15.73:0/4050423710 shutdown_connections 2024-09-05T12:56:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.652+0000 7f84b889c640 1 -- 172.21.15.73:0/4050423710 wait complete. 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.652+0000 7f84b889c640 1 Processor -- start 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.652+0000 7f84b889c640 1 -- start start 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b889c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84b4102dd0 0x7f84b4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b889c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b4103780 0x7f84b4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b889c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b4108300 0x7f84b419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b889c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f84b41120b0 con 0x7f84b4108300 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b889c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4111f30 con 0x7f84b4103780 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b889c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4112230 con 0x7f84b4102dd0 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b4108300 0x7f84b419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b4108300 0x7f84b419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43708/0 (socket says 172.21.15.73:43708) 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b2d9d640 1 -- 172.21.15.73:0/331004243 learned_addr learned my addr 172.21.15.73:0/331004243 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b259c640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84b4102dd0 0x7f84b4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b1d9b640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b4103780 0x7f84b4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b2d9d640 1 -- 172.21.15.73:0/331004243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84b4102dd0 msgr2=0x7f84b4198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b2d9d640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84b4102dd0 0x7f84b4198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b2d9d640 1 -- 172.21.15.73:0/331004243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b4103780 msgr2=0x7f84b4198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b2d9d640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b4103780 0x7f84b4198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b2d9d640 1 -- 172.21.15.73:0/331004243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b419d520 con 0x7f84b4108300 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b259c640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84b4102dd0 0x7f84b4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b2d9d640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b4108300 0x7f84b419ce40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84a400cce0 tx=0x7f84a400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84ab7fe640 1 -- 172.21.15.73:0/331004243 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a400f450 con 0x7f84b4108300 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b889c640 1 -- 172.21.15.73:0/331004243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b419d810 con 0x7f84b4108300 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84ab7fe640 1 -- 172.21.15.73:0/331004243 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84a400fad0 con 0x7f84b4108300 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84ab7fe640 1 -- 172.21.15.73:0/331004243 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4018c10 con 0x7f84b4108300 2024-09-05T12:56:17.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.653+0000 7f84b889c640 1 -- 172.21.15.73:0/331004243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b41a50f0 con 0x7f84b4108300 2024-09-05T12:56:17.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.655+0000 7f84b889c640 1 -- 172.21.15.73:0/331004243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b406a7b0 con 0x7f84b4108300 2024-09-05T12:56:17.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.656+0000 7f84ab7fe640 1 -- 172.21.15.73:0/331004243 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f84a400f5f0 con 0x7f84b4108300 2024-09-05T12:56:17.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.657+0000 7f84ab7fe640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f84a00a2c10 0x7f84a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:17.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.657+0000 7f84b259c640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f84a00a2c10 0x7f84a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:17.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.657+0000 7f84ab7fe640 1 -- 172.21.15.73:0/331004243 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f84a40cf950 con 0x7f84b4108300 2024-09-05T12:56:17.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.657+0000 7f84b259c640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f84a00a2c10 0x7f84a00a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84ac000c00 tx=0x7f84ac005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:17.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.660+0000 7f84ab7fe640 1 -- 172.21.15.73:0/331004243 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84a4014030 con 0x7f84b4108300 2024-09-05T12:56:17.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.827+0000 7f84b889c640 1 -- 172.21.15.73:0/331004243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84b41031b0 con 0x7f84b4108300 2024-09-05T12:56:17.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.829+0000 7f84ab7fe640 1 -- 172.21.15.73:0/331004243 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22645 (secure 0 0 0) 0x7f84b41031b0 con 0x7f84b4108300 2024-09-05T12:56:17.830 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:17.830 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":80,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T12:56:05.055165+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T12:56:17.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 -- 172.21.15.73:0/331004243 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f84a00a2c10 msgr2=0x7f84a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f84a00a2c10 0x7f84a00a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84ac000c00 tx=0x7f84ac005a20 comp rx=0 tx=0).stop 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 -- 172.21.15.73:0/331004243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b4108300 msgr2=0x7f84b419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b4108300 0x7f84b419ce40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84a400cce0 tx=0x7f84a400a620 comp rx=0 tx=0).stop 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 -- 172.21.15.73:0/331004243 shutdown_connections 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f84a00a2c10 0x7f84a00a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b4108300 0x7f84b419ce40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b4103780 0x7f84b4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 --2- 172.21.15.73:0/331004243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84b4102dd0 0x7f84b4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 -- 172.21.15.73:0/331004243 >> 172.21.15.73:0/331004243 conn(0x7f84b40fc7d0 msgr2=0x7f84b4105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 -- 172.21.15.73:0/331004243 shutdown_connections 2024-09-05T12:56:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:17.831+0000 7f84b889c640 1 -- 172.21.15.73:0/331004243 wait complete. 2024-09-05T12:56:18.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:18 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/331004243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:18.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:18 smithi169 ceph-mon[34823]: pgmap v287: 97 pgs: 97 active+clean; 634 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:18 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/331004243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:18 smithi073 ceph-mon[30883]: pgmap v287: 97 pgs: 97 active+clean; 634 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:18.584 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-05T12:56:18.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T12:56:18.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:18 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/331004243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:18.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:18 smithi162 ceph-mon[34220]: pgmap v287: 97 pgs: 97 active+clean; 634 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:18.830 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.305+0000 7fb809340640 1 -- 172.21.15.73:0/206059267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb804102d40 msgr2=0x7fb804103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.305+0000 7fb809340640 1 --2- 172.21.15.73:0/206059267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb804102d40 0x7fb804103120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009900 tx=0x7fb7f402a480 comp rx=0 tx=0).stop 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.305+0000 7fb809340640 1 -- 172.21.15.73:0/206059267 shutdown_connections 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.305+0000 7fb809340640 1 --2- 172.21.15.73:0/206059267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb80410c170 0x7fb80410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.305+0000 7fb809340640 1 --2- 172.21.15.73:0/206059267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb804103660 0x7fb80410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.305+0000 7fb809340640 1 --2- 172.21.15.73:0/206059267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb804102d40 0x7fb804103120 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.305+0000 7fb809340640 1 -- 172.21.15.73:0/206059267 >> 172.21.15.73:0/206059267 conn(0x7fb8040fc7a0 msgr2=0x7fb8040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.305+0000 7fb809340640 1 -- 172.21.15.73:0/206059267 shutdown_connections 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.305+0000 7fb809340640 1 -- 172.21.15.73:0/206059267 wait complete. 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.306+0000 7fb809340640 1 Processor -- start 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.306+0000 7fb809340640 1 -- start start 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.306+0000 7fb809340640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb804102d40 0x7fb8041a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.306+0000 7fb809340640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb804103660 0x7fb8041a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.306+0000 7fb809340640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80410c170 0x7fb80419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.306+0000 7fb809340640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb804112030 con 0x7fb80410c170 2024-09-05T12:56:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.306+0000 7fb809340640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb804111eb0 con 0x7fb804102d40 2024-09-05T12:56:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.306+0000 7fb809340640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8041121b0 con 0x7fb804103660 2024-09-05T12:56:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.306+0000 7fb8037fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80410c170 0x7fb80419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.306+0000 7fb8037fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80410c170 0x7fb80419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43726/0 (socket says 172.21.15.73:43726) 2024-09-05T12:56:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb8037fe640 1 -- 172.21.15.73:0/2741808673 learned_addr learned my addr 172.21.15.73:0/2741808673 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb802ffd640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb804102d40 0x7fb8041a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb8027fc640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb804103660 0x7fb8041a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb8037fe640 1 -- 172.21.15.73:0/2741808673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb804103660 msgr2=0x7fb8041a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb8037fe640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb804103660 0x7fb8041a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb8037fe640 1 -- 172.21.15.73:0/2741808673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb804102d40 msgr2=0x7fb8041a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb8037fe640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb804102d40 0x7fb8041a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb8037fe640 1 -- 172.21.15.73:0/2741808673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80419acd0 con 0x7fb80410c170 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb802ffd640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb804102d40 0x7fb8041a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb8037fe640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80410c170 0x7fb80419a5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00b970 tx=0x7fb7fc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb7ebfff640 1 -- 172.21.15.73:0/2741808673 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc019070 con 0x7fb80410c170 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb7ebfff640 1 -- 172.21.15.73:0/2741808673 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7fc00cb40 con 0x7fb80410c170 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb809340640 1 -- 172.21.15.73:0/2741808673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80419afc0 con 0x7fb80410c170 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb7ebfff640 1 -- 172.21.15.73:0/2741808673 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc007650 con 0x7fb80410c170 2024-09-05T12:56:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.307+0000 7fb809340640 1 -- 172.21.15.73:0/2741808673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8041a72b0 con 0x7fb80410c170 2024-09-05T12:56:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.308+0000 7fb809340640 1 -- 172.21.15.73:0/2741808673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8041031a0 con 0x7fb80410c170 2024-09-05T12:56:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.309+0000 7fb7ebfff640 1 -- 172.21.15.73:0/2741808673 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb7fc01c070 con 0x7fb80410c170 2024-09-05T12:56:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.310+0000 7fb7ebfff640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7ec0a2c90 0x7fb7ec0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.310+0000 7fb802ffd640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7ec0a2c90 0x7fb7ec0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.310+0000 7fb7ebfff640 1 -- 172.21.15.73:0/2741808673 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb7fc0ce6c0 con 0x7fb80410c170 2024-09-05T12:56:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.310+0000 7fb802ffd640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7ec0a2c90 0x7fb7ec0a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4005ab0 tx=0x7fb7f4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.314+0000 7fb7ebfff640 1 -- 172.21.15.73:0/2741808673 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7fc09b600 con 0x7fb80410c170 2024-09-05T12:56:19.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.484+0000 7fb809340640 1 -- 172.21.15.73:0/2741808673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8041a75e0 con 0x7fb80410c170 2024-09-05T12:56:19.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.486+0000 7fb7ebfff640 1 -- 172.21.15.73:0/2741808673 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22645 (secure 0 0 0) 0x7fb7fc09af00 con 0x7fb80410c170 2024-09-05T12:56:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:19.487 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":80,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T12:56:05.055165+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T12:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.488+0000 7fb809340640 1 -- 172.21.15.73:0/2741808673 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7ec0a2c90 msgr2=0x7fb7ec0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.488+0000 7fb809340640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7ec0a2c90 0x7fb7ec0a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4005ab0 tx=0x7fb7f4005a20 comp rx=0 tx=0).stop 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.488+0000 7fb809340640 1 -- 172.21.15.73:0/2741808673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80410c170 msgr2=0x7fb80419a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.488+0000 7fb809340640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80410c170 0x7fb80419a5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00b970 tx=0x7fb7fc00be30 comp rx=0 tx=0).stop 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.488+0000 7fb809340640 1 -- 172.21.15.73:0/2741808673 shutdown_connections 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.488+0000 7fb809340640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7ec0a2c90 0x7fb7ec0a5150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.488+0000 7fb809340640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80410c170 0x7fb80419a5a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.488+0000 7fb809340640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb804103660 0x7fb8041a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.488+0000 7fb809340640 1 --2- 172.21.15.73:0/2741808673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb804102d40 0x7fb8041a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.488+0000 7fb809340640 1 -- 172.21.15.73:0/2741808673 >> 172.21.15.73:0/2741808673 conn(0x7fb8040fc7a0 msgr2=0x7fb804100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.489+0000 7fb809340640 1 -- 172.21.15.73:0/2741808673 shutdown_connections 2024-09-05T12:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:19.489+0000 7fb809340640 1 -- 172.21.15.73:0/2741808673 wait complete. 2024-09-05T12:56:19.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:19 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2741808673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:19.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:19 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2741808673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:19.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:19 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2741808673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:20.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-05T12:56:20.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-05T12:56:20.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-05T12:56:20.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-05T12:56:20.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-05T12:56:20.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-05T12:56:20.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-05T12:56:20.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-05T12:56:20.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-05T12:56:20.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-05T12:56:20.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-05T12:56:20.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-05T12:56:20.860 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:20 smithi162 ceph-mon[34220]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:20.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:20 smithi169 ceph-mon[34823]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:20.919 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:20.921 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:20.927 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:20.935 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:20.935 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:20.936 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:20.938 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:20.938 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:20.941 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:20.985 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:21.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:20 smithi073 ceph-mon[30883]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.635+0000 7f103d346640 1 -- 172.21.15.73:0/2802352599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1038108160 msgr2=0x7f103810eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.635+0000 7f103d346640 1 --2- 172.21.15.73:0/2802352599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1038108160 0x7f103810eb00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1030009cd0 tx=0x7f103002a8e0 comp rx=0 tx=0).stop 2024-09-05T12:56:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.635+0000 7f103d346640 1 -- 172.21.15.73:0/2802352599 shutdown_connections 2024-09-05T12:56:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.635+0000 7f103d346640 1 --2- 172.21.15.73:0/2802352599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1038108160 0x7f103810eb00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.635+0000 7f103d346640 1 --2- 172.21.15.73:0/2802352599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1038101290 0x7f1038107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.635+0000 7f103d346640 1 --2- 172.21.15.73:0/2802352599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10381008e0 0x7f1038100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.635+0000 7f103d346640 1 -- 172.21.15.73:0/2802352599 >> 172.21.15.73:0/2802352599 conn(0x7f1038077210 msgr2=0x7f1038077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.635+0000 7f103d346640 1 -- 172.21.15.73:0/2802352599 shutdown_connections 2024-09-05T12:56:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.635+0000 7f103d346640 1 -- 172.21.15.73:0/2802352599 wait complete. 2024-09-05T12:56:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f103d346640 1 Processor -- start 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f103d346640 1 -- start start 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f103d346640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10381008e0 0x7f103819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f103d346640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1038101290 0x7f103819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f103d346640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1038108160 0x7f103819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f103d346640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1038111ff0 con 0x7f1038101290 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f103d346640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1038111e70 con 0x7f1038108160 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f103d346640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1038112170 con 0x7f10381008e0 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f102e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1038101290 0x7f103819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f102e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1038101290 0x7f103819abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43752/0 (socket says 172.21.15.73:43752) 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f102e7fc640 1 -- 172.21.15.73:0/4065206395 learned_addr learned my addr 172.21.15.73:0/4065206395 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f1036ffd640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10381008e0 0x7f103819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.636+0000 7f10377fe640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1038108160 0x7f103819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f102e7fc640 1 -- 172.21.15.73:0/4065206395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10381008e0 msgr2=0x7f103819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f102e7fc640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10381008e0 0x7f103819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f102e7fc640 1 -- 172.21.15.73:0/4065206395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1038108160 msgr2=0x7f103819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f102e7fc640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1038108160 0x7f103819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f102e7fc640 1 -- 172.21.15.73:0/4065206395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103819f630 con 0x7f1038101290 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f10377fe640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1038108160 0x7f103819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f102e7fc640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1038101290 0x7f103819abc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f102000c940 tx=0x7f102000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f1034ff9640 1 -- 172.21.15.73:0/4065206395 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020004220 con 0x7f1038101290 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f1034ff9640 1 -- 172.21.15.73:0/4065206395 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10200043c0 con 0x7f1038101290 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103819f920 con 0x7f1038101290 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f1034ff9640 1 -- 172.21.15.73:0/4065206395 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102000f450 con 0x7f1038101290 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.637+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10381a7200 con 0x7f1038101290 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.638+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10381000a0 con 0x7f1038101290 2024-09-05T12:56:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.639+0000 7f1034ff9640 1 -- 172.21.15.73:0/4065206395 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f10200079b0 con 0x7f1038101290 2024-09-05T12:56:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.640+0000 7f1034ff9640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10240a2c10 0x7f10240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.640+0000 7f1036ffd640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10240a2c10 0x7f10240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.640+0000 7f1034ff9640 1 -- 172.21.15.73:0/4065206395 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f10200ceec0 con 0x7f1038101290 2024-09-05T12:56:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.640+0000 7f1034ff9640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] conn(0x7f10240ac740 0x7f10240aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.640+0000 7f1034ff9640 1 -- 172.21.15.73:0/4065206395 --> [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10240af2b0 con 0x7f10240ac740 2024-09-05T12:56:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.640+0000 7f1034ff9640 1 -- 172.21.15.73:0/4065206395 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f10200cf310 con 0x7f1038101290 2024-09-05T12:56:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.640+0000 7f10377fe640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] conn(0x7f10240ac740 0x7f10240aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.640+0000 7f1036ffd640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10240a2c10 0x7f10240a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1028005fd0 tx=0x7f1028005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.641+0000 7f10377fe640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] conn(0x7f10240ac740 0x7f10240aebe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.641+0000 7f1034ff9640 1 -- 172.21.15.73:0/4065206395 <== osd.0 v2:172.21.15.73:6802/1199952118 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10240af2b0 con 0x7f10240ac740 2024-09-05T12:56:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.656+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 --> [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f103806a110 con 0x7f10240ac740 2024-09-05T12:56:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.656+0000 7f1034ff9640 1 -- 172.21.15.73:0/4065206395 <== osd.0 v2:172.21.15.73:6802/1199952118 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f103806a110 con 0x7f10240ac740 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] conn(0x7f10240ac740 msgr2=0x7f10240aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f103d346640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] conn(0x7f10240ac740 0x7f10240aebe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10240a2c10 msgr2=0x7f10240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f103d346640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10240a2c10 0x7f10240a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1028005fd0 tx=0x7f1028005e20 comp rx=0 tx=0).stop 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1038101290 msgr2=0x7f103819abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f103d346640 1 --2- 172.21.15.73:0/4065206395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1038101290 0x7f103819abc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f102000c940 tx=0x7f102000ce00 comp rx=0 tx=0).stop 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f10377fe640 1 -- 172.21.15.73:0/4065206395 reap_dead start 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 shutdown_connections 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 >> 172.21.15.73:0/4065206395 conn(0x7f1038077210 msgr2=0x7f10380ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 shutdown_connections 2024-09-05T12:56:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:21.657+0000 7f103d346640 1 -- 172.21.15.73:0/4065206395 wait complete. 2024-09-05T12:56:22.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.545+0000 7f6f9199d640 1 -- 172.21.15.73:0/3290077230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f8c102790 msgr2=0x7f6f8c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:22.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.545+0000 7f6f9199d640 1 --2- 172.21.15.73:0/3290077230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f8c102790 0x7f6f8c1067e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009900 tx=0x7f6f8002a410 comp rx=0 tx=0).stop 2024-09-05T12:56:22.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.545+0000 7f6f9199d640 1 -- 172.21.15.73:0/3290077230 shutdown_connections 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.545+0000 7f6f9199d640 1 --2- 172.21.15.73:0/3290077230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c106f10 0x7f6f8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.545+0000 7f6f9199d640 1 --2- 172.21.15.73:0/3290077230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f8c102790 0x7f6f8c1067e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.545+0000 7f6f9199d640 1 --2- 172.21.15.73:0/3290077230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f8c101de0 0x7f6f8c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.545+0000 7f6f9199d640 1 -- 172.21.15.73:0/3290077230 >> 172.21.15.73:0/3290077230 conn(0x7f6f8c0fd8c0 msgr2=0x7f6f8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.545+0000 7f6f9199d640 1 -- 172.21.15.73:0/3290077230 shutdown_connections 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.545+0000 7f6f9199d640 1 -- 172.21.15.73:0/3290077230 wait complete. 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.545+0000 7f6f9199d640 1 Processor -- start 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f9199d640 1 -- start start 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f9199d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f8c101de0 0x7f6f8c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f9199d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f8c102790 0x7f6f8c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f9199d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c106f10 0x7f6f8c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f9199d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c111f90 con 0x7f6f8c102790 2024-09-05T12:56:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f9199d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c111e10 con 0x7f6f8c106f10 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f9199d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c112110 con 0x7f6f8c101de0 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f8c102790 0x7f6f8c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f8c102790 0x7f6f8c1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43772/0 (socket says 172.21.15.73:43772) 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8a7fc640 1 -- 172.21.15.73:0/2429781509 learned_addr learned my addr 172.21.15.73:0/2429781509 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8b7fe640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c106f10 0x7f6f8c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8affd640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f8c101de0 0x7f6f8c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8a7fc640 1 -- 172.21.15.73:0/2429781509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f8c101de0 msgr2=0x7f6f8c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8a7fc640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f8c101de0 0x7f6f8c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8a7fc640 1 -- 172.21.15.73:0/2429781509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c106f10 msgr2=0x7f6f8c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8a7fc640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c106f10 0x7f6f8c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8a7fc640 1 -- 172.21.15.73:0/2429781509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c19d440 con 0x7f6f8c102790 2024-09-05T12:56:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8affd640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f8c101de0 0x7f6f8c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.546+0000 7f6f8a7fc640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f8c102790 0x7f6f8c1989d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6f80006010 tx=0x7f6f800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.547+0000 7f6f9099b640 1 -- 172.21.15.73:0/2429781509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8003f030 con 0x7f6f8c102790 2024-09-05T12:56:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.547+0000 7f6f9099b640 1 -- 172.21.15.73:0/2429781509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f80003ce0 con 0x7f6f8c102790 2024-09-05T12:56:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.547+0000 7f6f9099b640 1 -- 172.21.15.73:0/2429781509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80035070 con 0x7f6f8c102790 2024-09-05T12:56:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.547+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8c19d6d0 con 0x7f6f8c102790 2024-09-05T12:56:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.547+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f8c1a5010 con 0x7f6f8c102790 2024-09-05T12:56:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.547+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f8c062980 con 0x7f6f8c102790 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.549+0000 7f6f9099b640 1 -- 172.21.15.73:0/2429781509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6f80042030 con 0x7f6f8c102790 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.549+0000 7f6f9099b640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6f740a2c90 0x7f6f740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.550+0000 7f6f8affd640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6f740a2c90 0x7f6f740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.550+0000 7f6f9099b640 1 -- 172.21.15.73:0/2429781509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f6f800efdf0 con 0x7f6f8c102790 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.550+0000 7f6f9099b640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] conn(0x7f6f740ac7c0 0x7f6f740aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.550+0000 7f6f9099b640 1 -- 172.21.15.73:0/2429781509 --> [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f80001d30 con 0x7f6f740ac7c0 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.550+0000 7f6f9099b640 1 -- 172.21.15.73:0/2429781509 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f6f800f0240 con 0x7f6f8c102790 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.550+0000 7f6f8b7fe640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] conn(0x7f6f740ac7c0 0x7f6f740aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.550+0000 7f6f8affd640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6f740a2c90 0x7f6f740a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c006fd0 tx=0x7f6f7c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.550+0000 7f6f8b7fe640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] conn(0x7f6f740ac7c0 0x7f6f740aec60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.551+0000 7f6f9099b640 1 -- 172.21.15.73:0/2429781509 <== osd.9 v2:172.21.15.73:6826/3048419338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f80001d30 con 0x7f6f740ac7c0 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.564+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 --> [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f8c062d80 con 0x7f6f740ac7c0 2024-09-05T12:56:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.564+0000 7f6f9099b640 1 -- 172.21.15.73:0/2429781509 <== osd.9 v2:172.21.15.73:6826/3048419338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6f8c062d80 con 0x7f6f740ac7c0 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] conn(0x7f6f740ac7c0 msgr2=0x7f6f740aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f9199d640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] conn(0x7f6f740ac7c0 0x7f6f740aec60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6f740a2c90 msgr2=0x7f6f740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f9199d640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6f740a2c90 0x7f6f740a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c006fd0 tx=0x7f6f7c008040 comp rx=0 tx=0).stop 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f8c102790 msgr2=0x7f6f8c1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f9199d640 1 --2- 172.21.15.73:0/2429781509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f8c102790 0x7f6f8c1989d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6f80006010 tx=0x7f6f800042f0 comp rx=0 tx=0).stop 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f8b7fe640 1 -- 172.21.15.73:0/2429781509 reap_dead start 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 shutdown_connections 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 >> 172.21.15.73:0/2429781509 conn(0x7f6f8c0fd8c0 msgr2=0x7f6f8c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 shutdown_connections 2024-09-05T12:56:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.565+0000 7f6f9199d640 1 -- 172.21.15.73:0/2429781509 wait complete. 2024-09-05T12:56:23.164 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:23 smithi073 ceph-mon[30883]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:23.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:23 smithi162 ceph-mon[34220]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:23.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:23 smithi169 ceph-mon[34823]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T12:56:23.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.309+0000 7fd77370d640 1 -- 172.21.15.73:0/3341729728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd76c106f10 msgr2=0x7fd76c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.309+0000 7fd77370d640 1 --2- 172.21.15.73:0/3341729728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd76c106f10 0x7fd76c10ea90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd764009ca0 tx=0x7fd76402a8c0 comp rx=0 tx=0).stop 2024-09-05T12:56:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.309+0000 7fd77370d640 1 -- 172.21.15.73:0/3341729728 shutdown_connections 2024-09-05T12:56:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.309+0000 7fd77370d640 1 --2- 172.21.15.73:0/3341729728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd76c106f10 0x7fd76c10ea90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.309+0000 7fd77370d640 1 --2- 172.21.15.73:0/3341729728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd76c102790 0x7fd76c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.309+0000 7fd77370d640 1 --2- 172.21.15.73:0/3341729728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd76c101de0 0x7fd76c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.309+0000 7fd77370d640 1 -- 172.21.15.73:0/3341729728 >> 172.21.15.73:0/3341729728 conn(0x7fd76c0fd8c0 msgr2=0x7fd76c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.309+0000 7fd77370d640 1 -- 172.21.15.73:0/3341729728 shutdown_connections 2024-09-05T12:56:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.309+0000 7fd77370d640 1 -- 172.21.15.73:0/3341729728 wait complete. 2024-09-05T12:56:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd77370d640 1 Processor -- start 2024-09-05T12:56:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd77370d640 1 -- start start 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd77370d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd76c101de0 0x7fd76c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd77370d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd76c102790 0x7fd76c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd77370d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd76c106f10 0x7fd76c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd77370d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c111f90 con 0x7fd76c106f10 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd77370d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c111e10 con 0x7fd76c102790 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd77370d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c112110 con 0x7fd76c101de0 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd771caa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd76c106f10 0x7fd76c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd771caa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd76c106f10 0x7fd76c19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43760/0 (socket says 172.21.15.73:43760) 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd771caa640 1 -- 172.21.15.73:0/1127264633 learned_addr learned my addr 172.21.15.73:0/1127264633 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd770ca8640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd76c102790 0x7fd76c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd7714a9640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd76c101de0 0x7fd76c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd771caa640 1 -- 172.21.15.73:0/1127264633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd76c101de0 msgr2=0x7fd76c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:23.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd771caa640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd76c101de0 0x7fd76c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:23.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd771caa640 1 -- 172.21.15.73:0/1127264633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd76c102790 msgr2=0x7fd76c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:23.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd771caa640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd76c102790 0x7fd76c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:23.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.310+0000 7fd771caa640 1 -- 172.21.15.73:0/1127264633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c19d3e0 con 0x7fd76c106f10 2024-09-05T12:56:23.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.311+0000 7fd771caa640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd76c106f10 0x7fd76c19cd00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd764031a20 tx=0x7fd764031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:23.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.311+0000 7fd7627fc640 1 -- 172.21.15.73:0/1127264633 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764003c30 con 0x7fd76c106f10 2024-09-05T12:56:23.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.311+0000 7fd7627fc640 1 -- 172.21.15.73:0/1127264633 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd764003dd0 con 0x7fd76c106f10 2024-09-05T12:56:23.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.311+0000 7fd7627fc640 1 -- 172.21.15.73:0/1127264633 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76402fcf0 con 0x7fd76c106f10 2024-09-05T12:56:23.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.311+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76c19d670 con 0x7fd76c106f10 2024-09-05T12:56:23.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.311+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76c1a4fb0 con 0x7fd76c106f10 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.312+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd76c062980 con 0x7fd76c106f10 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.313+0000 7fd7627fc640 1 -- 172.21.15.73:0/1127264633 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd764004050 con 0x7fd76c106f10 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.314+0000 7fd7627fc640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7580a2c90 0x7fd7580a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.314+0000 7fd7714a9640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7580a2c90 0x7fd7580a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.314+0000 7fd7627fc640 1 -- 172.21.15.73:0/1127264633 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd7640f0690 con 0x7fd76c106f10 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.314+0000 7fd7627fc640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] conn(0x7fd7580ac7c0 0x7fd7580aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.314+0000 7fd7627fc640 1 -- 172.21.15.73:0/1127264633 --> [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7580af330 con 0x7fd7580ac7c0 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.314+0000 7fd7627fc640 1 -- 172.21.15.73:0/1127264633 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd7640f0ae0 con 0x7fd76c106f10 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.314+0000 7fd770ca8640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] conn(0x7fd7580ac7c0 0x7fd7580aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.314+0000 7fd7714a9640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7580a2c90 0x7fd7580a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd768005fd0 tx=0x7fd768005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.314+0000 7fd770ca8640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] conn(0x7fd7580ac7c0 0x7fd7580aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.315+0000 7fd7627fc640 1 -- 172.21.15.73:0/1127264633 <== osd.6 v2:172.21.15.73:6818/1759972661 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7580af330 con 0x7fd7580ac7c0 2024-09-05T12:56:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.328+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 --> [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd76c062d80 con 0x7fd7580ac7c0 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.328+0000 7fd7627fc640 1 -- 172.21.15.73:0/1127264633 <== osd.6 v2:172.21.15.73:6818/1759972661 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd76c062d80 con 0x7fd7580ac7c0 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] conn(0x7fd7580ac7c0 msgr2=0x7fd7580aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd77370d640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] conn(0x7fd7580ac7c0 0x7fd7580aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7580a2c90 msgr2=0x7fd7580a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd77370d640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7580a2c90 0x7fd7580a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd768005fd0 tx=0x7fd768005850 comp rx=0 tx=0).stop 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd76c106f10 msgr2=0x7fd76c19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd77370d640 1 --2- 172.21.15.73:0/1127264633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd76c106f10 0x7fd76c19cd00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd764031a20 tx=0x7fd764031a50 comp rx=0 tx=0).stop 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd771caa640 1 -- 172.21.15.73:0/1127264633 reap_dead start 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 shutdown_connections 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 >> 172.21.15.73:0/1127264633 conn(0x7fd76c0fd8c0 msgr2=0x7fd76c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 shutdown_connections 2024-09-05T12:56:23.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:22.329+0000 7fd77370d640 1 -- 172.21.15.73:0/1127264633 wait complete. 2024-09-05T12:56:24.212 INFO:teuthology.orchestra.run.smithi073.stdout:180388626478 2024-09-05T12:56:24.213 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-05T12:56:24.663 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:24.668 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.111+0000 7fac4d220640 1 -- 172.21.15.73:0/3539268979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac48106f20 msgr2=0x7fac4810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.111+0000 7fac4d220640 1 --2- 172.21.15.73:0/3539268979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac48106f20 0x7fac4810eaa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fac40009ca0 tx=0x7fac4002a8c0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.111+0000 7fac4d220640 1 -- 172.21.15.73:0/3539268979 shutdown_connections 2024-09-05T12:56:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.111+0000 7fac4d220640 1 --2- 172.21.15.73:0/3539268979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac48106f20 0x7fac4810eaa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.111+0000 7fac4d220640 1 --2- 172.21.15.73:0/3539268979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac481027a0 0x7fac481067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.111+0000 7fac4d220640 1 --2- 172.21.15.73:0/3539268979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac48101df0 0x7fac481021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.111+0000 7fac4d220640 1 -- 172.21.15.73:0/3539268979 >> 172.21.15.73:0/3539268979 conn(0x7fac480fd8f0 msgr2=0x7fac480ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.111+0000 7fac4d220640 1 -- 172.21.15.73:0/3539268979 shutdown_connections 2024-09-05T12:56:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.111+0000 7fac4d220640 1 -- 172.21.15.73:0/3539268979 wait complete. 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.111+0000 7fac4d220640 1 Processor -- start 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac4d220640 1 -- start start 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac4d220640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac48101df0 0x7fac4819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac4d220640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac481027a0 0x7fac4819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac4d220640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac48106f20 0x7fac4819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac4d220640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fac48111f80 con 0x7fac48101df0 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac4d220640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac48111e00 con 0x7fac48106f20 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac4d220640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac48112100 con 0x7fac481027a0 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac46d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac48101df0 0x7fac4819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac46d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac48101df0 0x7fac4819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44760/0 (socket says 172.21.15.73:44760) 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac46d9d640 1 -- 172.21.15.73:0/2030156581 learned_addr learned my addr 172.21.15.73:0/2030156581 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac4759e640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac48106f20 0x7fac4819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:25.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac4659c640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac481027a0 0x7fac4819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac46d9d640 1 -- 172.21.15.73:0/2030156581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac481027a0 msgr2=0x7fac4819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac46d9d640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac481027a0 0x7fac4819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac46d9d640 1 -- 172.21.15.73:0/2030156581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac48106f20 msgr2=0x7fac4819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac46d9d640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac48106f20 0x7fac4819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.112+0000 7fac46d9d640 1 -- 172.21.15.73:0/2030156581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4819f5d0 con 0x7fac48101df0 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.113+0000 7fac4759e640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac48106f20 0x7fac4819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.113+0000 7fac4659c640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac481027a0 0x7fac4819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.113+0000 7fac46d9d640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac48101df0 0x7fac4819a620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fac3800d770 tx=0x7fac3800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.113+0000 7fac2ffff640 1 -- 172.21.15.73:0/2030156581 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38017070 con 0x7fac48101df0 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.113+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4819f8c0 con 0x7fac48101df0 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.113+0000 7fac2ffff640 1 -- 172.21.15.73:0/2030156581 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac38005500 con 0x7fac48101df0 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.113+0000 7fac2ffff640 1 -- 172.21.15.73:0/2030156581 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38004e00 con 0x7fac48101df0 2024-09-05T12:56:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.113+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac481a71a0 con 0x7fac48101df0 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.114+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac4810e1c0 con 0x7fac48101df0 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.115+0000 7fac2ffff640 1 -- 172.21.15.73:0/2030156581 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fac38004fa0 con 0x7fac48101df0 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.116+0000 7fac2ffff640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac300a2c10 0x7fac300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.116+0000 7fac4659c640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac300a2c10 0x7fac300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.116+0000 7fac2ffff640 1 -- 172.21.15.73:0/2030156581 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fac380cf0d0 con 0x7fac48101df0 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.116+0000 7fac2ffff640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] conn(0x7fac300ac740 0x7fac300aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.116+0000 7fac2ffff640 1 -- 172.21.15.73:0/2030156581 --> [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac3800fec0 con 0x7fac300ac740 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.116+0000 7fac2ffff640 1 -- 172.21.15.73:0/2030156581 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fac380cf520 con 0x7fac48101df0 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.116+0000 7fac4659c640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac300a2c10 0x7fac300a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fac3c005d90 tx=0x7fac3c005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.117+0000 7fac4759e640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] conn(0x7fac300ac740 0x7fac300aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.117+0000 7fac4759e640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] conn(0x7fac300ac740 0x7fac300aebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.118+0000 7fac2ffff640 1 -- 172.21.15.73:0/2030156581 <== osd.4 v2:172.21.15.162:6808/2879857832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac3800fec0 con 0x7fac300ac740 2024-09-05T12:56:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.133+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 --> [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac481032d0 con 0x7fac300ac740 2024-09-05T12:56:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.133+0000 7fac2ffff640 1 -- 172.21.15.73:0/2030156581 <== osd.4 v2:172.21.15.162:6808/2879857832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fac481032d0 con 0x7fac300ac740 2024-09-05T12:56:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 >> [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] conn(0x7fac300ac740 msgr2=0x7fac300aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4d220640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] conn(0x7fac300ac740 0x7fac300aebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac300a2c10 msgr2=0x7fac300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4d220640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fac300a2c10 0x7fac300a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fac3c005d90 tx=0x7fac3c005d20 comp rx=0 tx=0).stop 2024-09-05T12:56:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac48101df0 msgr2=0x7fac4819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4d220640 1 --2- 172.21.15.73:0/2030156581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac48101df0 0x7fac4819a620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fac3800d770 tx=0x7fac3800dc30 comp rx=0 tx=0).stop 2024-09-05T12:56:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4759e640 1 -- 172.21.15.73:0/2030156581 reap_dead start 2024-09-05T12:56:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 shutdown_connections 2024-09-05T12:56:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 >> 172.21.15.73:0/2030156581 conn(0x7fac480fd8f0 msgr2=0x7fac480fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 shutdown_connections 2024-09-05T12:56:25.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.134+0000 7fac4d220640 1 -- 172.21.15.73:0/2030156581 wait complete. 2024-09-05T12:56:25.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.991+0000 7f0e6de8d640 1 -- 172.21.15.73:0/1162796428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68102570 msgr2=0x7f0e681029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.991+0000 7f0e6de8d640 1 --2- 172.21.15.73:0/1162796428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68102570 0x7f0e681029b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009900 tx=0x7f0e5c02a480 comp rx=0 tx=0).stop 2024-09-05T12:56:25.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.991+0000 7f0e6de8d640 1 -- 172.21.15.73:0/1162796428 shutdown_connections 2024-09-05T12:56:25.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.991+0000 7f0e6de8d640 1 --2- 172.21.15.73:0/1162796428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e68102ef0 0x7f0e6810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.991+0000 7f0e6de8d640 1 --2- 172.21.15.73:0/1162796428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68102570 0x7f0e681029b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.991+0000 7f0e6de8d640 1 --2- 172.21.15.73:0/1162796428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e68100e20 0x7f0e68101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.991+0000 7f0e6de8d640 1 -- 172.21.15.73:0/1162796428 >> 172.21.15.73:0/1162796428 conn(0x7f0e680fc7d0 msgr2=0x7f0e680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:25.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.991+0000 7f0e6de8d640 1 -- 172.21.15.73:0/1162796428 shutdown_connections 2024-09-05T12:56:25.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.991+0000 7f0e6de8d640 1 -- 172.21.15.73:0/1162796428 wait complete. 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.991+0000 7f0e6de8d640 1 Processor -- start 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e6de8d640 1 -- start start 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e6de8d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e68100e20 0x7f0e68198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e6de8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68102570 0x7f0e68198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e6de8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e68102ef0 0x7f0e6819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e6de8d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68110f80 con 0x7f0e68102570 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e6de8d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68110e00 con 0x7f0e68100e20 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e6de8d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68111100 con 0x7f0e68102ef0 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e66ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68102570 0x7f0e68198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e66ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68102570 0x7f0e68198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44742/0 (socket says 172.21.15.73:44742) 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e66ffd640 1 -- 172.21.15.73:0/2346215704 learned_addr learned my addr 172.21.15.73:0/2346215704 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e677fe640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e68100e20 0x7f0e68198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:25.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.992+0000 7f0e67fff640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e68102ef0 0x7f0e6819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:25.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e66ffd640 1 -- 172.21.15.73:0/2346215704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e68102ef0 msgr2=0x7f0e6819ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e66ffd640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e68102ef0 0x7f0e6819ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e66ffd640 1 -- 172.21.15.73:0/2346215704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e68100e20 msgr2=0x7f0e68198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e66ffd640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e68100e20 0x7f0e68198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e66ffd640 1 -- 172.21.15.73:0/2346215704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6819d540 con 0x7f0e68102570 2024-09-05T12:56:25.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e67fff640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e68102ef0 0x7f0e6819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:25.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e66ffd640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68102570 0x7f0e68198ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c006010 tx=0x7f0e5c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e64ff9640 1 -- 172.21.15.73:0/2346215704 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c03f070 con 0x7f0e68102570 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6819d7d0 con 0x7f0e68102570 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e64ff9640 1 -- 172.21.15.73:0/2346215704 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e5c031c30 con 0x7f0e68102570 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e64ff9640 1 -- 172.21.15.73:0/2346215704 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c035030 con 0x7f0e68102570 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.993+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e681a5110 con 0x7f0e68102570 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.994+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e68062980 con 0x7f0e68102570 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.995+0000 7f0e64ff9640 1 -- 172.21.15.73:0/2346215704 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0e5c042070 con 0x7f0e68102570 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.996+0000 7f0e64ff9640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e500a2c10 0x7f0e500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.996+0000 7f0e677fe640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e500a2c10 0x7f0e500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.996+0000 7f0e64ff9640 1 -- 172.21.15.73:0/2346215704 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0e5c0f0250 con 0x7f0e68102570 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.996+0000 7f0e64ff9640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] conn(0x7f0e500ac740 0x7f0e500aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.996+0000 7f0e64ff9640 1 -- 172.21.15.73:0/2346215704 --> [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e500af2b0 con 0x7f0e500ac740 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.996+0000 7f0e64ff9640 1 -- 172.21.15.73:0/2346215704 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f0e5c0f06a0 con 0x7f0e68102570 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.996+0000 7f0e67fff640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] conn(0x7f0e500ac740 0x7f0e500aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.996+0000 7f0e677fe640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e500a2c10 0x7f0e500a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0e580058c0 tx=0x7f0e5800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.997+0000 7f0e67fff640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] conn(0x7f0e500ac740 0x7f0e500aebe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:24.997+0000 7f0e64ff9640 1 -- 172.21.15.73:0/2346215704 <== osd.3 v2:172.21.15.73:6810/3192613076 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e500af2b0 con 0x7f0e500ac740 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.024+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 --> [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e68062d80 con 0x7f0e500ac740 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.024+0000 7f0e64ff9640 1 -- 172.21.15.73:0/2346215704 <== osd.3 v2:172.21.15.73:6810/3192613076 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0e68062d80 con 0x7f0e500ac740 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] conn(0x7f0e500ac740 msgr2=0x7f0e500aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e6de8d640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] conn(0x7f0e500ac740 0x7f0e500aebe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e500a2c10 msgr2=0x7f0e500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e6de8d640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e500a2c10 0x7f0e500a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0e580058c0 tx=0x7f0e5800a250 comp rx=0 tx=0).stop 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68102570 msgr2=0x7f0e68198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e6de8d640 1 --2- 172.21.15.73:0/2346215704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68102570 0x7f0e68198ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c006010 tx=0x7f0e5c003c10 comp rx=0 tx=0).stop 2024-09-05T12:56:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e67fff640 1 -- 172.21.15.73:0/2346215704 reap_dead start 2024-09-05T12:56:25.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 shutdown_connections 2024-09-05T12:56:25.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 >> 172.21.15.73:0/2346215704 conn(0x7f0e680fc7d0 msgr2=0x7f0e6806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:25.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 shutdown_connections 2024-09-05T12:56:25.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:25.025+0000 7f0e6de8d640 1 -- 172.21.15.73:0/2346215704 wait complete. 2024-09-05T12:56:25.250 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:25 smithi073 ceph-mon[30883]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-05T12:56:25.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:25 smithi162 ceph-mon[34220]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-05T12:56:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:25 smithi169 ceph-mon[34823]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-05T12:56:26.567 INFO:teuthology.orchestra.run.smithi073.stdout:128849018936 2024-09-05T12:56:26.567 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-05T12:56:26.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 -- 172.21.15.73:0/1265751844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae0102d30 msgr2=0x7fdae0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 --2- 172.21.15.73:0/1265751844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae0102d30 0x7fdae0103110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009930 tx=0x7fdad002a420 comp rx=0 tx=0).stop 2024-09-05T12:56:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 -- 172.21.15.73:0/1265751844 shutdown_connections 2024-09-05T12:56:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 --2- 172.21.15.73:0/1265751844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdae01082a0 0x7fdae010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 --2- 172.21.15.73:0/1265751844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae01036e0 0x7fdae0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 --2- 172.21.15.73:0/1265751844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae0102d30 0x7fdae0103110 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 -- 172.21.15.73:0/1265751844 >> 172.21.15.73:0/1265751844 conn(0x7fdae00fc7d0 msgr2=0x7fdae00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 -- 172.21.15.73:0/1265751844 shutdown_connections 2024-09-05T12:56:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 -- 172.21.15.73:0/1265751844 wait complete. 2024-09-05T12:56:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 Processor -- start 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.923+0000 7fdae5af1640 1 -- start start 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdae5af1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdae0102d30 0x7fdae01985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdae5af1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae01036e0 0x7fdae0198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdae5af1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae01082a0 0x7fdae019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdae5af1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdae01120a0 con 0x7fdae01082a0 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdae5af1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdae0111f20 con 0x7fdae01036e0 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdae5af1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdae0112220 con 0x7fdae0102d30 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdadffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae01082a0 0x7fdae019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdadffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae01082a0 0x7fdae019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44780/0 (socket says 172.21.15.73:44780) 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdadffff640 1 -- 172.21.15.73:0/3196604647 learned_addr learned my addr 172.21.15.73:0/3196604647 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdad6ffd640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae01036e0 0x7fdae0198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdadf7fe640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdae0102d30 0x7fdae01985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdadffff640 1 -- 172.21.15.73:0/3196604647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdae0102d30 msgr2=0x7fdae01985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdadffff640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdae0102d30 0x7fdae01985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdadffff640 1 -- 172.21.15.73:0/3196604647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae01036e0 msgr2=0x7fdae0198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdadffff640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae01036e0 0x7fdae0198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdadffff640 1 -- 172.21.15.73:0/3196604647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae019d590 con 0x7fdae01082a0 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdad6ffd640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae01036e0 0x7fdae0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.924+0000 7fdadffff640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae01082a0 0x7fdae019ceb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdad800cad0 tx=0x7fdad800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.925+0000 7fdadd7fa640 1 -- 172.21.15.73:0/3196604647 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad800ae20 con 0x7fdae01082a0 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.925+0000 7fdadd7fa640 1 -- 172.21.15.73:0/3196604647 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad8005020 con 0x7fdae01082a0 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.925+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae019d880 con 0x7fdae01082a0 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.925+0000 7fdadd7fa640 1 -- 172.21.15.73:0/3196604647 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad800f6f0 con 0x7fdae01082a0 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.925+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae01a5160 con 0x7fdae01082a0 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.926+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdae0062980 con 0x7fdae01082a0 2024-09-05T12:56:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.927+0000 7fdadd7fa640 1 -- 172.21.15.73:0/3196604647 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdad80051d0 con 0x7fdae01082a0 2024-09-05T12:56:26.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.927+0000 7fdadd7fa640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdacc0a2c90 0x7fdacc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:26.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.928+0000 7fdadf7fe640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdacc0a2c90 0x7fdacc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:26.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.928+0000 7fdadd7fa640 1 -- 172.21.15.73:0/3196604647 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fdad80cf4f0 con 0x7fdae01082a0 2024-09-05T12:56:26.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.928+0000 7fdadd7fa640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] conn(0x7fdacc0ac7c0 0x7fdacc0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:26.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.928+0000 7fdadd7fa640 1 -- 172.21.15.73:0/3196604647 --> [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdad8004e50 con 0x7fdacc0ac7c0 2024-09-05T12:56:26.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.928+0000 7fdadd7fa640 1 -- 172.21.15.73:0/3196604647 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fdad80d6050 con 0x7fdae01082a0 2024-09-05T12:56:26.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.928+0000 7fdadf7fe640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdacc0a2c90 0x7fdacc0a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdad0000c00 tx=0x7fdad0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:26.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.928+0000 7fdad6ffd640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] conn(0x7fdacc0ac7c0 0x7fdacc0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:26.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.929+0000 7fdad6ffd640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] conn(0x7fdacc0ac7c0 0x7fdacc0aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:26.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.929+0000 7fdadd7fa640 1 -- 172.21.15.73:0/3196604647 <== osd.1 v2:172.21.15.162:6800/1849982968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdad8004e50 con 0x7fdacc0ac7c0 2024-09-05T12:56:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.947+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 --> [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdae0062d80 con 0x7fdacc0ac7c0 2024-09-05T12:56:27.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.947+0000 7fdadd7fa640 1 -- 172.21.15.73:0/3196604647 <== osd.1 v2:172.21.15.162:6800/1849982968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdae0062d80 con 0x7fdacc0ac7c0 2024-09-05T12:56:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 >> [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] conn(0x7fdacc0ac7c0 msgr2=0x7fdacc0aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdae5af1640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] conn(0x7fdacc0ac7c0 0x7fdacc0aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdacc0a2c90 msgr2=0x7fdacc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdae5af1640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdacc0a2c90 0x7fdacc0a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdad0000c00 tx=0x7fdad0005a20 comp rx=0 tx=0).stop 2024-09-05T12:56:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae01082a0 msgr2=0x7fdae019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdae5af1640 1 --2- 172.21.15.73:0/3196604647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae01082a0 0x7fdae019ceb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdad800cad0 tx=0x7fdad800cf90 comp rx=0 tx=0).stop 2024-09-05T12:56:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdadffff640 1 -- 172.21.15.73:0/3196604647 reap_dead start 2024-09-05T12:56:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 shutdown_connections 2024-09-05T12:56:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 >> 172.21.15.73:0/3196604647 conn(0x7fdae00fc7d0 msgr2=0x7fdae0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 shutdown_connections 2024-09-05T12:56:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:26.948+0000 7fdae5af1640 1 -- 172.21.15.73:0/3196604647 wait complete. 2024-09-05T12:56:27.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:27 smithi162 ceph-mon[34220]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-05T12:56:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:27 smithi169 ceph-mon[34823]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-05T12:56:27.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:27 smithi073 ceph-mon[30883]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-05T12:56:27.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.787+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2792661799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8b4106a80 msgr2=0x7fc8b4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:27.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.788+0000 7fc8bbc63640 1 --2- 172.21.15.73:0/2792661799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8b4106a80 0x7fc8b4106e60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009930 tx=0x7fc8b002a420 comp rx=0 tx=0).stop 2024-09-05T12:56:27.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.788+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2792661799 shutdown_connections 2024-09-05T12:56:27.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.788+0000 7fc8bbc63640 1 --2- 172.21.15.73:0/2792661799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8b4101420 0x7fc8b410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:27.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.788+0000 7fc8bbc63640 1 --2- 172.21.15.73:0/2792661799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b4100a80 0x7fc8b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.788+0000 7fc8bbc63640 1 --2- 172.21.15.73:0/2792661799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8b4106a80 0x7fc8b4106e60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.788+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2792661799 >> 172.21.15.73:0/2792661799 conn(0x7fc8b40fc7a0 msgr2=0x7fc8b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.788+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2792661799 shutdown_connections 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.788+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2792661799 wait complete. 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.788+0000 7fc8bbc63640 1 Processor -- start 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.788+0000 7fc8bbc63640 1 -- start start 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8bbc63640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8b4100a80 0x7fc8b4197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8bbc63640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b4101420 0x7fc8b4197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8bbc63640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8b4106a80 0x7fc8b419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8bbc63640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b4110ea0 con 0x7fc8b4106a80 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8bbc63640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b4110d20 con 0x7fc8b4101420 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8bbc63640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b4111020 con 0x7fc8b4100a80 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8ba200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8b4106a80 0x7fc8b419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:27.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8ba200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8b4106a80 0x7fc8b419bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44790/0 (socket says 172.21.15.73:44790) 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8ba200640 1 -- 172.21.15.73:0/2622050211 learned_addr learned my addr 172.21.15.73:0/2622050211 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8b91fe640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b4101420 0x7fc8b4197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8b99ff640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8b4100a80 0x7fc8b4197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8ba200640 1 -- 172.21.15.73:0/2622050211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8b4100a80 msgr2=0x7fc8b4197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8ba200640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8b4100a80 0x7fc8b4197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8ba200640 1 -- 172.21.15.73:0/2622050211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b4101420 msgr2=0x7fc8b4197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8ba200640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b4101420 0x7fc8b4197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8ba200640 1 -- 172.21.15.73:0/2622050211 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b419c2d0 con 0x7fc8b4106a80 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8ba200640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8b4106a80 0x7fc8b419bbf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00b970 tx=0x7fc8ac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8aaffd640 1 -- 172.21.15.73:0/2622050211 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac019070 con 0x7fc8b4106a80 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8aaffd640 1 -- 172.21.15.73:0/2622050211 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8ac014440 con 0x7fc8b4106a80 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b419c5c0 con 0x7fc8b4106a80 2024-09-05T12:56:27.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.789+0000 7fc8aaffd640 1 -- 172.21.15.73:0/2622050211 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0075d0 con 0x7fc8b4106a80 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.790+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b41a3ea0 con 0x7fc8b4106a80 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.790+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8b40fd830 con 0x7fc8b4106a80 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.792+0000 7fc8aaffd640 1 -- 172.21.15.73:0/2622050211 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc8ac01c070 con 0x7fc8b4106a80 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.792+0000 7fc8aaffd640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc8a00a2c10 0x7fc8a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.792+0000 7fc8b99ff640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc8a00a2c10 0x7fc8a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.793+0000 7fc8aaffd640 1 -- 172.21.15.73:0/2622050211 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc8ac0cee70 con 0x7fc8b4106a80 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.793+0000 7fc8aaffd640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] conn(0x7fc8a00ac740 0x7fc8a00aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.793+0000 7fc8aaffd640 1 -- 172.21.15.73:0/2622050211 --> [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8a00af2b0 con 0x7fc8a00ac740 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.793+0000 7fc8aaffd640 1 -- 172.21.15.73:0/2622050211 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fc8ac0cf2c0 con 0x7fc8b4106a80 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.793+0000 7fc8b99ff640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc8a00a2c10 0x7fc8a00a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000c00 tx=0x7fc8b0031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.793+0000 7fc8b91fe640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] conn(0x7fc8a00ac740 0x7fc8a00aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.793+0000 7fc8b91fe640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] conn(0x7fc8a00ac740 0x7fc8a00aebe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.794+0000 7fc8aaffd640 1 -- 172.21.15.73:0/2622050211 <== osd.5 v2:172.21.15.169:6808/324340736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8a00af2b0 con 0x7fc8a00ac740 2024-09-05T12:56:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.808+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 --> [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc8b41021c0 con 0x7fc8a00ac740 2024-09-05T12:56:27.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.808+0000 7fc8aaffd640 1 -- 172.21.15.73:0/2622050211 <== osd.5 v2:172.21.15.169:6808/324340736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc8b41021c0 con 0x7fc8a00ac740 2024-09-05T12:56:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 >> [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] conn(0x7fc8a00ac740 msgr2=0x7fc8a00aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8bbc63640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] conn(0x7fc8a00ac740 0x7fc8a00aebe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc8a00a2c10 msgr2=0x7fc8a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8bbc63640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc8a00a2c10 0x7fc8a00a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000c00 tx=0x7fc8b0031490 comp rx=0 tx=0).stop 2024-09-05T12:56:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8b4106a80 msgr2=0x7fc8b419bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8bbc63640 1 --2- 172.21.15.73:0/2622050211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8b4106a80 0x7fc8b419bbf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00b970 tx=0x7fc8ac00bd70 comp rx=0 tx=0).stop 2024-09-05T12:56:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8ba200640 1 -- 172.21.15.73:0/2622050211 reap_dead start 2024-09-05T12:56:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 shutdown_connections 2024-09-05T12:56:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 >> 172.21.15.73:0/2622050211 conn(0x7fc8b40fc7a0 msgr2=0x7fc8b40fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 shutdown_connections 2024-09-05T12:56:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:27.809+0000 7fc8bbc63640 1 -- 172.21.15.73:0/2622050211 wait complete. 2024-09-05T12:56:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.189+0000 7f6fc5217640 1 -- 172.21.15.73:0/3376695178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc0102d40 msgr2=0x7f6fc0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.189+0000 7f6fc5217640 1 --2- 172.21.15.73:0/3376695178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc0102d40 0x7f6fc0103120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009900 tx=0x7f6fb002a480 comp rx=0 tx=0).stop 2024-09-05T12:56:28.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.189+0000 7f6fc5217640 1 -- 172.21.15.73:0/3376695178 shutdown_connections 2024-09-05T12:56:28.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.189+0000 7f6fc5217640 1 --2- 172.21.15.73:0/3376695178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc010c170 0x7f6fc010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:28.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.189+0000 7f6fc5217640 1 --2- 172.21.15.73:0/3376695178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc0103660 0x7f6fc010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:28.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.189+0000 7f6fc5217640 1 --2- 172.21.15.73:0/3376695178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc0102d40 0x7f6fc0103120 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:28.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.189+0000 7f6fc5217640 1 -- 172.21.15.73:0/3376695178 >> 172.21.15.73:0/3376695178 conn(0x7f6fc00fc7a0 msgr2=0x7f6fc00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:28.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.189+0000 7f6fc5217640 1 -- 172.21.15.73:0/3376695178 shutdown_connections 2024-09-05T12:56:28.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.189+0000 7f6fc5217640 1 -- 172.21.15.73:0/3376695178 wait complete. 2024-09-05T12:56:28.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fc5217640 1 Processor -- start 2024-09-05T12:56:28.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fc5217640 1 -- start start 2024-09-05T12:56:28.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fc5217640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc0102d40 0x7f6fc0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:28.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fc5217640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc0103660 0x7f6fc0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:28.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fc5217640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc010c170 0x7f6fc019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:28.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fc5217640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc0111f70 con 0x7f6fc0103660 2024-09-05T12:56:28.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fc5217640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc0111df0 con 0x7f6fc0102d40 2024-09-05T12:56:28.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fc5217640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc01120f0 con 0x7f6fc010c170 2024-09-05T12:56:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fbe59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc0103660 0x7f6fc0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fbe59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc0103660 0x7f6fc0198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44812/0 (socket says 172.21.15.73:44812) 2024-09-05T12:56:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.190+0000 7f6fbe59c640 1 -- 172.21.15.73:0/1273512010 learned_addr learned my addr 172.21.15.73:0/1273512010 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fbf59e640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc010c170 0x7f6fc019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fbed9d640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc0102d40 0x7f6fc0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fbe59c640 1 -- 172.21.15.73:0/1273512010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc010c170 msgr2=0x7f6fc019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fbe59c640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc010c170 0x7f6fc019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fbe59c640 1 -- 172.21.15.73:0/1273512010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc0102d40 msgr2=0x7f6fc0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fbe59c640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc0102d40 0x7f6fc0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fbe59c640 1 -- 172.21.15.73:0/1273512010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc019d3e0 con 0x7f6fc0103660 2024-09-05T12:56:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fbed9d640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc0102d40 0x7f6fc0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fbe59c640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc0103660 0x7f6fc0198970 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c970 tx=0x7f6fb400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fa7fff640 1 -- 172.21.15.73:0/1273512010 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4007bb0 con 0x7f6fc0103660 2024-09-05T12:56:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc019d6d0 con 0x7f6fc0103660 2024-09-05T12:56:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc01a4fb0 con 0x7f6fc0103660 2024-09-05T12:56:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fa7fff640 1 -- 172.21.15.73:0/1273512010 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fb4007d50 con 0x7f6fc0103660 2024-09-05T12:56:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.191+0000 7f6fa7fff640 1 -- 172.21.15.73:0/1273512010 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400f450 con 0x7f6fc0103660 2024-09-05T12:56:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.192+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fac001030 con 0x7f6fc0103660 2024-09-05T12:56:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.193+0000 7f6fa7fff640 1 -- 172.21.15.73:0/1273512010 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6fb4004f60 con 0x7f6fc0103660 2024-09-05T12:56:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.194+0000 7f6fa7fff640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fa80a2c90 0x7f6fa80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:28.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.194+0000 7f6fbed9d640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fa80a2c90 0x7f6fa80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:28.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.194+0000 7f6fa7fff640 1 -- 172.21.15.73:0/1273512010 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f6fb40ced40 con 0x7f6fc0103660 2024-09-05T12:56:28.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.194+0000 7f6fa7fff640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] conn(0x7f6fa80ac7c0 0x7f6fa80aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:28.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.194+0000 7f6fa7fff640 1 -- 172.21.15.73:0/1273512010 --> [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fa80af330 con 0x7f6fa80ac7c0 2024-09-05T12:56:28.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.194+0000 7f6fa7fff640 1 -- 172.21.15.73:0/1273512010 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f6fb40d1400 con 0x7f6fc0103660 2024-09-05T12:56:28.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.194+0000 7f6fbed9d640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fa80a2c90 0x7f6fa80a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0000c00 tx=0x7f6fb0032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:28.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.194+0000 7f6fbf59e640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] conn(0x7f6fa80ac7c0 0x7f6fa80aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:28.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.195+0000 7f6fbf59e640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] conn(0x7f6fa80ac7c0 0x7f6fa80aec60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:28.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.195+0000 7f6fa7fff640 1 -- 172.21.15.73:0/1273512010 <== osd.10 v2:172.21.15.162:6824/3623867420 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fa80af330 con 0x7f6fa80ac7c0 2024-09-05T12:56:28.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.209+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 --> [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6fac002dd0 con 0x7f6fa80ac7c0 2024-09-05T12:56:28.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.209+0000 7f6fa7fff640 1 -- 172.21.15.73:0/1273512010 <== osd.10 v2:172.21.15.162:6824/3623867420 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6fac002dd0 con 0x7f6fa80ac7c0 2024-09-05T12:56:28.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 >> [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] conn(0x7f6fa80ac7c0 msgr2=0x7f6fa80aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:28.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fc5217640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] conn(0x7f6fa80ac7c0 0x7f6fa80aec60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:28.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fa80a2c90 msgr2=0x7f6fa80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:28.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fc5217640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fa80a2c90 0x7f6fa80a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0000c00 tx=0x7f6fb0032d50 comp rx=0 tx=0).stop 2024-09-05T12:56:28.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc0103660 msgr2=0x7f6fc0198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:28.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fc5217640 1 --2- 172.21.15.73:0/1273512010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc0103660 0x7f6fc0198970 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c970 tx=0x7f6fb400ce30 comp rx=0 tx=0).stop 2024-09-05T12:56:28.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fbf59e640 1 -- 172.21.15.73:0/1273512010 reap_dead start 2024-09-05T12:56:28.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 shutdown_connections 2024-09-05T12:56:28.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 >> 172.21.15.73:0/1273512010 conn(0x7f6fc00fc7a0 msgr2=0x7f6fc00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:28.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 shutdown_connections 2024-09-05T12:56:28.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.210+0000 7f6fc5217640 1 -- 172.21.15.73:0/1273512010 wait complete. 2024-09-05T12:56:29.196 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:29 smithi073 ceph-mon[30883]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-05T12:56:29.222 INFO:teuthology.orchestra.run.smithi073.stdout:279172874267 2024-09-05T12:56:29.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-05T12:56:29.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.842+0000 7f0840b2e640 1 -- 172.21.15.73:0/2425439784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f083c101420 msgr2=0x7f083c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.842+0000 7f0840b2e640 1 --2- 172.21.15.73:0/2425439784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f083c101420 0x7f083c10d950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0834009cd0 tx=0x7f083402a8e0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.842+0000 7f0840b2e640 1 -- 172.21.15.73:0/2425439784 shutdown_connections 2024-09-05T12:56:29.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.842+0000 7f0840b2e640 1 --2- 172.21.15.73:0/2425439784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f083c101420 0x7f083c10d950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.842+0000 7f0840b2e640 1 --2- 172.21.15.73:0/2425439784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c100a80 0x7f083c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.842+0000 7f0840b2e640 1 --2- 172.21.15.73:0/2425439784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083c106a80 0x7f083c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.842+0000 7f0840b2e640 1 -- 172.21.15.73:0/2425439784 >> 172.21.15.73:0/2425439784 conn(0x7f083c0fc7a0 msgr2=0x7f083c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.842+0000 7f0840b2e640 1 -- 172.21.15.73:0/2425439784 shutdown_connections 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.843+0000 7f0840b2e640 1 -- 172.21.15.73:0/2425439784 wait complete. 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.843+0000 7f0840b2e640 1 Processor -- start 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.843+0000 7f0840b2e640 1 -- start start 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.843+0000 7f0840b2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083c100a80 0x7f083c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.843+0000 7f0840b2e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c101420 0x7f083c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.843+0000 7f0840b2e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f083c106a80 0x7f083c19ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f0840b2e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f083c110e80 con 0x7f083c106a80 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f0840b2e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f083c110d00 con 0x7f083c100a80 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f0840b2e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f083c111000 con 0x7f083c101420 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f083ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f083c106a80 0x7f083c19ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f083ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f083c106a80 0x7f083c19ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44842/0 (socket says 172.21.15.73:44842) 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f083ad9d640 1 -- 172.21.15.73:0/1880116119 learned_addr learned my addr 172.21.15.73:0/1880116119 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f083a59c640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083c100a80 0x7f083c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f0833fff640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c101420 0x7f083c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f083ad9d640 1 -- 172.21.15.73:0/1880116119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c101420 msgr2=0x7f083c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f083ad9d640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c101420 0x7f083c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f083ad9d640 1 -- 172.21.15.73:0/1880116119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083c100a80 msgr2=0x7f083c19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f083ad9d640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083c100a80 0x7f083c19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f083ad9d640 1 -- 172.21.15.73:0/1880116119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c19f560 con 0x7f083c106a80 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f0833fff640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c101420 0x7f083c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f083ad9d640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f083c106a80 0x7f083c19ee80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0834005cc0 tx=0x7f0834003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f08337fe640 1 -- 172.21.15.73:0/1880116119 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834004040 con 0x7f083c106a80 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f08337fe640 1 -- 172.21.15.73:0/1880116119 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08340046c0 con 0x7f083c106a80 2024-09-05T12:56:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083c19f7f0 con 0x7f083c106a80 2024-09-05T12:56:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f08337fe640 1 -- 172.21.15.73:0/1880116119 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834046480 con 0x7f083c106a80 2024-09-05T12:56:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.844+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f083c1a7130 con 0x7f083c106a80 2024-09-05T12:56:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.845+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f083c10d130 con 0x7f083c106a80 2024-09-05T12:56:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.847+0000 7f08337fe640 1 -- 172.21.15.73:0/1880116119 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f08340305a0 con 0x7f083c106a80 2024-09-05T12:56:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.847+0000 7f08337fe640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f08280a2c10 0x7f08280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.847+0000 7f083a59c640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f08280a2c10 0x7f08280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.847+0000 7f08337fe640 1 -- 172.21.15.73:0/1880116119 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f083402e030 con 0x7f083c106a80 2024-09-05T12:56:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.848+0000 7f08337fe640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] conn(0x7f08280ac740 0x7f08280aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.848+0000 7f08337fe640 1 -- 172.21.15.73:0/1880116119 --> [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f083404fe50 con 0x7f08280ac740 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.848+0000 7f08337fe640 1 -- 172.21.15.73:0/1880116119 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f08340f0e40 con 0x7f083c106a80 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.848+0000 7f083a59c640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f08280a2c10 0x7f08280a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f082c00bb60 tx=0x7f082c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.848+0000 7f0833fff640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] conn(0x7f08280ac740 0x7f08280aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.848+0000 7f0833fff640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] conn(0x7f08280ac740 0x7f08280aebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.849+0000 7f08337fe640 1 -- 172.21.15.73:0/1880116119 <== osd.2 v2:172.21.15.169:6800/2183957699 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f083404fe50 con 0x7f08280ac740 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.863+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 --> [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f083c1021c0 con 0x7f08280ac740 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.863+0000 7f08337fe640 1 -- 172.21.15.73:0/1880116119 <== osd.2 v2:172.21.15.169:6800/2183957699 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f083c1021c0 con 0x7f08280ac740 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.863+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 >> [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] conn(0x7f08280ac740 msgr2=0x7f08280aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.863+0000 7f0840b2e640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] conn(0x7f08280ac740 0x7f08280aebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.864+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f08280a2c10 msgr2=0x7f08280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.864+0000 7f0840b2e640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f08280a2c10 0x7f08280a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f082c00bb60 tx=0x7f082c00b390 comp rx=0 tx=0).stop 2024-09-05T12:56:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.864+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f083c106a80 msgr2=0x7f083c19ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.864+0000 7f0840b2e640 1 --2- 172.21.15.73:0/1880116119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f083c106a80 0x7f083c19ee80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0834005cc0 tx=0x7f0834003970 comp rx=0 tx=0).stop 2024-09-05T12:56:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.864+0000 7f083ad9d640 1 -- 172.21.15.73:0/1880116119 reap_dead start 2024-09-05T12:56:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.864+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 shutdown_connections 2024-09-05T12:56:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.864+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 >> 172.21.15.73:0/1880116119 conn(0x7f083c0fc7a0 msgr2=0x7f083c10c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.864+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 shutdown_connections 2024-09-05T12:56:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.864+0000 7f0840b2e640 1 -- 172.21.15.73:0/1880116119 wait complete. 2024-09-05T12:56:29.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:29 smithi162 ceph-mon[34220]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-05T12:56:29.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:29 smithi169 ceph-mon[34823]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-05T12:56:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.728+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/2739013104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa0100e20 msgr2=0x7f2fa0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.728+0000 7f2fa4fbf640 1 --2- 172.21.15.73:0/2739013104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa0100e20 0x7f2fa0101200 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009900 tx=0x7f2f9002a480 comp rx=0 tx=0).stop 2024-09-05T12:56:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.728+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/2739013104 shutdown_connections 2024-09-05T12:56:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.728+0000 7f2fa4fbf640 1 --2- 172.21.15.73:0/2739013104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0102ef0 0x7f2fa010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.728+0000 7f2fa4fbf640 1 --2- 172.21.15.73:0/2739013104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fa0102570 0x7f2fa01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.728+0000 7f2fa4fbf640 1 --2- 172.21.15.73:0/2739013104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa0100e20 0x7f2fa0101200 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.728+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/2739013104 >> 172.21.15.73:0/2739013104 conn(0x7f2fa00fc7d0 msgr2=0x7f2fa00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.728+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/2739013104 shutdown_connections 2024-09-05T12:56:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.728+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/2739013104 wait complete. 2024-09-05T12:56:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2fa4fbf640 1 Processor -- start 2024-09-05T12:56:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2fa4fbf640 1 -- start start 2024-09-05T12:56:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2fa4fbf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fa0100e20 0x7f2fa00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2fa4fbf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa0102570 0x7f2fa00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2fa4fbf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0102ef0 0x7f2fa00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2fa4fbf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa0110fa0 con 0x7f2fa0102570 2024-09-05T12:56:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2fa4fbf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa0110e20 con 0x7f2fa0102ef0 2024-09-05T12:56:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2fa4fbf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa0111120 con 0x7f2fa0100e20 2024-09-05T12:56:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa0102570 0x7f2fa00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa0102570 0x7f2fa00fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44832/0 (socket says 172.21.15.73:44832) 2024-09-05T12:56:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9dd9b640 1 -- 172.21.15.73:0/4197935525 learned_addr learned my addr 172.21.15.73:0/4197935525 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9ed9d640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0102ef0 0x7f2fa00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9e59c640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fa0100e20 0x7f2fa00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9dd9b640 1 -- 172.21.15.73:0/4197935525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fa0100e20 msgr2=0x7f2fa00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9dd9b640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fa0100e20 0x7f2fa00fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9dd9b640 1 -- 172.21.15.73:0/4197935525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0102ef0 msgr2=0x7f2fa00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9dd9b640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0102ef0 0x7f2fa00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9dd9b640 1 -- 172.21.15.73:0/4197935525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa01a69d0 con 0x7f2fa0102570 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.729+0000 7f2f9ed9d640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0102ef0 0x7f2fa00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.730+0000 7f2f9dd9b640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa0102570 0x7f2fa00fd1c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800b4a0 tx=0x7f2f8800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.730+0000 7f2f977fe640 1 -- 172.21.15.73:0/4197935525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88014070 con 0x7f2fa0102570 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.730+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa01a6cc0 con 0x7f2fa0102570 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.730+0000 7f2f977fe640 1 -- 172.21.15.73:0/4197935525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f88010af0 con 0x7f2fa0102570 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.730+0000 7f2f977fe640 1 -- 172.21.15.73:0/4197935525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88017d10 con 0x7f2fa0102570 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.730+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa01a71b0 con 0x7f2fa0102570 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.731+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2fa0062940 con 0x7f2fa0102570 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.732+0000 7f2f977fe640 1 -- 172.21.15.73:0/4197935525 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2f88017070 con 0x7f2fa0102570 2024-09-05T12:56:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.732+0000 7f2f977fe640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2f8c0a2c10 0x7f2f8c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.733+0000 7f2f9e59c640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2f8c0a2c10 0x7f2f8c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.733+0000 7f2f977fe640 1 -- 172.21.15.73:0/4197935525 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f2f880ce510 con 0x7f2fa0102570 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.733+0000 7f2f977fe640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] conn(0x7f2f8c0ac740 0x7f2f8c0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.733+0000 7f2f977fe640 1 -- 172.21.15.73:0/4197935525 --> [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f8c0af2b0 con 0x7f2f8c0ac740 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.733+0000 7f2f977fe640 1 -- 172.21.15.73:0/4197935525 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f2f880d5050 con 0x7f2fa0102570 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.733+0000 7f2f9e59c640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2f8c0a2c10 0x7f2f8c0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2f900096c0 tx=0x7f2f90000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.733+0000 7f2f9ed9d640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] conn(0x7f2f8c0ac740 0x7f2f8c0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.734+0000 7f2f9ed9d640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] conn(0x7f2f8c0ac740 0x7f2f8c0aebe0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.735+0000 7f2f977fe640 1 -- 172.21.15.73:0/4197935525 <== osd.11 v2:172.21.15.169:6824/1127339864 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f8c0af2b0 con 0x7f2f8c0ac740 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.748+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 --> [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2fa0062dc0 con 0x7f2f8c0ac740 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2f977fe640 1 -- 172.21.15.73:0/4197935525 <== osd.11 v2:172.21.15.169:6824/1127339864 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2fa0062dc0 con 0x7f2f8c0ac740 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 >> [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] conn(0x7f2f8c0ac740 msgr2=0x7f2f8c0aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2fa4fbf640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] conn(0x7f2f8c0ac740 0x7f2f8c0aebe0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2f8c0a2c10 msgr2=0x7f2f8c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2fa4fbf640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2f8c0a2c10 0x7f2f8c0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2f900096c0 tx=0x7f2f90000bc0 comp rx=0 tx=0).stop 2024-09-05T12:56:29.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa0102570 msgr2=0x7f2fa00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:29.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2fa4fbf640 1 --2- 172.21.15.73:0/4197935525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa0102570 0x7f2fa00fd1c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800b4a0 tx=0x7f2f8800b960 comp rx=0 tx=0).stop 2024-09-05T12:56:29.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2f9ed9d640 1 -- 172.21.15.73:0/4197935525 reap_dead start 2024-09-05T12:56:29.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 shutdown_connections 2024-09-05T12:56:29.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 >> 172.21.15.73:0/4197935525 conn(0x7f2fa00fc7d0 msgr2=0x7f2fa006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:29.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 shutdown_connections 2024-09-05T12:56:29.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:28.749+0000 7f2fa4fbf640 1 -- 172.21.15.73:0/4197935525 wait complete. 2024-09-05T12:56:30.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 -- 172.21.15.73:0/2897776865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3458102570 msgr2=0x7f34581029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:30.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 --2- 172.21.15.73:0/2897776865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3458102570 0x7f34581029b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3444009900 tx=0x7f344402a480 comp rx=0 tx=0).stop 2024-09-05T12:56:30.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 -- 172.21.15.73:0/2897776865 shutdown_connections 2024-09-05T12:56:30.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 --2- 172.21.15.73:0/2897776865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102ef0 0x7f345810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:30.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 --2- 172.21.15.73:0/2897776865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3458102570 0x7f34581029b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 --2- 172.21.15.73:0/2897776865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3458100e20 0x7f3458101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 -- 172.21.15.73:0/2897776865 >> 172.21.15.73:0/2897776865 conn(0x7f34580fc7d0 msgr2=0x7f34580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 -- 172.21.15.73:0/2897776865 shutdown_connections 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 -- 172.21.15.73:0/2897776865 wait complete. 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 Processor -- start 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.997+0000 7f345ee8e640 1 -- start start 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345ee8e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3458100e20 0x7f3458198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345ee8e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3458102570 0x7f3458198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345ee8e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102ef0 0x7f345819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345ee8e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3458111020 con 0x7f3458100e20 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345ee8e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3458110ea0 con 0x7f3458102ef0 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345ee8e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f34581111a0 con 0x7f3458102570 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345cc2a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3458100e20 0x7f3458198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:30.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345cc2a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3458100e20 0x7f3458198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44856/0 (socket says 172.21.15.73:44856) 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345cc2a640 1 -- 172.21.15.73:0/845160390 learned_addr learned my addr 172.21.15.73:0/845160390 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345d42b640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102ef0 0x7f345819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345cc2a640 1 -- 172.21.15.73:0/845160390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3458102570 msgr2=0x7f3458198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345cc2a640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3458102570 0x7f3458198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345cc2a640 1 -- 172.21.15.73:0/845160390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102ef0 msgr2=0x7f345819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345cc2a640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102ef0 0x7f345819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345cc2a640 1 -- 172.21.15.73:0/845160390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345819d620 con 0x7f3458100e20 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345d42b640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102ef0 0x7f345819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345cc2a640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3458100e20 0x7f3458198670 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f344c00b4a0 tx=0x7f344c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f3455ffb640 1 -- 172.21.15.73:0/845160390 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c014070 con 0x7f3458100e20 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345819d910 con 0x7f3458100e20 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f3455ffb640 1 -- 172.21.15.73:0/845160390 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f344c010af0 con 0x7f3458100e20 2024-09-05T12:56:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f3455ffb640 1 -- 172.21.15.73:0/845160390 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c017d10 con 0x7f3458100e20 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.998+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34581a51f0 con 0x7f3458100e20 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:29.999+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3458062980 con 0x7f3458100e20 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.000+0000 7f3455ffb640 1 -- 172.21.15.73:0/845160390 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f344c017070 con 0x7f3458100e20 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.001+0000 7f3455ffb640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34480a2c10 0x7f34480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.001+0000 7f3457fff640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34480a2c10 0x7f34480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.001+0000 7f3455ffb640 1 -- 172.21.15.73:0/845160390 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f344c0ce8e0 con 0x7f3458100e20 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.001+0000 7f3455ffb640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] conn(0x7f34480ac740 0x7f34480aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.001+0000 7f3455ffb640 1 -- 172.21.15.73:0/845160390 --> [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34480af2b0 con 0x7f34480ac740 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.001+0000 7f3455ffb640 1 -- 172.21.15.73:0/845160390 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f344c0ced30 con 0x7f3458100e20 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.002+0000 7f3457fff640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34480a2c10 0x7f34480a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34440096c0 tx=0x7f3444000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.002+0000 7f345d42b640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] conn(0x7f34480ac740 0x7f34480aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.002+0000 7f345d42b640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] conn(0x7f34480ac740 0x7f34480aebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.003+0000 7f3455ffb640 1 -- 172.21.15.73:0/845160390 <== osd.8 v2:172.21.15.169:6816/3235960631 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34480af2b0 con 0x7f34480ac740 2024-09-05T12:56:30.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.016+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 --> [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3458062d80 con 0x7f34480ac740 2024-09-05T12:56:30.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.017+0000 7f3455ffb640 1 -- 172.21.15.73:0/845160390 <== osd.8 v2:172.21.15.169:6816/3235960631 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3458062d80 con 0x7f34480ac740 2024-09-05T12:56:30.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.017+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 >> [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] conn(0x7f34480ac740 msgr2=0x7f34480aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:30.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.017+0000 7f345ee8e640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] conn(0x7f34480ac740 0x7f34480aebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.017+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34480a2c10 msgr2=0x7f34480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.017+0000 7f345ee8e640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34480a2c10 0x7f34480a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34440096c0 tx=0x7f3444000bc0 comp rx=0 tx=0).stop 2024-09-05T12:56:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.017+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3458100e20 msgr2=0x7f3458198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.017+0000 7f345ee8e640 1 --2- 172.21.15.73:0/845160390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3458100e20 0x7f3458198670 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f344c00b4a0 tx=0x7f344c00b960 comp rx=0 tx=0).stop 2024-09-05T12:56:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.017+0000 7f345d42b640 1 -- 172.21.15.73:0/845160390 reap_dead start 2024-09-05T12:56:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.017+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 shutdown_connections 2024-09-05T12:56:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.017+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 >> 172.21.15.73:0/845160390 conn(0x7f34580fc7d0 msgr2=0x7f345806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.018+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 shutdown_connections 2024-09-05T12:56:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:30.018+0000 7f345ee8e640 1 -- 172.21.15.73:0/845160390 wait complete. 2024-09-05T12:56:30.581 INFO:teuthology.orchestra.run.smithi073.stdout:73014444098 2024-09-05T12:56:30.581 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-05T12:56:31.186 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:31 smithi073 ceph-mon[30883]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-05T12:56:31.216 INFO:teuthology.orchestra.run.smithi073.stdout:231928234022 2024-09-05T12:56:31.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-05T12:56:31.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:31 smithi162 ceph-mon[34220]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-05T12:56:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:31 smithi169 ceph-mon[34823]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-05T12:56:31.758 INFO:teuthology.orchestra.run.smithi073.stdout:51539607623 2024-09-05T12:56:31.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-05T12:56:32.168 INFO:teuthology.orchestra.run.smithi073.stdout:150323855412 2024-09-05T12:56:32.169 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-05T12:56:32.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.332+0000 7f8c922b9640 1 -- 172.21.15.73:0/560152745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8c1027a0 msgr2=0x7f8c8c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:32.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.332+0000 7f8c922b9640 1 --2- 172.21.15.73:0/560152745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8c1027a0 0x7f8c8c1067f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009900 tx=0x7f8c7c02a410 comp rx=0 tx=0).stop 2024-09-05T12:56:32.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.333+0000 7f8c922b9640 1 -- 172.21.15.73:0/560152745 shutdown_connections 2024-09-05T12:56:32.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.333+0000 7f8c922b9640 1 --2- 172.21.15.73:0/560152745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c8c106f20 0x7f8c8c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:32.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.333+0000 7f8c922b9640 1 --2- 172.21.15.73:0/560152745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8c1027a0 0x7f8c8c1067f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:32.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.333+0000 7f8c922b9640 1 --2- 172.21.15.73:0/560152745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c8c101df0 0x7f8c8c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:32.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.333+0000 7f8c922b9640 1 -- 172.21.15.73:0/560152745 >> 172.21.15.73:0/560152745 conn(0x7f8c8c0fd8f0 msgr2=0x7f8c8c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:32.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.333+0000 7f8c922b9640 1 -- 172.21.15.73:0/560152745 shutdown_connections 2024-09-05T12:56:32.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.333+0000 7f8c922b9640 1 -- 172.21.15.73:0/560152745 wait complete. 2024-09-05T12:56:32.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.333+0000 7f8c922b9640 1 Processor -- start 2024-09-05T12:56:32.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.333+0000 7f8c922b9640 1 -- start start 2024-09-05T12:56:32.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c922b9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c8c101df0 0x7f8c8c1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:32.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c922b9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c8c1027a0 0x7f8c8c198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:32.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c922b9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8c106f20 0x7f8c8c19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:32.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c922b9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c112020 con 0x7f8c8c106f20 2024-09-05T12:56:32.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c922b9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c111ea0 con 0x7f8c8c1027a0 2024-09-05T12:56:32.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c922b9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1121a0 con 0x7f8c8c101df0 2024-09-05T12:56:32.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c90856640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8c106f20 0x7f8c8c19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:32.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c90856640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8c106f20 0x7f8c8c19ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44870/0 (socket says 172.21.15.73:44870) 2024-09-05T12:56:32.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c90856640 1 -- 172.21.15.73:0/1783539620 learned_addr learned my addr 172.21.15.73:0/1783539620 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:32.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c8b7fe640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c8c1027a0 0x7f8c8c198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:32.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c8bfff640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c8c101df0 0x7f8c8c1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:32.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c90856640 1 -- 172.21.15.73:0/1783539620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c8c101df0 msgr2=0x7f8c8c1985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:32.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c90856640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c8c101df0 0x7f8c8c1985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:32.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c90856640 1 -- 172.21.15.73:0/1783539620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c8c1027a0 msgr2=0x7f8c8c198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:32.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c90856640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c8c1027a0 0x7f8c8c198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:32.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c90856640 1 -- 172.21.15.73:0/1783539620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c19d590 con 0x7f8c8c106f20 2024-09-05T12:56:32.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c8bfff640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c8c101df0 0x7f8c8c1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:32.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c8b7fe640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c8c1027a0 0x7f8c8c198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:32.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c90856640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8c106f20 0x7f8c8c19ceb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400b970 tx=0x7f8c8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:32.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c897fa640 1 -- 172.21.15.73:0/1783539620 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84019070 con 0x7f8c8c106f20 2024-09-05T12:56:32.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.334+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8c19d880 con 0x7f8c8c106f20 2024-09-05T12:56:32.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.335+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8c1a5160 con 0x7f8c8c106f20 2024-09-05T12:56:32.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.335+0000 7f8c897fa640 1 -- 172.21.15.73:0/1783539620 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c8400cb40 con 0x7f8c8c106f20 2024-09-05T12:56:32.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.335+0000 7f8c897fa640 1 -- 172.21.15.73:0/1783539620 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8401d5d0 con 0x7f8c8c106f20 2024-09-05T12:56:32.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.335+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c8c062980 con 0x7f8c8c106f20 2024-09-05T12:56:32.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.337+0000 7f8c897fa640 1 -- 172.21.15.73:0/1783539620 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8c8401c070 con 0x7f8c8c106f20 2024-09-05T12:56:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.338+0000 7f8c897fa640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8c740a2c90 0x7f8c740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.338+0000 7f8c8bfff640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8c740a2c90 0x7f8c740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.338+0000 7f8c897fa640 1 -- 172.21.15.73:0/1783539620 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f8c840ce6c0 con 0x7f8c8c106f20 2024-09-05T12:56:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.338+0000 7f8c897fa640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] conn(0x7f8c740ac7c0 0x7f8c740aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:32.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.338+0000 7f8c897fa640 1 -- 172.21.15.73:0/1783539620 --> [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c84010ec0 con 0x7f8c740ac7c0 2024-09-05T12:56:32.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.338+0000 7f8c897fa640 1 -- 172.21.15.73:0/1783539620 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f8c840d5050 con 0x7f8c8c106f20 2024-09-05T12:56:32.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.338+0000 7f8c8bfff640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8c740a2c90 0x7f8c740a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c80006fd0 tx=0x7f8c80008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:32.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.339+0000 7f8c8b7fe640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] conn(0x7f8c740ac7c0 0x7f8c740aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:32.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.339+0000 7f8c8b7fe640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] conn(0x7f8c740ac7c0 0x7f8c740aec60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:32.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.340+0000 7f8c897fa640 1 -- 172.21.15.73:0/1783539620 <== osd.7 v2:172.21.15.162:6816/1574930675 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c84010ec0 con 0x7f8c740ac7c0 2024-09-05T12:56:32.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.354+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 --> [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c8c062d80 con 0x7f8c740ac7c0 2024-09-05T12:56:32.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.355+0000 7f8c897fa640 1 -- 172.21.15.73:0/1783539620 <== osd.7 v2:172.21.15.162:6816/1574930675 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8c8c062d80 con 0x7f8c740ac7c0 2024-09-05T12:56:32.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.355+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 >> [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] conn(0x7f8c740ac7c0 msgr2=0x7f8c740aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:32.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.355+0000 7f8c922b9640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] conn(0x7f8c740ac7c0 0x7f8c740aec60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:32.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.355+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8c740a2c90 msgr2=0x7f8c740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:32.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.355+0000 7f8c922b9640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8c740a2c90 0x7f8c740a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c80006fd0 tx=0x7f8c80008040 comp rx=0 tx=0).stop 2024-09-05T12:56:32.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.355+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8c106f20 msgr2=0x7f8c8c19ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:32.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.355+0000 7f8c922b9640 1 --2- 172.21.15.73:0/1783539620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8c106f20 0x7f8c8c19ceb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400b970 tx=0x7f8c8400be30 comp rx=0 tx=0).stop 2024-09-05T12:56:32.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.355+0000 7f8c90856640 1 -- 172.21.15.73:0/1783539620 reap_dead start 2024-09-05T12:56:32.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.356+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 shutdown_connections 2024-09-05T12:56:32.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.356+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 >> 172.21.15.73:0/1783539620 conn(0x7f8c8c0fd8f0 msgr2=0x7f8c8c0fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:32.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.356+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 shutdown_connections 2024-09-05T12:56:32.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:32.356+0000 7f8c922b9640 1 -- 172.21.15.73:0/1783539620 wait complete. 2024-09-05T12:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout:34359738443 2024-09-05T12:56:32.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-05T12:56:33.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:33 smithi073 ceph-mon[30883]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-05T12:56:33.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:33 smithi162 ceph-mon[34220]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-05T12:56:33.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:33 smithi169 ceph-mon[34823]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-05T12:56:33.419 INFO:teuthology.orchestra.run.smithi073.stdout:98784247868 2024-09-05T12:56:33.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-05T12:56:34.050 INFO:teuthology.orchestra.run.smithi073.stdout:309237645334 2024-09-05T12:56:34.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-05T12:56:34.527 INFO:teuthology.orchestra.run.smithi073.stdout:261993005086 2024-09-05T12:56:34.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-05T12:56:34.973 INFO:teuthology.orchestra.run.smithi073.stdout:201863462954 2024-09-05T12:56:34.973 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-05T12:56:35.059 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:35.059 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:35.084 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:35.139 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:35.208 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:35 smithi073 ceph-mon[30883]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-05T12:56:35.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:35 smithi162 ceph-mon[34220]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-05T12:56:35.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:35 smithi169 ceph-mon[34823]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-05T12:56:36.035 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:36.036 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:36.049 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:36.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 -- 172.21.15.73:0/2309764161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe590101420 msgr2=0x7fe59010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:36.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 --2- 172.21.15.73:0/2309764161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe590101420 0x7fe59010d950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe580009cd0 tx=0x7fe58002a8e0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 -- 172.21.15.73:0/2309764161 shutdown_connections 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 --2- 172.21.15.73:0/2309764161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe590101420 0x7fe59010d950 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 --2- 172.21.15.73:0/2309764161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe590100a80 0x7fe590100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 --2- 172.21.15.73:0/2309764161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe590106a80 0x7fe590106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 -- 172.21.15.73:0/2309764161 >> 172.21.15.73:0/2309764161 conn(0x7fe5900fc7a0 msgr2=0x7fe5900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 -- 172.21.15.73:0/2309764161 shutdown_connections 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 -- 172.21.15.73:0/2309764161 wait complete. 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 Processor -- start 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.224+0000 7fe598455640 1 -- start start 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe598455640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe590100a80 0x7fe590198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe598455640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe590101420 0x7fe5901989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe598455640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe590106a80 0x7fe59019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe598455640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe590110ea0 con 0x7fe590100a80 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe598455640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe590110d20 con 0x7fe590106a80 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe598455640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe590111020 con 0x7fe590101420 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5961f1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe590100a80 0x7fe590198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5961f1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe590100a80 0x7fe590198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41700/0 (socket says 172.21.15.73:41700) 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5961f1640 1 -- 172.21.15.73:0/3769450265 learned_addr learned my addr 172.21.15.73:0/3769450265 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5969f2640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe590106a80 0x7fe59019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5959f0640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe590101420 0x7fe5901989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5961f1640 1 -- 172.21.15.73:0/3769450265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe590101420 msgr2=0x7fe5901989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5961f1640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe590101420 0x7fe5901989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5961f1640 1 -- 172.21.15.73:0/3769450265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe590106a80 msgr2=0x7fe59019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5961f1640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe590106a80 0x7fe59019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5961f1640 1 -- 172.21.15.73:0/3769450265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59019d420 con 0x7fe590100a80 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe5961f1640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe590100a80 0x7fe590198470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe58800b4a0 tx=0x7fe58800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe58f7fe640 1 -- 172.21.15.73:0/3769450265 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588014070 con 0x7fe590100a80 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe598455640 1 -- 172.21.15.73:0/3769450265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59019d710 con 0x7fe590100a80 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe58f7fe640 1 -- 172.21.15.73:0/3769450265 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe588010af0 con 0x7fe590100a80 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe58f7fe640 1 -- 172.21.15.73:0/3769450265 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588017d10 con 0x7fe590100a80 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.225+0000 7fe598455640 1 -- 172.21.15.73:0/3769450265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5901a4ff0 con 0x7fe590100a80 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.226+0000 7fe598455640 1 -- 172.21.15.73:0/3769450265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe590100ee0 con 0x7fe590100a80 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.228+0000 7fe58f7fe640 1 -- 172.21.15.73:0/3769450265 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe588017070 con 0x7fe590100a80 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.228+0000 7fe58f7fe640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe5780a2c10 0x7fe5780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.228+0000 7fe5959f0640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe5780a2c10 0x7fe5780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.228+0000 7fe58f7fe640 1 -- 172.21.15.73:0/3769450265 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe5880ce8b0 con 0x7fe590100a80 2024-09-05T12:56:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.229+0000 7fe5959f0640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe5780a2c10 0x7fe5780a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe584005e10 tx=0x7fe584005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.231+0000 7fe58f7fe640 1 -- 172.21.15.73:0/3769450265 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe58809b7f0 con 0x7fe590100a80 2024-09-05T12:56:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.414+0000 7fe598455640 1 -- 172.21.15.73:0/3769450265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe59010a020 con 0x7fe590100a80 2024-09-05T12:56:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.414+0000 7fe58f7fe640 1 -- 172.21.15.73:0/3769450265 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe58809b0f0 con 0x7fe590100a80 2024-09-05T12:56:36.416 INFO:teuthology.orchestra.run.smithi073.stdout:128849018938 2024-09-05T12:56:36.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 -- 172.21.15.73:0/3769450265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe5780a2c10 msgr2=0x7fe5780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:36.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe5780a2c10 0x7fe5780a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe584005e10 tx=0x7fe584005da0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 -- 172.21.15.73:0/3769450265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe590100a80 msgr2=0x7fe590198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:36.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe590100a80 0x7fe590198470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe58800b4a0 tx=0x7fe58800b960 comp rx=0 tx=0).stop 2024-09-05T12:56:36.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 -- 172.21.15.73:0/3769450265 shutdown_connections 2024-09-05T12:56:36.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe5780a2c10 0x7fe5780a50d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe590106a80 0x7fe59019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe590101420 0x7fe5901989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 --2- 172.21.15.73:0/3769450265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe590100a80 0x7fe590198470 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:36.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 -- 172.21.15.73:0/3769450265 >> 172.21.15.73:0/3769450265 conn(0x7fe5900fc7a0 msgr2=0x7fe59006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:36.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 -- 172.21.15.73:0/3769450265 shutdown_connections 2024-09-05T12:56:36.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.416+0000 7fe598455640 1 -- 172.21.15.73:0/3769450265 wait complete. 2024-09-05T12:56:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.064+0000 7f85b43e0640 1 -- 172.21.15.73:0/3035163934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85ac106f20 msgr2=0x7f85ac10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.064+0000 7f85b43e0640 1 --2- 172.21.15.73:0/3035163934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85ac106f20 0x7f85ac10eaa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009ca0 tx=0x7f85a402a8c0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.064+0000 7f85b43e0640 1 -- 172.21.15.73:0/3035163934 shutdown_connections 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.064+0000 7f85b43e0640 1 --2- 172.21.15.73:0/3035163934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85ac106f20 0x7f85ac10eaa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.064+0000 7f85b43e0640 1 --2- 172.21.15.73:0/3035163934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85ac1027a0 0x7f85ac1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.064+0000 7f85b43e0640 1 --2- 172.21.15.73:0/3035163934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85ac101df0 0x7f85ac1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.064+0000 7f85b43e0640 1 -- 172.21.15.73:0/3035163934 >> 172.21.15.73:0/3035163934 conn(0x7f85ac0fd8f0 msgr2=0x7f85ac0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.064+0000 7f85b43e0640 1 -- 172.21.15.73:0/3035163934 shutdown_connections 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.064+0000 7f85b43e0640 1 -- 172.21.15.73:0/3035163934 wait complete. 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b43e0640 1 Processor -- start 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b43e0640 1 -- start start 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b43e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85ac101df0 0x7f85ac1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b43e0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85ac1027a0 0x7f85ac198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b43e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85ac106f20 0x7f85ac19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b43e0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac111f80 con 0x7f85ac106f20 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b43e0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac111e00 con 0x7f85ac101df0 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b43e0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac112100 con 0x7f85ac1027a0 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b297d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85ac106f20 0x7f85ac19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b297d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85ac106f20 0x7f85ac19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41730/0 (socket says 172.21.15.73:41730) 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b297d640 1 -- 172.21.15.73:0/2143185677 learned_addr learned my addr 172.21.15.73:0/2143185677 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b217c640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85ac101df0 0x7f85ac1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b197b640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85ac1027a0 0x7f85ac198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b297d640 1 -- 172.21.15.73:0/2143185677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85ac1027a0 msgr2=0x7f85ac198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b297d640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85ac1027a0 0x7f85ac198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b297d640 1 -- 172.21.15.73:0/2143185677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85ac101df0 msgr2=0x7f85ac1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.065+0000 7f85b297d640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85ac101df0 0x7f85ac1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.066+0000 7f85b297d640 1 -- 172.21.15.73:0/2143185677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac19d3a0 con 0x7f85ac106f20 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.066+0000 7f85b297d640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85ac106f20 0x7f85ac19ccc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f85a4031a20 tx=0x7f85a4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.066+0000 7f85a37fe640 1 -- 172.21.15.73:0/2143185677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4003c30 con 0x7f85ac106f20 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.066+0000 7f85b43e0640 1 -- 172.21.15.73:0/2143185677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ac19d630 con 0x7f85ac106f20 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.066+0000 7f85a37fe640 1 -- 172.21.15.73:0/2143185677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85a4003dd0 con 0x7f85ac106f20 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.066+0000 7f85a37fe640 1 -- 172.21.15.73:0/2143185677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a402fcf0 con 0x7f85ac106f20 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.066+0000 7f85b43e0640 1 -- 172.21.15.73:0/2143185677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ac1a4f70 con 0x7f85ac106f20 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.067+0000 7f85b43e0640 1 -- 172.21.15.73:0/2143185677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ac1021d0 con 0x7f85ac106f20 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.068+0000 7f85a37fe640 1 -- 172.21.15.73:0/2143185677 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f85a4004b40 con 0x7f85ac106f20 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.069+0000 7f85a37fe640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85980a2c10 0x7f85980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.069+0000 7f85b217c640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85980a2c10 0x7f85980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.069+0000 7f85a37fe640 1 -- 172.21.15.73:0/2143185677 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f85a40f04a0 con 0x7f85ac106f20 2024-09-05T12:56:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.069+0000 7f85b217c640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85980a2c10 0x7f85980a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f85a8005d00 tx=0x7f85a800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:37.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.076+0000 7f85a37fe640 1 -- 172.21.15.73:0/2143185677 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f85a40bd470 con 0x7f85ac106f20 2024-09-05T12:56:37.146 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:37 smithi073 ceph-mon[30883]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-05T12:56:37.146 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:37 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3769450265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-05T12:56:37.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.256+0000 7f85b43e0640 1 -- 172.21.15.73:0/2143185677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f85ac199750 con 0x7f85ac106f20 2024-09-05T12:56:37.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.256+0000 7f85a37fe640 1 -- 172.21.15.73:0/2143185677 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f85ac199750 con 0x7f85ac106f20 2024-09-05T12:56:37.258 INFO:teuthology.orchestra.run.smithi073.stdout:150323855413 2024-09-05T12:56:37.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 -- 172.21.15.73:0/2143185677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85980a2c10 msgr2=0x7f85980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85980a2c10 0x7f85980a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f85a8005d00 tx=0x7f85a800b410 comp rx=0 tx=0).stop 2024-09-05T12:56:37.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 -- 172.21.15.73:0/2143185677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85ac106f20 msgr2=0x7f85ac19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85ac106f20 0x7f85ac19ccc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f85a4031a20 tx=0x7f85a4031a50 comp rx=0 tx=0).stop 2024-09-05T12:56:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 -- 172.21.15.73:0/2143185677 shutdown_connections 2024-09-05T12:56:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f85980a2c10 0x7f85980a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85ac106f20 0x7f85ac19ccc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85ac1027a0 0x7f85ac198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 --2- 172.21.15.73:0/2143185677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85ac101df0 0x7f85ac1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 -- 172.21.15.73:0/2143185677 >> 172.21.15.73:0/2143185677 conn(0x7f85ac0fd8f0 msgr2=0x7f85ac0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 -- 172.21.15.73:0/2143185677 shutdown_connections 2024-09-05T12:56:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.258+0000 7f85b43e0640 1 -- 172.21.15.73:0/2143185677 wait complete. 2024-09-05T12:56:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:37 smithi162 ceph-mon[34220]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-05T12:56:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:37 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3769450265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-05T12:56:37.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:37 smithi169 ceph-mon[34823]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-05T12:56:37.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:37 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3769450265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-05T12:56:37.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.702+0000 7f0edbd9e640 1 -- 172.21.15.73:0/1598152117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ed4102570 msgr2=0x7f0ed41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.702+0000 7f0edbd9e640 1 --2- 172.21.15.73:0/1598152117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ed4102570 0x7f0ed41029b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009900 tx=0x7f0ed002a480 comp rx=0 tx=0).stop 2024-09-05T12:56:37.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 -- 172.21.15.73:0/1598152117 shutdown_connections 2024-09-05T12:56:37.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 --2- 172.21.15.73:0/1598152117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4102ef0 0x7f0ed410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 --2- 172.21.15.73:0/1598152117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ed4102570 0x7f0ed41029b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 --2- 172.21.15.73:0/1598152117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed4100e20 0x7f0ed4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 -- 172.21.15.73:0/1598152117 >> 172.21.15.73:0/1598152117 conn(0x7f0ed40fc7d0 msgr2=0x7f0ed40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:37.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 -- 172.21.15.73:0/1598152117 shutdown_connections 2024-09-05T12:56:37.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 -- 172.21.15.73:0/1598152117 wait complete. 2024-09-05T12:56:37.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 Processor -- start 2024-09-05T12:56:37.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 -- start start 2024-09-05T12:56:37.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed4100e20 0x7f0ed4197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4102570 0x7f0ed4197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ed4102ef0 0x7f0ed4197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed4110f80 con 0x7f0ed4102ef0 2024-09-05T12:56:37.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed4110e00 con 0x7f0ed4100e20 2024-09-05T12:56:37.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.703+0000 7f0edbd9e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed4111100 con 0x7f0ed4102570 2024-09-05T12:56:37.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0eda33b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ed4102ef0 0x7f0ed4197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0eda33b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ed4102ef0 0x7f0ed4197bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41742/0 (socket says 172.21.15.73:41742) 2024-09-05T12:56:37.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0eda33b640 1 -- 172.21.15.73:0/2036629706 learned_addr learned my addr 172.21.15.73:0/2036629706 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:37.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0ed9339640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4102570 0x7f0ed4197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0eda33b640 1 -- 172.21.15.73:0/2036629706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4102570 msgr2=0x7f0ed4197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0eda33b640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4102570 0x7f0ed4197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0eda33b640 1 -- 172.21.15.73:0/2036629706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed4100e20 msgr2=0x7f0ed4197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0ed9b3a640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed4100e20 0x7f0ed4197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0eda33b640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed4100e20 0x7f0ed4197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0eda33b640 1 -- 172.21.15.73:0/2036629706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed41a69b0 con 0x7f0ed4102ef0 2024-09-05T12:56:37.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0ed9339640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4102570 0x7f0ed4197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:37.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0eda33b640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ed4102ef0 0x7f0ed4197bc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00eaa0 tx=0x7f0ecc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:37.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0ec6ffd640 1 -- 172.21.15.73:0/2036629706 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00cdb0 con 0x7f0ed4102ef0 2024-09-05T12:56:37.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0ec6ffd640 1 -- 172.21.15.73:0/2036629706 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ecc005020 con 0x7f0ed4102ef0 2024-09-05T12:56:37.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0edbd9e640 1 -- 172.21.15.73:0/2036629706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed41a6ca0 con 0x7f0ed4102ef0 2024-09-05T12:56:37.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0ec6ffd640 1 -- 172.21.15.73:0/2036629706 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0116d0 con 0x7f0ed4102ef0 2024-09-05T12:56:37.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.704+0000 7f0edbd9e640 1 -- 172.21.15.73:0/2036629706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed41a71e0 con 0x7f0ed4102ef0 2024-09-05T12:56:37.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.705+0000 7f0edbd9e640 1 -- 172.21.15.73:0/2036629706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed4101200 con 0x7f0ed4102ef0 2024-09-05T12:56:37.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.706+0000 7f0ec6ffd640 1 -- 172.21.15.73:0/2036629706 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0ecc0054d0 con 0x7f0ed4102ef0 2024-09-05T12:56:37.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.707+0000 7f0ec6ffd640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ec00a2c10 0x7f0ec00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.707+0000 7f0ed9b3a640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ec00a2c10 0x7f0ec00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.707+0000 7f0ec6ffd640 1 -- 172.21.15.73:0/2036629706 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0ecc0cf7e0 con 0x7f0ed4102ef0 2024-09-05T12:56:37.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.707+0000 7f0ed9b3a640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ec00a2c10 0x7f0ec00a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8005fd0 tx=0x7f0ec8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:37.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.710+0000 7f0ec6ffd640 1 -- 172.21.15.73:0/2036629706 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ecc016030 con 0x7f0ed4102ef0 2024-09-05T12:56:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.884+0000 7f0edbd9e640 1 -- 172.21.15.73:0/2036629706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f0ed406a560 con 0x7f0ed4102ef0 2024-09-05T12:56:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.885+0000 7f0ec6ffd640 1 -- 172.21.15.73:0/2036629706 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0ed406a560 con 0x7f0ed4102ef0 2024-09-05T12:56:37.888 INFO:teuthology.orchestra.run.smithi073.stdout:231928234023 2024-09-05T12:56:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 -- 172.21.15.73:0/2036629706 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ec00a2c10 msgr2=0x7f0ec00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ec00a2c10 0x7f0ec00a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8005fd0 tx=0x7f0ec8005850 comp rx=0 tx=0).stop 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 -- 172.21.15.73:0/2036629706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ed4102ef0 msgr2=0x7f0ed4197bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ed4102ef0 0x7f0ed4197bc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00eaa0 tx=0x7f0ecc00ef60 comp rx=0 tx=0).stop 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 -- 172.21.15.73:0/2036629706 shutdown_connections 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ec00a2c10 0x7f0ec00a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ed4102ef0 0x7f0ed4197bc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4102570 0x7f0ed4197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 --2- 172.21.15.73:0/2036629706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed4100e20 0x7f0ed4197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 -- 172.21.15.73:0/2036629706 >> 172.21.15.73:0/2036629706 conn(0x7f0ed40fc7d0 msgr2=0x7f0ed41068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 -- 172.21.15.73:0/2036629706 shutdown_connections 2024-09-05T12:56:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.887+0000 7f0edbd9e640 1 -- 172.21.15.73:0/2036629706 wait complete. 2024-09-05T12:56:37.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.941+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2736833103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb28101420 msgr2=0x7ffb2810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.941+0000 7ffb2db2e640 1 --2- 172.21.15.73:0/2736833103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb28101420 0x7ffb2810d950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009cd0 tx=0x7ffb2002a8e0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.941+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2736833103 shutdown_connections 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.941+0000 7ffb2db2e640 1 --2- 172.21.15.73:0/2736833103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb28101420 0x7ffb2810d950 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.941+0000 7ffb2db2e640 1 --2- 172.21.15.73:0/2736833103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28100a80 0x7ffb28100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.941+0000 7ffb2db2e640 1 --2- 172.21.15.73:0/2736833103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb28106a80 0x7ffb28106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.941+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2736833103 >> 172.21.15.73:0/2736833103 conn(0x7ffb280fc7a0 msgr2=0x7ffb280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.941+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2736833103 shutdown_connections 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.941+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2736833103 wait complete. 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb2db2e640 1 Processor -- start 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb2db2e640 1 -- start start 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb2db2e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb28100a80 0x7ffb281972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb2db2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28101420 0x7ffb28197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb2db2e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb28106a80 0x7ffb2819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb2db2e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28110e80 con 0x7ffb28100a80 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb2db2e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28110d00 con 0x7ffb28101420 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb2db2e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28111000 con 0x7ffb28106a80 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb277fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb28100a80 0x7ffb281972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb277fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb28100a80 0x7ffb281972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41754/0 (socket says 172.21.15.73:41754) 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb277fe640 1 -- 172.21.15.73:0/2785523176 learned_addr learned my addr 172.21.15.73:0/2785523176 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb1ffff640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28101420 0x7ffb28197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb27fff640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb28106a80 0x7ffb2819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb277fe640 1 -- 172.21.15.73:0/2785523176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb28106a80 msgr2=0x7ffb2819bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb277fe640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb28106a80 0x7ffb2819bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb277fe640 1 -- 172.21.15.73:0/2785523176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28101420 msgr2=0x7ffb28197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb277fe640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28101420 0x7ffb28197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb277fe640 1 -- 172.21.15.73:0/2785523176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2819c290 con 0x7ffb28100a80 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.942+0000 7ffb277fe640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb28100a80 0x7ffb281972e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800d770 tx=0x7ffb1800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.943+0000 7ffb257fa640 1 -- 172.21.15.73:0/2785523176 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18017070 con 0x7ffb28100a80 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.943+0000 7ffb257fa640 1 -- 172.21.15.73:0/2785523176 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb18005500 con 0x7ffb28100a80 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.943+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2785523176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2819c580 con 0x7ffb28100a80 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.943+0000 7ffb257fa640 1 -- 172.21.15.73:0/2785523176 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18004e00 con 0x7ffb28100a80 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.943+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2785523176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb281a3e60 con 0x7ffb28100a80 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.944+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2785523176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb28100ee0 con 0x7ffb28100a80 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.945+0000 7ffb257fa640 1 -- 172.21.15.73:0/2785523176 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffb18004fa0 con 0x7ffb28100a80 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.945+0000 7ffb257fa640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb140a2c90 0x7ffb140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.946+0000 7ffb1ffff640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb140a2c90 0x7ffb140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.946+0000 7ffb257fa640 1 -- 172.21.15.73:0/2785523176 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ffb180cebf0 con 0x7ffb28100a80 2024-09-05T12:56:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.946+0000 7ffb1ffff640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb140a2c90 0x7ffb140a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffb10005e10 tx=0x7ffb10005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:37.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.950+0000 7ffb257fa640 1 -- 172.21.15.73:0/2785523176 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb1809ba20 con 0x7ffb28100a80 2024-09-05T12:56:38.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.129+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2785523176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7ffb281a40f0 con 0x7ffb28100a80 2024-09-05T12:56:38.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.129+0000 7ffb257fa640 1 -- 172.21.15.73:0/2785523176 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ffb1809b320 con 0x7ffb28100a80 2024-09-05T12:56:38.132 INFO:teuthology.orchestra.run.smithi073.stdout:279172874269 2024-09-05T12:56:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2785523176 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb140a2c90 msgr2=0x7ffb140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb140a2c90 0x7ffb140a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffb10005e10 tx=0x7ffb10005da0 comp rx=0 tx=0).stop 2024-09-05T12:56:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2785523176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb28100a80 msgr2=0x7ffb281972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb28100a80 0x7ffb281972e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800d770 tx=0x7ffb1800dc30 comp rx=0 tx=0).stop 2024-09-05T12:56:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2785523176 shutdown_connections 2024-09-05T12:56:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb140a2c90 0x7ffb140a5150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb28106a80 0x7ffb2819bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28101420 0x7ffb28197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 --2- 172.21.15.73:0/2785523176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb28100a80 0x7ffb281972e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2785523176 >> 172.21.15.73:0/2785523176 conn(0x7ffb280fc7a0 msgr2=0x7ffb280fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2785523176 shutdown_connections 2024-09-05T12:56:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:38.131+0000 7ffb2db2e640 1 -- 172.21.15.73:0/2785523176 wait complete. 2024-09-05T12:56:38.143 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:38 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1175309409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-05T12:56:38.143 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:38 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2143185677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-05T12:56:38.143 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:38 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2036629706' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-05T12:56:38.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:38 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1175309409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-05T12:56:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:38 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2143185677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-05T12:56:38.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:38 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2036629706' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-05T12:56:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:38 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1175309409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-05T12:56:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:38 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2143185677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-05T12:56:38.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:38 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2036629706' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-05T12:56:39.256 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:39 smithi073 ceph-mon[30883]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:56:39.256 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:39 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2785523176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-05T12:56:39.284 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234022 got 231928234023 for osd.8 2024-09-05T12:56:39.284 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:39 smithi162 ceph-mon[34220]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:56:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:39 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2785523176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-05T12:56:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:39 smithi169 ceph-mon[34823]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:56:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:39 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2785523176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-05T12:56:39.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.671+0000 7f18ae35c640 1 -- 172.21.15.73:0/2922963829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a8106a80 msgr2=0x7f18a8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:39.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.671+0000 7f18ae35c640 1 --2- 172.21.15.73:0/2922963829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a8106a80 0x7f18a8106e60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1898009930 tx=0x7f189802a420 comp rx=0 tx=0).stop 2024-09-05T12:56:39.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.671+0000 7f18ae35c640 1 -- 172.21.15.73:0/2922963829 shutdown_connections 2024-09-05T12:56:39.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.671+0000 7f18ae35c640 1 --2- 172.21.15.73:0/2922963829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18a8101420 0x7f18a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.671+0000 7f18ae35c640 1 --2- 172.21.15.73:0/2922963829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a8100a80 0x7f18a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.671+0000 7f18ae35c640 1 --2- 172.21.15.73:0/2922963829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a8106a80 0x7f18a8106e60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.671+0000 7f18ae35c640 1 -- 172.21.15.73:0/2922963829 >> 172.21.15.73:0/2922963829 conn(0x7f18a80fc7a0 msgr2=0x7f18a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.671+0000 7f18ae35c640 1 -- 172.21.15.73:0/2922963829 shutdown_connections 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.671+0000 7f18ae35c640 1 -- 172.21.15.73:0/2922963829 wait complete. 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18ae35c640 1 Processor -- start 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18ae35c640 1 -- start start 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18ae35c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a8100a80 0x7f18a8198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18ae35c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18a8101420 0x7f18a8198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18ae35c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a8106a80 0x7f18a819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18ae35c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f18a8112020 con 0x7f18a8100a80 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18ae35c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f18a8111ea0 con 0x7f18a8106a80 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18ae35c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f18a81121a0 con 0x7f18a8101420 2024-09-05T12:56:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18a7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a8100a80 0x7f18a8198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18a7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a8100a80 0x7f18a8198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41762/0 (socket says 172.21.15.73:41762) 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18a7fff640 1 -- 172.21.15.73:0/797976125 learned_addr learned my addr 172.21.15.73:0/797976125 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18a7fff640 1 -- 172.21.15.73:0/797976125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18a8101420 msgr2=0x7f18a8198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18a7fff640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18a8101420 0x7f18a8198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18ac8f9640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a8106a80 0x7f18a819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18a7fff640 1 -- 172.21.15.73:0/797976125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a8106a80 msgr2=0x7f18a819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18a7fff640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a8106a80 0x7f18a819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18a7fff640 1 -- 172.21.15.73:0/797976125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a819d5d0 con 0x7f18a8100a80 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.672+0000 7f18ac8f9640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a8106a80 0x7f18a819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.673+0000 7f18a7fff640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a8100a80 0x7f18a8198620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1898009a50 tx=0x7f1898004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.673+0000 7f18a57fa640 1 -- 172.21.15.73:0/797976125 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189803f030 con 0x7f18a8100a80 2024-09-05T12:56:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.673+0000 7f18ae35c640 1 -- 172.21.15.73:0/797976125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a819d860 con 0x7f18a8100a80 2024-09-05T12:56:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.673+0000 7f18a57fa640 1 -- 172.21.15.73:0/797976125 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1898003ce0 con 0x7f18a8100a80 2024-09-05T12:56:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.673+0000 7f18a57fa640 1 -- 172.21.15.73:0/797976125 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898035070 con 0x7f18a8100a80 2024-09-05T12:56:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.673+0000 7f18ae35c640 1 -- 172.21.15.73:0/797976125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a81a51a0 con 0x7f18a8100a80 2024-09-05T12:56:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.674+0000 7f18ae35c640 1 -- 172.21.15.73:0/797976125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a8100f60 con 0x7f18a8100a80 2024-09-05T12:56:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.675+0000 7f18a57fa640 1 -- 172.21.15.73:0/797976125 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1898042030 con 0x7f18a8100a80 2024-09-05T12:56:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.676+0000 7f18a57fa640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f18900a2c10 0x7f18900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.676+0000 7f18a77fe640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f18900a2c10 0x7f18900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.676+0000 7f18a57fa640 1 -- 172.21.15.73:0/797976125 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f18980efc40 con 0x7f18a8100a80 2024-09-05T12:56:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.676+0000 7f18a77fe640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f18900a2c10 0x7f18900a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18a80fee10 tx=0x7f189c006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.679+0000 7f18a57fa640 1 -- 172.21.15.73:0/797976125 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18980bca70 con 0x7f18a8100a80 2024-09-05T12:56:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.850+0000 7f18ae35c640 1 -- 172.21.15.73:0/797976125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f18a8108ff0 con 0x7f18a8100a80 2024-09-05T12:56:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.850+0000 7f18a57fa640 1 -- 172.21.15.73:0/797976125 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f18980bc370 con 0x7f18a8100a80 2024-09-05T12:56:39.852 INFO:teuthology.orchestra.run.smithi073.stdout:309237645336 2024-09-05T12:56:39.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 -- 172.21.15.73:0/797976125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f18900a2c10 msgr2=0x7f18900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:39.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f18900a2c10 0x7f18900a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18a80fee10 tx=0x7f189c006c90 comp rx=0 tx=0).stop 2024-09-05T12:56:39.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 -- 172.21.15.73:0/797976125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a8100a80 msgr2=0x7f18a8198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:39.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a8100a80 0x7f18a8198620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1898009a50 tx=0x7f1898004270 comp rx=0 tx=0).stop 2024-09-05T12:56:39.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 -- 172.21.15.73:0/797976125 shutdown_connections 2024-09-05T12:56:39.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f18900a2c10 0x7f18900a50d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a8106a80 0x7f18a819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18a8101420 0x7f18a8198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 --2- 172.21.15.73:0/797976125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a8100a80 0x7f18a8198620 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 -- 172.21.15.73:0/797976125 >> 172.21.15.73:0/797976125 conn(0x7f18a80fc7a0 msgr2=0x7f18a80fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:39.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 -- 172.21.15.73:0/797976125 shutdown_connections 2024-09-05T12:56:39.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.853+0000 7f18ae35c640 1 -- 172.21.15.73:0/797976125 wait complete. 2024-09-05T12:56:39.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.876+0000 7f1c1502d640 1 -- 172.21.15.73:0/4245487943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c10106a90 msgr2=0x7f1c10106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:39.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.876+0000 7f1c1502d640 1 --2- 172.21.15.73:0/4245487943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c10106a90 0x7f1c10106e70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009930 tx=0x7f1c0002a420 comp rx=0 tx=0).stop 2024-09-05T12:56:39.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.876+0000 7f1c1502d640 1 -- 172.21.15.73:0/4245487943 shutdown_connections 2024-09-05T12:56:39.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.876+0000 7f1c1502d640 1 --2- 172.21.15.73:0/4245487943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c10101430 0x7f1c1010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.876+0000 7f1c1502d640 1 --2- 172.21.15.73:0/4245487943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10100a90 0x7f1c10100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.876+0000 7f1c1502d640 1 --2- 172.21.15.73:0/4245487943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c10106a90 0x7f1c10106e70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.876+0000 7f1c1502d640 1 -- 172.21.15.73:0/4245487943 >> 172.21.15.73:0/4245487943 conn(0x7f1c100fc7d0 msgr2=0x7f1c100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.876+0000 7f1c1502d640 1 -- 172.21.15.73:0/4245487943 shutdown_connections 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.876+0000 7f1c1502d640 1 -- 172.21.15.73:0/4245487943 wait complete. 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.877+0000 7f1c1502d640 1 Processor -- start 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.877+0000 7f1c1502d640 1 -- start start 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.877+0000 7f1c1502d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c10100a90 0x7f1c10198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.877+0000 7f1c1502d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c10101430 0x7f1c10198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.877+0000 7f1c1502d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10106a90 0x7f1c1019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.877+0000 7f1c1502d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10110e90 con 0x7f1c10100a90 2024-09-05T12:56:39.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.877+0000 7f1c1502d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10110d10 con 0x7f1c10106a90 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.877+0000 7f1c1502d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10111010 con 0x7f1c10101430 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c10100a90 0x7f1c10198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c10100a90 0x7f1c10198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41778/0 (socket says 172.21.15.73:41778) 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0ed9d640 1 -- 172.21.15.73:0/3723705126 learned_addr learned my addr 172.21.15.73:0/3723705126 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0e59c640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c10101430 0x7f1c10198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0f59e640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10106a90 0x7f1c1019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0ed9d640 1 -- 172.21.15.73:0/3723705126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c10101430 msgr2=0x7f1c10198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0ed9d640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c10101430 0x7f1c10198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0ed9d640 1 -- 172.21.15.73:0/3723705126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10106a90 msgr2=0x7f1c1019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0ed9d640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10106a90 0x7f1c1019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0ed9d640 1 -- 172.21.15.73:0/3723705126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1019d3b0 con 0x7f1c10100a90 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c0ed9d640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c10100a90 0x7f1c10198400 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009230 tx=0x7f1c00004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1bf7fff640 1 -- 172.21.15.73:0/3723705126 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0003f030 con 0x7f1c10100a90 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1bf7fff640 1 -- 172.21.15.73:0/3723705126 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c00004440 con 0x7f1c10100a90 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c1502d640 1 -- 172.21.15.73:0/3723705126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1019d640 con 0x7f1c10100a90 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1bf7fff640 1 -- 172.21.15.73:0/3723705126 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00035070 con 0x7f1c10100a90 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.878+0000 7f1c1502d640 1 -- 172.21.15.73:0/3723705126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c101a4f80 con 0x7f1c10100a90 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.879+0000 7f1c1502d640 1 -- 172.21.15.73:0/3723705126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c101021d0 con 0x7f1c10100a90 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.881+0000 7f1bf7fff640 1 -- 172.21.15.73:0/3723705126 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1c00042030 con 0x7f1c10100a90 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.882+0000 7f1bf7fff640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1bf80a2c10 0x7f1bf80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.882+0000 7f1bf7fff640 1 -- 172.21.15.73:0/3723705126 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f1c000ef890 con 0x7f1c10100a90 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.882+0000 7f1c0e59c640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1bf80a2c10 0x7f1bf80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.882+0000 7f1c0e59c640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1bf80a2c10 0x7f1bf80a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1c100fed80 tx=0x7f1c04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:39.885+0000 7f1bf7fff640 1 -- 172.21.15.73:0/3723705126 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c000bc070 con 0x7f1c10100a90 2024-09-05T12:56:40.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.056+0000 7f1c1502d640 1 -- 172.21.15.73:0/3723705126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1c101a5150 con 0x7f1c10100a90 2024-09-05T12:56:40.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.057+0000 7f1bf7fff640 1 -- 172.21.15.73:0/3723705126 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1c000c0370 con 0x7f1c10100a90 2024-09-05T12:56:40.058 INFO:teuthology.orchestra.run.smithi073.stdout:73014444100 2024-09-05T12:56:40.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 -- 172.21.15.73:0/3723705126 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1bf80a2c10 msgr2=0x7f1bf80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:40.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1bf80a2c10 0x7f1bf80a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1c100fed80 tx=0x7f1c04005f90 comp rx=0 tx=0).stop 2024-09-05T12:56:40.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 -- 172.21.15.73:0/3723705126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c10100a90 msgr2=0x7f1c10198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:40.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c10100a90 0x7f1c10198400 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009230 tx=0x7f1c00004040 comp rx=0 tx=0).stop 2024-09-05T12:56:40.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 -- 172.21.15.73:0/3723705126 shutdown_connections 2024-09-05T12:56:40.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1bf80a2c10 0x7f1bf80a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10106a90 0x7f1c1019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c10101430 0x7f1c10198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 --2- 172.21.15.73:0/3723705126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c10100a90 0x7f1c10198400 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 -- 172.21.15.73:0/3723705126 >> 172.21.15.73:0/3723705126 conn(0x7f1c100fc7d0 msgr2=0x7f1c1006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:40.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 -- 172.21.15.73:0/3723705126 shutdown_connections 2024-09-05T12:56:40.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.059+0000 7f1c1502d640 1 -- 172.21.15.73:0/3723705126 wait complete. 2024-09-05T12:56:40.130 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:40 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/797976125' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-05T12:56:40.131 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:40 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3723705126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-05T12:56:40.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.129+0000 7f548f7aa640 1 -- 172.21.15.73:0/299349866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5488100a80 msgr2=0x7f5488100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:40.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.129+0000 7f548f7aa640 1 --2- 172.21.15.73:0/299349866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5488100a80 0x7f5488100ee0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5478009930 tx=0x7f547802a420 comp rx=0 tx=0).stop 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.129+0000 7f548f7aa640 1 -- 172.21.15.73:0/299349866 shutdown_connections 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.129+0000 7f548f7aa640 1 --2- 172.21.15.73:0/299349866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5488101420 0x7f548810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.129+0000 7f548f7aa640 1 --2- 172.21.15.73:0/299349866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5488100a80 0x7f5488100ee0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.129+0000 7f548f7aa640 1 --2- 172.21.15.73:0/299349866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5488106a80 0x7f5488106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.129+0000 7f548f7aa640 1 -- 172.21.15.73:0/299349866 >> 172.21.15.73:0/299349866 conn(0x7f54880fc7a0 msgr2=0x7f54880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.130+0000 7f548f7aa640 1 -- 172.21.15.73:0/299349866 shutdown_connections 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.130+0000 7f548f7aa640 1 -- 172.21.15.73:0/299349866 wait complete. 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.130+0000 7f548f7aa640 1 Processor -- start 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.130+0000 7f548f7aa640 1 -- start start 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548f7aa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5488100a80 0x7f54881984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548f7aa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5488101420 0x7f54881989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548f7aa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5488106a80 0x7f548819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548f7aa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5488110e80 con 0x7f5488101420 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548f7aa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5488110d00 con 0x7f5488106a80 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548f7aa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5488111000 con 0x7f5488100a80 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548cd45640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5488101420 0x7f54881989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548cd45640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5488101420 0x7f54881989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41802/0 (socket says 172.21.15.73:41802) 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548cd45640 1 -- 172.21.15.73:0/937933623 learned_addr learned my addr 172.21.15.73:0/937933623 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548d546640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5488100a80 0x7f54881984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548dd47640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5488106a80 0x7f548819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548cd45640 1 -- 172.21.15.73:0/937933623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5488100a80 msgr2=0x7f54881984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548cd45640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5488100a80 0x7f54881984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548cd45640 1 -- 172.21.15.73:0/937933623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5488106a80 msgr2=0x7f548819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548cd45640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5488106a80 0x7f548819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548cd45640 1 -- 172.21.15.73:0/937933623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548819d450 con 0x7f5488101420 2024-09-05T12:56:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548cd45640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5488101420 0x7f54881989e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5478009230 tx=0x7f5478004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f547e7fc640 1 -- 172.21.15.73:0/937933623 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547803f030 con 0x7f5488101420 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f548f7aa640 1 -- 172.21.15.73:0/937933623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548819d6e0 con 0x7f5488101420 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f547e7fc640 1 -- 172.21.15.73:0/937933623 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5478003ad0 con 0x7f5488101420 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.131+0000 7f547e7fc640 1 -- 172.21.15.73:0/937933623 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478035070 con 0x7f5488101420 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.132+0000 7f548f7aa640 1 -- 172.21.15.73:0/937933623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54881a5020 con 0x7f5488101420 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.133+0000 7f548f7aa640 1 -- 172.21.15.73:0/937933623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54881021c0 con 0x7f5488101420 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.133+0000 7f547e7fc640 1 -- 172.21.15.73:0/937933623 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5478042030 con 0x7f5488101420 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.134+0000 7f547e7fc640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f54740a2c10 0x7f54740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.134+0000 7f548d546640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f54740a2c10 0x7f54740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.134+0000 7f547e7fc640 1 -- 172.21.15.73:0/937933623 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f54780ef690 con 0x7f5488101420 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.135+0000 7f548d546640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f54740a2c10 0x7f54740a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f548400bb60 tx=0x7f548400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.138+0000 7f547e7fc640 1 -- 172.21.15.73:0/937933623 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54780bc4c0 con 0x7f5488101420 2024-09-05T12:56:40.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.306+0000 7f548f7aa640 1 -- 172.21.15.73:0/937933623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f548810a020 con 0x7f5488101420 2024-09-05T12:56:40.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.307+0000 7f547e7fc640 1 -- 172.21.15.73:0/937933623 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f54780bbdc0 con 0x7f5488101420 2024-09-05T12:56:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:180388626481 2024-09-05T12:56:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.308+0000 7f548f7aa640 1 -- 172.21.15.73:0/937933623 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f54740a2c10 msgr2=0x7f54740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.308+0000 7f548f7aa640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f54740a2c10 0x7f54740a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f548400bb60 tx=0x7f548400b390 comp rx=0 tx=0).stop 2024-09-05T12:56:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.309+0000 7f548f7aa640 1 -- 172.21.15.73:0/937933623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5488101420 msgr2=0x7f54881989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.309+0000 7f548f7aa640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5488101420 0x7f54881989e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5478009230 tx=0x7f5478004270 comp rx=0 tx=0).stop 2024-09-05T12:56:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.309+0000 7f548f7aa640 1 -- 172.21.15.73:0/937933623 shutdown_connections 2024-09-05T12:56:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.309+0000 7f548f7aa640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f54740a2c10 0x7f54740a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.309+0000 7f548f7aa640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5488106a80 0x7f548819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.309+0000 7f548f7aa640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5488101420 0x7f54881989e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.309+0000 7f548f7aa640 1 --2- 172.21.15.73:0/937933623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5488100a80 0x7f54881984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.309+0000 7f548f7aa640 1 -- 172.21.15.73:0/937933623 >> 172.21.15.73:0/937933623 conn(0x7f54880fc7a0 msgr2=0x7f548806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:40.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.309+0000 7f548f7aa640 1 -- 172.21.15.73:0/937933623 shutdown_connections 2024-09-05T12:56:40.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:40.309+0000 7f548f7aa640 1 -- 172.21.15.73:0/937933623 wait complete. 2024-09-05T12:56:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:40 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/797976125' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-05T12:56:40.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:40 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3723705126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-05T12:56:40.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:40 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/797976125' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-05T12:56:40.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:40 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3723705126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-05T12:56:40.791 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444098 got 73014444100 for osd.2 2024-09-05T12:56:40.791 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.957+0000 7f56f56fb640 1 -- 172.21.15.73:0/122843399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f0106a80 msgr2=0x7f56f0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.957+0000 7f56f56fb640 1 --2- 172.21.15.73:0/122843399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f0106a80 0x7f56f0106e60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009930 tx=0x7f56e002a420 comp rx=0 tx=0).stop 2024-09-05T12:56:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.957+0000 7f56f56fb640 1 -- 172.21.15.73:0/122843399 shutdown_connections 2024-09-05T12:56:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.957+0000 7f56f56fb640 1 --2- 172.21.15.73:0/122843399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f0101420 0x7f56f010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.957+0000 7f56f56fb640 1 --2- 172.21.15.73:0/122843399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56f0100a80 0x7f56f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.957+0000 7f56f56fb640 1 --2- 172.21.15.73:0/122843399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f0106a80 0x7f56f0106e60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.957+0000 7f56f56fb640 1 -- 172.21.15.73:0/122843399 >> 172.21.15.73:0/122843399 conn(0x7f56f00fc7a0 msgr2=0x7f56f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.957+0000 7f56f56fb640 1 -- 172.21.15.73:0/122843399 shutdown_connections 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.957+0000 7f56f56fb640 1 -- 172.21.15.73:0/122843399 wait complete. 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.957+0000 7f56f56fb640 1 Processor -- start 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56f56fb640 1 -- start start 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56f56fb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f0100a80 0x7f56f0197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56f56fb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f0101420 0x7f56f0197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56f56fb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56f0106a80 0x7f56f019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56f56fb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f56f0110ea0 con 0x7f56f0101420 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56f56fb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56f0110d20 con 0x7f56f0100a80 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56f56fb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f56f0111020 con 0x7f56f0106a80 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56e67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f0101420 0x7f56f0197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56e67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f0101420 0x7f56f0197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41708/0 (socket says 172.21.15.73:41708) 2024-09-05T12:56:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56e67fc640 1 -- 172.21.15.73:0/1175309409 learned_addr learned my addr 172.21.15.73:0/1175309409 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56eeffd640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f0100a80 0x7f56f0197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56ef7fe640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56f0106a80 0x7f56f019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:98784247871 2024-09-05T12:56:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56e67fc640 1 -- 172.21.15.73:0/1175309409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56f0106a80 msgr2=0x7f56f019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56e67fc640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56f0106a80 0x7f56f019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56e67fc640 1 -- 172.21.15.73:0/1175309409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f0100a80 msgr2=0x7f56f0197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56e67fc640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f0100a80 0x7f56f0197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.958+0000 7f56e67fc640 1 -- 172.21.15.73:0/1175309409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f019c3f0 con 0x7f56f0101420 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.959+0000 7f56e67fc640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f0101420 0x7f56f0197980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f56d800b4a0 tx=0x7f56d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.959+0000 7f56ecff9640 1 -- 172.21.15.73:0/1175309409 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8014070 con 0x7f56f0101420 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.959+0000 7f56f56fb640 1 -- 172.21.15.73:0/1175309409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f019c6e0 con 0x7f56f0101420 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.959+0000 7f56ecff9640 1 -- 172.21.15.73:0/1175309409 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56d8010af0 con 0x7f56f0101420 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.959+0000 7f56ecff9640 1 -- 172.21.15.73:0/1175309409 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8017d10 con 0x7f56f0101420 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.959+0000 7f56f56fb640 1 -- 172.21.15.73:0/1175309409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f01a3fc0 con 0x7f56f0101420 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.960+0000 7f56f56fb640 1 -- 172.21.15.73:0/1175309409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f0100ee0 con 0x7f56f0101420 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.961+0000 7f56ecff9640 1 -- 172.21.15.73:0/1175309409 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f56d8017070 con 0x7f56f0101420 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.961+0000 7f56ecff9640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f56dc0a2c10 0x7f56dc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.962+0000 7f56eeffd640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f56dc0a2c10 0x7f56dc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:41.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.962+0000 7f56ecff9640 1 -- 172.21.15.73:0/1175309409 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f56d80ce4d0 con 0x7f56f0101420 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.962+0000 7f56eeffd640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f56dc0a2c10 0x7f56dc0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009900 tx=0x7f56e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:36.966+0000 7f56ecff9640 1 -- 172.21.15.73:0/1175309409 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56d809b410 con 0x7f56f0101420 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.144+0000 7f56f56fb640 1 -- 172.21.15.73:0/1175309409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f56f0108a60 con 0x7f56f0101420 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.144+0000 7f56ecff9640 1 -- 172.21.15.73:0/1175309409 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56d809ad10 con 0x7f56f0101420 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.146+0000 7f56f56fb640 1 -- 172.21.15.73:0/1175309409 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f56dc0a2c10 msgr2=0x7f56dc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.146+0000 7f56f56fb640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f56dc0a2c10 0x7f56dc0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009900 tx=0x7f56e00058d0 comp rx=0 tx=0).stop 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.147+0000 7f56f56fb640 1 -- 172.21.15.73:0/1175309409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f0101420 msgr2=0x7f56f0197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.147+0000 7f56f56fb640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f0101420 0x7f56f0197980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f56d800b4a0 tx=0x7f56d800b960 comp rx=0 tx=0).stop 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.147+0000 7f56f56fb640 1 -- 172.21.15.73:0/1175309409 shutdown_connections 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.147+0000 7f56f56fb640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f56dc0a2c10 0x7f56dc0a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.147+0000 7f56f56fb640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56f0106a80 0x7f56f019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.147+0000 7f56f56fb640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f0101420 0x7f56f0197980 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.147+0000 7f56f56fb640 1 --2- 172.21.15.73:0/1175309409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f0100a80 0x7f56f0197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.147+0000 7f56f56fb640 1 -- 172.21.15.73:0/1175309409 >> 172.21.15.73:0/1175309409 conn(0x7f56f00fc7a0 msgr2=0x7f56f00fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.147+0000 7f56f56fb640 1 -- 172.21.15.73:0/1175309409 shutdown_connections 2024-09-05T12:56:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:37.147+0000 7f56f56fb640 1 -- 172.21.15.73:0/1175309409 wait complete. 2024-09-05T12:56:41.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:41 smithi162 ceph-mon[34220]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:41 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/937933623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-05T12:56:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:41 smithi169 ceph-mon[34823]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:41 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/937933623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-05T12:56:41.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:41 smithi073 ceph-mon[30883]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:41.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:41 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/937933623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-05T12:56:41.854 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874267 got 279172874269 for osd.10 2024-09-05T12:56:41.854 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:42.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:42 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:56:42.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:42 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:56:42.415 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:42 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:56:42.449 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626478 got 180388626481 for osd.6 2024-09-05T12:56:42.449 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:43.042 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645334 got 309237645336 for osd.11 2024-09-05T12:56:43.043 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:43 smithi073 ceph-mon[30883]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:56:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:43 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:43 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:43 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:43 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:43 smithi162 ceph-mon[34220]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:56:43.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:43 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:43 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:43 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:43 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:43 smithi169 ceph-mon[34823]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:56:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:43 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:43 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:43 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:43 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:43.469 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855412 got 150323855413 for osd.5 2024-09-05T12:56:43.470 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:43.899 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247868 got 98784247871 for osd.3 2024-09-05T12:56:43.899 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:44.306 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:44.341 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018936 got 128849018938 for osd.4 2024-09-05T12:56:44.341 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:45.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.229+0000 7f3a6d119640 1 -- 172.21.15.73:0/3607977310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a681036c0 msgr2=0x7f3a6810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:45.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.229+0000 7f3a6d119640 1 --2- 172.21.15.73:0/3607977310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a681036c0 0x7f3a6810bbb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009900 tx=0x7f3a5c02a480 comp rx=0 tx=0).stop 2024-09-05T12:56:45.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.229+0000 7f3a6d119640 1 -- 172.21.15.73:0/3607977310 shutdown_connections 2024-09-05T12:56:45.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.229+0000 7f3a6d119640 1 --2- 172.21.15.73:0/3607977310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a6810c180 0x7f3a6810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.229+0000 7f3a6d119640 1 --2- 172.21.15.73:0/3607977310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a681036c0 0x7f3a6810bbb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.229+0000 7f3a6d119640 1 --2- 172.21.15.73:0/3607977310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a68102da0 0x7f3a68103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.229+0000 7f3a6d119640 1 -- 172.21.15.73:0/3607977310 >> 172.21.15.73:0/3607977310 conn(0x7f3a680fc7a0 msgr2=0x7f3a680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.229+0000 7f3a6d119640 1 -- 172.21.15.73:0/3607977310 shutdown_connections 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.229+0000 7f3a6d119640 1 -- 172.21.15.73:0/3607977310 wait complete. 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6d119640 1 Processor -- start 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6d119640 1 -- start start 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6d119640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a68102da0 0x7f3a681985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6d119640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a681036c0 0x7f3a68198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6d119640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a6810c180 0x7f3a6819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6d119640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68112020 con 0x7f3a6810c180 2024-09-05T12:56:45.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6d119640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68111ea0 con 0x7f3a681036c0 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6d119640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681121a0 con 0x7f3a68102da0 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a6810c180 0x7f3a6819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a6810c180 0x7f3a6819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55108/0 (socket says 172.21.15.73:55108) 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6759e640 1 -- 172.21.15.73:0/1928196035 learned_addr learned my addr 172.21.15.73:0/1928196035 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.230+0000 7f3a6659c640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a681036c0 0x7f3a68198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a66d9d640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a68102da0 0x7f3a681985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a6759e640 1 -- 172.21.15.73:0/1928196035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a68102da0 msgr2=0x7f3a681985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a6759e640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a68102da0 0x7f3a681985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a6759e640 1 -- 172.21.15.73:0/1928196035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a681036c0 msgr2=0x7f3a68198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a6759e640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a681036c0 0x7f3a68198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a6759e640 1 -- 172.21.15.73:0/1928196035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6819d550 con 0x7f3a6810c180 2024-09-05T12:56:45.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a6759e640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a6810c180 0x7f3a6819ce70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000b970 tx=0x7f3a6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:45.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a4ffff640 1 -- 172.21.15.73:0/1928196035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60019070 con 0x7f3a6810c180 2024-09-05T12:56:45.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a6d119640 1 -- 172.21.15.73:0/1928196035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6819d840 con 0x7f3a6810c180 2024-09-05T12:56:45.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a4ffff640 1 -- 172.21.15.73:0/1928196035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a6000cb40 con 0x7f3a6810c180 2024-09-05T12:56:45.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a4ffff640 1 -- 172.21.15.73:0/1928196035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60007650 con 0x7f3a6810c180 2024-09-05T12:56:45.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.231+0000 7f3a6d119640 1 -- 172.21.15.73:0/1928196035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a681a5120 con 0x7f3a6810c180 2024-09-05T12:56:45.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.232+0000 7f3a6d119640 1 -- 172.21.15.73:0/1928196035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6806b010 con 0x7f3a6810c180 2024-09-05T12:56:45.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.233+0000 7f3a4ffff640 1 -- 172.21.15.73:0/1928196035 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3a6001c070 con 0x7f3a6810c180 2024-09-05T12:56:45.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.234+0000 7f3a4ffff640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3a500a2c10 0x7f3a500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:45.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.234+0000 7f3a66d9d640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3a500a2c10 0x7f3a500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:45.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.234+0000 7f3a4ffff640 1 -- 172.21.15.73:0/1928196035 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3a600ceb90 con 0x7f3a6810c180 2024-09-05T12:56:45.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.235+0000 7f3a66d9d640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3a500a2c10 0x7f3a500a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009890 tx=0x7f3a58008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:45.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.238+0000 7f3a4ffff640 1 -- 172.21.15.73:0/1928196035 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a6009b420 con 0x7f3a6810c180 2024-09-05T12:56:45.360 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:45 smithi073 ceph-mon[30883]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:45.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:45 smithi162 ceph-mon[34220]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:45.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:45 smithi169 ceph-mon[34823]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:45.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.409+0000 7f3a6d119640 1 -- 172.21.15.73:0/1928196035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3a68103200 con 0x7f3a6810c180 2024-09-05T12:56:45.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.410+0000 7f3a4ffff640 1 -- 172.21.15.73:0/1928196035 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3a68103200 con 0x7f3a6810c180 2024-09-05T12:56:45.411 INFO:teuthology.orchestra.run.smithi073.stdout:201863462956 2024-09-05T12:56:45.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 -- 172.21.15.73:0/1928196035 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3a500a2c10 msgr2=0x7f3a500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:45.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3a500a2c10 0x7f3a500a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009890 tx=0x7f3a58008040 comp rx=0 tx=0).stop 2024-09-05T12:56:45.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 -- 172.21.15.73:0/1928196035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a6810c180 msgr2=0x7f3a6819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:45.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a6810c180 0x7f3a6819ce70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000b970 tx=0x7f3a6000be30 comp rx=0 tx=0).stop 2024-09-05T12:56:45.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 -- 172.21.15.73:0/1928196035 shutdown_connections 2024-09-05T12:56:45.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3a500a2c10 0x7f3a500a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a6810c180 0x7f3a6819ce70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a681036c0 0x7f3a68198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 --2- 172.21.15.73:0/1928196035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a68102da0 0x7f3a681985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 -- 172.21.15.73:0/1928196035 >> 172.21.15.73:0/1928196035 conn(0x7f3a680fc7a0 msgr2=0x7f3a680fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:45.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 -- 172.21.15.73:0/1928196035 shutdown_connections 2024-09-05T12:56:45.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.413+0000 7f3a6d119640 1 -- 172.21.15.73:0/1928196035 wait complete. 2024-09-05T12:56:45.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.447+0000 7fec92fba640 1 -- 172.21.15.73:0/576090538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c100a90 msgr2=0x7fec8c100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:45.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.447+0000 7fec92fba640 1 --2- 172.21.15.73:0/576090538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c100a90 0x7fec8c100ef0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fec78009930 tx=0x7fec7802a420 comp rx=0 tx=0).stop 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.447+0000 7fec92fba640 1 -- 172.21.15.73:0/576090538 shutdown_connections 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 --2- 172.21.15.73:0/576090538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8c101430 0x7fec8c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 --2- 172.21.15.73:0/576090538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c100a90 0x7fec8c100ef0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 --2- 172.21.15.73:0/576090538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8c106a90 0x7fec8c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 -- 172.21.15.73:0/576090538 >> 172.21.15.73:0/576090538 conn(0x7fec8c0fc7d0 msgr2=0x7fec8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 -- 172.21.15.73:0/576090538 shutdown_connections 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 -- 172.21.15.73:0/576090538 wait complete. 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 Processor -- start 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 -- start start 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8c100a90 0x7fec8c107a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c101430 0x7fec8c107f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8c106a90 0x7fec8c108480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c110e90 con 0x7fec8c101430 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c110d10 con 0x7fec8c100a90 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec92fba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c111010 con 0x7fec8c106a90 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec8bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c101430 0x7fec8c107f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec8bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c101430 0x7fec8c107f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55134/0 (socket says 172.21.15.73:55134) 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.448+0000 7fec8bfff640 1 -- 172.21.15.73:0/97427258 learned_addr learned my addr 172.21.15.73:0/97427258 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec90d56640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8c100a90 0x7fec8c107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec91557640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8c106a90 0x7fec8c108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec8bfff640 1 -- 172.21.15.73:0/97427258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8c106a90 msgr2=0x7fec8c108480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec8bfff640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8c106a90 0x7fec8c108480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec8bfff640 1 -- 172.21.15.73:0/97427258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8c100a90 msgr2=0x7fec8c107a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec8bfff640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8c100a90 0x7fec8c107a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec8bfff640 1 -- 172.21.15.73:0/97427258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8c1a68e0 con 0x7fec8c101430 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec91557640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8c106a90 0x7fec8c108480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec8bfff640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c101430 0x7fec8c107f40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fec78009230 tx=0x7fec78004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec89ffb640 1 -- 172.21.15.73:0/97427258 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7803f030 con 0x7fec8c101430 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec92fba640 1 -- 172.21.15.73:0/97427258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8c1a6b70 con 0x7fec8c101430 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec89ffb640 1 -- 172.21.15.73:0/97427258 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec78003ad0 con 0x7fec8c101430 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec89ffb640 1 -- 172.21.15.73:0/97427258 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78035070 con 0x7fec8c101430 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.449+0000 7fec92fba640 1 -- 172.21.15.73:0/97427258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec8c1a70a0 con 0x7fec8c101430 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.450+0000 7fec92fba640 1 -- 172.21.15.73:0/97427258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec8c106e70 con 0x7fec8c101430 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.452+0000 7fec89ffb640 1 -- 172.21.15.73:0/97427258 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fec78042030 con 0x7fec8c101430 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.452+0000 7fec89ffb640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fec7c0a2c90 0x7fec7c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.452+0000 7fec90d56640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fec7c0a2c90 0x7fec7c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.452+0000 7fec89ffb640 1 -- 172.21.15.73:0/97427258 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fec780ef9d0 con 0x7fec8c101430 2024-09-05T12:56:45.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.453+0000 7fec90d56640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fec7c0a2c90 0x7fec7c0a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fec80005fd0 tx=0x7fec8000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:45.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.455+0000 7fec89ffb640 1 -- 172.21.15.73:0/97427258 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec780bc800 con 0x7fec8c101430 2024-09-05T12:56:45.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.625+0000 7fec92fba640 1 -- 172.21.15.73:0/97427258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fec8c1a7270 con 0x7fec8c101430 2024-09-05T12:56:45.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.626+0000 7fec89ffb640 1 -- 172.21.15.73:0/97427258 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fec780bc100 con 0x7fec8c101430 2024-09-05T12:56:45.627 INFO:teuthology.orchestra.run.smithi073.stdout:34359738447 2024-09-05T12:56:45.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 -- 172.21.15.73:0/97427258 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fec7c0a2c90 msgr2=0x7fec7c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:45.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fec7c0a2c90 0x7fec7c0a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fec80005fd0 tx=0x7fec8000b390 comp rx=0 tx=0).stop 2024-09-05T12:56:45.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 -- 172.21.15.73:0/97427258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c101430 msgr2=0x7fec8c107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:45.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c101430 0x7fec8c107f40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fec78009230 tx=0x7fec78004270 comp rx=0 tx=0).stop 2024-09-05T12:56:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 -- 172.21.15.73:0/97427258 shutdown_connections 2024-09-05T12:56:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fec7c0a2c90 0x7fec7c0a5150 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8c106a90 0x7fec8c108480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c101430 0x7fec8c107f40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 --2- 172.21.15.73:0/97427258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8c100a90 0x7fec8c107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 -- 172.21.15.73:0/97427258 >> 172.21.15.73:0/97427258 conn(0x7fec8c0fc7d0 msgr2=0x7fec8c0fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 -- 172.21.15.73:0/97427258 shutdown_connections 2024-09-05T12:56:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:45.628+0000 7fec92fba640 1 -- 172.21.15.73:0/97427258 wait complete. 2024-09-05T12:56:46.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:46 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1928196035' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-05T12:56:46.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:46 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/97427258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-05T12:56:46.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:46 smithi073 ceph-mon[30883]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:56:46.314 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462954 got 201863462956 for osd.7 2024-09-05T12:56:46.314 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:46.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:46 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1928196035' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-05T12:56:46.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:46 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/97427258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-05T12:56:46.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:46 smithi169 ceph-mon[34823]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:56:46.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.585+0000 7fc3018c9640 1 -- 172.21.15.73:0/2813205146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2fc101de0 msgr2=0x7fc2fc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:46.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.585+0000 7fc3018c9640 1 --2- 172.21.15.73:0/2813205146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2fc101de0 0x7fc2fc1021c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009900 tx=0x7fc2ec02a410 comp rx=0 tx=0).stop 2024-09-05T12:56:46.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.585+0000 7fc3018c9640 1 -- 172.21.15.73:0/2813205146 shutdown_connections 2024-09-05T12:56:46.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.585+0000 7fc3018c9640 1 --2- 172.21.15.73:0/2813205146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2fc106f10 0x7fc2fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:46.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.585+0000 7fc3018c9640 1 --2- 172.21.15.73:0/2813205146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2fc102790 0x7fc2fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:46.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.585+0000 7fc3018c9640 1 --2- 172.21.15.73:0/2813205146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2fc101de0 0x7fc2fc1021c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:46.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.585+0000 7fc3018c9640 1 -- 172.21.15.73:0/2813205146 >> 172.21.15.73:0/2813205146 conn(0x7fc2fc0fd8c0 msgr2=0x7fc2fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:46.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.585+0000 7fc3018c9640 1 -- 172.21.15.73:0/2813205146 shutdown_connections 2024-09-05T12:56:46.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.585+0000 7fc3018c9640 1 -- 172.21.15.73:0/2813205146 wait complete. 2024-09-05T12:56:46.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc3018c9640 1 Processor -- start 2024-09-05T12:56:46.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc3018c9640 1 -- start start 2024-09-05T12:56:46.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc3018c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2fc101de0 0x7fc2fc1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:46.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc3018c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2fc102790 0x7fc2fc1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc3018c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2fc106f10 0x7fc2fc19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc3018c9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc111f90 con 0x7fc2fc106f10 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc3018c9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc111e10 con 0x7fc2fc102790 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc3018c9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc112110 con 0x7fc2fc101de0 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc2fb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2fc106f10 0x7fc2fc19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc2fb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2fc106f10 0x7fc2fc19cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55154/0 (socket says 172.21.15.73:55154) 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc2fb7fe640 1 -- 172.21.15.73:0/1547300981 learned_addr learned my addr 172.21.15.73:0/1547300981 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc2faffd640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2fc101de0 0x7fc2fc1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.586+0000 7fc2fa7fc640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2fc102790 0x7fc2fc1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc2fb7fe640 1 -- 172.21.15.73:0/1547300981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2fc101de0 msgr2=0x7fc2fc1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc2fb7fe640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2fc101de0 0x7fc2fc1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:46.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc2fb7fe640 1 -- 172.21.15.73:0/1547300981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2fc102790 msgr2=0x7fc2fc1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc2fb7fe640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2fc102790 0x7fc2fc1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc2fb7fe640 1 -- 172.21.15.73:0/1547300981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc19d460 con 0x7fc2fc106f10 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc2fa7fc640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2fc102790 0x7fc2fc1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc2fb7fe640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2fc106f10 0x7fc2fc19cd80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400b970 tx=0x7fc2f400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc3008c7640 1 -- 172.21.15.73:0/1547300981 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4019070 con 0x7fc2fc106f10 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc3008c7640 1 -- 172.21.15.73:0/1547300981 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2f400cb40 con 0x7fc2fc106f10 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc3008c7640 1 -- 172.21.15.73:0/1547300981 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4007650 con 0x7fc2fc106f10 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc3018c9640 1 -- 172.21.15.73:0/1547300981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2fc19d750 con 0x7fc2fc106f10 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.587+0000 7fc3018c9640 1 -- 172.21.15.73:0/1547300981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2fc1a5030 con 0x7fc2fc106f10 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.588+0000 7fc3018c9640 1 -- 172.21.15.73:0/1547300981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2fc1021c0 con 0x7fc2fc106f10 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.589+0000 7fc3008c7640 1 -- 172.21.15.73:0/1547300981 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc2f401c070 con 0x7fc2fc106f10 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.590+0000 7fc3008c7640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc2e40a2c90 0x7fc2e40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:46.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.590+0000 7fc2faffd640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc2e40a2c90 0x7fc2e40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:46.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.590+0000 7fc3008c7640 1 -- 172.21.15.73:0/1547300981 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc2f40ce5c0 con 0x7fc2fc106f10 2024-09-05T12:56:46.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.590+0000 7fc2faffd640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc2e40a2c90 0x7fc2e40a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009230 tx=0x7fc2ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:46.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.594+0000 7fc3008c7640 1 -- 172.21.15.73:0/1547300981 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2f409aeb0 con 0x7fc2fc106f10 2024-09-05T12:56:46.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:46 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1928196035' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-05T12:56:46.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:46 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/97427258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-05T12:56:46.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:46 smithi162 ceph-mon[34220]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:56:46.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.776+0000 7fc3018c9640 1 -- 172.21.15.73:0/1547300981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc2fc109b60 con 0x7fc2fc106f10 2024-09-05T12:56:46.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.777+0000 7fc3008c7640 1 -- 172.21.15.73:0/1547300981 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc2f409f1b0 con 0x7fc2fc106f10 2024-09-05T12:56:46.778 INFO:teuthology.orchestra.run.smithi073.stdout:51539607627 2024-09-05T12:56:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 -- 172.21.15.73:0/1547300981 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc2e40a2c90 msgr2=0x7fc2e40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc2e40a2c90 0x7fc2e40a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009230 tx=0x7fc2ec0058d0 comp rx=0 tx=0).stop 2024-09-05T12:56:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 -- 172.21.15.73:0/1547300981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2fc106f10 msgr2=0x7fc2fc19cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2fc106f10 0x7fc2fc19cd80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400b970 tx=0x7fc2f400be30 comp rx=0 tx=0).stop 2024-09-05T12:56:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 -- 172.21.15.73:0/1547300981 shutdown_connections 2024-09-05T12:56:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc2e40a2c90 0x7fc2e40a5150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2fc106f10 0x7fc2fc19cd80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2fc102790 0x7fc2fc1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 --2- 172.21.15.73:0/1547300981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2fc101de0 0x7fc2fc1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:46.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 -- 172.21.15.73:0/1547300981 >> 172.21.15.73:0/1547300981 conn(0x7fc2fc0fd8c0 msgr2=0x7fc2fc0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:46.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 -- 172.21.15.73:0/1547300981 shutdown_connections 2024-09-05T12:56:46.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:46.779+0000 7fc3018c9640 1 -- 172.21.15.73:0/1547300981 wait complete. 2024-09-05T12:56:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:47 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1547300981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-05T12:56:47.478 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:47 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1547300981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-05T12:56:47.514 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607623 got 51539607627 for osd.1 2024-09-05T12:56:47.515 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:47.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:47 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1547300981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-05T12:56:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.694+0000 7f26bb734640 1 -- 172.21.15.73:0/2485947553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26b4106f10 msgr2=0x7f26b410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.694+0000 7f26bb734640 1 --2- 172.21.15.73:0/2485947553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26b4106f10 0x7f26b410ea90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009ca0 tx=0x7f26ac02a8c0 comp rx=0 tx=0).stop 2024-09-05T12:56:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.694+0000 7f26bb734640 1 -- 172.21.15.73:0/2485947553 shutdown_connections 2024-09-05T12:56:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.694+0000 7f26bb734640 1 --2- 172.21.15.73:0/2485947553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26b4106f10 0x7f26b410ea90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.694+0000 7f26bb734640 1 --2- 172.21.15.73:0/2485947553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b4102790 0x7f26b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.694+0000 7f26bb734640 1 --2- 172.21.15.73:0/2485947553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26b4101de0 0x7f26b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.694+0000 7f26bb734640 1 -- 172.21.15.73:0/2485947553 >> 172.21.15.73:0/2485947553 conn(0x7f26b40fd8c0 msgr2=0x7f26b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.694+0000 7f26bb734640 1 -- 172.21.15.73:0/2485947553 shutdown_connections 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.694+0000 7f26bb734640 1 -- 172.21.15.73:0/2485947553 wait complete. 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26bb734640 1 Processor -- start 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26bb734640 1 -- start start 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26bb734640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26b4101de0 0x7f26b4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26bb734640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b4102790 0x7f26b4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26bb734640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26b4106f10 0x7f26b419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26bb734640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4112010 con 0x7f26b4106f10 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26bb734640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4111e90 con 0x7f26b4102790 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26bb734640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4112190 con 0x7f26b4101de0 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26b9cd1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26b4106f10 0x7f26b419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:47.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26b9cd1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26b4106f10 0x7f26b419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55166/0 (socket says 172.21.15.73:55166) 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26b9cd1640 1 -- 172.21.15.73:0/356578780 learned_addr learned my addr 172.21.15.73:0/356578780 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26b94d0640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26b4101de0 0x7f26b4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26b8ccf640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b4102790 0x7f26b4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26b9cd1640 1 -- 172.21.15.73:0/356578780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26b4101de0 msgr2=0x7f26b4198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26b9cd1640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26b4101de0 0x7f26b4198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.695+0000 7f26b9cd1640 1 -- 172.21.15.73:0/356578780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b4102790 msgr2=0x7f26b4198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.696+0000 7f26b9cd1640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b4102790 0x7f26b4198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.696+0000 7f26b9cd1640 1 -- 172.21.15.73:0/356578780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b419d520 con 0x7f26b4106f10 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.696+0000 7f26b8ccf640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b4102790 0x7f26b4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.696+0000 7f26b9cd1640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26b4106f10 0x7f26b419ce40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f26ac031a60 tx=0x7f26ac031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.696+0000 7f26aa7fc640 1 -- 172.21.15.73:0/356578780 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac003c30 con 0x7f26b4106f10 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.696+0000 7f26bb734640 1 -- 172.21.15.73:0/356578780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b419d7b0 con 0x7f26b4106f10 2024-09-05T12:56:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.696+0000 7f26aa7fc640 1 -- 172.21.15.73:0/356578780 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26ac003dd0 con 0x7f26b4106f10 2024-09-05T12:56:47.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.696+0000 7f26aa7fc640 1 -- 172.21.15.73:0/356578780 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0047e0 con 0x7f26b4106f10 2024-09-05T12:56:47.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.696+0000 7f26bb734640 1 -- 172.21.15.73:0/356578780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b41a50f0 con 0x7f26b4106f10 2024-09-05T12:56:47.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.697+0000 7f26bb734640 1 -- 172.21.15.73:0/356578780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b4102240 con 0x7f26b4106f10 2024-09-05T12:56:47.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.698+0000 7f26aa7fc640 1 -- 172.21.15.73:0/356578780 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f26ac02f790 con 0x7f26b4106f10 2024-09-05T12:56:47.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.699+0000 7f26aa7fc640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26a00a2c10 0x7f26a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:47.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.699+0000 7f26b94d0640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26a00a2c10 0x7f26a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:47.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.699+0000 7f26aa7fc640 1 -- 172.21.15.73:0/356578780 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f26ac0f06f0 con 0x7f26b4106f10 2024-09-05T12:56:47.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.699+0000 7f26b94d0640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26a00a2c10 0x7f26a00a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f26b000a810 tx=0x7f26b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:47.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.702+0000 7f26aa7fc640 1 -- 172.21.15.73:0/356578780 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26ac0bd630 con 0x7f26b4106f10 2024-09-05T12:56:47.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.875+0000 7f26bb734640 1 -- 172.21.15.73:0/356578780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f26b41998d0 con 0x7f26b4106f10 2024-09-05T12:56:47.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.875+0000 7f26aa7fc640 1 -- 172.21.15.73:0/356578780 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f26b41998d0 con 0x7f26b4106f10 2024-09-05T12:56:47.877 INFO:teuthology.orchestra.run.smithi073.stdout:261993005091 2024-09-05T12:56:47.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 -- 172.21.15.73:0/356578780 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26a00a2c10 msgr2=0x7f26a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:47.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26a00a2c10 0x7f26a00a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f26b000a810 tx=0x7f26b0008040 comp rx=0 tx=0).stop 2024-09-05T12:56:47.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 -- 172.21.15.73:0/356578780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26b4106f10 msgr2=0x7f26b419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:47.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26b4106f10 0x7f26b419ce40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f26ac031a60 tx=0x7f26ac031a90 comp rx=0 tx=0).stop 2024-09-05T12:56:47.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 -- 172.21.15.73:0/356578780 shutdown_connections 2024-09-05T12:56:47.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f26a00a2c10 0x7f26a00a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:47.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26b4106f10 0x7f26b419ce40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:47.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26b4102790 0x7f26b4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:47.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 --2- 172.21.15.73:0/356578780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26b4101de0 0x7f26b4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:47.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 -- 172.21.15.73:0/356578780 >> 172.21.15.73:0/356578780 conn(0x7f26b40fd8c0 msgr2=0x7f26b40fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:47.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 -- 172.21.15.73:0/356578780 shutdown_connections 2024-09-05T12:56:47.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:47.877+0000 7f26bb734640 1 -- 172.21.15.73:0/356578780 wait complete. 2024-09-05T12:56:48.130 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:48 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/356578780' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-05T12:56:48.130 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:48 smithi073 ceph-mon[30883]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:56:48.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:48 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/356578780' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-05T12:56:48.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:48 smithi162 ceph-mon[34220]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:56:48.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:48 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/356578780' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-05T12:56:48.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:48 smithi169 ceph-mon[34823]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:56:48.770 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005086 got 261993005091 for osd.9 2024-09-05T12:56:48.770 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:49.302 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738443 got 34359738447 for osd.0 2024-09-05T12:56:49.302 DEBUG:teuthology.parallel:result is None 2024-09-05T12:56:49.302 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-05T12:56:49.303 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T12:56:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:50.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.071+0000 7f5f33201640 1 -- 172.21.15.73:0/395173089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f2c106f10 msgr2=0x7f5f2c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:50.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.071+0000 7f5f33201640 1 --2- 172.21.15.73:0/395173089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f2c106f10 0x7f5f2c10ea90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009900 tx=0x7f5f2402a410 comp rx=0 tx=0).stop 2024-09-05T12:56:50.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.071+0000 7f5f33201640 1 -- 172.21.15.73:0/395173089 shutdown_connections 2024-09-05T12:56:50.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.071+0000 7f5f33201640 1 --2- 172.21.15.73:0/395173089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f2c106f10 0x7f5f2c10ea90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:50.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.071+0000 7f5f33201640 1 --2- 172.21.15.73:0/395173089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f2c102790 0x7f5f2c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.071+0000 7f5f33201640 1 --2- 172.21.15.73:0/395173089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c101de0 0x7f5f2c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.071+0000 7f5f33201640 1 -- 172.21.15.73:0/395173089 >> 172.21.15.73:0/395173089 conn(0x7f5f2c0fd8c0 msgr2=0x7f5f2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.071+0000 7f5f33201640 1 -- 172.21.15.73:0/395173089 shutdown_connections 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.071+0000 7f5f33201640 1 -- 172.21.15.73:0/395173089 wait complete. 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f33201640 1 Processor -- start 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f33201640 1 -- start start 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f33201640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f2c101de0 0x7f5f2c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f33201640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c102790 0x7f5f2c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f33201640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f2c106f10 0x7f5f2c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f33201640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c111f90 con 0x7f5f2c106f10 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f33201640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c111e10 con 0x7f5f2c102790 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f33201640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c112110 con 0x7f5f2c101de0 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f3179e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f2c106f10 0x7f5f2c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:50.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f3179e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f2c106f10 0x7f5f2c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55178/0 (socket says 172.21.15.73:55178) 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f3179e640 1 -- 172.21.15.73:0/3609057423 learned_addr learned my addr 172.21.15.73:0/3609057423 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f2bfff640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c102790 0x7f5f2c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f3179e640 1 -- 172.21.15.73:0/3609057423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f2c101de0 msgr2=0x7f5f2c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f30f9d640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f2c101de0 0x7f5f2c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f3179e640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f2c101de0 0x7f5f2c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f3179e640 1 -- 172.21.15.73:0/3609057423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c102790 msgr2=0x7f5f2c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f3179e640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c102790 0x7f5f2c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f3179e640 1 -- 172.21.15.73:0/3609057423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c19d420 con 0x7f5f2c106f10 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.072+0000 7f5f2bfff640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c102790 0x7f5f2c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.073+0000 7f5f3179e640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f2c106f10 0x7f5f2c19cd40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009230 tx=0x7f5f240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.073+0000 7f5f29ffb640 1 -- 172.21.15.73:0/3609057423 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2403f030 con 0x7f5f2c106f10 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.073+0000 7f5f29ffb640 1 -- 172.21.15.73:0/3609057423 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f24003ce0 con 0x7f5f2c106f10 2024-09-05T12:56:50.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.073+0000 7f5f33201640 1 -- 172.21.15.73:0/3609057423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2c19d6b0 con 0x7f5f2c106f10 2024-09-05T12:56:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.073+0000 7f5f29ffb640 1 -- 172.21.15.73:0/3609057423 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24035070 con 0x7f5f2c106f10 2024-09-05T12:56:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.073+0000 7f5f33201640 1 -- 172.21.15.73:0/3609057423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2c1a4ff0 con 0x7f5f2c106f10 2024-09-05T12:56:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.074+0000 7f5f33201640 1 -- 172.21.15.73:0/3609057423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f2c1032c0 con 0x7f5f2c106f10 2024-09-05T12:56:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.075+0000 7f5f29ffb640 1 -- 172.21.15.73:0/3609057423 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5f24042030 con 0x7f5f2c106f10 2024-09-05T12:56:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.075+0000 7f5f29ffb640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f180a2c10 0x7f5f180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.076+0000 7f5f30f9d640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f180a2c10 0x7f5f180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.076+0000 7f5f29ffb640 1 -- 172.21.15.73:0/3609057423 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f5f240efb80 con 0x7f5f2c106f10 2024-09-05T12:56:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.076+0000 7f5f30f9d640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f180a2c10 0x7f5f180a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f140058c0 tx=0x7f5f14005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.080+0000 7f5f29ffb640 1 -- 172.21.15.73:0/3609057423 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f240bc9b0 con 0x7f5f2c106f10 2024-09-05T12:56:50.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.266+0000 7f5f33201640 1 -- 172.21.15.73:0/3609057423 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f2c10a160 con 0x7f5f180a2c10 2024-09-05T12:56:50.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.276+0000 7f5f29ffb640 1 -- 172.21.15.73:0/3609057423 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258871 (secure 0 0 0) 0x7f5f1400d9c0 con 0x7f5f180a2c10 2024-09-05T12:56:50.281 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-05T12:56:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 -- 172.21.15.73:0/3609057423 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f180a2c10 msgr2=0x7f5f180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f180a2c10 0x7f5f180a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f140058c0 tx=0x7f5f14005c60 comp rx=0 tx=0).stop 2024-09-05T12:56:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 -- 172.21.15.73:0/3609057423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f2c106f10 msgr2=0x7f5f2c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f2c106f10 0x7f5f2c19cd40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009230 tx=0x7f5f240042f0 comp rx=0 tx=0).stop 2024-09-05T12:56:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 -- 172.21.15.73:0/3609057423 shutdown_connections 2024-09-05T12:56:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5f180a2c10 0x7f5f180a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f2c106f10 0x7f5f2c19cd40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c102790 0x7f5f2c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 --2- 172.21.15.73:0/3609057423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f2c101de0 0x7f5f2c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 -- 172.21.15.73:0/3609057423 >> 172.21.15.73:0/3609057423 conn(0x7f5f2c0fd8c0 msgr2=0x7f5f2c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 -- 172.21.15.73:0/3609057423 shutdown_connections 2024-09-05T12:56:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:50.280+0000 7f5f33201640 1 -- 172.21.15.73:0/3609057423 wait complete. 2024-09-05T12:56:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-05T12:56:49.988764+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":468,"num_read_kb":348,"num_write":344,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351664,"kb_used_data":10704,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590160,"statfs":{"total":1151940427776,"available":1151580323840,"internally_reserved":0,"allocated":10960896,"data_stored":7061847,"data_compressed":107439,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002771"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059332+0000","last_change":"2024-09-05T12:55:45.753801+0000","last_active":"2024-09-05T12:56:05.059332+0000","last_peered":"2024-09-05T12:56:05.059332+0000","last_clean":"2024-09-05T12:56:05.059332+0000","last_became_active":"2024-09-05T12:55:45.753480+0000","last_became_peered":"2024-09-05T12:55:45.753480+0000","last_unstale":"2024-09-05T12:56:05.059332+0000","last_undegraded":"2024-09-05T12:56:05.059332+0000","last_fullsized":"2024-09-05T12:56:05.059332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:34.806083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063464+0000","last_change":"2024-09-05T12:55:45.744629+0000","last_active":"2024-09-05T12:56:05.063464+0000","last_peered":"2024-09-05T12:56:05.063464+0000","last_clean":"2024-09-05T12:56:05.063464+0000","last_became_active":"2024-09-05T12:55:45.744311+0000","last_became_peered":"2024-09-05T12:55:45.744311+0000","last_unstale":"2024-09-05T12:56:05.063464+0000","last_undegraded":"2024-09-05T12:56:05.063464+0000","last_fullsized":"2024-09-05T12:56:05.063464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:08:57.032929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063504+0000","last_change":"2024-09-05T12:55:45.745128+0000","last_active":"2024-09-05T12:56:05.063504+0000","last_peered":"2024-09-05T12:56:05.063504+0000","last_clean":"2024-09-05T12:56:05.063504+0000","last_became_active":"2024-09-05T12:55:45.744799+0000","last_became_peered":"2024-09-05T12:55:45.744799+0000","last_unstale":"2024-09-05T12:56:05.063504+0000","last_undegraded":"2024-09-05T12:56:05.063504+0000","last_fullsized":"2024-09-05T12:56:05.063504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:35:48.528336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201949+0000","last_change":"2024-09-05T12:55:45.749471+0000","last_active":"2024-09-05T12:56:05.201949+0000","last_peered":"2024-09-05T12:56:05.201949+0000","last_clean":"2024-09-05T12:56:05.201949+0000","last_became_active":"2024-09-05T12:55:45.749126+0000","last_became_peered":"2024-09-05T12:55:45.749126+0000","last_unstale":"2024-09-05T12:56:05.201949+0000","last_undegraded":"2024-09-05T12:56:05.201949+0000","last_fullsized":"2024-09-05T12:56:05.201949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:36.152934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061325+0000","last_change":"2024-09-05T12:55:45.741243+0000","last_active":"2024-09-05T12:56:05.061325+0000","last_peered":"2024-09-05T12:56:05.061325+0000","last_clean":"2024-09-05T12:56:05.061325+0000","last_became_active":"2024-09-05T12:55:45.740849+0000","last_became_peered":"2024-09-05T12:55:45.740849+0000","last_unstale":"2024-09-05T12:56:05.061325+0000","last_undegraded":"2024-09-05T12:56:05.061325+0000","last_fullsized":"2024-09-05T12:56:05.061325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:01.323875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061912+0000","last_change":"2024-09-05T12:55:45.744599+0000","last_active":"2024-09-05T12:56:05.061912+0000","last_peered":"2024-09-05T12:56:05.061912+0000","last_clean":"2024-09-05T12:56:05.061912+0000","last_became_active":"2024-09-05T12:55:45.744304+0000","last_became_peered":"2024-09-05T12:55:45.744304+0000","last_unstale":"2024-09-05T12:56:05.061912+0000","last_undegraded":"2024-09-05T12:56:05.061912+0000","last_fullsized":"2024-09-05T12:56:05.061912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:15:55.340505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676096+0000","last_change":"2024-09-05T12:55:45.744802+0000","last_active":"2024-09-05T12:56:05.676096+0000","last_peered":"2024-09-05T12:56:05.676096+0000","last_clean":"2024-09-05T12:56:05.676096+0000","last_became_active":"2024-09-05T12:55:45.744525+0000","last_became_peered":"2024-09-05T12:55:45.744525+0000","last_unstale":"2024-09-05T12:56:05.676096+0000","last_undegraded":"2024-09-05T12:56:05.676096+0000","last_fullsized":"2024-09-05T12:56:05.676096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:03:04.047389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060470+0000","last_change":"2024-09-05T12:55:45.742141+0000","last_active":"2024-09-05T12:56:05.060470+0000","last_peered":"2024-09-05T12:56:05.060470+0000","last_clean":"2024-09-05T12:56:05.060470+0000","last_became_active":"2024-09-05T12:55:45.741445+0000","last_became_peered":"2024-09-05T12:55:45.741445+0000","last_unstale":"2024-09-05T12:56:05.060470+0000","last_undegraded":"2024-09-05T12:56:05.060470+0000","last_fullsized":"2024-09-05T12:56:05.060470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:38:28.859589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.852099+0000","last_change":"2024-09-05T12:55:45.747321+0000","last_active":"2024-09-05T12:56:05.852099+0000","last_peered":"2024-09-05T12:56:05.852099+0000","last_clean":"2024-09-05T12:56:05.852099+0000","last_became_active":"2024-09-05T12:55:45.747013+0000","last_became_peered":"2024-09-05T12:55:45.747013+0000","last_unstale":"2024-09-05T12:56:05.852099+0000","last_undegraded":"2024-09-05T12:56:05.852099+0000","last_fullsized":"2024-09-05T12:56:05.852099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:42:00.402789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064498+0000","last_change":"2024-09-05T12:56:05.064498+0000","last_active":"2024-09-05T12:56:05.064498+0000","last_peered":"2024-09-05T12:56:05.064498+0000","last_clean":"2024-09-05T12:56:05.064498+0000","last_became_active":"2024-09-05T12:56:05.064200+0000","last_became_peered":"2024-09-05T12:56:05.064200+0000","last_unstale":"2024-09-05T12:56:05.064498+0000","last_undegraded":"2024-09-05T12:56:05.064498+0000","last_fullsized":"2024-09-05T12:56:05.064498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:37:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676376+0000","last_change":"2024-09-05T12:55:45.748372+0000","last_active":"2024-09-05T12:56:05.676376+0000","last_peered":"2024-09-05T12:56:05.676376+0000","last_clean":"2024-09-05T12:56:05.676376+0000","last_became_active":"2024-09-05T12:55:45.748093+0000","last_became_peered":"2024-09-05T12:55:45.748093+0000","last_unstale":"2024-09-05T12:56:05.676376+0000","last_undegraded":"2024-09-05T12:56:05.676376+0000","last_fullsized":"2024-09-05T12:56:05.676376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:32:25.938128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201978+0000","last_change":"2024-09-05T12:55:45.749433+0000","last_active":"2024-09-05T12:56:05.201978+0000","last_peered":"2024-09-05T12:56:05.201978+0000","last_clean":"2024-09-05T12:56:05.201978+0000","last_became_active":"2024-09-05T12:55:45.748677+0000","last_became_peered":"2024-09-05T12:55:45.748677+0000","last_unstale":"2024-09-05T12:56:05.201978+0000","last_undegraded":"2024-09-05T12:56:05.201978+0000","last_fullsized":"2024-09-05T12:56:05.201978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:27:57.896752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819602+0000","last_change":"2024-09-05T12:55:45.743212+0000","last_active":"2024-09-05T12:56:05.819602+0000","last_peered":"2024-09-05T12:56:05.819602+0000","last_clean":"2024-09-05T12:56:05.819602+0000","last_became_active":"2024-09-05T12:55:45.742918+0000","last_became_peered":"2024-09-05T12:55:45.742918+0000","last_unstale":"2024-09-05T12:56:05.819602+0000","last_undegraded":"2024-09-05T12:56:05.819602+0000","last_fullsized":"2024-09-05T12:56:05.819602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:21:18.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063680+0000","last_change":"2024-09-05T12:55:45.745058+0000","last_active":"2024-09-05T12:56:05.063680+0000","last_peered":"2024-09-05T12:56:05.063680+0000","last_clean":"2024-09-05T12:56:05.063680+0000","last_became_active":"2024-09-05T12:55:45.744349+0000","last_became_peered":"2024-09-05T12:55:45.744349+0000","last_unstale":"2024-09-05T12:56:05.063680+0000","last_undegraded":"2024-09-05T12:56:05.063680+0000","last_fullsized":"2024-09-05T12:56:05.063680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:26:21.034864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063126+0000","last_change":"2024-09-05T12:55:45.748387+0000","last_active":"2024-09-05T12:56:05.063126+0000","last_peered":"2024-09-05T12:56:05.063126+0000","last_clean":"2024-09-05T12:56:05.063126+0000","last_became_active":"2024-09-05T12:55:45.748082+0000","last_became_peered":"2024-09-05T12:55:45.748082+0000","last_unstale":"2024-09-05T12:56:05.063126+0000","last_undegraded":"2024-09-05T12:56:05.063126+0000","last_fullsized":"2024-09-05T12:56:05.063126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:51:23.835278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851526+0000","last_change":"2024-09-05T12:55:45.742195+0000","last_active":"2024-09-05T12:56:05.851526+0000","last_peered":"2024-09-05T12:56:05.851526+0000","last_clean":"2024-09-05T12:56:05.851526+0000","last_became_active":"2024-09-05T12:55:45.741888+0000","last_became_peered":"2024-09-05T12:55:45.741888+0000","last_unstale":"2024-09-05T12:56:05.851526+0000","last_undegraded":"2024-09-05T12:56:05.851526+0000","last_fullsized":"2024-09-05T12:56:05.851526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:19:17.556164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059394+0000","last_change":"2024-09-05T12:55:45.755255+0000","last_active":"2024-09-05T12:56:05.059394+0000","last_peered":"2024-09-05T12:56:05.059394+0000","last_clean":"2024-09-05T12:56:05.059394+0000","last_became_active":"2024-09-05T12:55:45.754939+0000","last_became_peered":"2024-09-05T12:55:45.754939+0000","last_unstale":"2024-09-05T12:56:05.059394+0000","last_undegraded":"2024-09-05T12:56:05.059394+0000","last_fullsized":"2024-09-05T12:56:05.059394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:48:34.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061596+0000","last_change":"2024-09-05T12:55:45.745496+0000","last_active":"2024-09-05T12:56:05.061596+0000","last_peered":"2024-09-05T12:56:05.061596+0000","last_clean":"2024-09-05T12:56:05.061596+0000","last_became_active":"2024-09-05T12:55:45.745153+0000","last_became_peered":"2024-09-05T12:55:45.745153+0000","last_unstale":"2024-09-05T12:56:05.061596+0000","last_undegraded":"2024-09-05T12:56:05.061596+0000","last_fullsized":"2024-09-05T12:56:05.061596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:16:52.255227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062235+0000","last_change":"2024-09-05T12:55:45.747353+0000","last_active":"2024-09-05T12:56:05.062235+0000","last_peered":"2024-09-05T12:56:05.062235+0000","last_clean":"2024-09-05T12:56:05.062235+0000","last_became_active":"2024-09-05T12:55:45.747018+0000","last_became_peered":"2024-09-05T12:55:45.747018+0000","last_unstale":"2024-09-05T12:56:05.062235+0000","last_undegraded":"2024-09-05T12:56:05.062235+0000","last_fullsized":"2024-09-05T12:56:05.062235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:12:25.217057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059013+0000","last_change":"2024-09-05T12:55:45.754023+0000","last_active":"2024-09-05T12:56:05.059013+0000","last_peered":"2024-09-05T12:56:05.059013+0000","last_clean":"2024-09-05T12:56:05.059013+0000","last_became_active":"2024-09-05T12:55:45.753723+0000","last_became_peered":"2024-09-05T12:55:45.753723+0000","last_unstale":"2024-09-05T12:56:05.059013+0000","last_undegraded":"2024-09-05T12:56:05.059013+0000","last_fullsized":"2024-09-05T12:56:05.059013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:16:01.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819690+0000","last_change":"2024-09-05T12:55:45.742627+0000","last_active":"2024-09-05T12:56:05.819690+0000","last_peered":"2024-09-05T12:56:05.819690+0000","last_clean":"2024-09-05T12:56:05.819690+0000","last_became_active":"2024-09-05T12:55:45.742252+0000","last_became_peered":"2024-09-05T12:55:45.742252+0000","last_unstale":"2024-09-05T12:56:05.819690+0000","last_undegraded":"2024-09-05T12:56:05.819690+0000","last_fullsized":"2024-09-05T12:56:05.819690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:14:34.476156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851781+0000","last_change":"2024-09-05T12:55:45.743587+0000","last_active":"2024-09-05T12:56:05.851781+0000","last_peered":"2024-09-05T12:56:05.851781+0000","last_clean":"2024-09-05T12:56:05.851781+0000","last_became_active":"2024-09-05T12:55:45.742624+0000","last_became_peered":"2024-09-05T12:55:45.742624+0000","last_unstale":"2024-09-05T12:56:05.851781+0000","last_undegraded":"2024-09-05T12:56:05.851781+0000","last_fullsized":"2024-09-05T12:56:05.851781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:15.981929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060563+0000","last_change":"2024-09-05T12:55:45.747430+0000","last_active":"2024-09-05T12:56:05.060563+0000","last_peered":"2024-09-05T12:56:05.060563+0000","last_clean":"2024-09-05T12:56:05.060563+0000","last_became_active":"2024-09-05T12:55:45.747049+0000","last_became_peered":"2024-09-05T12:55:45.747049+0000","last_unstale":"2024-09-05T12:56:05.060563+0000","last_undegraded":"2024-09-05T12:56:05.060563+0000","last_fullsized":"2024-09-05T12:56:05.060563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:31:08.388375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065470+0000","last_change":"2024-09-05T12:55:45.741645+0000","last_active":"2024-09-05T12:56:05.065470+0000","last_peered":"2024-09-05T12:56:05.065470+0000","last_clean":"2024-09-05T12:56:05.065470+0000","last_became_active":"2024-09-05T12:55:45.741341+0000","last_became_peered":"2024-09-05T12:55:45.741341+0000","last_unstale":"2024-09-05T12:56:05.065470+0000","last_undegraded":"2024-09-05T12:56:05.065470+0000","last_fullsized":"2024-09-05T12:56:05.065470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:24:11.896491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061589+0000","last_change":"2024-09-05T12:55:45.747609+0000","last_active":"2024-09-05T12:56:05.061589+0000","last_peered":"2024-09-05T12:56:05.061589+0000","last_clean":"2024-09-05T12:56:05.061589+0000","last_became_active":"2024-09-05T12:55:45.745899+0000","last_became_peered":"2024-09-05T12:55:45.745899+0000","last_unstale":"2024-09-05T12:56:05.061589+0000","last_undegraded":"2024-09-05T12:56:05.061589+0000","last_fullsized":"2024-09-05T12:56:05.061589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:21:42.224663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061958+0000","last_change":"2024-09-05T12:55:45.744974+0000","last_active":"2024-09-05T12:56:05.061958+0000","last_peered":"2024-09-05T12:56:05.061958+0000","last_clean":"2024-09-05T12:56:05.061958+0000","last_became_active":"2024-09-05T12:55:45.744538+0000","last_became_peered":"2024-09-05T12:55:45.744538+0000","last_unstale":"2024-09-05T12:56:05.061958+0000","last_undegraded":"2024-09-05T12:56:05.061958+0000","last_fullsized":"2024-09-05T12:56:05.061958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:48:46.695178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064626+0000","last_change":"2024-09-05T12:56:05.064626+0000","last_active":"2024-09-05T12:56:05.064626+0000","last_peered":"2024-09-05T12:56:05.064626+0000","last_clean":"2024-09-05T12:56:05.064626+0000","last_became_active":"2024-09-05T12:56:05.063972+0000","last_became_peered":"2024-09-05T12:56:05.063972+0000","last_unstale":"2024-09-05T12:56:05.064626+0000","last_undegraded":"2024-09-05T12:56:05.064626+0000","last_fullsized":"2024-09-05T12:56:05.064626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:57.345008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819769+0000","last_change":"2024-09-05T12:55:45.753630+0000","last_active":"2024-09-05T12:56:05.819769+0000","last_peered":"2024-09-05T12:56:05.819769+0000","last_clean":"2024-09-05T12:56:05.819769+0000","last_became_active":"2024-09-05T12:55:45.753328+0000","last_became_peered":"2024-09-05T12:55:45.753328+0000","last_unstale":"2024-09-05T12:56:05.819769+0000","last_undegraded":"2024-09-05T12:56:05.819769+0000","last_fullsized":"2024-09-05T12:56:05.819769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:55:39.064374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063372+0000","last_change":"2024-09-05T12:55:45.749596+0000","last_active":"2024-09-05T12:56:05.063372+0000","last_peered":"2024-09-05T12:56:05.063372+0000","last_clean":"2024-09-05T12:56:05.063372+0000","last_became_active":"2024-09-05T12:55:45.749150+0000","last_became_peered":"2024-09-05T12:55:45.749150+0000","last_unstale":"2024-09-05T12:56:05.063372+0000","last_undegraded":"2024-09-05T12:56:05.063372+0000","last_fullsized":"2024-09-05T12:56:05.063372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:14:06.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062144+0000","last_change":"2024-09-05T12:55:45.748414+0000","last_active":"2024-09-05T12:56:05.062144+0000","last_peered":"2024-09-05T12:56:05.062144+0000","last_clean":"2024-09-05T12:56:05.062144+0000","last_became_active":"2024-09-05T12:55:45.747952+0000","last_became_peered":"2024-09-05T12:55:45.747952+0000","last_unstale":"2024-09-05T12:56:05.062144+0000","last_undegraded":"2024-09-05T12:56:05.062144+0000","last_fullsized":"2024-09-05T12:56:05.062144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:45:04.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061467+0000","last_change":"2024-09-05T12:55:45.754145+0000","last_active":"2024-09-05T12:56:05.061467+0000","last_peered":"2024-09-05T12:56:05.061467+0000","last_clean":"2024-09-05T12:56:05.061467+0000","last_became_active":"2024-09-05T12:55:45.753833+0000","last_became_peered":"2024-09-05T12:55:45.753833+0000","last_unstale":"2024-09-05T12:56:05.061467+0000","last_undegraded":"2024-09-05T12:56:05.061467+0000","last_fullsized":"2024-09-05T12:56:05.061467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:45:24.606506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.058922+0000","last_change":"2024-09-05T12:55:45.750283+0000","last_active":"2024-09-05T12:56:05.058922+0000","last_peered":"2024-09-05T12:56:05.058922+0000","last_clean":"2024-09-05T12:56:05.058922+0000","last_became_active":"2024-09-05T12:55:45.749901+0000","last_became_peered":"2024-09-05T12:55:45.749901+0000","last_unstale":"2024-09-05T12:56:05.058922+0000","last_undegraded":"2024-09-05T12:56:05.058922+0000","last_fullsized":"2024-09-05T12:56:05.058922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:45:57.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061784+0000","last_change":"2024-09-05T12:55:45.743239+0000","last_active":"2024-09-05T12:56:05.061784+0000","last_peered":"2024-09-05T12:56:05.061784+0000","last_clean":"2024-09-05T12:56:05.061784+0000","last_became_active":"2024-09-05T12:55:45.742926+0000","last_became_peered":"2024-09-05T12:55:45.742926+0000","last_unstale":"2024-09-05T12:56:05.061784+0000","last_undegraded":"2024-09-05T12:56:05.061784+0000","last_fullsized":"2024-09-05T12:56:05.061784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:26:05.559405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:44.877221+0000","last_change":"2024-09-05T12:55:43.727301+0000","last_active":"2024-09-05T12:56:44.877221+0000","last_peered":"2024-09-05T12:56:44.877221+0000","last_clean":"2024-09-05T12:56:44.877221+0000","last_became_active":"2024-09-05T12:55:43.727006+0000","last_became_peered":"2024-09-05T12:55:43.727006+0000","last_unstale":"2024-09-05T12:56:44.877221+0000","last_undegraded":"2024-09-05T12:56:44.877221+0000","last_fullsized":"2024-09-05T12:56:44.877221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:54:32.725098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066620+0000","last_change":"2024-09-05T12:55:45.735835+0000","last_active":"2024-09-05T12:56:05.066620+0000","last_peered":"2024-09-05T12:56:05.066620+0000","last_clean":"2024-09-05T12:56:05.066620+0000","last_became_active":"2024-09-05T12:55:45.735404+0000","last_became_peered":"2024-09-05T12:55:45.735404+0000","last_unstale":"2024-09-05T12:56:05.066620+0000","last_undegraded":"2024-09-05T12:56:05.066620+0000","last_fullsized":"2024-09-05T12:56:05.066620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:06:47.174441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062007+0000","last_change":"2024-09-05T12:55:43.724561+0000","last_active":"2024-09-05T12:56:05.062007+0000","last_peered":"2024-09-05T12:56:05.062007+0000","last_clean":"2024-09-05T12:56:05.062007+0000","last_became_active":"2024-09-05T12:55:43.722704+0000","last_became_peered":"2024-09-05T12:55:43.722704+0000","last_unstale":"2024-09-05T12:56:05.062007+0000","last_undegraded":"2024-09-05T12:56:05.062007+0000","last_fullsized":"2024-09-05T12:56:05.062007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:20:20.692844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819297+0000","last_change":"2024-09-05T12:55:43.722937+0000","last_active":"2024-09-05T12:56:05.819297+0000","last_peered":"2024-09-05T12:56:05.819297+0000","last_clean":"2024-09-05T12:56:05.819297+0000","last_became_active":"2024-09-05T12:55:43.722606+0000","last_became_peered":"2024-09-05T12:55:43.722606+0000","last_unstale":"2024-09-05T12:56:05.819297+0000","last_undegraded":"2024-09-05T12:56:05.819297+0000","last_fullsized":"2024-09-05T12:56:05.819297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:47:38.448865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.820632+0000","last_change":"2024-09-05T12:56:05.820632+0000","last_active":"2024-09-05T12:56:05.820632+0000","last_peered":"2024-09-05T12:56:05.820632+0000","last_clean":"2024-09-05T12:56:05.820632+0000","last_became_active":"2024-09-05T12:56:05.820239+0000","last_became_peered":"2024-09-05T12:56:05.820239+0000","last_unstale":"2024-09-05T12:56:05.820632+0000","last_undegraded":"2024-09-05T12:56:05.820632+0000","last_fullsized":"2024-09-05T12:56:05.820632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:36:59.659783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065764+0000","last_change":"2024-09-05T12:55:43.725546+0000","last_active":"2024-09-05T12:56:05.065764+0000","last_peered":"2024-09-05T12:56:05.065764+0000","last_clean":"2024-09-05T12:56:05.065764+0000","last_became_active":"2024-09-05T12:55:43.725252+0000","last_became_peered":"2024-09-05T12:55:43.725252+0000","last_unstale":"2024-09-05T12:56:05.065764+0000","last_undegraded":"2024-09-05T12:56:05.065764+0000","last_fullsized":"2024-09-05T12:56:05.065764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:49:16.085799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060968+0000","last_change":"2024-09-05T12:55:45.745358+0000","last_active":"2024-09-05T12:56:05.060968+0000","last_peered":"2024-09-05T12:56:05.060968+0000","last_clean":"2024-09-05T12:56:05.060968+0000","last_became_active":"2024-09-05T12:55:45.745040+0000","last_became_peered":"2024-09-05T12:55:45.745040+0000","last_unstale":"2024-09-05T12:56:05.060968+0000","last_undegraded":"2024-09-05T12:56:05.060968+0000","last_fullsized":"2024-09-05T12:56:05.060968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:42:42.906745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:47.881120+0000","last_change":"2024-09-05T12:55:43.726138+0000","last_active":"2024-09-05T12:56:47.881120+0000","last_peered":"2024-09-05T12:56:47.881120+0000","last_clean":"2024-09-05T12:56:47.881120+0000","last_became_active":"2024-09-05T12:55:43.725815+0000","last_became_peered":"2024-09-05T12:55:43.725815+0000","last_unstale":"2024-09-05T12:56:47.881120+0000","last_undegraded":"2024-09-05T12:56:47.881120+0000","last_fullsized":"2024-09-05T12:56:47.881120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:35:38.041757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851996+0000","last_change":"2024-09-05T12:55:45.743580+0000","last_active":"2024-09-05T12:56:05.851996+0000","last_peered":"2024-09-05T12:56:05.851996+0000","last_clean":"2024-09-05T12:56:05.851996+0000","last_became_active":"2024-09-05T12:55:45.743307+0000","last_became_peered":"2024-09-05T12:55:45.743307+0000","last_unstale":"2024-09-05T12:56:05.851996+0000","last_undegraded":"2024-09-05T12:56:05.851996+0000","last_fullsized":"2024-09-05T12:56:05.851996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:15:13.898218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676632+0000","last_change":"2024-09-05T12:55:43.725373+0000","last_active":"2024-09-05T12:56:05.676632+0000","last_peered":"2024-09-05T12:56:05.676632+0000","last_clean":"2024-09-05T12:56:05.676632+0000","last_became_active":"2024-09-05T12:55:43.725062+0000","last_became_peered":"2024-09-05T12:55:43.725062+0000","last_unstale":"2024-09-05T12:56:05.676632+0000","last_undegraded":"2024-09-05T12:56:05.676632+0000","last_fullsized":"2024-09-05T12:56:05.676632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:42:27.994499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063879+0000","last_change":"2024-09-05T12:55:45.750265+0000","last_active":"2024-09-05T12:56:05.063879+0000","last_peered":"2024-09-05T12:56:05.063879+0000","last_clean":"2024-09-05T12:56:05.063879+0000","last_became_active":"2024-09-05T12:55:45.749928+0000","last_became_peered":"2024-09-05T12:55:45.749928+0000","last_unstale":"2024-09-05T12:56:05.063879+0000","last_undegraded":"2024-09-05T12:56:05.063879+0000","last_fullsized":"2024-09-05T12:56:05.063879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:56:19.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065937+0000","last_change":"2024-09-05T12:55:43.736248+0000","last_active":"2024-09-05T12:56:05.065937+0000","last_peered":"2024-09-05T12:56:05.065937+0000","last_clean":"2024-09-05T12:56:05.065937+0000","last_became_active":"2024-09-05T12:55:43.735928+0000","last_became_peered":"2024-09-05T12:55:43.735928+0000","last_unstale":"2024-09-05T12:56:05.065937+0000","last_undegraded":"2024-09-05T12:56:05.065937+0000","last_fullsized":"2024-09-05T12:56:05.065937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:04:43.215616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851777+0000","last_change":"2024-09-05T12:55:45.739178+0000","last_active":"2024-09-05T12:56:05.851777+0000","last_peered":"2024-09-05T12:56:05.851777+0000","last_clean":"2024-09-05T12:56:05.851777+0000","last_became_active":"2024-09-05T12:55:45.738863+0000","last_became_peered":"2024-09-05T12:55:45.738863+0000","last_unstale":"2024-09-05T12:56:05.851777+0000","last_undegraded":"2024-09-05T12:56:05.851777+0000","last_fullsized":"2024-09-05T12:56:05.851777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:08.273036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":167,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:48.882822+0000","last_change":"2024-09-05T12:55:43.725380+0000","last_active":"2024-09-05T12:56:48.882822+0000","last_peered":"2024-09-05T12:56:48.882822+0000","last_clean":"2024-09-05T12:56:48.882822+0000","last_became_active":"2024-09-05T12:55:43.725000+0000","last_became_peered":"2024-09-05T12:55:43.725000+0000","last_unstale":"2024-09-05T12:56:48.882822+0000","last_undegraded":"2024-09-05T12:56:48.882822+0000","last_fullsized":"2024-09-05T12:56:48.882822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:34:13.288894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061405+0000","last_change":"2024-09-05T12:55:45.742269+0000","last_active":"2024-09-05T12:56:05.061405+0000","last_peered":"2024-09-05T12:56:05.061405+0000","last_clean":"2024-09-05T12:56:05.061405+0000","last_became_active":"2024-09-05T12:55:45.741723+0000","last_became_peered":"2024-09-05T12:55:45.741723+0000","last_unstale":"2024-09-05T12:56:05.061405+0000","last_undegraded":"2024-09-05T12:56:05.061405+0000","last_fullsized":"2024-09-05T12:56:05.061405+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:39.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061771+0000","last_change":"2024-09-05T12:55:43.723725+0000","last_active":"2024-09-05T12:56:05.061771+0000","last_peered":"2024-09-05T12:56:05.061771+0000","last_clean":"2024-09-05T12:56:05.061771+0000","last_became_active":"2024-09-05T12:55:43.723351+0000","last_became_peered":"2024-09-05T12:55:43.723351+0000","last_unstale":"2024-09-05T12:56:05.061771+0000","last_undegraded":"2024-09-05T12:56:05.061771+0000","last_fullsized":"2024-09-05T12:56:05.061771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:15:40.485461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819355+0000","last_change":"2024-09-05T12:55:45.742293+0000","last_active":"2024-09-05T12:56:05.819355+0000","last_peered":"2024-09-05T12:56:05.819355+0000","last_clean":"2024-09-05T12:56:05.819355+0000","last_became_active":"2024-09-05T12:55:45.741998+0000","last_became_peered":"2024-09-05T12:55:45.741998+0000","last_unstale":"2024-09-05T12:56:05.819355+0000","last_undegraded":"2024-09-05T12:56:05.819355+0000","last_fullsized":"2024-09-05T12:56:05.819355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:25:23.731384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065615+0000","last_change":"2024-09-05T12:55:43.726519+0000","last_active":"2024-09-05T12:56:05.065615+0000","last_peered":"2024-09-05T12:56:05.065615+0000","last_clean":"2024-09-05T12:56:05.065615+0000","last_became_active":"2024-09-05T12:55:43.726231+0000","last_became_peered":"2024-09-05T12:55:43.726231+0000","last_unstale":"2024-09-05T12:56:05.065615+0000","last_undegraded":"2024-09-05T12:56:05.065615+0000","last_fullsized":"2024-09-05T12:56:05.065615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:22:55.460814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676243+0000","last_change":"2024-09-05T12:55:45.739359+0000","last_active":"2024-09-05T12:56:05.676243+0000","last_peered":"2024-09-05T12:56:05.676243+0000","last_clean":"2024-09-05T12:56:05.676243+0000","last_became_active":"2024-09-05T12:55:45.738358+0000","last_became_peered":"2024-09-05T12:55:45.738358+0000","last_unstale":"2024-09-05T12:56:05.676243+0000","last_undegraded":"2024-09-05T12:56:05.676243+0000","last_fullsized":"2024-09-05T12:56:05.676243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:11:37.144174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:44.876581+0000","last_change":"2024-09-05T12:55:43.726623+0000","last_active":"2024-09-05T12:56:44.876581+0000","last_peered":"2024-09-05T12:56:44.876581+0000","last_clean":"2024-09-05T12:56:44.876581+0000","last_became_active":"2024-09-05T12:55:43.726281+0000","last_became_peered":"2024-09-05T12:55:43.726281+0000","last_unstale":"2024-09-05T12:56:44.876581+0000","last_undegraded":"2024-09-05T12:56:44.876581+0000","last_fullsized":"2024-09-05T12:56:44.876581+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:59:07.503458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676010+0000","last_change":"2024-09-05T12:55:45.745731+0000","last_active":"2024-09-05T12:56:05.676010+0000","last_peered":"2024-09-05T12:56:05.676010+0000","last_clean":"2024-09-05T12:56:05.676010+0000","last_became_active":"2024-09-05T12:55:45.745399+0000","last_became_peered":"2024-09-05T12:55:45.745399+0000","last_unstale":"2024-09-05T12:56:05.676010+0000","last_undegraded":"2024-09-05T12:56:05.676010+0000","last_fullsized":"2024-09-05T12:56:05.676010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:47:44.737335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061012+0000","last_change":"2024-09-05T12:55:43.736527+0000","last_active":"2024-09-05T12:56:05.061012+0000","last_peered":"2024-09-05T12:56:05.061012+0000","last_clean":"2024-09-05T12:56:05.061012+0000","last_became_active":"2024-09-05T12:55:43.736088+0000","last_became_peered":"2024-09-05T12:55:43.736088+0000","last_unstale":"2024-09-05T12:56:05.061012+0000","last_undegraded":"2024-09-05T12:56:05.061012+0000","last_fullsized":"2024-09-05T12:56:05.061012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:14.570503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.853150+0000","last_change":"2024-09-05T12:56:05.853150+0000","last_active":"2024-09-05T12:56:05.853150+0000","last_peered":"2024-09-05T12:56:05.853150+0000","last_clean":"2024-09-05T12:56:05.853150+0000","last_became_active":"2024-09-05T12:56:05.852728+0000","last_became_peered":"2024-09-05T12:56:05.852728+0000","last_unstale":"2024-09-05T12:56:05.853150+0000","last_undegraded":"2024-09-05T12:56:05.853150+0000","last_fullsized":"2024-09-05T12:56:05.853150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:58:49.654402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062050+0000","last_change":"2024-09-05T12:55:43.726989+0000","last_active":"2024-09-05T12:56:05.062050+0000","last_peered":"2024-09-05T12:56:05.062050+0000","last_clean":"2024-09-05T12:56:05.062050+0000","last_became_active":"2024-09-05T12:55:43.726690+0000","last_became_peered":"2024-09-05T12:55:43.726690+0000","last_unstale":"2024-09-05T12:56:05.062050+0000","last_undegraded":"2024-09-05T12:56:05.062050+0000","last_fullsized":"2024-09-05T12:56:05.062050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:15:31.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059176+0000","last_change":"2024-09-05T12:55:45.754849+0000","last_active":"2024-09-05T12:56:05.059176+0000","last_peered":"2024-09-05T12:56:05.059176+0000","last_clean":"2024-09-05T12:56:05.059176+0000","last_became_active":"2024-09-05T12:55:45.754539+0000","last_became_peered":"2024-09-05T12:55:45.754539+0000","last_unstale":"2024-09-05T12:56:05.059176+0000","last_undegraded":"2024-09-05T12:56:05.059176+0000","last_fullsized":"2024-09-05T12:56:05.059176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:14:17.628561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819674+0000","last_change":"2024-09-05T12:55:43.723140+0000","last_active":"2024-09-05T12:56:05.819674+0000","last_peered":"2024-09-05T12:56:05.819674+0000","last_clean":"2024-09-05T12:56:05.819674+0000","last_became_active":"2024-09-05T12:55:43.722806+0000","last_became_peered":"2024-09-05T12:55:43.722806+0000","last_unstale":"2024-09-05T12:56:05.819674+0000","last_undegraded":"2024-09-05T12:56:05.819674+0000","last_fullsized":"2024-09-05T12:56:05.819674+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:00:30.041237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676678+0000","last_change":"2024-09-05T12:55:45.750948+0000","last_active":"2024-09-05T12:56:05.676678+0000","last_peered":"2024-09-05T12:56:05.676678+0000","last_clean":"2024-09-05T12:56:05.676678+0000","last_became_active":"2024-09-05T12:55:45.750642+0000","last_became_peered":"2024-09-05T12:55:45.750642+0000","last_unstale":"2024-09-05T12:56:05.676678+0000","last_undegraded":"2024-09-05T12:56:05.676678+0000","last_fullsized":"2024-09-05T12:56:05.676678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:17:48.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066001+0000","last_change":"2024-09-05T12:55:43.724847+0000","last_active":"2024-09-05T12:56:05.066001+0000","last_peered":"2024-09-05T12:56:05.066001+0000","last_clean":"2024-09-05T12:56:05.066001+0000","last_became_active":"2024-09-05T12:55:43.724538+0000","last_became_peered":"2024-09-05T12:55:43.724538+0000","last_unstale":"2024-09-05T12:56:05.066001+0000","last_undegraded":"2024-09-05T12:56:05.066001+0000","last_fullsized":"2024-09-05T12:56:05.066001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:13:46.011992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676407+0000","last_change":"2024-09-05T12:55:45.742080+0000","last_active":"2024-09-05T12:56:05.676407+0000","last_peered":"2024-09-05T12:56:05.676407+0000","last_clean":"2024-09-05T12:56:05.676407+0000","last_became_active":"2024-09-05T12:55:45.741749+0000","last_became_peered":"2024-09-05T12:55:45.741749+0000","last_unstale":"2024-09-05T12:56:05.676407+0000","last_undegraded":"2024-09-05T12:56:05.676407+0000","last_fullsized":"2024-09-05T12:56:05.676407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:20.597209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061670+0000","last_change":"2024-09-05T12:55:43.736856+0000","last_active":"2024-09-05T12:56:05.061670+0000","last_peered":"2024-09-05T12:56:05.061670+0000","last_clean":"2024-09-05T12:56:05.061670+0000","last_became_active":"2024-09-05T12:55:43.736490+0000","last_became_peered":"2024-09-05T12:55:43.736490+0000","last_unstale":"2024-09-05T12:56:05.061670+0000","last_undegraded":"2024-09-05T12:56:05.061670+0000","last_fullsized":"2024-09-05T12:56:05.061670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:36:55.286932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676384+0000","last_change":"2024-09-05T12:55:45.750667+0000","last_active":"2024-09-05T12:56:05.676384+0000","last_peered":"2024-09-05T12:56:05.676384+0000","last_clean":"2024-09-05T12:56:05.676384+0000","last_became_active":"2024-09-05T12:55:45.750386+0000","last_became_peered":"2024-09-05T12:55:45.750386+0000","last_unstale":"2024-09-05T12:56:05.676384+0000","last_undegraded":"2024-09-05T12:56:05.676384+0000","last_fullsized":"2024-09-05T12:56:05.676384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:32:41.443471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676291+0000","last_change":"2024-09-05T12:54:31.534043+0000","last_active":"2024-09-05T12:56:05.676291+0000","last_peered":"2024-09-05T12:56:05.676291+0000","last_clean":"2024-09-05T12:56:05.676291+0000","last_became_active":"2024-09-05T12:54:31.533610+0000","last_became_peered":"2024-09-05T12:54:31.533610+0000","last_unstale":"2024-09-05T12:56:05.676291+0000","last_undegraded":"2024-09-05T12:56:05.676291+0000","last_fullsized":"2024-09-05T12:56:05.676291+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_clean_scrub_stamp":"2024-09-05T12:51:12.506567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:30:50.399925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201941+0000","last_change":"2024-09-05T12:55:43.727743+0000","last_active":"2024-09-05T12:56:05.201941+0000","last_peered":"2024-09-05T12:56:05.201941+0000","last_clean":"2024-09-05T12:56:05.201941+0000","last_became_active":"2024-09-05T12:55:43.727333+0000","last_became_peered":"2024-09-05T12:55:43.727333+0000","last_unstale":"2024-09-05T12:56:05.201941+0000","last_undegraded":"2024-09-05T12:56:05.201941+0000","last_fullsized":"2024-09-05T12:56:05.201941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:41:21.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061274+0000","last_change":"2024-09-05T12:55:45.744268+0000","last_active":"2024-09-05T12:56:05.061274+0000","last_peered":"2024-09-05T12:56:05.061274+0000","last_clean":"2024-09-05T12:56:05.061274+0000","last_became_active":"2024-09-05T12:55:45.743976+0000","last_became_peered":"2024-09-05T12:55:45.743976+0000","last_unstale":"2024-09-05T12:56:05.061274+0000","last_undegraded":"2024-09-05T12:56:05.061274+0000","last_fullsized":"2024-09-05T12:56:05.061274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:02.568293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676247+0000","last_change":"2024-09-05T12:55:43.728853+0000","last_active":"2024-09-05T12:56:05.676247+0000","last_peered":"2024-09-05T12:56:05.676247+0000","last_clean":"2024-09-05T12:56:05.676247+0000","last_became_active":"2024-09-05T12:55:43.728559+0000","last_became_peered":"2024-09-05T12:55:43.728559+0000","last_unstale":"2024-09-05T12:56:05.676247+0000","last_undegraded":"2024-09-05T12:56:05.676247+0000","last_fullsized":"2024-09-05T12:56:05.676247+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:16:53.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819290+0000","last_change":"2024-09-05T12:55:45.748445+0000","last_active":"2024-09-05T12:56:05.819290+0000","last_peered":"2024-09-05T12:56:05.819290+0000","last_clean":"2024-09-05T12:56:05.819290+0000","last_became_active":"2024-09-05T12:55:45.748152+0000","last_became_peered":"2024-09-05T12:55:45.748152+0000","last_unstale":"2024-09-05T12:56:05.819290+0000","last_undegraded":"2024-09-05T12:56:05.819290+0000","last_fullsized":"2024-09-05T12:56:05.819290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:37:35.842555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:43.874703+0000","last_change":"2024-09-05T12:55:43.734607+0000","last_active":"2024-09-05T12:56:43.874703+0000","last_peered":"2024-09-05T12:56:43.874703+0000","last_clean":"2024-09-05T12:56:43.874703+0000","last_became_active":"2024-09-05T12:55:43.734288+0000","last_became_peered":"2024-09-05T12:55:43.734288+0000","last_unstale":"2024-09-05T12:56:43.874703+0000","last_undegraded":"2024-09-05T12:56:43.874703+0000","last_fullsized":"2024-09-05T12:56:43.874703+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:40:40.350335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065590+0000","last_change":"2024-09-05T12:55:45.745622+0000","last_active":"2024-09-05T12:56:05.065590+0000","last_peered":"2024-09-05T12:56:05.065590+0000","last_clean":"2024-09-05T12:56:05.065590+0000","last_became_active":"2024-09-05T12:55:45.745282+0000","last_became_peered":"2024-09-05T12:55:45.745282+0000","last_unstale":"2024-09-05T12:56:05.065590+0000","last_undegraded":"2024-09-05T12:56:05.065590+0000","last_fullsized":"2024-09-05T12:56:05.065590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:50:19.657275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676337+0000","last_change":"2024-09-05T12:55:43.723985+0000","last_active":"2024-09-05T12:56:05.676337+0000","last_peered":"2024-09-05T12:56:05.676337+0000","last_clean":"2024-09-05T12:56:05.676337+0000","last_became_active":"2024-09-05T12:55:43.723651+0000","last_became_peered":"2024-09-05T12:55:43.723651+0000","last_unstale":"2024-09-05T12:56:05.676337+0000","last_undegraded":"2024-09-05T12:56:05.676337+0000","last_fullsized":"2024-09-05T12:56:05.676337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:10:45.723258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062115+0000","last_change":"2024-09-05T12:55:45.738603+0000","last_active":"2024-09-05T12:56:05.062115+0000","last_peered":"2024-09-05T12:56:05.062115+0000","last_clean":"2024-09-05T12:56:05.062115+0000","last_became_active":"2024-09-05T12:55:45.738299+0000","last_became_peered":"2024-09-05T12:55:45.738299+0000","last_unstale":"2024-09-05T12:56:05.062115+0000","last_undegraded":"2024-09-05T12:56:05.062115+0000","last_fullsized":"2024-09-05T12:56:05.062115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:05:28.174555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061144+0000","last_change":"2024-09-05T12:55:43.734587+0000","last_active":"2024-09-05T12:56:05.061144+0000","last_peered":"2024-09-05T12:56:05.061144+0000","last_clean":"2024-09-05T12:56:05.061144+0000","last_became_active":"2024-09-05T12:55:43.734260+0000","last_became_peered":"2024-09-05T12:55:43.734260+0000","last_unstale":"2024-09-05T12:56:05.061144+0000","last_undegraded":"2024-09-05T12:56:05.061144+0000","last_fullsized":"2024-09-05T12:56:05.061144+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:37:00.235234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062195+0000","last_change":"2024-09-05T12:55:45.740516+0000","last_active":"2024-09-05T12:56:05.062195+0000","last_peered":"2024-09-05T12:56:05.062195+0000","last_clean":"2024-09-05T12:56:05.062195+0000","last_became_active":"2024-09-05T12:55:45.740227+0000","last_became_peered":"2024-09-05T12:55:45.740227+0000","last_unstale":"2024-09-05T12:56:05.062195+0000","last_undegraded":"2024-09-05T12:56:05.062195+0000","last_fullsized":"2024-09-05T12:56:05.062195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:34:44.922326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061647+0000","last_change":"2024-09-05T12:55:43.734592+0000","last_active":"2024-09-05T12:56:05.061647+0000","last_peered":"2024-09-05T12:56:05.061647+0000","last_clean":"2024-09-05T12:56:05.061647+0000","last_became_active":"2024-09-05T12:55:43.734243+0000","last_became_peered":"2024-09-05T12:55:43.734243+0000","last_unstale":"2024-09-05T12:56:05.061647+0000","last_undegraded":"2024-09-05T12:56:05.061647+0000","last_fullsized":"2024-09-05T12:56:05.061647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:14.368806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819567+0000","last_change":"2024-09-05T12:55:45.748201+0000","last_active":"2024-09-05T12:56:05.819567+0000","last_peered":"2024-09-05T12:56:05.819567+0000","last_clean":"2024-09-05T12:56:05.819567+0000","last_became_active":"2024-09-05T12:55:45.747906+0000","last_became_peered":"2024-09-05T12:55:45.747906+0000","last_unstale":"2024-09-05T12:56:05.819567+0000","last_undegraded":"2024-09-05T12:56:05.819567+0000","last_fullsized":"2024-09-05T12:56:05.819567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:07.984589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:09.748332+0000","last_change":"2024-09-05T12:56:05.071328+0000","last_active":"2024-09-05T12:56:09.748332+0000","last_peered":"2024-09-05T12:56:09.748332+0000","last_clean":"2024-09-05T12:56:09.748332+0000","last_became_active":"2024-09-05T12:56:05.064345+0000","last_became_peered":"2024-09-05T12:56:05.064345+0000","last_unstale":"2024-09-05T12:56:09.748332+0000","last_undegraded":"2024-09-05T12:56:09.748332+0000","last_fullsized":"2024-09-05T12:56:09.748332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:30:31.850824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061601+0000","last_change":"2024-09-05T12:55:45.743225+0000","last_active":"2024-09-05T12:56:05.061601+0000","last_peered":"2024-09-05T12:56:05.061601+0000","last_clean":"2024-09-05T12:56:05.061601+0000","last_became_active":"2024-09-05T12:55:45.742923+0000","last_became_peered":"2024-09-05T12:55:45.742923+0000","last_unstale":"2024-09-05T12:56:05.061601+0000","last_undegraded":"2024-09-05T12:56:05.061601+0000","last_fullsized":"2024-09-05T12:56:05.061601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:50:09.056893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.202275+0000","last_change":"2024-09-05T12:55:43.723420+0000","last_active":"2024-09-05T12:56:05.202275+0000","last_peered":"2024-09-05T12:56:05.202275+0000","last_clean":"2024-09-05T12:56:05.202275+0000","last_became_active":"2024-09-05T12:55:43.723100+0000","last_became_peered":"2024-09-05T12:55:43.723100+0000","last_unstale":"2024-09-05T12:56:05.202275+0000","last_undegraded":"2024-09-05T12:56:05.202275+0000","last_fullsized":"2024-09-05T12:56:05.202275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:21:33.307826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.678039+0000","last_change":"2024-09-05T12:56:05.678039+0000","last_active":"2024-09-05T12:56:05.678039+0000","last_peered":"2024-09-05T12:56:05.678039+0000","last_clean":"2024-09-05T12:56:05.678039+0000","last_became_active":"2024-09-05T12:56:05.677749+0000","last_became_peered":"2024-09-05T12:56:05.677749+0000","last_unstale":"2024-09-05T12:56:05.678039+0000","last_undegraded":"2024-09-05T12:56:05.678039+0000","last_fullsized":"2024-09-05T12:56:05.678039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:47:12.770873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851620+0000","last_change":"2024-09-05T12:55:43.736075+0000","last_active":"2024-09-05T12:56:05.851620+0000","last_peered":"2024-09-05T12:56:05.851620+0000","last_clean":"2024-09-05T12:56:05.851620+0000","last_became_active":"2024-09-05T12:55:43.735808+0000","last_became_peered":"2024-09-05T12:55:43.735808+0000","last_unstale":"2024-09-05T12:56:05.851620+0000","last_undegraded":"2024-09-05T12:56:05.851620+0000","last_fullsized":"2024-09-05T12:56:05.851620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:52:25.842728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061815+0000","last_change":"2024-09-05T12:55:45.747180+0000","last_active":"2024-09-05T12:56:05.061815+0000","last_peered":"2024-09-05T12:56:05.061815+0000","last_clean":"2024-09-05T12:56:05.061815+0000","last_became_active":"2024-09-05T12:55:45.746297+0000","last_became_peered":"2024-09-05T12:55:45.746297+0000","last_unstale":"2024-09-05T12:56:05.061815+0000","last_undegraded":"2024-09-05T12:56:05.061815+0000","last_fullsized":"2024-09-05T12:56:05.061815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:24:33.657861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060711+0000","last_change":"2024-09-05T12:55:43.720054+0000","last_active":"2024-09-05T12:56:05.060711+0000","last_peered":"2024-09-05T12:56:05.060711+0000","last_clean":"2024-09-05T12:56:05.060711+0000","last_became_active":"2024-09-05T12:55:43.719762+0000","last_became_peered":"2024-09-05T12:55:43.719762+0000","last_unstale":"2024-09-05T12:56:05.060711+0000","last_undegraded":"2024-09-05T12:56:05.060711+0000","last_fullsized":"2024-09-05T12:56:05.060711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:07:57.623333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059189+0000","last_change":"2024-09-05T12:55:45.756031+0000","last_active":"2024-09-05T12:56:05.059189+0000","last_peered":"2024-09-05T12:56:05.059189+0000","last_clean":"2024-09-05T12:56:05.059189+0000","last_became_active":"2024-09-05T12:55:45.755723+0000","last_became_peered":"2024-09-05T12:55:45.755723+0000","last_unstale":"2024-09-05T12:56:05.059189+0000","last_undegraded":"2024-09-05T12:56:05.059189+0000","last_fullsized":"2024-09-05T12:56:05.059189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:26.760307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.069746+0000","last_change":"2024-09-05T12:56:05.069208+0000","last_active":"2024-09-05T12:56:05.069746+0000","last_peered":"2024-09-05T12:56:05.069746+0000","last_clean":"2024-09-05T12:56:05.069746+0000","last_became_active":"2024-09-05T12:56:05.063698+0000","last_became_peered":"2024-09-05T12:56:05.063698+0000","last_unstale":"2024-09-05T12:56:05.069746+0000","last_undegraded":"2024-09-05T12:56:05.069746+0000","last_fullsized":"2024-09-05T12:56:05.069746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:55:54.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061163+0000","last_change":"2024-09-05T12:55:45.743108+0000","last_active":"2024-09-05T12:56:05.061163+0000","last_peered":"2024-09-05T12:56:05.061163+0000","last_clean":"2024-09-05T12:56:05.061163+0000","last_became_active":"2024-09-05T12:55:45.742197+0000","last_became_peered":"2024-09-05T12:55:45.742197+0000","last_unstale":"2024-09-05T12:56:05.061163+0000","last_undegraded":"2024-09-05T12:56:05.061163+0000","last_fullsized":"2024-09-05T12:56:05.061163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:13:15.192298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061447+0000","last_change":"2024-09-05T12:55:43.725893+0000","last_active":"2024-09-05T12:56:05.061447+0000","last_peered":"2024-09-05T12:56:05.061447+0000","last_clean":"2024-09-05T12:56:05.061447+0000","last_became_active":"2024-09-05T12:55:43.725578+0000","last_became_peered":"2024-09-05T12:55:43.725578+0000","last_unstale":"2024-09-05T12:56:05.061447+0000","last_undegraded":"2024-09-05T12:56:05.061447+0000","last_fullsized":"2024-09-05T12:56:05.061447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:39.101167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676363+0000","last_change":"2024-09-05T12:55:45.746727+0000","last_active":"2024-09-05T12:56:05.676363+0000","last_peered":"2024-09-05T12:56:05.676363+0000","last_clean":"2024-09-05T12:56:05.676363+0000","last_became_active":"2024-09-05T12:55:45.746446+0000","last_became_peered":"2024-09-05T12:55:45.746446+0000","last_unstale":"2024-09-05T12:56:05.676363+0000","last_undegraded":"2024-09-05T12:56:05.676363+0000","last_fullsized":"2024-09-05T12:56:05.676363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:56:51.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065862+0000","last_change":"2024-09-05T12:55:45.750253+0000","last_active":"2024-09-05T12:56:05.065862+0000","last_peered":"2024-09-05T12:56:05.065862+0000","last_clean":"2024-09-05T12:56:05.065862+0000","last_became_active":"2024-09-05T12:55:45.749911+0000","last_became_peered":"2024-09-05T12:55:45.749911+0000","last_unstale":"2024-09-05T12:56:05.065862+0000","last_undegraded":"2024-09-05T12:56:05.065862+0000","last_fullsized":"2024-09-05T12:56:05.065862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:04:04.164858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061563+0000","last_change":"2024-09-05T12:55:43.728597+0000","last_active":"2024-09-05T12:56:05.061563+0000","last_peered":"2024-09-05T12:56:05.061563+0000","last_clean":"2024-09-05T12:56:05.061563+0000","last_became_active":"2024-09-05T12:55:43.727633+0000","last_became_peered":"2024-09-05T12:55:43.727633+0000","last_unstale":"2024-09-05T12:56:05.061563+0000","last_undegraded":"2024-09-05T12:56:05.061563+0000","last_fullsized":"2024-09-05T12:56:05.061563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:50:04.775603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851671+0000","last_change":"2024-09-05T12:55:45.741539+0000","last_active":"2024-09-05T12:56:05.851671+0000","last_peered":"2024-09-05T12:56:05.851671+0000","last_clean":"2024-09-05T12:56:05.851671+0000","last_became_active":"2024-09-05T12:55:45.741247+0000","last_became_peered":"2024-09-05T12:55:45.741247+0000","last_unstale":"2024-09-05T12:56:05.851671+0000","last_undegraded":"2024-09-05T12:56:05.851671+0000","last_fullsized":"2024-09-05T12:56:05.851671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:57:23.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061516+0000","last_change":"2024-09-05T12:55:43.725085+0000","last_active":"2024-09-05T12:56:05.061516+0000","last_peered":"2024-09-05T12:56:05.061516+0000","last_clean":"2024-09-05T12:56:05.061516+0000","last_became_active":"2024-09-05T12:55:43.724772+0000","last_became_peered":"2024-09-05T12:55:43.724772+0000","last_unstale":"2024-09-05T12:56:05.061516+0000","last_undegraded":"2024-09-05T12:56:05.061516+0000","last_fullsized":"2024-09-05T12:56:05.061516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:48:16.567841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063834+0000","last_change":"2024-09-05T12:55:45.745635+0000","last_active":"2024-09-05T12:56:05.063834+0000","last_peered":"2024-09-05T12:56:05.063834+0000","last_clean":"2024-09-05T12:56:05.063834+0000","last_became_active":"2024-09-05T12:55:45.745331+0000","last_became_peered":"2024-09-05T12:55:45.745331+0000","last_unstale":"2024-09-05T12:56:05.063834+0000","last_undegraded":"2024-09-05T12:56:05.063834+0000","last_fullsized":"2024-09-05T12:56:05.063834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:15:58.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061048+0000","last_change":"2024-09-05T12:55:43.734466+0000","last_active":"2024-09-05T12:56:05.061048+0000","last_peered":"2024-09-05T12:56:05.061048+0000","last_clean":"2024-09-05T12:56:05.061048+0000","last_became_active":"2024-09-05T12:55:43.734147+0000","last_became_peered":"2024-09-05T12:55:43.734147+0000","last_unstale":"2024-09-05T12:56:05.061048+0000","last_undegraded":"2024-09-05T12:56:05.061048+0000","last_fullsized":"2024-09-05T12:56:05.061048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:53:22.588471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060906+0000","last_change":"2024-09-05T12:55:45.746328+0000","last_active":"2024-09-05T12:56:05.060906+0000","last_peered":"2024-09-05T12:56:05.060906+0000","last_clean":"2024-09-05T12:56:05.060906+0000","last_became_active":"2024-09-05T12:55:45.746012+0000","last_became_peered":"2024-09-05T12:55:45.746012+0000","last_unstale":"2024-09-05T12:56:05.060906+0000","last_undegraded":"2024-09-05T12:56:05.060906+0000","last_fullsized":"2024-09-05T12:56:05.060906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:23:12.886759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061386+0000","last_change":"2024-09-05T12:55:43.722519+0000","last_active":"2024-09-05T12:56:05.061386+0000","last_peered":"2024-09-05T12:56:05.061386+0000","last_clean":"2024-09-05T12:56:05.061386+0000","last_became_active":"2024-09-05T12:55:43.722220+0000","last_became_peered":"2024-09-05T12:55:43.722220+0000","last_unstale":"2024-09-05T12:56:05.061386+0000","last_undegraded":"2024-09-05T12:56:05.061386+0000","last_fullsized":"2024-09-05T12:56:05.061386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:15.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":342,"num_read_kb":239,"num_write":161,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281587,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645338,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":425477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874272,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":1076722,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":425713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234026,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":1017565,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":425102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855416,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1017249,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018941,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":425539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":425413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":486402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":484659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":426373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T12:56:50.986 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T12:56:51.266 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:51.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:51 smithi162 ceph-mon[34220]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:51.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:51 smithi169 ceph-mon[34823]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:51.387 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:51 smithi073 ceph-mon[30883]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.743+0000 7ff8da22a640 1 -- 172.21.15.73:0/2616309753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d4101de0 msgr2=0x7ff8d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.743+0000 7ff8da22a640 1 --2- 172.21.15.73:0/2616309753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d4101de0 0x7ff8d41021c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009900 tx=0x7ff8c402a410 comp rx=0 tx=0).stop 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.743+0000 7ff8da22a640 1 -- 172.21.15.73:0/2616309753 shutdown_connections 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.743+0000 7ff8da22a640 1 --2- 172.21.15.73:0/2616309753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8d4106f10 0x7ff8d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.743+0000 7ff8da22a640 1 --2- 172.21.15.73:0/2616309753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d4102790 0x7ff8d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.743+0000 7ff8da22a640 1 --2- 172.21.15.73:0/2616309753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d4101de0 0x7ff8d41021c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.743+0000 7ff8da22a640 1 -- 172.21.15.73:0/2616309753 >> 172.21.15.73:0/2616309753 conn(0x7ff8d40fd8c0 msgr2=0x7ff8d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.743+0000 7ff8da22a640 1 -- 172.21.15.73:0/2616309753 shutdown_connections 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.743+0000 7ff8da22a640 1 -- 172.21.15.73:0/2616309753 wait complete. 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8da22a640 1 Processor -- start 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8da22a640 1 -- start start 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8da22a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d4101de0 0x7ff8d4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8da22a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8d4102790 0x7ff8d4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8da22a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d4106f10 0x7ff8d419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8da22a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d4111f30 con 0x7ff8d4101de0 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8da22a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d4111db0 con 0x7ff8d4102790 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8da22a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d41120b0 con 0x7ff8d4106f10 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8d37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d4101de0 0x7ff8d4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8d37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d4101de0 0x7ff8d4198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55200/0 (socket says 172.21.15.73:55200) 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8d37fe640 1 -- 172.21.15.73:0/3459073972 learned_addr learned my addr 172.21.15.73:0/3459073972 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8d4102790 0x7ff8d4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.744+0000 7ff8d3fff640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d4106f10 0x7ff8d419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8d37fe640 1 -- 172.21.15.73:0/3459073972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d4106f10 msgr2=0x7ff8d419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8d37fe640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d4106f10 0x7ff8d419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8d37fe640 1 -- 172.21.15.73:0/3459073972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8d4102790 msgr2=0x7ff8d4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8d37fe640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8d4102790 0x7ff8d4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8d37fe640 1 -- 172.21.15.73:0/3459073972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d419d4c0 con 0x7ff8d4101de0 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8d37fe640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d4101de0 0x7ff8d4198510 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4006010 tx=0x7ff8c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8d17fa640 1 -- 172.21.15.73:0/3459073972 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c403f030 con 0x7ff8d4101de0 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8d17fa640 1 -- 172.21.15.73:0/3459073972 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8c4003ce0 con 0x7ff8d4101de0 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8da22a640 1 -- 172.21.15.73:0/3459073972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d419d750 con 0x7ff8d4101de0 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8d17fa640 1 -- 172.21.15.73:0/3459073972 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4035070 con 0x7ff8d4101de0 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.745+0000 7ff8da22a640 1 -- 172.21.15.73:0/3459073972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d41a5090 con 0x7ff8d4101de0 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.746+0000 7ff8da22a640 1 -- 172.21.15.73:0/3459073972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d41032c0 con 0x7ff8d4101de0 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.747+0000 7ff8d17fa640 1 -- 172.21.15.73:0/3459073972 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff8c4042030 con 0x7ff8d4101de0 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.748+0000 7ff8d17fa640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8c00a2c10 0x7ff8c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:51.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.748+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8c00a2c10 0x7ff8c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:51.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.748+0000 7ff8d17fa640 1 -- 172.21.15.73:0/3459073972 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ff8c40ef7d0 con 0x7ff8d4101de0 2024-09-05T12:56:51.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.748+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8c00a2c10 0x7ff8c00a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff8d41087b0 tx=0x7ff8bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:51.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.754+0000 7ff8d17fa640 1 -- 172.21.15.73:0/3459073972 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8c40bc6c0 con 0x7ff8d4101de0 2024-09-05T12:56:51.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.920+0000 7ff8da22a640 1 -- 172.21.15.73:0/3459073972 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8d4062630 con 0x7ff8c00a2c10 2024-09-05T12:56:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.926+0000 7ff8d17fa640 1 -- 172.21.15.73:0/3459073972 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258871 (secure 0 0 0) 0x7ff8d4062630 con 0x7ff8c00a2c10 2024-09-05T12:56:51.929 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:51.930 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-05T12:56:51.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.929+0000 7ff8da22a640 1 -- 172.21.15.73:0/3459073972 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8c00a2c10 msgr2=0x7ff8c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.929+0000 7ff8da22a640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8c00a2c10 0x7ff8c00a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff8d41087b0 tx=0x7ff8bc00b390 comp rx=0 tx=0).stop 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.929+0000 7ff8da22a640 1 -- 172.21.15.73:0/3459073972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d4101de0 msgr2=0x7ff8d4198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.929+0000 7ff8da22a640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d4101de0 0x7ff8d4198510 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4006010 tx=0x7ff8c40042f0 comp rx=0 tx=0).stop 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.929+0000 7ff8da22a640 1 -- 172.21.15.73:0/3459073972 shutdown_connections 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.929+0000 7ff8da22a640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8c00a2c10 0x7ff8c00a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.929+0000 7ff8da22a640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d4106f10 0x7ff8d419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.929+0000 7ff8da22a640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8d4102790 0x7ff8d4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.929+0000 7ff8da22a640 1 --2- 172.21.15.73:0/3459073972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d4101de0 0x7ff8d4198510 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.929+0000 7ff8da22a640 1 -- 172.21.15.73:0/3459073972 >> 172.21.15.73:0/3459073972 conn(0x7ff8d40fd8c0 msgr2=0x7ff8d40fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.930+0000 7ff8da22a640 1 -- 172.21.15.73:0/3459073972 shutdown_connections 2024-09-05T12:56:51.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:51.930+0000 7ff8da22a640 1 -- 172.21.15.73:0/3459073972 wait complete. 2024-09-05T12:56:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:52 smithi073 ceph-mon[30883]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:56:52.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:56:52.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:52.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:52 smithi162 ceph-mon[34220]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:52.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:52.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:52.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:56:52.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:56:52.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:52.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:52 smithi169 ceph-mon[34823]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:52.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:52.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:52.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:56:52.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:56:52.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:56:52.661 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-05T12:56:49.988764+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":468,"num_read_kb":348,"num_write":344,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351664,"kb_used_data":10704,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590160,"statfs":{"total":1151940427776,"available":1151580323840,"internally_reserved":0,"allocated":10960896,"data_stored":7061847,"data_compressed":107439,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002771"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059332+0000","last_change":"2024-09-05T12:55:45.753801+0000","last_active":"2024-09-05T12:56:05.059332+0000","last_peered":"2024-09-05T12:56:05.059332+0000","last_clean":"2024-09-05T12:56:05.059332+0000","last_became_active":"2024-09-05T12:55:45.753480+0000","last_became_peered":"2024-09-05T12:55:45.753480+0000","last_unstale":"2024-09-05T12:56:05.059332+0000","last_undegraded":"2024-09-05T12:56:05.059332+0000","last_fullsized":"2024-09-05T12:56:05.059332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:34.806083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063464+0000","last_change":"2024-09-05T12:55:45.744629+0000","last_active":"2024-09-05T12:56:05.063464+0000","last_peered":"2024-09-05T12:56:05.063464+0000","last_clean":"2024-09-05T12:56:05.063464+0000","last_became_active":"2024-09-05T12:55:45.744311+0000","last_became_peered":"2024-09-05T12:55:45.744311+0000","last_unstale":"2024-09-05T12:56:05.063464+0000","last_undegraded":"2024-09-05T12:56:05.063464+0000","last_fullsized":"2024-09-05T12:56:05.063464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:08:57.032929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063504+0000","last_change":"2024-09-05T12:55:45.745128+0000","last_active":"2024-09-05T12:56:05.063504+0000","last_peered":"2024-09-05T12:56:05.063504+0000","last_clean":"2024-09-05T12:56:05.063504+0000","last_became_active":"2024-09-05T12:55:45.744799+0000","last_became_peered":"2024-09-05T12:55:45.744799+0000","last_unstale":"2024-09-05T12:56:05.063504+0000","last_undegraded":"2024-09-05T12:56:05.063504+0000","last_fullsized":"2024-09-05T12:56:05.063504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:35:48.528336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201949+0000","last_change":"2024-09-05T12:55:45.749471+0000","last_active":"2024-09-05T12:56:05.201949+0000","last_peered":"2024-09-05T12:56:05.201949+0000","last_clean":"2024-09-05T12:56:05.201949+0000","last_became_active":"2024-09-05T12:55:45.749126+0000","last_became_peered":"2024-09-05T12:55:45.749126+0000","last_unstale":"2024-09-05T12:56:05.201949+0000","last_undegraded":"2024-09-05T12:56:05.201949+0000","last_fullsized":"2024-09-05T12:56:05.201949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:36.152934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061325+0000","last_change":"2024-09-05T12:55:45.741243+0000","last_active":"2024-09-05T12:56:05.061325+0000","last_peered":"2024-09-05T12:56:05.061325+0000","last_clean":"2024-09-05T12:56:05.061325+0000","last_became_active":"2024-09-05T12:55:45.740849+0000","last_became_peered":"2024-09-05T12:55:45.740849+0000","last_unstale":"2024-09-05T12:56:05.061325+0000","last_undegraded":"2024-09-05T12:56:05.061325+0000","last_fullsized":"2024-09-05T12:56:05.061325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:01.323875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061912+0000","last_change":"2024-09-05T12:55:45.744599+0000","last_active":"2024-09-05T12:56:05.061912+0000","last_peered":"2024-09-05T12:56:05.061912+0000","last_clean":"2024-09-05T12:56:05.061912+0000","last_became_active":"2024-09-05T12:55:45.744304+0000","last_became_peered":"2024-09-05T12:55:45.744304+0000","last_unstale":"2024-09-05T12:56:05.061912+0000","last_undegraded":"2024-09-05T12:56:05.061912+0000","last_fullsized":"2024-09-05T12:56:05.061912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:15:55.340505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676096+0000","last_change":"2024-09-05T12:55:45.744802+0000","last_active":"2024-09-05T12:56:05.676096+0000","last_peered":"2024-09-05T12:56:05.676096+0000","last_clean":"2024-09-05T12:56:05.676096+0000","last_became_active":"2024-09-05T12:55:45.744525+0000","last_became_peered":"2024-09-05T12:55:45.744525+0000","last_unstale":"2024-09-05T12:56:05.676096+0000","last_undegraded":"2024-09-05T12:56:05.676096+0000","last_fullsized":"2024-09-05T12:56:05.676096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:03:04.047389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060470+0000","last_change":"2024-09-05T12:55:45.742141+0000","last_active":"2024-09-05T12:56:05.060470+0000","last_peered":"2024-09-05T12:56:05.060470+0000","last_clean":"2024-09-05T12:56:05.060470+0000","last_became_active":"2024-09-05T12:55:45.741445+0000","last_became_peered":"2024-09-05T12:55:45.741445+0000","last_unstale":"2024-09-05T12:56:05.060470+0000","last_undegraded":"2024-09-05T12:56:05.060470+0000","last_fullsized":"2024-09-05T12:56:05.060470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:38:28.859589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.852099+0000","last_change":"2024-09-05T12:55:45.747321+0000","last_active":"2024-09-05T12:56:05.852099+0000","last_peered":"2024-09-05T12:56:05.852099+0000","last_clean":"2024-09-05T12:56:05.852099+0000","last_became_active":"2024-09-05T12:55:45.747013+0000","last_became_peered":"2024-09-05T12:55:45.747013+0000","last_unstale":"2024-09-05T12:56:05.852099+0000","last_undegraded":"2024-09-05T12:56:05.852099+0000","last_fullsized":"2024-09-05T12:56:05.852099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:42:00.402789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064498+0000","last_change":"2024-09-05T12:56:05.064498+0000","last_active":"2024-09-05T12:56:05.064498+0000","last_peered":"2024-09-05T12:56:05.064498+0000","last_clean":"2024-09-05T12:56:05.064498+0000","last_became_active":"2024-09-05T12:56:05.064200+0000","last_became_peered":"2024-09-05T12:56:05.064200+0000","last_unstale":"2024-09-05T12:56:05.064498+0000","last_undegraded":"2024-09-05T12:56:05.064498+0000","last_fullsized":"2024-09-05T12:56:05.064498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:37:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676376+0000","last_change":"2024-09-05T12:55:45.748372+0000","last_active":"2024-09-05T12:56:05.676376+0000","last_peered":"2024-09-05T12:56:05.676376+0000","last_clean":"2024-09-05T12:56:05.676376+0000","last_became_active":"2024-09-05T12:55:45.748093+0000","last_became_peered":"2024-09-05T12:55:45.748093+0000","last_unstale":"2024-09-05T12:56:05.676376+0000","last_undegraded":"2024-09-05T12:56:05.676376+0000","last_fullsized":"2024-09-05T12:56:05.676376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:32:25.938128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201978+0000","last_change":"2024-09-05T12:55:45.749433+0000","last_active":"2024-09-05T12:56:05.201978+0000","last_peered":"2024-09-05T12:56:05.201978+0000","last_clean":"2024-09-05T12:56:05.201978+0000","last_became_active":"2024-09-05T12:55:45.748677+0000","last_became_peered":"2024-09-05T12:55:45.748677+0000","last_unstale":"2024-09-05T12:56:05.201978+0000","last_undegraded":"2024-09-05T12:56:05.201978+0000","last_fullsized":"2024-09-05T12:56:05.201978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:27:57.896752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819602+0000","last_change":"2024-09-05T12:55:45.743212+0000","last_active":"2024-09-05T12:56:05.819602+0000","last_peered":"2024-09-05T12:56:05.819602+0000","last_clean":"2024-09-05T12:56:05.819602+0000","last_became_active":"2024-09-05T12:55:45.742918+0000","last_became_peered":"2024-09-05T12:55:45.742918+0000","last_unstale":"2024-09-05T12:56:05.819602+0000","last_undegraded":"2024-09-05T12:56:05.819602+0000","last_fullsized":"2024-09-05T12:56:05.819602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:21:18.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063680+0000","last_change":"2024-09-05T12:55:45.745058+0000","last_active":"2024-09-05T12:56:05.063680+0000","last_peered":"2024-09-05T12:56:05.063680+0000","last_clean":"2024-09-05T12:56:05.063680+0000","last_became_active":"2024-09-05T12:55:45.744349+0000","last_became_peered":"2024-09-05T12:55:45.744349+0000","last_unstale":"2024-09-05T12:56:05.063680+0000","last_undegraded":"2024-09-05T12:56:05.063680+0000","last_fullsized":"2024-09-05T12:56:05.063680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:26:21.034864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063126+0000","last_change":"2024-09-05T12:55:45.748387+0000","last_active":"2024-09-05T12:56:05.063126+0000","last_peered":"2024-09-05T12:56:05.063126+0000","last_clean":"2024-09-05T12:56:05.063126+0000","last_became_active":"2024-09-05T12:55:45.748082+0000","last_became_peered":"2024-09-05T12:55:45.748082+0000","last_unstale":"2024-09-05T12:56:05.063126+0000","last_undegraded":"2024-09-05T12:56:05.063126+0000","last_fullsized":"2024-09-05T12:56:05.063126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:51:23.835278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851526+0000","last_change":"2024-09-05T12:55:45.742195+0000","last_active":"2024-09-05T12:56:05.851526+0000","last_peered":"2024-09-05T12:56:05.851526+0000","last_clean":"2024-09-05T12:56:05.851526+0000","last_became_active":"2024-09-05T12:55:45.741888+0000","last_became_peered":"2024-09-05T12:55:45.741888+0000","last_unstale":"2024-09-05T12:56:05.851526+0000","last_undegraded":"2024-09-05T12:56:05.851526+0000","last_fullsized":"2024-09-05T12:56:05.851526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:19:17.556164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059394+0000","last_change":"2024-09-05T12:55:45.755255+0000","last_active":"2024-09-05T12:56:05.059394+0000","last_peered":"2024-09-05T12:56:05.059394+0000","last_clean":"2024-09-05T12:56:05.059394+0000","last_became_active":"2024-09-05T12:55:45.754939+0000","last_became_peered":"2024-09-05T12:55:45.754939+0000","last_unstale":"2024-09-05T12:56:05.059394+0000","last_undegraded":"2024-09-05T12:56:05.059394+0000","last_fullsized":"2024-09-05T12:56:05.059394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:48:34.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061596+0000","last_change":"2024-09-05T12:55:45.745496+0000","last_active":"2024-09-05T12:56:05.061596+0000","last_peered":"2024-09-05T12:56:05.061596+0000","last_clean":"2024-09-05T12:56:05.061596+0000","last_became_active":"2024-09-05T12:55:45.745153+0000","last_became_peered":"2024-09-05T12:55:45.745153+0000","last_unstale":"2024-09-05T12:56:05.061596+0000","last_undegraded":"2024-09-05T12:56:05.061596+0000","last_fullsized":"2024-09-05T12:56:05.061596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:16:52.255227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062235+0000","last_change":"2024-09-05T12:55:45.747353+0000","last_active":"2024-09-05T12:56:05.062235+0000","last_peered":"2024-09-05T12:56:05.062235+0000","last_clean":"2024-09-05T12:56:05.062235+0000","last_became_active":"2024-09-05T12:55:45.747018+0000","last_became_peered":"2024-09-05T12:55:45.747018+0000","last_unstale":"2024-09-05T12:56:05.062235+0000","last_undegraded":"2024-09-05T12:56:05.062235+0000","last_fullsized":"2024-09-05T12:56:05.062235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:12:25.217057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059013+0000","last_change":"2024-09-05T12:55:45.754023+0000","last_active":"2024-09-05T12:56:05.059013+0000","last_peered":"2024-09-05T12:56:05.059013+0000","last_clean":"2024-09-05T12:56:05.059013+0000","last_became_active":"2024-09-05T12:55:45.753723+0000","last_became_peered":"2024-09-05T12:55:45.753723+0000","last_unstale":"2024-09-05T12:56:05.059013+0000","last_undegraded":"2024-09-05T12:56:05.059013+0000","last_fullsized":"2024-09-05T12:56:05.059013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:16:01.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819690+0000","last_change":"2024-09-05T12:55:45.742627+0000","last_active":"2024-09-05T12:56:05.819690+0000","last_peered":"2024-09-05T12:56:05.819690+0000","last_clean":"2024-09-05T12:56:05.819690+0000","last_became_active":"2024-09-05T12:55:45.742252+0000","last_became_peered":"2024-09-05T12:55:45.742252+0000","last_unstale":"2024-09-05T12:56:05.819690+0000","last_undegraded":"2024-09-05T12:56:05.819690+0000","last_fullsized":"2024-09-05T12:56:05.819690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:14:34.476156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851781+0000","last_change":"2024-09-05T12:55:45.743587+0000","last_active":"2024-09-05T12:56:05.851781+0000","last_peered":"2024-09-05T12:56:05.851781+0000","last_clean":"2024-09-05T12:56:05.851781+0000","last_became_active":"2024-09-05T12:55:45.742624+0000","last_became_peered":"2024-09-05T12:55:45.742624+0000","last_unstale":"2024-09-05T12:56:05.851781+0000","last_undegraded":"2024-09-05T12:56:05.851781+0000","last_fullsized":"2024-09-05T12:56:05.851781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:15.981929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060563+0000","last_change":"2024-09-05T12:55:45.747430+0000","last_active":"2024-09-05T12:56:05.060563+0000","last_peered":"2024-09-05T12:56:05.060563+0000","last_clean":"2024-09-05T12:56:05.060563+0000","last_became_active":"2024-09-05T12:55:45.747049+0000","last_became_peered":"2024-09-05T12:55:45.747049+0000","last_unstale":"2024-09-05T12:56:05.060563+0000","last_undegraded":"2024-09-05T12:56:05.060563+0000","last_fullsized":"2024-09-05T12:56:05.060563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:31:08.388375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065470+0000","last_change":"2024-09-05T12:55:45.741645+0000","last_active":"2024-09-05T12:56:05.065470+0000","last_peered":"2024-09-05T12:56:05.065470+0000","last_clean":"2024-09-05T12:56:05.065470+0000","last_became_active":"2024-09-05T12:55:45.741341+0000","last_became_peered":"2024-09-05T12:55:45.741341+0000","last_unstale":"2024-09-05T12:56:05.065470+0000","last_undegraded":"2024-09-05T12:56:05.065470+0000","last_fullsized":"2024-09-05T12:56:05.065470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:24:11.896491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061589+0000","last_change":"2024-09-05T12:55:45.747609+0000","last_active":"2024-09-05T12:56:05.061589+0000","last_peered":"2024-09-05T12:56:05.061589+0000","last_clean":"2024-09-05T12:56:05.061589+0000","last_became_active":"2024-09-05T12:55:45.745899+0000","last_became_peered":"2024-09-05T12:55:45.745899+0000","last_unstale":"2024-09-05T12:56:05.061589+0000","last_undegraded":"2024-09-05T12:56:05.061589+0000","last_fullsized":"2024-09-05T12:56:05.061589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:21:42.224663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061958+0000","last_change":"2024-09-05T12:55:45.744974+0000","last_active":"2024-09-05T12:56:05.061958+0000","last_peered":"2024-09-05T12:56:05.061958+0000","last_clean":"2024-09-05T12:56:05.061958+0000","last_became_active":"2024-09-05T12:55:45.744538+0000","last_became_peered":"2024-09-05T12:55:45.744538+0000","last_unstale":"2024-09-05T12:56:05.061958+0000","last_undegraded":"2024-09-05T12:56:05.061958+0000","last_fullsized":"2024-09-05T12:56:05.061958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:48:46.695178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064626+0000","last_change":"2024-09-05T12:56:05.064626+0000","last_active":"2024-09-05T12:56:05.064626+0000","last_peered":"2024-09-05T12:56:05.064626+0000","last_clean":"2024-09-05T12:56:05.064626+0000","last_became_active":"2024-09-05T12:56:05.063972+0000","last_became_peered":"2024-09-05T12:56:05.063972+0000","last_unstale":"2024-09-05T12:56:05.064626+0000","last_undegraded":"2024-09-05T12:56:05.064626+0000","last_fullsized":"2024-09-05T12:56:05.064626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:57.345008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819769+0000","last_change":"2024-09-05T12:55:45.753630+0000","last_active":"2024-09-05T12:56:05.819769+0000","last_peered":"2024-09-05T12:56:05.819769+0000","last_clean":"2024-09-05T12:56:05.819769+0000","last_became_active":"2024-09-05T12:55:45.753328+0000","last_became_peered":"2024-09-05T12:55:45.753328+0000","last_unstale":"2024-09-05T12:56:05.819769+0000","last_undegraded":"2024-09-05T12:56:05.819769+0000","last_fullsized":"2024-09-05T12:56:05.819769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:55:39.064374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063372+0000","last_change":"2024-09-05T12:55:45.749596+0000","last_active":"2024-09-05T12:56:05.063372+0000","last_peered":"2024-09-05T12:56:05.063372+0000","last_clean":"2024-09-05T12:56:05.063372+0000","last_became_active":"2024-09-05T12:55:45.749150+0000","last_became_peered":"2024-09-05T12:55:45.749150+0000","last_unstale":"2024-09-05T12:56:05.063372+0000","last_undegraded":"2024-09-05T12:56:05.063372+0000","last_fullsized":"2024-09-05T12:56:05.063372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:14:06.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062144+0000","last_change":"2024-09-05T12:55:45.748414+0000","last_active":"2024-09-05T12:56:05.062144+0000","last_peered":"2024-09-05T12:56:05.062144+0000","last_clean":"2024-09-05T12:56:05.062144+0000","last_became_active":"2024-09-05T12:55:45.747952+0000","last_became_peered":"2024-09-05T12:55:45.747952+0000","last_unstale":"2024-09-05T12:56:05.062144+0000","last_undegraded":"2024-09-05T12:56:05.062144+0000","last_fullsized":"2024-09-05T12:56:05.062144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:45:04.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061467+0000","last_change":"2024-09-05T12:55:45.754145+0000","last_active":"2024-09-05T12:56:05.061467+0000","last_peered":"2024-09-05T12:56:05.061467+0000","last_clean":"2024-09-05T12:56:05.061467+0000","last_became_active":"2024-09-05T12:55:45.753833+0000","last_became_peered":"2024-09-05T12:55:45.753833+0000","last_unstale":"2024-09-05T12:56:05.061467+0000","last_undegraded":"2024-09-05T12:56:05.061467+0000","last_fullsized":"2024-09-05T12:56:05.061467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:45:24.606506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.058922+0000","last_change":"2024-09-05T12:55:45.750283+0000","last_active":"2024-09-05T12:56:05.058922+0000","last_peered":"2024-09-05T12:56:05.058922+0000","last_clean":"2024-09-05T12:56:05.058922+0000","last_became_active":"2024-09-05T12:55:45.749901+0000","last_became_peered":"2024-09-05T12:55:45.749901+0000","last_unstale":"2024-09-05T12:56:05.058922+0000","last_undegraded":"2024-09-05T12:56:05.058922+0000","last_fullsized":"2024-09-05T12:56:05.058922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:45:57.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061784+0000","last_change":"2024-09-05T12:55:45.743239+0000","last_active":"2024-09-05T12:56:05.061784+0000","last_peered":"2024-09-05T12:56:05.061784+0000","last_clean":"2024-09-05T12:56:05.061784+0000","last_became_active":"2024-09-05T12:55:45.742926+0000","last_became_peered":"2024-09-05T12:55:45.742926+0000","last_unstale":"2024-09-05T12:56:05.061784+0000","last_undegraded":"2024-09-05T12:56:05.061784+0000","last_fullsized":"2024-09-05T12:56:05.061784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:26:05.559405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:44.877221+0000","last_change":"2024-09-05T12:55:43.727301+0000","last_active":"2024-09-05T12:56:44.877221+0000","last_peered":"2024-09-05T12:56:44.877221+0000","last_clean":"2024-09-05T12:56:44.877221+0000","last_became_active":"2024-09-05T12:55:43.727006+0000","last_became_peered":"2024-09-05T12:55:43.727006+0000","last_unstale":"2024-09-05T12:56:44.877221+0000","last_undegraded":"2024-09-05T12:56:44.877221+0000","last_fullsized":"2024-09-05T12:56:44.877221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:54:32.725098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066620+0000","last_change":"2024-09-05T12:55:45.735835+0000","last_active":"2024-09-05T12:56:05.066620+0000","last_peered":"2024-09-05T12:56:05.066620+0000","last_clean":"2024-09-05T12:56:05.066620+0000","last_became_active":"2024-09-05T12:55:45.735404+0000","last_became_peered":"2024-09-05T12:55:45.735404+0000","last_unstale":"2024-09-05T12:56:05.066620+0000","last_undegraded":"2024-09-05T12:56:05.066620+0000","last_fullsized":"2024-09-05T12:56:05.066620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:06:47.174441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062007+0000","last_change":"2024-09-05T12:55:43.724561+0000","last_active":"2024-09-05T12:56:05.062007+0000","last_peered":"2024-09-05T12:56:05.062007+0000","last_clean":"2024-09-05T12:56:05.062007+0000","last_became_active":"2024-09-05T12:55:43.722704+0000","last_became_peered":"2024-09-05T12:55:43.722704+0000","last_unstale":"2024-09-05T12:56:05.062007+0000","last_undegraded":"2024-09-05T12:56:05.062007+0000","last_fullsized":"2024-09-05T12:56:05.062007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:20:20.692844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819297+0000","last_change":"2024-09-05T12:55:43.722937+0000","last_active":"2024-09-05T12:56:05.819297+0000","last_peered":"2024-09-05T12:56:05.819297+0000","last_clean":"2024-09-05T12:56:05.819297+0000","last_became_active":"2024-09-05T12:55:43.722606+0000","last_became_peered":"2024-09-05T12:55:43.722606+0000","last_unstale":"2024-09-05T12:56:05.819297+0000","last_undegraded":"2024-09-05T12:56:05.819297+0000","last_fullsized":"2024-09-05T12:56:05.819297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:47:38.448865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.820632+0000","last_change":"2024-09-05T12:56:05.820632+0000","last_active":"2024-09-05T12:56:05.820632+0000","last_peered":"2024-09-05T12:56:05.820632+0000","last_clean":"2024-09-05T12:56:05.820632+0000","last_became_active":"2024-09-05T12:56:05.820239+0000","last_became_peered":"2024-09-05T12:56:05.820239+0000","last_unstale":"2024-09-05T12:56:05.820632+0000","last_undegraded":"2024-09-05T12:56:05.820632+0000","last_fullsized":"2024-09-05T12:56:05.820632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:36:59.659783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065764+0000","last_change":"2024-09-05T12:55:43.725546+0000","last_active":"2024-09-05T12:56:05.065764+0000","last_peered":"2024-09-05T12:56:05.065764+0000","last_clean":"2024-09-05T12:56:05.065764+0000","last_became_active":"2024-09-05T12:55:43.725252+0000","last_became_peered":"2024-09-05T12:55:43.725252+0000","last_unstale":"2024-09-05T12:56:05.065764+0000","last_undegraded":"2024-09-05T12:56:05.065764+0000","last_fullsized":"2024-09-05T12:56:05.065764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:49:16.085799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060968+0000","last_change":"2024-09-05T12:55:45.745358+0000","last_active":"2024-09-05T12:56:05.060968+0000","last_peered":"2024-09-05T12:56:05.060968+0000","last_clean":"2024-09-05T12:56:05.060968+0000","last_became_active":"2024-09-05T12:55:45.745040+0000","last_became_peered":"2024-09-05T12:55:45.745040+0000","last_unstale":"2024-09-05T12:56:05.060968+0000","last_undegraded":"2024-09-05T12:56:05.060968+0000","last_fullsized":"2024-09-05T12:56:05.060968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:42:42.906745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:47.881120+0000","last_change":"2024-09-05T12:55:43.726138+0000","last_active":"2024-09-05T12:56:47.881120+0000","last_peered":"2024-09-05T12:56:47.881120+0000","last_clean":"2024-09-05T12:56:47.881120+0000","last_became_active":"2024-09-05T12:55:43.725815+0000","last_became_peered":"2024-09-05T12:55:43.725815+0000","last_unstale":"2024-09-05T12:56:47.881120+0000","last_undegraded":"2024-09-05T12:56:47.881120+0000","last_fullsized":"2024-09-05T12:56:47.881120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:35:38.041757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851996+0000","last_change":"2024-09-05T12:55:45.743580+0000","last_active":"2024-09-05T12:56:05.851996+0000","last_peered":"2024-09-05T12:56:05.851996+0000","last_clean":"2024-09-05T12:56:05.851996+0000","last_became_active":"2024-09-05T12:55:45.743307+0000","last_became_peered":"2024-09-05T12:55:45.743307+0000","last_unstale":"2024-09-05T12:56:05.851996+0000","last_undegraded":"2024-09-05T12:56:05.851996+0000","last_fullsized":"2024-09-05T12:56:05.851996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:15:13.898218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676632+0000","last_change":"2024-09-05T12:55:43.725373+0000","last_active":"2024-09-05T12:56:05.676632+0000","last_peered":"2024-09-05T12:56:05.676632+0000","last_clean":"2024-09-05T12:56:05.676632+0000","last_became_active":"2024-09-05T12:55:43.725062+0000","last_became_peered":"2024-09-05T12:55:43.725062+0000","last_unstale":"2024-09-05T12:56:05.676632+0000","last_undegraded":"2024-09-05T12:56:05.676632+0000","last_fullsized":"2024-09-05T12:56:05.676632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:42:27.994499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063879+0000","last_change":"2024-09-05T12:55:45.750265+0000","last_active":"2024-09-05T12:56:05.063879+0000","last_peered":"2024-09-05T12:56:05.063879+0000","last_clean":"2024-09-05T12:56:05.063879+0000","last_became_active":"2024-09-05T12:55:45.749928+0000","last_became_peered":"2024-09-05T12:55:45.749928+0000","last_unstale":"2024-09-05T12:56:05.063879+0000","last_undegraded":"2024-09-05T12:56:05.063879+0000","last_fullsized":"2024-09-05T12:56:05.063879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:56:19.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065937+0000","last_change":"2024-09-05T12:55:43.736248+0000","last_active":"2024-09-05T12:56:05.065937+0000","last_peered":"2024-09-05T12:56:05.065937+0000","last_clean":"2024-09-05T12:56:05.065937+0000","last_became_active":"2024-09-05T12:55:43.735928+0000","last_became_peered":"2024-09-05T12:55:43.735928+0000","last_unstale":"2024-09-05T12:56:05.065937+0000","last_undegraded":"2024-09-05T12:56:05.065937+0000","last_fullsized":"2024-09-05T12:56:05.065937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:04:43.215616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851777+0000","last_change":"2024-09-05T12:55:45.739178+0000","last_active":"2024-09-05T12:56:05.851777+0000","last_peered":"2024-09-05T12:56:05.851777+0000","last_clean":"2024-09-05T12:56:05.851777+0000","last_became_active":"2024-09-05T12:55:45.738863+0000","last_became_peered":"2024-09-05T12:55:45.738863+0000","last_unstale":"2024-09-05T12:56:05.851777+0000","last_undegraded":"2024-09-05T12:56:05.851777+0000","last_fullsized":"2024-09-05T12:56:05.851777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:08.273036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":167,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:48.882822+0000","last_change":"2024-09-05T12:55:43.725380+0000","last_active":"2024-09-05T12:56:48.882822+0000","last_peered":"2024-09-05T12:56:48.882822+0000","last_clean":"2024-09-05T12:56:48.882822+0000","last_became_active":"2024-09-05T12:55:43.725000+0000","last_became_peered":"2024-09-05T12:55:43.725000+0000","last_unstale":"2024-09-05T12:56:48.882822+0000","last_undegraded":"2024-09-05T12:56:48.882822+0000","last_fullsized":"2024-09-05T12:56:48.882822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:34:13.288894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061405+0000","last_change":"2024-09-05T12:55:45.742269+0000","last_active":"2024-09-05T12:56:05.061405+0000","last_peered":"2024-09-05T12:56:05.061405+0000","last_clean":"2024-09-05T12:56:05.061405+0000","last_became_active":"2024-09-05T12:55:45.741723+0000","last_became_peered":"2024-09-05T12:55:45.741723+0000","last_unstale":"2024-09-05T12:56:05.061405+0000","last_undegraded":"2024-09-05T12:56:05.061405+0000","last_fullsized":"2024-09-05T12:56:05.061405+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:39.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061771+0000","last_change":"2024-09-05T12:55:43.723725+0000","last_active":"2024-09-05T12:56:05.061771+0000","last_peered":"2024-09-05T12:56:05.061771+0000","last_clean":"2024-09-05T12:56:05.061771+0000","last_became_active":"2024-09-05T12:55:43.723351+0000","last_became_peered":"2024-09-05T12:55:43.723351+0000","last_unstale":"2024-09-05T12:56:05.061771+0000","last_undegraded":"2024-09-05T12:56:05.061771+0000","last_fullsized":"2024-09-05T12:56:05.061771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:15:40.485461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819355+0000","last_change":"2024-09-05T12:55:45.742293+0000","last_active":"2024-09-05T12:56:05.819355+0000","last_peered":"2024-09-05T12:56:05.819355+0000","last_clean":"2024-09-05T12:56:05.819355+0000","last_became_active":"2024-09-05T12:55:45.741998+0000","last_became_peered":"2024-09-05T12:55:45.741998+0000","last_unstale":"2024-09-05T12:56:05.819355+0000","last_undegraded":"2024-09-05T12:56:05.819355+0000","last_fullsized":"2024-09-05T12:56:05.819355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:25:23.731384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065615+0000","last_change":"2024-09-05T12:55:43.726519+0000","last_active":"2024-09-05T12:56:05.065615+0000","last_peered":"2024-09-05T12:56:05.065615+0000","last_clean":"2024-09-05T12:56:05.065615+0000","last_became_active":"2024-09-05T12:55:43.726231+0000","last_became_peered":"2024-09-05T12:55:43.726231+0000","last_unstale":"2024-09-05T12:56:05.065615+0000","last_undegraded":"2024-09-05T12:56:05.065615+0000","last_fullsized":"2024-09-05T12:56:05.065615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:22:55.460814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676243+0000","last_change":"2024-09-05T12:55:45.739359+0000","last_active":"2024-09-05T12:56:05.676243+0000","last_peered":"2024-09-05T12:56:05.676243+0000","last_clean":"2024-09-05T12:56:05.676243+0000","last_became_active":"2024-09-05T12:55:45.738358+0000","last_became_peered":"2024-09-05T12:55:45.738358+0000","last_unstale":"2024-09-05T12:56:05.676243+0000","last_undegraded":"2024-09-05T12:56:05.676243+0000","last_fullsized":"2024-09-05T12:56:05.676243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:11:37.144174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:44.876581+0000","last_change":"2024-09-05T12:55:43.726623+0000","last_active":"2024-09-05T12:56:44.876581+0000","last_peered":"2024-09-05T12:56:44.876581+0000","last_clean":"2024-09-05T12:56:44.876581+0000","last_became_active":"2024-09-05T12:55:43.726281+0000","last_became_peered":"2024-09-05T12:55:43.726281+0000","last_unstale":"2024-09-05T12:56:44.876581+0000","last_undegraded":"2024-09-05T12:56:44.876581+0000","last_fullsized":"2024-09-05T12:56:44.876581+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:59:07.503458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676010+0000","last_change":"2024-09-05T12:55:45.745731+0000","last_active":"2024-09-05T12:56:05.676010+0000","last_peered":"2024-09-05T12:56:05.676010+0000","last_clean":"2024-09-05T12:56:05.676010+0000","last_became_active":"2024-09-05T12:55:45.745399+0000","last_became_peered":"2024-09-05T12:55:45.745399+0000","last_unstale":"2024-09-05T12:56:05.676010+0000","last_undegraded":"2024-09-05T12:56:05.676010+0000","last_fullsized":"2024-09-05T12:56:05.676010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:47:44.737335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061012+0000","last_change":"2024-09-05T12:55:43.736527+0000","last_active":"2024-09-05T12:56:05.061012+0000","last_peered":"2024-09-05T12:56:05.061012+0000","last_clean":"2024-09-05T12:56:05.061012+0000","last_became_active":"2024-09-05T12:55:43.736088+0000","last_became_peered":"2024-09-05T12:55:43.736088+0000","last_unstale":"2024-09-05T12:56:05.061012+0000","last_undegraded":"2024-09-05T12:56:05.061012+0000","last_fullsized":"2024-09-05T12:56:05.061012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:14.570503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.853150+0000","last_change":"2024-09-05T12:56:05.853150+0000","last_active":"2024-09-05T12:56:05.853150+0000","last_peered":"2024-09-05T12:56:05.853150+0000","last_clean":"2024-09-05T12:56:05.853150+0000","last_became_active":"2024-09-05T12:56:05.852728+0000","last_became_peered":"2024-09-05T12:56:05.852728+0000","last_unstale":"2024-09-05T12:56:05.853150+0000","last_undegraded":"2024-09-05T12:56:05.853150+0000","last_fullsized":"2024-09-05T12:56:05.853150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:58:49.654402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062050+0000","last_change":"2024-09-05T12:55:43.726989+0000","last_active":"2024-09-05T12:56:05.062050+0000","last_peered":"2024-09-05T12:56:05.062050+0000","last_clean":"2024-09-05T12:56:05.062050+0000","last_became_active":"2024-09-05T12:55:43.726690+0000","last_became_peered":"2024-09-05T12:55:43.726690+0000","last_unstale":"2024-09-05T12:56:05.062050+0000","last_undegraded":"2024-09-05T12:56:05.062050+0000","last_fullsized":"2024-09-05T12:56:05.062050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:15:31.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059176+0000","last_change":"2024-09-05T12:55:45.754849+0000","last_active":"2024-09-05T12:56:05.059176+0000","last_peered":"2024-09-05T12:56:05.059176+0000","last_clean":"2024-09-05T12:56:05.059176+0000","last_became_active":"2024-09-05T12:55:45.754539+0000","last_became_peered":"2024-09-05T12:55:45.754539+0000","last_unstale":"2024-09-05T12:56:05.059176+0000","last_undegraded":"2024-09-05T12:56:05.059176+0000","last_fullsized":"2024-09-05T12:56:05.059176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:14:17.628561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819674+0000","last_change":"2024-09-05T12:55:43.723140+0000","last_active":"2024-09-05T12:56:05.819674+0000","last_peered":"2024-09-05T12:56:05.819674+0000","last_clean":"2024-09-05T12:56:05.819674+0000","last_became_active":"2024-09-05T12:55:43.722806+0000","last_became_peered":"2024-09-05T12:55:43.722806+0000","last_unstale":"2024-09-05T12:56:05.819674+0000","last_undegraded":"2024-09-05T12:56:05.819674+0000","last_fullsized":"2024-09-05T12:56:05.819674+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:00:30.041237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676678+0000","last_change":"2024-09-05T12:55:45.750948+0000","last_active":"2024-09-05T12:56:05.676678+0000","last_peered":"2024-09-05T12:56:05.676678+0000","last_clean":"2024-09-05T12:56:05.676678+0000","last_became_active":"2024-09-05T12:55:45.750642+0000","last_became_peered":"2024-09-05T12:55:45.750642+0000","last_unstale":"2024-09-05T12:56:05.676678+0000","last_undegraded":"2024-09-05T12:56:05.676678+0000","last_fullsized":"2024-09-05T12:56:05.676678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:17:48.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066001+0000","last_change":"2024-09-05T12:55:43.724847+0000","last_active":"2024-09-05T12:56:05.066001+0000","last_peered":"2024-09-05T12:56:05.066001+0000","last_clean":"2024-09-05T12:56:05.066001+0000","last_became_active":"2024-09-05T12:55:43.724538+0000","last_became_peered":"2024-09-05T12:55:43.724538+0000","last_unstale":"2024-09-05T12:56:05.066001+0000","last_undegraded":"2024-09-05T12:56:05.066001+0000","last_fullsized":"2024-09-05T12:56:05.066001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:13:46.011992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676407+0000","last_change":"2024-09-05T12:55:45.742080+0000","last_active":"2024-09-05T12:56:05.676407+0000","last_peered":"2024-09-05T12:56:05.676407+0000","last_clean":"2024-09-05T12:56:05.676407+0000","last_became_active":"2024-09-05T12:55:45.741749+0000","last_became_peered":"2024-09-05T12:55:45.741749+0000","last_unstale":"2024-09-05T12:56:05.676407+0000","last_undegraded":"2024-09-05T12:56:05.676407+0000","last_fullsized":"2024-09-05T12:56:05.676407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:20.597209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061670+0000","last_change":"2024-09-05T12:55:43.736856+0000","last_active":"2024-09-05T12:56:05.061670+0000","last_peered":"2024-09-05T12:56:05.061670+0000","last_clean":"2024-09-05T12:56:05.061670+0000","last_became_active":"2024-09-05T12:55:43.736490+0000","last_became_peered":"2024-09-05T12:55:43.736490+0000","last_unstale":"2024-09-05T12:56:05.061670+0000","last_undegraded":"2024-09-05T12:56:05.061670+0000","last_fullsized":"2024-09-05T12:56:05.061670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:36:55.286932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676384+0000","last_change":"2024-09-05T12:55:45.750667+0000","last_active":"2024-09-05T12:56:05.676384+0000","last_peered":"2024-09-05T12:56:05.676384+0000","last_clean":"2024-09-05T12:56:05.676384+0000","last_became_active":"2024-09-05T12:55:45.750386+0000","last_became_peered":"2024-09-05T12:55:45.750386+0000","last_unstale":"2024-09-05T12:56:05.676384+0000","last_undegraded":"2024-09-05T12:56:05.676384+0000","last_fullsized":"2024-09-05T12:56:05.676384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:32:41.443471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676291+0000","last_change":"2024-09-05T12:54:31.534043+0000","last_active":"2024-09-05T12:56:05.676291+0000","last_peered":"2024-09-05T12:56:05.676291+0000","last_clean":"2024-09-05T12:56:05.676291+0000","last_became_active":"2024-09-05T12:54:31.533610+0000","last_became_peered":"2024-09-05T12:54:31.533610+0000","last_unstale":"2024-09-05T12:56:05.676291+0000","last_undegraded":"2024-09-05T12:56:05.676291+0000","last_fullsized":"2024-09-05T12:56:05.676291+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_clean_scrub_stamp":"2024-09-05T12:51:12.506567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:30:50.399925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201941+0000","last_change":"2024-09-05T12:55:43.727743+0000","last_active":"2024-09-05T12:56:05.201941+0000","last_peered":"2024-09-05T12:56:05.201941+0000","last_clean":"2024-09-05T12:56:05.201941+0000","last_became_active":"2024-09-05T12:55:43.727333+0000","last_became_peered":"2024-09-05T12:55:43.727333+0000","last_unstale":"2024-09-05T12:56:05.201941+0000","last_undegraded":"2024-09-05T12:56:05.201941+0000","last_fullsized":"2024-09-05T12:56:05.201941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:41:21.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061274+0000","last_change":"2024-09-05T12:55:45.744268+0000","last_active":"2024-09-05T12:56:05.061274+0000","last_peered":"2024-09-05T12:56:05.061274+0000","last_clean":"2024-09-05T12:56:05.061274+0000","last_became_active":"2024-09-05T12:55:45.743976+0000","last_became_peered":"2024-09-05T12:55:45.743976+0000","last_unstale":"2024-09-05T12:56:05.061274+0000","last_undegraded":"2024-09-05T12:56:05.061274+0000","last_fullsized":"2024-09-05T12:56:05.061274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:02.568293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676247+0000","last_change":"2024-09-05T12:55:43.728853+0000","last_active":"2024-09-05T12:56:05.676247+0000","last_peered":"2024-09-05T12:56:05.676247+0000","last_clean":"2024-09-05T12:56:05.676247+0000","last_became_active":"2024-09-05T12:55:43.728559+0000","last_became_peered":"2024-09-05T12:55:43.728559+0000","last_unstale":"2024-09-05T12:56:05.676247+0000","last_undegraded":"2024-09-05T12:56:05.676247+0000","last_fullsized":"2024-09-05T12:56:05.676247+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:16:53.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819290+0000","last_change":"2024-09-05T12:55:45.748445+0000","last_active":"2024-09-05T12:56:05.819290+0000","last_peered":"2024-09-05T12:56:05.819290+0000","last_clean":"2024-09-05T12:56:05.819290+0000","last_became_active":"2024-09-05T12:55:45.748152+0000","last_became_peered":"2024-09-05T12:55:45.748152+0000","last_unstale":"2024-09-05T12:56:05.819290+0000","last_undegraded":"2024-09-05T12:56:05.819290+0000","last_fullsized":"2024-09-05T12:56:05.819290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:37:35.842555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:43.874703+0000","last_change":"2024-09-05T12:55:43.734607+0000","last_active":"2024-09-05T12:56:43.874703+0000","last_peered":"2024-09-05T12:56:43.874703+0000","last_clean":"2024-09-05T12:56:43.874703+0000","last_became_active":"2024-09-05T12:55:43.734288+0000","last_became_peered":"2024-09-05T12:55:43.734288+0000","last_unstale":"2024-09-05T12:56:43.874703+0000","last_undegraded":"2024-09-05T12:56:43.874703+0000","last_fullsized":"2024-09-05T12:56:43.874703+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:40:40.350335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065590+0000","last_change":"2024-09-05T12:55:45.745622+0000","last_active":"2024-09-05T12:56:05.065590+0000","last_peered":"2024-09-05T12:56:05.065590+0000","last_clean":"2024-09-05T12:56:05.065590+0000","last_became_active":"2024-09-05T12:55:45.745282+0000","last_became_peered":"2024-09-05T12:55:45.745282+0000","last_unstale":"2024-09-05T12:56:05.065590+0000","last_undegraded":"2024-09-05T12:56:05.065590+0000","last_fullsized":"2024-09-05T12:56:05.065590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:50:19.657275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676337+0000","last_change":"2024-09-05T12:55:43.723985+0000","last_active":"2024-09-05T12:56:05.676337+0000","last_peered":"2024-09-05T12:56:05.676337+0000","last_clean":"2024-09-05T12:56:05.676337+0000","last_became_active":"2024-09-05T12:55:43.723651+0000","last_became_peered":"2024-09-05T12:55:43.723651+0000","last_unstale":"2024-09-05T12:56:05.676337+0000","last_undegraded":"2024-09-05T12:56:05.676337+0000","last_fullsized":"2024-09-05T12:56:05.676337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:10:45.723258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062115+0000","last_change":"2024-09-05T12:55:45.738603+0000","last_active":"2024-09-05T12:56:05.062115+0000","last_peered":"2024-09-05T12:56:05.062115+0000","last_clean":"2024-09-05T12:56:05.062115+0000","last_became_active":"2024-09-05T12:55:45.738299+0000","last_became_peered":"2024-09-05T12:55:45.738299+0000","last_unstale":"2024-09-05T12:56:05.062115+0000","last_undegraded":"2024-09-05T12:56:05.062115+0000","last_fullsized":"2024-09-05T12:56:05.062115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:05:28.174555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061144+0000","last_change":"2024-09-05T12:55:43.734587+0000","last_active":"2024-09-05T12:56:05.061144+0000","last_peered":"2024-09-05T12:56:05.061144+0000","last_clean":"2024-09-05T12:56:05.061144+0000","last_became_active":"2024-09-05T12:55:43.734260+0000","last_became_peered":"2024-09-05T12:55:43.734260+0000","last_unstale":"2024-09-05T12:56:05.061144+0000","last_undegraded":"2024-09-05T12:56:05.061144+0000","last_fullsized":"2024-09-05T12:56:05.061144+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:37:00.235234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062195+0000","last_change":"2024-09-05T12:55:45.740516+0000","last_active":"2024-09-05T12:56:05.062195+0000","last_peered":"2024-09-05T12:56:05.062195+0000","last_clean":"2024-09-05T12:56:05.062195+0000","last_became_active":"2024-09-05T12:55:45.740227+0000","last_became_peered":"2024-09-05T12:55:45.740227+0000","last_unstale":"2024-09-05T12:56:05.062195+0000","last_undegraded":"2024-09-05T12:56:05.062195+0000","last_fullsized":"2024-09-05T12:56:05.062195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:34:44.922326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061647+0000","last_change":"2024-09-05T12:55:43.734592+0000","last_active":"2024-09-05T12:56:05.061647+0000","last_peered":"2024-09-05T12:56:05.061647+0000","last_clean":"2024-09-05T12:56:05.061647+0000","last_became_active":"2024-09-05T12:55:43.734243+0000","last_became_peered":"2024-09-05T12:55:43.734243+0000","last_unstale":"2024-09-05T12:56:05.061647+0000","last_undegraded":"2024-09-05T12:56:05.061647+0000","last_fullsized":"2024-09-05T12:56:05.061647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:14.368806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819567+0000","last_change":"2024-09-05T12:55:45.748201+0000","last_active":"2024-09-05T12:56:05.819567+0000","last_peered":"2024-09-05T12:56:05.819567+0000","last_clean":"2024-09-05T12:56:05.819567+0000","last_became_active":"2024-09-05T12:55:45.747906+0000","last_became_peered":"2024-09-05T12:55:45.747906+0000","last_unstale":"2024-09-05T12:56:05.819567+0000","last_undegraded":"2024-09-05T12:56:05.819567+0000","last_fullsized":"2024-09-05T12:56:05.819567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:07.984589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:09.748332+0000","last_change":"2024-09-05T12:56:05.071328+0000","last_active":"2024-09-05T12:56:09.748332+0000","last_peered":"2024-09-05T12:56:09.748332+0000","last_clean":"2024-09-05T12:56:09.748332+0000","last_became_active":"2024-09-05T12:56:05.064345+0000","last_became_peered":"2024-09-05T12:56:05.064345+0000","last_unstale":"2024-09-05T12:56:09.748332+0000","last_undegraded":"2024-09-05T12:56:09.748332+0000","last_fullsized":"2024-09-05T12:56:09.748332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:30:31.850824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061601+0000","last_change":"2024-09-05T12:55:45.743225+0000","last_active":"2024-09-05T12:56:05.061601+0000","last_peered":"2024-09-05T12:56:05.061601+0000","last_clean":"2024-09-05T12:56:05.061601+0000","last_became_active":"2024-09-05T12:55:45.742923+0000","last_became_peered":"2024-09-05T12:55:45.742923+0000","last_unstale":"2024-09-05T12:56:05.061601+0000","last_undegraded":"2024-09-05T12:56:05.061601+0000","last_fullsized":"2024-09-05T12:56:05.061601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:50:09.056893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.202275+0000","last_change":"2024-09-05T12:55:43.723420+0000","last_active":"2024-09-05T12:56:05.202275+0000","last_peered":"2024-09-05T12:56:05.202275+0000","last_clean":"2024-09-05T12:56:05.202275+0000","last_became_active":"2024-09-05T12:55:43.723100+0000","last_became_peered":"2024-09-05T12:55:43.723100+0000","last_unstale":"2024-09-05T12:56:05.202275+0000","last_undegraded":"2024-09-05T12:56:05.202275+0000","last_fullsized":"2024-09-05T12:56:05.202275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:21:33.307826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.678039+0000","last_change":"2024-09-05T12:56:05.678039+0000","last_active":"2024-09-05T12:56:05.678039+0000","last_peered":"2024-09-05T12:56:05.678039+0000","last_clean":"2024-09-05T12:56:05.678039+0000","last_became_active":"2024-09-05T12:56:05.677749+0000","last_became_peered":"2024-09-05T12:56:05.677749+0000","last_unstale":"2024-09-05T12:56:05.678039+0000","last_undegraded":"2024-09-05T12:56:05.678039+0000","last_fullsized":"2024-09-05T12:56:05.678039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:47:12.770873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851620+0000","last_change":"2024-09-05T12:55:43.736075+0000","last_active":"2024-09-05T12:56:05.851620+0000","last_peered":"2024-09-05T12:56:05.851620+0000","last_clean":"2024-09-05T12:56:05.851620+0000","last_became_active":"2024-09-05T12:55:43.735808+0000","last_became_peered":"2024-09-05T12:55:43.735808+0000","last_unstale":"2024-09-05T12:56:05.851620+0000","last_undegraded":"2024-09-05T12:56:05.851620+0000","last_fullsized":"2024-09-05T12:56:05.851620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:52:25.842728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061815+0000","last_change":"2024-09-05T12:55:45.747180+0000","last_active":"2024-09-05T12:56:05.061815+0000","last_peered":"2024-09-05T12:56:05.061815+0000","last_clean":"2024-09-05T12:56:05.061815+0000","last_became_active":"2024-09-05T12:55:45.746297+0000","last_became_peered":"2024-09-05T12:55:45.746297+0000","last_unstale":"2024-09-05T12:56:05.061815+0000","last_undegraded":"2024-09-05T12:56:05.061815+0000","last_fullsized":"2024-09-05T12:56:05.061815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:24:33.657861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060711+0000","last_change":"2024-09-05T12:55:43.720054+0000","last_active":"2024-09-05T12:56:05.060711+0000","last_peered":"2024-09-05T12:56:05.060711+0000","last_clean":"2024-09-05T12:56:05.060711+0000","last_became_active":"2024-09-05T12:55:43.719762+0000","last_became_peered":"2024-09-05T12:55:43.719762+0000","last_unstale":"2024-09-05T12:56:05.060711+0000","last_undegraded":"2024-09-05T12:56:05.060711+0000","last_fullsized":"2024-09-05T12:56:05.060711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:07:57.623333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059189+0000","last_change":"2024-09-05T12:55:45.756031+0000","last_active":"2024-09-05T12:56:05.059189+0000","last_peered":"2024-09-05T12:56:05.059189+0000","last_clean":"2024-09-05T12:56:05.059189+0000","last_became_active":"2024-09-05T12:55:45.755723+0000","last_became_peered":"2024-09-05T12:55:45.755723+0000","last_unstale":"2024-09-05T12:56:05.059189+0000","last_undegraded":"2024-09-05T12:56:05.059189+0000","last_fullsized":"2024-09-05T12:56:05.059189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:26.760307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.069746+0000","last_change":"2024-09-05T12:56:05.069208+0000","last_active":"2024-09-05T12:56:05.069746+0000","last_peered":"2024-09-05T12:56:05.069746+0000","last_clean":"2024-09-05T12:56:05.069746+0000","last_became_active":"2024-09-05T12:56:05.063698+0000","last_became_peered":"2024-09-05T12:56:05.063698+0000","last_unstale":"2024-09-05T12:56:05.069746+0000","last_undegraded":"2024-09-05T12:56:05.069746+0000","last_fullsized":"2024-09-05T12:56:05.069746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:55:54.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061163+0000","last_change":"2024-09-05T12:55:45.743108+0000","last_active":"2024-09-05T12:56:05.061163+0000","last_peered":"2024-09-05T12:56:05.061163+0000","last_clean":"2024-09-05T12:56:05.061163+0000","last_became_active":"2024-09-05T12:55:45.742197+0000","last_became_peered":"2024-09-05T12:55:45.742197+0000","last_unstale":"2024-09-05T12:56:05.061163+0000","last_undegraded":"2024-09-05T12:56:05.061163+0000","last_fullsized":"2024-09-05T12:56:05.061163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:13:15.192298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061447+0000","last_change":"2024-09-05T12:55:43.725893+0000","last_active":"2024-09-05T12:56:05.061447+0000","last_peered":"2024-09-05T12:56:05.061447+0000","last_clean":"2024-09-05T12:56:05.061447+0000","last_became_active":"2024-09-05T12:55:43.725578+0000","last_became_peered":"2024-09-05T12:55:43.725578+0000","last_unstale":"2024-09-05T12:56:05.061447+0000","last_undegraded":"2024-09-05T12:56:05.061447+0000","last_fullsized":"2024-09-05T12:56:05.061447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:39.101167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676363+0000","last_change":"2024-09-05T12:55:45.746727+0000","last_active":"2024-09-05T12:56:05.676363+0000","last_peered":"2024-09-05T12:56:05.676363+0000","last_clean":"2024-09-05T12:56:05.676363+0000","last_became_active":"2024-09-05T12:55:45.746446+0000","last_became_peered":"2024-09-05T12:55:45.746446+0000","last_unstale":"2024-09-05T12:56:05.676363+0000","last_undegraded":"2024-09-05T12:56:05.676363+0000","last_fullsized":"2024-09-05T12:56:05.676363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:56:51.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065862+0000","last_change":"2024-09-05T12:55:45.750253+0000","last_active":"2024-09-05T12:56:05.065862+0000","last_peered":"2024-09-05T12:56:05.065862+0000","last_clean":"2024-09-05T12:56:05.065862+0000","last_became_active":"2024-09-05T12:55:45.749911+0000","last_became_peered":"2024-09-05T12:55:45.749911+0000","last_unstale":"2024-09-05T12:56:05.065862+0000","last_undegraded":"2024-09-05T12:56:05.065862+0000","last_fullsized":"2024-09-05T12:56:05.065862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:04:04.164858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061563+0000","last_change":"2024-09-05T12:55:43.728597+0000","last_active":"2024-09-05T12:56:05.061563+0000","last_peered":"2024-09-05T12:56:05.061563+0000","last_clean":"2024-09-05T12:56:05.061563+0000","last_became_active":"2024-09-05T12:55:43.727633+0000","last_became_peered":"2024-09-05T12:55:43.727633+0000","last_unstale":"2024-09-05T12:56:05.061563+0000","last_undegraded":"2024-09-05T12:56:05.061563+0000","last_fullsized":"2024-09-05T12:56:05.061563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:50:04.775603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851671+0000","last_change":"2024-09-05T12:55:45.741539+0000","last_active":"2024-09-05T12:56:05.851671+0000","last_peered":"2024-09-05T12:56:05.851671+0000","last_clean":"2024-09-05T12:56:05.851671+0000","last_became_active":"2024-09-05T12:55:45.741247+0000","last_became_peered":"2024-09-05T12:55:45.741247+0000","last_unstale":"2024-09-05T12:56:05.851671+0000","last_undegraded":"2024-09-05T12:56:05.851671+0000","last_fullsized":"2024-09-05T12:56:05.851671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:57:23.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061516+0000","last_change":"2024-09-05T12:55:43.725085+0000","last_active":"2024-09-05T12:56:05.061516+0000","last_peered":"2024-09-05T12:56:05.061516+0000","last_clean":"2024-09-05T12:56:05.061516+0000","last_became_active":"2024-09-05T12:55:43.724772+0000","last_became_peered":"2024-09-05T12:55:43.724772+0000","last_unstale":"2024-09-05T12:56:05.061516+0000","last_undegraded":"2024-09-05T12:56:05.061516+0000","last_fullsized":"2024-09-05T12:56:05.061516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:48:16.567841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063834+0000","last_change":"2024-09-05T12:55:45.745635+0000","last_active":"2024-09-05T12:56:05.063834+0000","last_peered":"2024-09-05T12:56:05.063834+0000","last_clean":"2024-09-05T12:56:05.063834+0000","last_became_active":"2024-09-05T12:55:45.745331+0000","last_became_peered":"2024-09-05T12:55:45.745331+0000","last_unstale":"2024-09-05T12:56:05.063834+0000","last_undegraded":"2024-09-05T12:56:05.063834+0000","last_fullsized":"2024-09-05T12:56:05.063834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:15:58.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061048+0000","last_change":"2024-09-05T12:55:43.734466+0000","last_active":"2024-09-05T12:56:05.061048+0000","last_peered":"2024-09-05T12:56:05.061048+0000","last_clean":"2024-09-05T12:56:05.061048+0000","last_became_active":"2024-09-05T12:55:43.734147+0000","last_became_peered":"2024-09-05T12:55:43.734147+0000","last_unstale":"2024-09-05T12:56:05.061048+0000","last_undegraded":"2024-09-05T12:56:05.061048+0000","last_fullsized":"2024-09-05T12:56:05.061048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:53:22.588471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060906+0000","last_change":"2024-09-05T12:55:45.746328+0000","last_active":"2024-09-05T12:56:05.060906+0000","last_peered":"2024-09-05T12:56:05.060906+0000","last_clean":"2024-09-05T12:56:05.060906+0000","last_became_active":"2024-09-05T12:55:45.746012+0000","last_became_peered":"2024-09-05T12:55:45.746012+0000","last_unstale":"2024-09-05T12:56:05.060906+0000","last_undegraded":"2024-09-05T12:56:05.060906+0000","last_fullsized":"2024-09-05T12:56:05.060906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:23:12.886759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061386+0000","last_change":"2024-09-05T12:55:43.722519+0000","last_active":"2024-09-05T12:56:05.061386+0000","last_peered":"2024-09-05T12:56:05.061386+0000","last_clean":"2024-09-05T12:56:05.061386+0000","last_became_active":"2024-09-05T12:55:43.722220+0000","last_became_peered":"2024-09-05T12:55:43.722220+0000","last_unstale":"2024-09-05T12:56:05.061386+0000","last_undegraded":"2024-09-05T12:56:05.061386+0000","last_fullsized":"2024-09-05T12:56:05.061386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:15.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":342,"num_read_kb":239,"num_write":161,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281587,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645338,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":425477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874272,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":1076722,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":425713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234026,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":1017565,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":425102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855416,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1017249,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018941,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":425539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":425413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":486402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":484659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":426373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T12:56:52.665 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-05T12:56:52.665 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-05T12:56:52.666 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-05T12:56:52.666 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph health --format=json 2024-09-05T12:56:52.911 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:53.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:53 smithi073 ceph-mon[30883]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:53.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:53 smithi073 ceph-mon[30883]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:56:53.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:53 smithi162 ceph-mon[34220]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:53.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:53 smithi162 ceph-mon[34220]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:56:53.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:53 smithi169 ceph-mon[34823]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:56:53.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:53 smithi169 ceph-mon[34823]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:56:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.404+0000 7fc9f136e640 1 -- 172.21.15.73:0/4198877066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ec100a80 msgr2=0x7fc9ec100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.404+0000 7fc9f136e640 1 --2- 172.21.15.73:0/4198877066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ec100a80 0x7fc9ec100ee0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009930 tx=0x7fc9d402a420 comp rx=0 tx=0).stop 2024-09-05T12:56:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.404+0000 7fc9f136e640 1 -- 172.21.15.73:0/4198877066 shutdown_connections 2024-09-05T12:56:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.404+0000 7fc9f136e640 1 --2- 172.21.15.73:0/4198877066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec101420 0x7fc9ec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.404+0000 7fc9f136e640 1 --2- 172.21.15.73:0/4198877066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ec100a80 0x7fc9ec100ee0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.404+0000 7fc9f136e640 1 --2- 172.21.15.73:0/4198877066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ec106a80 0x7fc9ec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.404+0000 7fc9f136e640 1 -- 172.21.15.73:0/4198877066 >> 172.21.15.73:0/4198877066 conn(0x7fc9ec0fc7a0 msgr2=0x7fc9ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.404+0000 7fc9f136e640 1 -- 172.21.15.73:0/4198877066 shutdown_connections 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9f136e640 1 -- 172.21.15.73:0/4198877066 wait complete. 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9f136e640 1 Processor -- start 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9f136e640 1 -- start start 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9f136e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec100a80 0x7fc9ec1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9f136e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ec101420 0x7fc9ec1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9f136e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ec106a80 0x7fc9ec1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9f136e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec110e80 con 0x7fc9ec101420 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9f136e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec110d00 con 0x7fc9ec100a80 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9f136e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec111000 con 0x7fc9ec106a80 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9e3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ec101420 0x7fc9ec1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.405+0000 7fc9e3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ec101420 0x7fc9ec1997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44192/0 (socket says 172.21.15.73:44192) 2024-09-05T12:56:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9e3fff640 1 -- 172.21.15.73:0/574287004 learned_addr learned my addr 172.21.15.73:0/574287004 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9eb7fe640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ec106a80 0x7fc9ec1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9eaffd640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec100a80 0x7fc9ec1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9e3fff640 1 -- 172.21.15.73:0/574287004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ec106a80 msgr2=0x7fc9ec1a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9e3fff640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ec106a80 0x7fc9ec1a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9e3fff640 1 -- 172.21.15.73:0/574287004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec100a80 msgr2=0x7fc9ec1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9e3fff640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec100a80 0x7fc9ec1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9e3fff640 1 -- 172.21.15.73:0/574287004 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec1a4870 con 0x7fc9ec101420 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9eaffd640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec100a80 0x7fc9ec1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9e3fff640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ec101420 0x7fc9ec1997f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009230 tx=0x7fc9d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9e8ff9640 1 -- 172.21.15.73:0/574287004 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d403f030 con 0x7fc9ec101420 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9f136e640 1 -- 172.21.15.73:0/574287004 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ec1a4a40 con 0x7fc9ec101420 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9e8ff9640 1 -- 172.21.15.73:0/574287004 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9d4003ad0 con 0x7fc9ec101420 2024-09-05T12:56:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9e8ff9640 1 -- 172.21.15.73:0/574287004 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4035070 con 0x7fc9ec101420 2024-09-05T12:56:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.406+0000 7fc9f136e640 1 -- 172.21.15.73:0/574287004 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ec1a4ef0 con 0x7fc9ec101420 2024-09-05T12:56:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.407+0000 7fc9f136e640 1 -- 172.21.15.73:0/574287004 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ec100ee0 con 0x7fc9ec101420 2024-09-05T12:56:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.408+0000 7fc9e8ff9640 1 -- 172.21.15.73:0/574287004 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc9d4042030 con 0x7fc9ec101420 2024-09-05T12:56:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.409+0000 7fc9e8ff9640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc9d80a2c10 0x7fc9d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.409+0000 7fc9eaffd640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc9d80a2c10 0x7fc9d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.409+0000 7fc9e8ff9640 1 -- 172.21.15.73:0/574287004 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc9d40ef690 con 0x7fc9ec101420 2024-09-05T12:56:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.410+0000 7fc9eaffd640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc9d80a2c10 0x7fc9d80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc005fd0 tx=0x7fc9dc0094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.414+0000 7fc9e8ff9640 1 -- 172.21.15.73:0/574287004 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9d40bc4c0 con 0x7fc9ec101420 2024-09-05T12:56:53.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.622+0000 7fc9f136e640 1 -- 172.21.15.73:0/574287004 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc9ec108ff0 con 0x7fc9ec101420 2024-09-05T12:56:53.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.622+0000 7fc9e8ff9640 1 -- 172.21.15.73:0/574287004 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc9d40bbdc0 con 0x7fc9ec101420 2024-09-05T12:56:53.624 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:53.624 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-05T12:56:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 -- 172.21.15.73:0/574287004 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc9d80a2c10 msgr2=0x7fc9d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc9d80a2c10 0x7fc9d80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc005fd0 tx=0x7fc9dc0094d0 comp rx=0 tx=0).stop 2024-09-05T12:56:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 -- 172.21.15.73:0/574287004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ec101420 msgr2=0x7fc9ec1997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ec101420 0x7fc9ec1997f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009230 tx=0x7fc9d4004270 comp rx=0 tx=0).stop 2024-09-05T12:56:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 -- 172.21.15.73:0/574287004 shutdown_connections 2024-09-05T12:56:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc9d80a2c10 0x7fc9d80a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ec106a80 0x7fc9ec1a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ec101420 0x7fc9ec1997f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 --2- 172.21.15.73:0/574287004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec100a80 0x7fc9ec1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 -- 172.21.15.73:0/574287004 >> 172.21.15.73:0/574287004 conn(0x7fc9ec0fc7a0 msgr2=0x7fc9ec0fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 -- 172.21.15.73:0/574287004 shutdown_connections 2024-09-05T12:56:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:53.624+0000 7fc9f136e640 1 -- 172.21.15.73:0/574287004 wait complete. 2024-09-05T12:56:54.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:54 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/574287004' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-05T12:56:54.269 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-05T12:56:54.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:56:54.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:54 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/574287004' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-05T12:56:54.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:54 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/574287004' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-05T12:56:54.523 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.024+0000 7f5848355640 1 -- 172.21.15.73:0/2782317751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5840101de0 msgr2=0x7f58401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.024+0000 7f5848355640 1 --2- 172.21.15.73:0/2782317751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5840101de0 0x7f58401021c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5834009900 tx=0x7f583402a410 comp rx=0 tx=0).stop 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.024+0000 7f5848355640 1 -- 172.21.15.73:0/2782317751 shutdown_connections 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.024+0000 7f5848355640 1 --2- 172.21.15.73:0/2782317751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5840106f10 0x7f584010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.024+0000 7f5848355640 1 --2- 172.21.15.73:0/2782317751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5840102790 0x7f58401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.024+0000 7f5848355640 1 --2- 172.21.15.73:0/2782317751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5840101de0 0x7f58401021c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.024+0000 7f5848355640 1 -- 172.21.15.73:0/2782317751 >> 172.21.15.73:0/2782317751 conn(0x7f58400fd8c0 msgr2=0x7f58400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.024+0000 7f5848355640 1 -- 172.21.15.73:0/2782317751 shutdown_connections 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.024+0000 7f5848355640 1 -- 172.21.15.73:0/2782317751 wait complete. 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f5848355640 1 Processor -- start 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f5848355640 1 -- start start 2024-09-05T12:56:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f5848355640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5840101de0 0x7f5840198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f5848355640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5840102790 0x7f5840198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f5848355640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5840106f10 0x7f584019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f5848355640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5840111f70 con 0x7f5840102790 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f5848355640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5840111df0 con 0x7f5840101de0 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f5848355640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58401120f0 con 0x7f5840106f10 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f58458f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5840102790 0x7f5840198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f58458f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5840102790 0x7f5840198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44208/0 (socket says 172.21.15.73:44208) 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f58458f0640 1 -- 172.21.15.73:0/3449946025 learned_addr learned my addr 172.21.15.73:0/3449946025 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f58460f1640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5840101de0 0x7f5840198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f58468f2640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5840106f10 0x7f584019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f58458f0640 1 -- 172.21.15.73:0/3449946025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5840106f10 msgr2=0x7f584019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f58458f0640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5840106f10 0x7f584019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f58458f0640 1 -- 172.21.15.73:0/3449946025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5840101de0 msgr2=0x7f5840198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f58458f0640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5840101de0 0x7f5840198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.025+0000 7f58458f0640 1 -- 172.21.15.73:0/3449946025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584019d3e0 con 0x7f5840102790 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.026+0000 7f58458f0640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5840102790 0x7f5840198970 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f583c00c920 tx=0x7f583c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.026+0000 7f58337fe640 1 -- 172.21.15.73:0/3449946025 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c007c70 con 0x7f5840102790 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.026+0000 7f58337fe640 1 -- 172.21.15.73:0/3449946025 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f583c007e10 con 0x7f5840102790 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.026+0000 7f5848355640 1 -- 172.21.15.73:0/3449946025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584019d6d0 con 0x7f5840102790 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.026+0000 7f58337fe640 1 -- 172.21.15.73:0/3449946025 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c018890 con 0x7f5840102790 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.026+0000 7f5848355640 1 -- 172.21.15.73:0/3449946025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58401a4fb0 con 0x7f5840102790 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.027+0000 7f5848355640 1 -- 172.21.15.73:0/3449946025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58401021c0 con 0x7f5840102790 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.028+0000 7f58337fe640 1 -- 172.21.15.73:0/3449946025 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f583c018a70 con 0x7f5840102790 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.028+0000 7f58337fe640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f582c0a2c10 0x7f582c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.029+0000 7f58460f1640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f582c0a2c10 0x7f582c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.029+0000 7f58337fe640 1 -- 172.21.15.73:0/3449946025 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f583c0cf2f0 con 0x7f5840102790 2024-09-05T12:56:55.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.029+0000 7f58460f1640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f582c0a2c10 0x7f582c0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5834000c00 tx=0x7f58340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:55.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.033+0000 7f58337fe640 1 -- 172.21.15.73:0/3449946025 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f583c014030 con 0x7f5840102790 2024-09-05T12:56:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.235+0000 7f5848355640 1 -- 172.21.15.73:0/3449946025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5840109b60 con 0x7f5840102790 2024-09-05T12:56:55.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:55 smithi073 ceph-mon[30883]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.235+0000 7f58337fe640 1 -- 172.21.15.73:0/3449946025 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11926 (secure 0 0 0) 0x7f583c09c120 con 0x7f5840102790 2024-09-05T12:56:55.237 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:55.237 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-05T12:55:57:797257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:55:57.388420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24452,24466,24482]},"id":1}]} 2024-09-05T12:56:55.237 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-05T12:56:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.237+0000 7f5848355640 1 -- 172.21.15.73:0/3449946025 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f582c0a2c10 msgr2=0x7f582c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.237+0000 7f5848355640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f582c0a2c10 0x7f582c0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5834000c00 tx=0x7f58340058d0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.237+0000 7f5848355640 1 -- 172.21.15.73:0/3449946025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5840102790 msgr2=0x7f5840198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.237+0000 7f5848355640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5840102790 0x7f5840198970 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f583c00c920 tx=0x7f583c00cde0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.237+0000 7f5848355640 1 -- 172.21.15.73:0/3449946025 shutdown_connections 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.237+0000 7f5848355640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f582c0a2c10 0x7f582c0a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.237+0000 7f5848355640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5840106f10 0x7f584019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.237+0000 7f5848355640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5840102790 0x7f5840198970 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.237+0000 7f5848355640 1 --2- 172.21.15.73:0/3449946025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5840101de0 0x7f5840198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.237+0000 7f5848355640 1 -- 172.21.15.73:0/3449946025 >> 172.21.15.73:0/3449946025 conn(0x7f58400fd8c0 msgr2=0x7f58400feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.238+0000 7f5848355640 1 -- 172.21.15.73:0/3449946025 shutdown_connections 2024-09-05T12:56:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:55.238+0000 7f5848355640 1 -- 172.21.15.73:0/3449946025 wait complete. 2024-09-05T12:56:55.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:55 smithi162 ceph-mon[34220]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:55 smithi169 ceph-mon[34823]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:56:55.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:56:56.176 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:56.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:56 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3449946025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:56:56.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:56 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3449946025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:56:56.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:56 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3449946025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 -- 172.21.15.73:0/3824391858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5120106a60 msgr2=0x7f5120106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 --2- 172.21.15.73:0/3824391858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5120106a60 0x7f5120106e40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5118009cd0 tx=0x7f511802a8e0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 -- 172.21.15.73:0/3824391858 shutdown_connections 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 --2- 172.21.15.73:0/3824391858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5120101400 0x7f512010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 --2- 172.21.15.73:0/3824391858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5120100a60 0x7f5120100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 --2- 172.21.15.73:0/3824391858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5120106a60 0x7f5120106e40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 -- 172.21.15.73:0/3824391858 >> 172.21.15.73:0/3824391858 conn(0x7f51200fc780 msgr2=0x7f51200feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 -- 172.21.15.73:0/3824391858 shutdown_connections 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 -- 172.21.15.73:0/3824391858 wait complete. 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 Processor -- start 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.649+0000 7f512575a640 1 -- start start 2024-09-05T12:56:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f512575a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5120100a60 0x7f51201985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f512575a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5120101400 0x7f5120198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f512575a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5120106a60 0x7f512019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f512575a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5120112000 con 0x7f5120106a60 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f512575a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5120111e80 con 0x7f5120101400 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f512575a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5120112180 con 0x7f5120100a60 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5120106a60 0x7f512019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5120106a60 0x7f512019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44218/0 (socket says 172.21.15.73:44218) 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511f7fe640 1 -- 172.21.15.73:0/4240134762 learned_addr learned my addr 172.21.15.73:0/4240134762 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511effd640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5120100a60 0x7f51201985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511e7fc640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5120101400 0x7f5120198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511f7fe640 1 -- 172.21.15.73:0/4240134762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5120100a60 msgr2=0x7f51201985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511f7fe640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5120100a60 0x7f51201985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511f7fe640 1 -- 172.21.15.73:0/4240134762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5120101400 msgr2=0x7f5120198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511f7fe640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5120101400 0x7f5120198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511f7fe640 1 -- 172.21.15.73:0/4240134762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512019d590 con 0x7f5120106a60 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f511f7fe640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5120106a60 0x7f512019ceb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5110009fd0 tx=0x7f511000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f5117fff640 1 -- 172.21.15.73:0/4240134762 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110011830 con 0x7f5120106a60 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f5117fff640 1 -- 172.21.15.73:0/4240134762 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5110016070 con 0x7f5120106a60 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f512575a640 1 -- 172.21.15.73:0/4240134762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512019d880 con 0x7f5120106a60 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f5117fff640 1 -- 172.21.15.73:0/4240134762 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511000f2e0 con 0x7f5120106a60 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.650+0000 7f512575a640 1 -- 172.21.15.73:0/4240134762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51201a5160 con 0x7f5120106a60 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.652+0000 7f512575a640 1 -- 172.21.15.73:0/4240134762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5120100f40 con 0x7f5120106a60 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.653+0000 7f5117fff640 1 -- 172.21.15.73:0/4240134762 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f51100119d0 con 0x7f5120106a60 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.654+0000 7f5117fff640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f510c0a2c10 0x7f510c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.654+0000 7f511effd640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f510c0a2c10 0x7f510c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.654+0000 7f5117fff640 1 -- 172.21.15.73:0/4240134762 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f51100ce770 con 0x7f5120106a60 2024-09-05T12:56:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.654+0000 7f511effd640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f510c0a2c10 0x7f510c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5118006010 tx=0x7f5118000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:56.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.658+0000 7f5117fff640 1 -- 172.21.15.73:0/4240134762 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f511009b6b0 con 0x7f5120106a60 2024-09-05T12:56:56.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.856+0000 7f512575a640 1 -- 172.21.15.73:0/4240134762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f512002d7c0 con 0x7f5120106a60 2024-09-05T12:56:56.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.857+0000 7f5117fff640 1 -- 172.21.15.73:0/4240134762 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11926 (secure 0 0 0) 0x7f511009afb0 con 0x7f5120106a60 2024-09-05T12:56:56.858 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:56.858 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-05T12:55:57:797257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:55:57.388420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24452,24466,24482]},"id":1}]} 2024-09-05T12:56:56.858 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 -- 172.21.15.73:0/4240134762 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f510c0a2c10 msgr2=0x7f510c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f510c0a2c10 0x7f510c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5118006010 tx=0x7f5118000f40 comp rx=0 tx=0).stop 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 -- 172.21.15.73:0/4240134762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5120106a60 msgr2=0x7f512019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5120106a60 0x7f512019ceb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5110009fd0 tx=0x7f511000b8e0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 -- 172.21.15.73:0/4240134762 shutdown_connections 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f510c0a2c10 0x7f510c0a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5120106a60 0x7f512019ceb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5120101400 0x7f5120198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 --2- 172.21.15.73:0/4240134762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5120100a60 0x7f51201985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 -- 172.21.15.73:0/4240134762 >> 172.21.15.73:0/4240134762 conn(0x7f51200fc780 msgr2=0x7f51200fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 -- 172.21.15.73:0/4240134762 shutdown_connections 2024-09-05T12:56:56.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:56.859+0000 7f512575a640 1 -- 172.21.15.73:0/4240134762 wait complete. 2024-09-05T12:56:57.167 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:57 smithi073 ceph-mon[30883]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:56:57.167 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:57 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/4240134762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:56:57.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:57 smithi162 ceph-mon[34220]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:56:57.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:57 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/4240134762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:56:57.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:57 smithi169 ceph-mon[34823]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:56:57.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:57 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/4240134762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:56:57.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T12:56:57.733 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 -- 172.21.15.73:0/895374125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0054101420 msgr2=0x7f005410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:58.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 --2- 172.21.15.73:0/895374125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0054101420 0x7f005410d950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f004c009930 tx=0x7f004c02a420 comp rx=0 tx=0).stop 2024-09-05T12:56:58.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 -- 172.21.15.73:0/895374125 shutdown_connections 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 --2- 172.21.15.73:0/895374125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0054101420 0x7f005410d950 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 --2- 172.21.15.73:0/895374125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0054100a80 0x7f0054100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 --2- 172.21.15.73:0/895374125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0054106a80 0x7f0054106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 -- 172.21.15.73:0/895374125 >> 172.21.15.73:0/895374125 conn(0x7f00540fc7a0 msgr2=0x7f00540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 -- 172.21.15.73:0/895374125 shutdown_connections 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 -- 172.21.15.73:0/895374125 wait complete. 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 Processor -- start 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.194+0000 7f00594cc640 1 -- start start 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00594cc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0054100a80 0x7f00541972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00594cc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0054101420 0x7f0054197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00594cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0054106a80 0x7f005419bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00594cc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0054110ea0 con 0x7f0054101420 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00594cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0054110d20 con 0x7f0054106a80 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00594cc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0054111020 con 0x7f0054100a80 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00527fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0054101420 0x7f0054197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00527fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0054101420 0x7f0054197820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44234/0 (socket says 172.21.15.73:44234) 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00527fc640 1 -- 172.21.15.73:0/3638933189 learned_addr learned my addr 172.21.15.73:0/3638933189 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00537fe640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0054106a80 0x7f005419bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f0052ffd640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0054100a80 0x7f00541972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00527fc640 1 -- 172.21.15.73:0/3638933189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0054100a80 msgr2=0x7f00541972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00527fc640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0054100a80 0x7f00541972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00527fc640 1 -- 172.21.15.73:0/3638933189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0054106a80 msgr2=0x7f005419bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00527fc640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0054106a80 0x7f005419bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00527fc640 1 -- 172.21.15.73:0/3638933189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005419c290 con 0x7f0054101420 2024-09-05T12:56:58.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00527fc640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0054101420 0x7f0054197820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f004800c920 tx=0x7f004800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f003bfff640 1 -- 172.21.15.73:0/3638933189 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048007c70 con 0x7f0054101420 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f003bfff640 1 -- 172.21.15.73:0/3638933189 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0048007e10 con 0x7f0054101420 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00594cc640 1 -- 172.21.15.73:0/3638933189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005419c580 con 0x7f0054101420 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f003bfff640 1 -- 172.21.15.73:0/3638933189 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048018890 con 0x7f0054101420 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.195+0000 7f00594cc640 1 -- 172.21.15.73:0/3638933189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00541a3e60 con 0x7f0054101420 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.196+0000 7f00594cc640 1 -- 172.21.15.73:0/3638933189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0054100ee0 con 0x7f0054101420 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.198+0000 7f003bfff640 1 -- 172.21.15.73:0/3638933189 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0048018a70 con 0x7f0054101420 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.198+0000 7f003bfff640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f003c0a2c90 0x7f003c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.199+0000 7f0052ffd640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f003c0a2c90 0x7f003c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.199+0000 7f003bfff640 1 -- 172.21.15.73:0/3638933189 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f00480cf370 con 0x7f0054101420 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.199+0000 7f0052ffd640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f003c0a2c90 0x7f003c0a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0044007dc0 tx=0x7f00440072f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:58.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.203+0000 7f003bfff640 1 -- 172.21.15.73:0/3638933189 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0048014030 con 0x7f0054101420 2024-09-05T12:56:58.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.372+0000 7f00594cc640 1 -- 172.21.15.73:0/3638933189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00541a4160 con 0x7f0054101420 2024-09-05T12:56:58.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.373+0000 7f003bfff640 1 -- 172.21.15.73:0/3638933189 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22645 (secure 0 0 0) 0x7f004809c1a0 con 0x7f0054101420 2024-09-05T12:56:58.393 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:58.393 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":80,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T12:56:05.055165+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T12:56:58.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.376+0000 7f00594cc640 1 -- 172.21.15.73:0/3638933189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f003c0a2c90 msgr2=0x7f003c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:58.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.376+0000 7f00594cc640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f003c0a2c90 0x7f003c0a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0044007dc0 tx=0x7f00440072f0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.376+0000 7f00594cc640 1 -- 172.21.15.73:0/3638933189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0054101420 msgr2=0x7f0054197820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:58.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.376+0000 7f00594cc640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0054101420 0x7f0054197820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f004800c920 tx=0x7f004800cde0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.376+0000 7f00594cc640 1 -- 172.21.15.73:0/3638933189 shutdown_connections 2024-09-05T12:56:58.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.376+0000 7f00594cc640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f003c0a2c90 0x7f003c0a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.376+0000 7f00594cc640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0054106a80 0x7f005419bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.376+0000 7f00594cc640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0054101420 0x7f0054197820 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.376+0000 7f00594cc640 1 --2- 172.21.15.73:0/3638933189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0054100a80 0x7f00541972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:58.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.376+0000 7f00594cc640 1 -- 172.21.15.73:0/3638933189 >> 172.21.15.73:0/3638933189 conn(0x7f00540fc7a0 msgr2=0x7f00540fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:58.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.377+0000 7f00594cc640 1 -- 172.21.15.73:0/3638933189 shutdown_connections 2024-09-05T12:56:58.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:58.377+0000 7f00594cc640 1 -- 172.21.15.73:0/3638933189 wait complete. 2024-09-05T12:56:59.032 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:56:59.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:59 smithi073 ceph-mon[30883]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:56:59.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:56:59 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3638933189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:59.281 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:56:59.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:59 smithi162 ceph-mon[34220]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:56:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:56:59 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3638933189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:59 smithi169 ceph-mon[34823]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:56:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:56:59 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3638933189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:56:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.752+0000 7ff988d90640 1 -- 172.21.15.73:0/788728522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff984102570 msgr2=0x7ff9841029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.752+0000 7ff988d90640 1 --2- 172.21.15.73:0/788728522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff984102570 0x7ff9841029b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff978009900 tx=0x7ff97802a480 comp rx=0 tx=0).stop 2024-09-05T12:56:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.752+0000 7ff988d90640 1 -- 172.21.15.73:0/788728522 shutdown_connections 2024-09-05T12:56:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.752+0000 7ff988d90640 1 --2- 172.21.15.73:0/788728522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff984102ef0 0x7ff98410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.752+0000 7ff988d90640 1 --2- 172.21.15.73:0/788728522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff984102570 0x7ff9841029b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.752+0000 7ff988d90640 1 --2- 172.21.15.73:0/788728522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff984100e20 0x7ff984101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.752+0000 7ff988d90640 1 -- 172.21.15.73:0/788728522 >> 172.21.15.73:0/788728522 conn(0x7ff9840fc7d0 msgr2=0x7ff9840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.752+0000 7ff988d90640 1 -- 172.21.15.73:0/788728522 shutdown_connections 2024-09-05T12:56:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.752+0000 7ff988d90640 1 -- 172.21.15.73:0/788728522 wait complete. 2024-09-05T12:56:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff988d90640 1 Processor -- start 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff988d90640 1 -- start start 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff988d90640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff984100e20 0x7ff984198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff988d90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff984102570 0x7ff984198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff988d90640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff984102ef0 0x7ff98419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff988d90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff984110f50 con 0x7ff984102570 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff988d90640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff984110dd0 con 0x7ff984100e20 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff988d90640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9841110d0 con 0x7ff984102ef0 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff981d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff984102570 0x7ff984198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff981d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff984102570 0x7ff984198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44258/0 (socket says 172.21.15.73:44258) 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.753+0000 7ff981d9b640 1 -- 172.21.15.73:0/3583267304 learned_addr learned my addr 172.21.15.73:0/3583267304 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff98259c640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff984100e20 0x7ff984198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:59.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff982d9d640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff984102ef0 0x7ff98419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff981d9b640 1 -- 172.21.15.73:0/3583267304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff984102ef0 msgr2=0x7ff98419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff981d9b640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff984102ef0 0x7ff98419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff981d9b640 1 -- 172.21.15.73:0/3583267304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff984100e20 msgr2=0x7ff984198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff981d9b640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff984100e20 0x7ff984198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff981d9b640 1 -- 172.21.15.73:0/3583267304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98419d4f0 con 0x7ff984102570 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff982d9d640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff984102ef0 0x7ff98419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff981d9b640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff984102570 0x7ff984198a80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff978006010 tx=0x7ff978003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff9737fe640 1 -- 172.21.15.73:0/3583267304 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97803f070 con 0x7ff984102570 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff9737fe640 1 -- 172.21.15.73:0/3583267304 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff978031c30 con 0x7ff984102570 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff988d90640 1 -- 172.21.15.73:0/3583267304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98419d780 con 0x7ff984102570 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff9737fe640 1 -- 172.21.15.73:0/3583267304 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978035030 con 0x7ff984102570 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.754+0000 7ff988d90640 1 -- 172.21.15.73:0/3583267304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9841a50c0 con 0x7ff984102570 2024-09-05T12:56:59.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.755+0000 7ff988d90640 1 -- 172.21.15.73:0/3583267304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9841021b0 con 0x7ff984102570 2024-09-05T12:56:59.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.756+0000 7ff9737fe640 1 -- 172.21.15.73:0/3583267304 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff978042070 con 0x7ff984102570 2024-09-05T12:56:59.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.757+0000 7ff9737fe640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff96c0a2c10 0x7ff96c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:56:59.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.757+0000 7ff98259c640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff96c0a2c10 0x7ff96c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:56:59.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.757+0000 7ff9737fe640 1 -- 172.21.15.73:0/3583267304 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ff9780efab0 con 0x7ff984102570 2024-09-05T12:56:59.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.757+0000 7ff98259c640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff96c0a2c10 0x7ff96c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff974005fd0 tx=0x7ff974005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:56:59.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.761+0000 7ff9737fe640 1 -- 172.21.15.73:0/3583267304 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff978031de0 con 0x7ff984102570 2024-09-05T12:56:59.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.961+0000 7ff988d90640 1 -- 172.21.15.73:0/3583267304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9841a5290 con 0x7ff984102570 2024-09-05T12:56:59.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.961+0000 7ff9737fe640 1 -- 172.21.15.73:0/3583267304 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11926 (secure 0 0 0) 0x7ff9780dae20 con 0x7ff984102570 2024-09-05T12:56:59.963 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:56:59.963 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-05T12:55:57:797257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:55:57.388420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24452,24466,24482]},"id":1}]} 2024-09-05T12:56:59.964 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-05T12:56:59.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.963+0000 7ff988d90640 1 -- 172.21.15.73:0/3583267304 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff96c0a2c10 msgr2=0x7ff96c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:59.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.963+0000 7ff988d90640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff96c0a2c10 0x7ff96c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff974005fd0 tx=0x7ff974005850 comp rx=0 tx=0).stop 2024-09-05T12:56:59.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.963+0000 7ff988d90640 1 -- 172.21.15.73:0/3583267304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff984102570 msgr2=0x7ff984198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:56:59.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.963+0000 7ff988d90640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff984102570 0x7ff984198a80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff978006010 tx=0x7ff978003c10 comp rx=0 tx=0).stop 2024-09-05T12:56:59.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.964+0000 7ff988d90640 1 -- 172.21.15.73:0/3583267304 shutdown_connections 2024-09-05T12:56:59.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.964+0000 7ff988d90640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff96c0a2c10 0x7ff96c0a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:59.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.964+0000 7ff988d90640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff984102ef0 0x7ff98419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:59.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.964+0000 7ff988d90640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff984102570 0x7ff984198a80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:59.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.964+0000 7ff988d90640 1 --2- 172.21.15.73:0/3583267304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff984100e20 0x7ff984198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:56:59.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.964+0000 7ff988d90640 1 -- 172.21.15.73:0/3583267304 >> 172.21.15.73:0/3583267304 conn(0x7ff9840fc7d0 msgr2=0x7ff984069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:56:59.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.964+0000 7ff988d90640 1 -- 172.21.15.73:0/3583267304 shutdown_connections 2024-09-05T12:56:59.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:56:59.964+0000 7ff988d90640 1 -- 172.21.15.73:0/3583267304 wait complete. 2024-09-05T12:57:00.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:00 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3583267304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:00.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:00 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3583267304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:00.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:00 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3583267304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:00.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-05T12:55:46.371642+0000', 'modified': '2024-09-05T12:55:57.388420+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24482, 'mds_1': 24466, 'mds_2': 24452}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/3122717185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 3122717185}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 3122717185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/4085562536', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 4085562536}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 4085562536}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6837/2325276065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 2325276065}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 2325276065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.162:6837/3027533309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 3027533309}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 3027533309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.169:6839/3351085082', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 3351085082}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 3351085082}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.162:6839/3413521160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 3413521160}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 3413521160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24482, 'qdb_cluster': [24452, 24466, 24482]} 2024-09-05T12:57:00.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-05T12:57:00.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.h status 2024-09-05T12:57:00.886 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:01.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:01 smithi073 ceph-mon[30883]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:01.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:01 smithi162 ceph-mon[34220]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:01.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:01 smithi169 ceph-mon[34823]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.347+0000 7f7da6330640 1 -- 172.21.15.73:0/4243524494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da0102570 msgr2=0x7f7da01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.347+0000 7f7da6330640 1 --2- 172.21.15.73:0/4243524494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da0102570 0x7f7da01029b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009900 tx=0x7f7d9402a480 comp rx=0 tx=0).stop 2024-09-05T12:57:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.347+0000 7f7da6330640 1 -- 172.21.15.73:0/4243524494 shutdown_connections 2024-09-05T12:57:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.347+0000 7f7da6330640 1 --2- 172.21.15.73:0/4243524494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7da0102ef0 0x7f7da010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.347+0000 7f7da6330640 1 --2- 172.21.15.73:0/4243524494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da0102570 0x7f7da01029b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.347+0000 7f7da6330640 1 --2- 172.21.15.73:0/4243524494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7da0100e20 0x7f7da0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.347+0000 7f7da6330640 1 -- 172.21.15.73:0/4243524494 >> 172.21.15.73:0/4243524494 conn(0x7f7da00fc7d0 msgr2=0x7f7da00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.347+0000 7f7da6330640 1 -- 172.21.15.73:0/4243524494 shutdown_connections 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.347+0000 7f7da6330640 1 -- 172.21.15.73:0/4243524494 wait complete. 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.348+0000 7f7da6330640 1 Processor -- start 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.348+0000 7f7da6330640 1 -- start start 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.348+0000 7f7da6330640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da0100e20 0x7f7da0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.348+0000 7f7da6330640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7da0102570 0x7f7da0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.348+0000 7f7da6330640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7da0102ef0 0x7f7da019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.348+0000 7f7da6330640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0110fa0 con 0x7f7da0100e20 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.348+0000 7f7da6330640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0110e20 con 0x7f7da0102ef0 2024-09-05T12:57:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.348+0000 7f7da6330640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0111120 con 0x7f7da0102570 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.348+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da0100e20 0x7f7da0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da0100e20 0x7f7da0198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44278/0 (socket says 172.21.15.73:44278) 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9ffff640 1 -- 172.21.15.73:0/520009072 learned_addr learned my addr 172.21.15.73:0/520009072 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9f7fe640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7da0102570 0x7f7da0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7da48cd640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7da0102ef0 0x7f7da019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9ffff640 1 -- 172.21.15.73:0/520009072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7da0102570 msgr2=0x7f7da0198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9ffff640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7da0102570 0x7f7da0198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9ffff640 1 -- 172.21.15.73:0/520009072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7da0102ef0 msgr2=0x7f7da019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9ffff640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7da0102ef0 0x7f7da019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9ffff640 1 -- 172.21.15.73:0/520009072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da019d540 con 0x7f7da0100e20 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9ffff640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da0100e20 0x7f7da0198590 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c920 tx=0x7f7d9000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9d7fa640 1 -- 172.21.15.73:0/520009072 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90007c70 con 0x7f7da0100e20 2024-09-05T12:57:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9d7fa640 1 -- 172.21.15.73:0/520009072 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d90007e10 con 0x7f7da0100e20 2024-09-05T12:57:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7da6330640 1 -- 172.21.15.73:0/520009072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da019d830 con 0x7f7da0100e20 2024-09-05T12:57:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7d9d7fa640 1 -- 172.21.15.73:0/520009072 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90018890 con 0x7f7da0100e20 2024-09-05T12:57:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.349+0000 7f7da6330640 1 -- 172.21.15.73:0/520009072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da01a5110 con 0x7f7da0100e20 2024-09-05T12:57:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7d9d7fa640 1 -- 172.21.15.73:0/520009072 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7d90018a70 con 0x7f7da0100e20 2024-09-05T12:57:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da8706740 1 Processor -- start 2024-09-05T12:57:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da8706740 1 -- start start 2024-09-05T12:57:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da8706740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158979890 0x559158979c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7d9d7fa640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7d880a2c10 0x7f7d880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da8706740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55915897a1b0 0x559158988a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da8706740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x55915898b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da8706740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5591588e0090 con 0x559158988fc0 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da8706740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559158887a70 con 0x559158979890 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da8706740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5591588dc050 con 0x55915897a1b0 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da48cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x55915898b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da48cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x55915898b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44288/0 (socket says 172.21.15.73:44288) 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7da48cd640 1 -- 172.21.15.73:0/2660800606 learned_addr learned my addr 172.21.15.73:0/2660800606 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7d9ffff640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7d880a2c10 0x7f7d880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.352+0000 7f7d9d7fa640 1 -- 172.21.15.73:0/520009072 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f7d900cf3a0 con 0x7f7da0100e20 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2660800606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158979890 0x559158979c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7d9f7fe640 1 --2- 172.21.15.73:0/2660800606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55915897a1b0 0x559158988a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7da48cd640 1 -- 172.21.15.73:0/2660800606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55915897a1b0 msgr2=0x559158988a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2660800606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55915897a1b0 0x559158988a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7da48cd640 1 -- 172.21.15.73:0/2660800606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158979890 msgr2=0x559158979c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2660800606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158979890 0x559158979c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7da48cd640 1 -- 172.21.15.73:0/2660800606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559158894130 con 0x559158988fc0 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2660800606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x55915898b3b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800c630 tx=0x7f7d98009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9b0561449445e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7d9ffff640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7d880a2c10 0x7f7d880a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7d9009b7d0 tx=0x7f7d90020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7d867fc640 1 -- 172.21.15.73:0/2660800606 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98007700 con 0x559158988fc0 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7d867fc640 1 -- 172.21.15.73:0/2660800606 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d98007d80 con 0x559158988fc0 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.353+0000 7f7d867fc640 1 -- 172.21.15.73:0/2660800606 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98019d70 con 0x559158988fc0 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 -- 172.21.15.73:0/2660800606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 msgr2=0x55915898b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 --2- 172.21.15.73:0/2660800606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x55915898b3b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800c630 tx=0x7f7d98009990 comp rx=0 tx=0).stop 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 -- 172.21.15.73:0/2660800606 shutdown_connections 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 --2- 172.21.15.73:0/2660800606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x55915898b3b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 --2- 172.21.15.73:0/2660800606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55915897a1b0 0x559158988a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 --2- 172.21.15.73:0/2660800606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158979890 0x559158979c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 -- 172.21.15.73:0/2660800606 >> 172.21.15.73:0/2660800606 conn(0x559158975f60 msgr2=0x559158976340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 -- 172.21.15.73:0/2660800606 shutdown_connections 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 -- 172.21.15.73:0/2660800606 wait complete. 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 -- start start 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.354+0000 7f7da8706740 1 Processor -- start 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da8706740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559158979890 0x5591589888f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da8706740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55915897a1b0 0x559158985c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da8706740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x559158986180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da8706740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55915898bc20 con 0x559158988fc0 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da8706740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55915889af20 con 0x55915897a1b0 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da8706740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55915898bda0 con 0x559158979890 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da8706740 10 client.0 _ll_register_callbacks cb 0x559158864030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da48cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x559158986180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da48cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x559158986180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44298/0 (socket says 172.21.15.73:44298) 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da48cd640 1 -- 172.21.15.73:0/1368626638 learned_addr learned my addr 172.21.15.73:0/1368626638 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da48cd640 1 -- 172.21.15.73:0/1368626638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559158979890 msgr2=0x5591589888f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da48cd640 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559158979890 0x5591589888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da48cd640 1 -- 172.21.15.73:0/1368626638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55915897a1b0 msgr2=0x559158985c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da48cd640 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55915897a1b0 0x559158985c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da48cd640 1 -- 172.21.15.73:0/1368626638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591586512b0 con 0x559158988fc0 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da48cd640 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x559158986180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7d98004b90 tx=0x7f7d98019970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32438fbb1a14f3e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7d7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/1368626638 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98020030 con 0x559158988fc0 2024-09-05T12:57:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/1368626638 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f7d98019bb0 con 0x559158988fc0 2024-09-05T12:57:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da8706740 1 -- 172.21.15.73:0/1368626638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d98007d80 con 0x559158988fc0 2024-09-05T12:57:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/1368626638 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7d9802b050 con 0x559158988fc0 2024-09-05T12:57:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da8706740 10 client.14967 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.355+0000 7f7da8706740 1 -- 172.21.15.73:0/1368626638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559158997610 con 0x559158988fc0 2024-09-05T12:57:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/1368626638 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d98007d80 con 0x559158988fc0 2024-09-05T12:57:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/1368626638 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7d9800aa70 con 0x559158988fc0 2024-09-05T12:57:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7da8706740 10 client.14967 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7da8706740 10 client.14967 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-05T12:57:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7da8706740 20 client.14967 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7da8706740 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5591589997e0 0x55915899ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7da8706740 4 client.14967 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7da8706740 1 -- 172.21.15.73:0/1368626638 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591588ed600 con 0x5591589997e0 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7d9f7fe640 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5591589997e0 0x55915899ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7d7f7fe640 10 client.14967 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.356+0000 7f7d9f7fe640 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5591589997e0 0x55915899ac50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6282055d825612d1 server_cookie=83e155d46e109e19 in_seq=0 out_seq=0 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.357+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/1368626638 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591588ed600 con 0x5591589997e0 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.357+0000 7f7d7f7fe640 10 client.14967 handle_command_reply: tid=0 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.357+0000 7f7da8706740 1 client.14967 shutdown 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.357+0000 7f7da8706740 1 -- 172.21.15.73:0/1368626638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 msgr2=0x559158986180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.357+0000 7f7da8706740 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x559158986180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7d98004b90 tx=0x7f7d98019970 comp rx=0 tx=0).stop 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.357+0000 7f7da8706740 1 -- 172.21.15.73:0/1368626638 shutdown_connections 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.357+0000 7f7da8706740 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158988fc0 0x559158986180 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.357+0000 7f7da8706740 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55915897a1b0 0x559158985c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.357+0000 7f7da8706740 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5591589997e0 0x55915899ac50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.357+0000 7f7da8706740 1 --2- 172.21.15.73:0/1368626638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559158979890 0x5591589888f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.358+0000 7f7d7f7fe640 0 client.14967 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T12:57:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.358+0000 7f7da8706740 1 -- 172.21.15.73:0/1368626638 >> 172.21.15.73:0/1368626638 conn(0x559158975f60 msgr2=0x55915897bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.358+0000 7f7da8706740 1 -- 172.21.15.73:0/1368626638 shutdown_connections 2024-09-05T12:57:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.358+0000 7f7da8706740 1 -- 172.21.15.73:0/1368626638 wait complete. 2024-09-05T12:57:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.358+0000 7f7da8706740 20 client.14967 trim_cache size 0 max 16384 2024-09-05T12:57:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.375+0000 7f7da8706740 1 Processor -- start 2024-09-05T12:57:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.375+0000 7f7da8706740 1 -- start start 2024-09-05T12:57:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.375+0000 7f7da8706740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158979890 0x559158999110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.375+0000 7f7da8706740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55915897a1b0 0x55915899a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.375+0000 7f7da8706740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158988fc0 0x559158985520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.375+0000 7f7da8706740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559158998f90 con 0x559158979890 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.375+0000 7f7da8706740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559158999660 con 0x559158988fc0 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.375+0000 7f7da8706740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559158999d30 con 0x55915897a1b0 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7da48cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158979890 0x559158999110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7da48cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158979890 0x559158999110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44312/0 (socket says 172.21.15.73:44312) 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7da48cd640 1 -- 172.21.15.73:0/2677040928 learned_addr learned my addr 172.21.15.73:0/2677040928 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7d9f7fe640 1 --2- 172.21.15.73:0/2677040928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55915897a1b0 0x55915899a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7da48cd640 1 -- 172.21.15.73:0/2677040928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55915897a1b0 msgr2=0x55915899a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2677040928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55915897a1b0 0x55915899a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7da48cd640 1 -- 172.21.15.73:0/2677040928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158988fc0 msgr2=0x559158985520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2677040928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158988fc0 0x559158985520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7da48cd640 1 -- 172.21.15.73:0/2677040928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559158988510 con 0x559158979890 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2677040928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158979890 0x559158999110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009be0 tx=0x7f7d980276b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8697db611d2a62a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7d85ffb640 1 -- 172.21.15.73:0/2677040928 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98034070 con 0x559158979890 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7d85ffb640 1 -- 172.21.15.73:0/2677040928 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d9801d070 con 0x559158979890 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.376+0000 7f7d85ffb640 1 -- 172.21.15.73:0/2677040928 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98020030 con 0x559158979890 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 -- 172.21.15.73:0/2677040928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158979890 msgr2=0x559158999110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 --2- 172.21.15.73:0/2677040928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158979890 0x559158999110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009be0 tx=0x7f7d980276b0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 -- 172.21.15.73:0/2677040928 shutdown_connections 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 --2- 172.21.15.73:0/2677040928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158988fc0 0x559158985520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 --2- 172.21.15.73:0/2677040928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55915897a1b0 0x55915899a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 --2- 172.21.15.73:0/2677040928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559158979890 0x559158999110 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 -- 172.21.15.73:0/2677040928 >> 172.21.15.73:0/2677040928 conn(0x559158975f60 msgr2=0x559158985c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 -- 172.21.15.73:0/2677040928 shutdown_connections 2024-09-05T12:57:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 -- 172.21.15.73:0/2677040928 wait complete. 2024-09-05T12:57:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 -- start start 2024-09-05T12:57:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.377+0000 7f7da8706740 1 Processor -- start 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7da8706740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559158979890 0x5591589835d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7da8706740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55915897a1b0 0x559158981eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7da8706740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158988fc0 0x5591589823f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7da8706740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55915899aad0 con 0x55915897a1b0 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7da8706740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55915899a400 con 0x559158988fc0 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7da8706740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55915899b1a0 con 0x559158979890 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7da8706740 10 client.0 _ll_register_callbacks cb 0x7f7d9800c460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d9f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55915897a1b0 0x559158981eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d9f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55915897a1b0 0x559158981eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44318/0 (socket says 172.21.15.73:44318) 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d9f7fe640 1 -- 172.21.15.73:0/2903948162 learned_addr learned my addr 172.21.15.73:0/2903948162 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158988fc0 0x5591589823f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559158979890 0x5591589835d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d9f7fe640 1 -- 172.21.15.73:0/2903948162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559158979890 msgr2=0x5591589835d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d9f7fe640 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559158979890 0x5591589835d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d9f7fe640 1 -- 172.21.15.73:0/2903948162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158988fc0 msgr2=0x5591589823f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d9f7fe640 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158988fc0 0x5591589823f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d9f7fe640 1 -- 172.21.15.73:0/2903948162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559158982a30 con 0x55915897a1b0 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d9f7fe640 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55915897a1b0 0x559158981eb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d940314e0 tx=0x7f7d94004350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfdeac6fa8c0fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.378+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/2903948162 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94035050 con 0x55915897a1b0 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/2903948162 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f7d94005220 con 0x55915897a1b0 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7da8706740 1 -- 172.21.15.73:0/2903948162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d9801d070 con 0x55915897a1b0 2024-09-05T12:57:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/2903948162 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7d94053050 con 0x55915897a1b0 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7da8706740 10 client.14973 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7da8706740 1 -- 172.21.15.73:0/2903948162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5591589a2d70 con 0x55915897a1b0 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/2903948162 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d9801d070 con 0x55915897a1b0 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/2903948162 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7d94004830 con 0x55915897a1b0 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7da8706740 10 client.14973 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7da8706740 10 client.14973 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7da8706740 20 client.14973 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7da8706740 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559158a07a90 0x559158a067a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7da8706740 4 client.14973 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7da8706740 1 -- 172.21.15.73:0/2903948162 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "status"}) -- 0x5591588e7b10 con 0x559158a07a90 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.379+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559158a07a90 0x559158a067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da48cd640 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559158a07a90 0x559158a067a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39d91c30d22ff7cd server_cookie=614c4ce62b75a7 in_seq=0 out_seq=0 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7d7f7fe640 10 client.14973 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T12:57:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7d7f7fe640 1 -- 172.21.15.73:0/2903948162 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5591588e7b10 con 0x559158a07a90 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7d7f7fe640 10 client.14973 handle_command_reply: tid=0 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 client.14973 shutdown 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 -- 172.21.15.73:0/2903948162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55915897a1b0 msgr2=0x559158981eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55915897a1b0 0x559158981eb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d940314e0 tx=0x7f7d94004350 comp rx=0 tx=0).stop 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 -- 172.21.15.73:0/2903948162 shutdown_connections 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559158988fc0 0x5591589823f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55915897a1b0 0x559158981eb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559158a07a90 0x559158a067a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 --2- 172.21.15.73:0/2903948162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559158979890 0x5591589835d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7d7f7fe640 0 client.14973 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 -- 172.21.15.73:0/2903948162 >> 172.21.15.73:0/2903948162 conn(0x559158975f60 msgr2=0x559158980a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 -- 172.21.15.73:0/2903948162 shutdown_connections 2024-09-05T12:57:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 1 -- 172.21.15.73:0/2903948162 wait complete. 2024-09-05T12:57:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.380+0000 7f7da8706740 20 client.14973 trim_cache size 0 max 16384 2024-09-05T12:57:01.399 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:57:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "febf1dd4-6b84-11ef-bcd6-c7b262605968", 2024-09-05T12:57:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 2, 2024-09-05T12:57:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24452, 2024-09-05T12:57:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-05T12:57:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-05T12:57:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-05T12:57:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 66.591603560999999, 2024-09-05T12:57:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 24, 2024-09-05T12:57:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 80, 2024-09-05T12:57:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 78, 2024-09-05T12:57:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 96.848393556999994 2024-09-05T12:57:01.400 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:57:01.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 -- 172.21.15.73:0/520009072 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7d880a2c10 msgr2=0x7f7d880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:01.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7d880a2c10 0x7f7d880a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7d9009b7d0 tx=0x7f7d90020000 comp rx=0 tx=0).stop 2024-09-05T12:57:01.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 -- 172.21.15.73:0/520009072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da0100e20 msgr2=0x7f7da0198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:01.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da0100e20 0x7f7da0198590 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c920 tx=0x7f7d9000cde0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 -- 172.21.15.73:0/520009072 shutdown_connections 2024-09-05T12:57:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7d880a2c10 0x7f7d880a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7da0102ef0 0x7f7da019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7da0102570 0x7f7da0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 --2- 172.21.15.73:0/520009072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da0100e20 0x7f7da0198590 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 -- 172.21.15.73:0/520009072 >> 172.21.15.73:0/520009072 conn(0x7f7da00fc7d0 msgr2=0x7f7da006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 -- 172.21.15.73:0/520009072 shutdown_connections 2024-09-05T12:57:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:01.381+0000 7f7da6330640 1 -- 172.21.15.73:0/520009072 wait complete. 2024-09-05T12:57:02.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.i status 2024-09-05T12:57:02.398 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:02.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:02 smithi073 ceph-mon[30883]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:02.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:02 smithi162 ceph-mon[34220]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:02.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:02 smithi169 ceph-mon[34823]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:02.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.875+0000 7fa45c73e640 1 -- 172.21.15.73:0/3840774726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa454100a80 msgr2=0x7fa454100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:02.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.875+0000 7fa45c73e640 1 --2- 172.21.15.73:0/3840774726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa454100a80 0x7fa454100ee0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa444009930 tx=0x7fa44402a420 comp rx=0 tx=0).stop 2024-09-05T12:57:02.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.875+0000 7fa45c73e640 1 -- 172.21.15.73:0/3840774726 shutdown_connections 2024-09-05T12:57:02.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.875+0000 7fa45c73e640 1 --2- 172.21.15.73:0/3840774726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa454101420 0x7fa45410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.875+0000 7fa45c73e640 1 --2- 172.21.15.73:0/3840774726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa454100a80 0x7fa454100ee0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.875+0000 7fa45c73e640 1 --2- 172.21.15.73:0/3840774726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa454106a80 0x7fa454106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.875+0000 7fa45c73e640 1 -- 172.21.15.73:0/3840774726 >> 172.21.15.73:0/3840774726 conn(0x7fa4540fc7a0 msgr2=0x7fa4540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.875+0000 7fa45c73e640 1 -- 172.21.15.73:0/3840774726 shutdown_connections 2024-09-05T12:57:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.876+0000 7fa45c73e640 1 -- 172.21.15.73:0/3840774726 wait complete. 2024-09-05T12:57:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.876+0000 7fa45c73e640 1 Processor -- start 2024-09-05T12:57:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.876+0000 7fa45c73e640 1 -- start start 2024-09-05T12:57:02.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.876+0000 7fa45c73e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa454100a80 0x7fa4541974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.876+0000 7fa45c73e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa454101420 0x7fa454197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45c73e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa454106a80 0x7fa45419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45c73e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa454110f20 con 0x7fa454100a80 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45c73e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa454110da0 con 0x7fa454101420 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45c73e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4541110a0 con 0x7fa454106a80 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45a4da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa454100a80 0x7fa4541974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45a4da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa454100a80 0x7fa4541974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44332/0 (socket says 172.21.15.73:44332) 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45a4da640 1 -- 172.21.15.73:0/2256907603 learned_addr learned my addr 172.21.15.73:0/2256907603 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45acdb640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa454106a80 0x7fa45419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa459cd9640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa454101420 0x7fa454197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45a4da640 1 -- 172.21.15.73:0/2256907603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa454106a80 msgr2=0x7fa45419bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45a4da640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa454106a80 0x7fa45419bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45a4da640 1 -- 172.21.15.73:0/2256907603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa454101420 msgr2=0x7fa454197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45a4da640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa454101420 0x7fa454197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45a4da640 1 -- 172.21.15.73:0/2256907603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45419c4a0 con 0x7fa454100a80 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45acdb640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa454106a80 0x7fa45419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa459cd9640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa454101420 0x7fa454197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45a4da640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa454100a80 0x7fa4541974f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa45000ba50 tx=0x7fa45000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa44b7fe640 1 -- 172.21.15.73:0/2256907603 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450019070 con 0x7fa454100a80 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa44b7fe640 1 -- 172.21.15.73:0/2256907603 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa45000cbe0 con 0x7fa454100a80 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45c73e640 1 -- 172.21.15.73:0/2256907603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45419c790 con 0x7fa454100a80 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa44b7fe640 1 -- 172.21.15.73:0/2256907603 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4500076e0 con 0x7fa454100a80 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.877+0000 7fa45c73e640 1 -- 172.21.15.73:0/2256907603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4541a4070 con 0x7fa454100a80 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa44b7fe640 1 -- 172.21.15.73:0/2256907603 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa45001c070 con 0x7fa454100a80 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45eb14740 1 Processor -- start 2024-09-05T12:57:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45eb14740 1 -- start start 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b8f6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b901670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b901bb0 0x56324b903fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45eb14740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56324b85d090 con 0x56324b8f69d0 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45eb14740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56324b804a70 con 0x56324b901bb0 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45eb14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56324b859050 con 0x56324b8f72f0 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45acdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b8f6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45acdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b8f6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44334/0 (socket says 172.21.15.73:44334) 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.880+0000 7fa45acdb640 1 -- 172.21.15.73:0/2070340493 learned_addr learned my addr 172.21.15.73:0/2070340493 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa44b7fe640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa4400a2c90 0x7fa4400a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa45a4da640 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b901670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa459cd9640 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b901bb0 0x56324b903fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa45acdb640 1 -- 172.21.15.73:0/2070340493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 msgr2=0x56324b901670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa45acdb640 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b901670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa45acdb640 1 -- 172.21.15.73:0/2070340493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b901bb0 msgr2=0x56324b903fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa45acdb640 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b901bb0 0x56324b903fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa45acdb640 1 -- 172.21.15.73:0/2070340493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324b811130 con 0x56324b8f69d0 2024-09-05T12:57:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa45a4da640 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b901670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:02.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa459cd9640 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b901bb0 0x56324b903fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:02.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa44b7fe640 1 -- 172.21.15.73:0/2256907603 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fa4500ce650 con 0x7fa454100a80 2024-09-05T12:57:02.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa45acdb640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa4400a2c90 0x7fa4400a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa45acdb640 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b8f6db0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00ab10 tx=0x7fa44c00c150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e1ed4cfdbe58d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:02.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa448ff9640 1 -- 172.21.15.73:0/2070340493 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c013610 con 0x56324b8f69d0 2024-09-05T12:57:02.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa448ff9640 1 -- 172.21.15.73:0/2070340493 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa44c013c90 con 0x56324b8f69d0 2024-09-05T12:57:02.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.881+0000 7fa448ff9640 1 -- 172.21.15.73:0/2070340493 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c01cac0 con 0x56324b8f69d0 2024-09-05T12:57:02.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 -- 172.21.15.73:0/2070340493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 msgr2=0x56324b8f6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:02.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b8f6db0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00ab10 tx=0x7fa44c00c150 comp rx=0 tx=0).stop 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45acdb640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa4400a2c90 0x7fa4400a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa44c01e000 tx=0x7fa44c01b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 -- 172.21.15.73:0/2070340493 shutdown_connections 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b901bb0 0x56324b903fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b901670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 --2- 172.21.15.73:0/2070340493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b8f6db0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 -- 172.21.15.73:0/2070340493 >> 172.21.15.73:0/2070340493 conn(0x56324b8f2f60 msgr2=0x56324b8f3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 -- 172.21.15.73:0/2070340493 shutdown_connections 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 -- 172.21.15.73:0/2070340493 wait complete. 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 -- start start 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.882+0000 7fa45eb14740 1 Processor -- start 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f69d0 0x56324b9013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b8fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b8fec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45eb14740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56324b904780 con 0x56324b901bb0 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45eb14740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56324b817f20 con 0x56324b8f69d0 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45eb14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56324b904900 con 0x56324b8f72f0 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45eb14740 10 client.0 _ll_register_callbacks cb 0x56324b7e1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45acdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b8fec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45acdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b8fec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44346/0 (socket says 172.21.15.73:44346) 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45acdb640 1 -- 172.21.15.73:0/1282440055 learned_addr learned my addr 172.21.15.73:0/1282440055 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45a4da640 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f69d0 0x56324b9013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa459cd9640 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b8fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45acdb640 1 -- 172.21.15.73:0/1282440055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 msgr2=0x56324b8fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45acdb640 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b8fe6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45acdb640 1 -- 172.21.15.73:0/1282440055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f69d0 msgr2=0x56324b9013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45acdb640 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f69d0 0x56324b9013a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45acdb640 1 -- 172.21.15.73:0/1282440055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324b5ce2b0 con 0x56324b901bb0 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa459cd9640 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b8fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa45acdb640 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b8fec30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00a480 tx=0x7fa44c006c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da266c70b89c9bec server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.883+0000 7fa43dffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa43dffb640 1 -- 172.21.15.73:0/1282440055 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c013e40 con 0x56324b901bb0 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa43dffb640 1 -- 172.21.15.73:0/1282440055 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fa44c013410 con 0x56324b901bb0 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa45eb14740 1 -- 172.21.15.73:0/1282440055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa44c013c90 con 0x56324b901bb0 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa43dffb640 1 -- 172.21.15.73:0/1282440055 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa44c036070 con 0x56324b901bb0 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa45eb14740 10 client.14985 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa45eb14740 1 -- 172.21.15.73:0/1282440055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56324b90ff60 con 0x56324b901bb0 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa43dffb640 1 -- 172.21.15.73:0/1282440055 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa44c013c90 con 0x56324b901bb0 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa43dffb640 1 -- 172.21.15.73:0/1282440055 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa44c026040 con 0x56324b901bb0 2024-09-05T12:57:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa45eb14740 10 client.14985 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa45eb14740 10 client.14985 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa45eb14740 20 client.14985 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa45eb14740 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x56324b9121a0 0x56324b913610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa45eb14740 4 client.14985 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.884+0000 7fa45eb14740 1 -- 172.21.15.73:0/1282440055 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56324b86a600 con 0x56324b9121a0 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.885+0000 7fa45a4da640 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x56324b9121a0 0x56324b913610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.885+0000 7fa43dffb640 10 client.14985 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.885+0000 7fa45a4da640 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x56324b9121a0 0x56324b913610 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b382b9f548f526ca server_cookie=beab8aac658f2c22 in_seq=0 out_seq=0 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa43dffb640 1 -- 172.21.15.73:0/1282440055 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56324b86a600 con 0x56324b9121a0 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa43dffb640 10 client.14985 handle_command_reply: tid=0 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa45eb14740 1 client.14985 shutdown 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa45eb14740 1 -- 172.21.15.73:0/1282440055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 msgr2=0x56324b8fec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa45eb14740 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b8fec30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00a480 tx=0x7fa44c006c90 comp rx=0 tx=0).stop 2024-09-05T12:57:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa45eb14740 1 -- 172.21.15.73:0/1282440055 shutdown_connections 2024-09-05T12:57:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa45eb14740 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x56324b9121a0 0x56324b913610 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa45eb14740 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b8fec30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa45eb14740 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b8fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa45eb14740 1 --2- 172.21.15.73:0/1282440055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f69d0 0x56324b9013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa45eb14740 1 -- 172.21.15.73:0/1282440055 >> 172.21.15.73:0/1282440055 conn(0x56324b8f2f60 msgr2=0x56324b8f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.886+0000 7fa43dffb640 0 client.14985 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T12:57:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.887+0000 7fa45eb14740 1 -- 172.21.15.73:0/1282440055 shutdown_connections 2024-09-05T12:57:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.887+0000 7fa45eb14740 1 -- 172.21.15.73:0/1282440055 wait complete. 2024-09-05T12:57:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.887+0000 7fa45eb14740 20 client.14985 trim_cache size 0 max 16384 2024-09-05T12:57:02.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.904+0000 7fa45eb14740 1 Processor -- start 2024-09-05T12:57:02.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.904+0000 7fa45eb14740 1 -- start start 2024-09-05T12:57:02.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.904+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b9121a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.904+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f72f0 0x56324b8f9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.904+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b901bb0 0x56324b91b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.904+0000 7fa45eb14740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56324b911950 con 0x56324b8f69d0 2024-09-05T12:57:02.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.904+0000 7fa45eb14740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56324b912020 con 0x56324b8f72f0 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.904+0000 7fa45eb14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56324b9126f0 con 0x56324b901bb0 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa45a4da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b9121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa45a4da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b9121a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44356/0 (socket says 172.21.15.73:44356) 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa45a4da640 1 -- 172.21.15.73:0/3098562263 learned_addr learned my addr 172.21.15.73:0/3098562263 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa45acdb640 1 --2- 172.21.15.73:0/3098562263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b901bb0 0x56324b91b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa459cd9640 1 --2- 172.21.15.73:0/3098562263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f72f0 0x56324b8f9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa45a4da640 1 -- 172.21.15.73:0/3098562263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b901bb0 msgr2=0x56324b91b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa45a4da640 1 --2- 172.21.15.73:0/3098562263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b901bb0 0x56324b91b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa45a4da640 1 -- 172.21.15.73:0/3098562263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f72f0 msgr2=0x56324b8f9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa45a4da640 1 --2- 172.21.15.73:0/3098562263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f72f0 0x56324b8f9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa45a4da640 1 -- 172.21.15.73:0/3098562263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324b8f67e0 con 0x56324b8f69d0 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa459cd9640 1 --2- 172.21.15.73:0/3098562263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f72f0 0x56324b8f9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa45a4da640 1 --2- 172.21.15.73:0/3098562263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b9121a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa4500cc1c0 tx=0x7fa4500d0b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da6f78a02f19925 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa43ffff640 1 -- 172.21.15.73:0/3098562263 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4500a3b00 con 0x56324b8f69d0 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa43ffff640 1 -- 172.21.15.73:0/3098562263 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa45000cd90 con 0x56324b8f69d0 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.905+0000 7fa43ffff640 1 -- 172.21.15.73:0/3098562263 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4500a38d0 con 0x56324b8f69d0 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 -- 172.21.15.73:0/3098562263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 msgr2=0x56324b9121a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 --2- 172.21.15.73:0/3098562263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b9121a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa4500cc1c0 tx=0x7fa4500d0b30 comp rx=0 tx=0).stop 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 -- 172.21.15.73:0/3098562263 shutdown_connections 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 --2- 172.21.15.73:0/3098562263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b901bb0 0x56324b91b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 --2- 172.21.15.73:0/3098562263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f72f0 0x56324b8f9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 --2- 172.21.15.73:0/3098562263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b8f69d0 0x56324b9121a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 -- 172.21.15.73:0/3098562263 >> 172.21.15.73:0/3098562263 conn(0x56324b8f2f60 msgr2=0x56324b8f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 -- 172.21.15.73:0/3098562263 shutdown_connections 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 -- 172.21.15.73:0/3098562263 wait complete. 2024-09-05T12:57:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 -- start start 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 Processor -- start 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f69d0 0x56324b91bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b91c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b914ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56324b913490 con 0x56324b901bb0 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56324b912dc0 con 0x56324b8f69d0 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.906+0000 7fa45eb14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56324b913b60 con 0x56324b8f72f0 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45eb14740 10 client.0 _ll_register_callbacks cb 0x7fa44c00a940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45acdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b914ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45acdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b914ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44364/0 (socket says 172.21.15.73:44364) 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45acdb640 1 -- 172.21.15.73:0/3262957661 learned_addr learned my addr 172.21.15.73:0/3262957661 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa459cd9640 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b91c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45a4da640 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f69d0 0x56324b91bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45acdb640 1 -- 172.21.15.73:0/3262957661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 msgr2=0x56324b91c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45acdb640 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b91c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45acdb640 1 -- 172.21.15.73:0/3262957661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f69d0 msgr2=0x56324b91bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45acdb640 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f69d0 0x56324b91bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45acdb640 1 -- 172.21.15.73:0/3262957661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324b915720 con 0x56324b901bb0 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45acdb640 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b914ef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00a910 tx=0x7fa44c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5303ae3e613bb551 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa43dffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa43dffb640 1 -- 172.21.15.73:0/3262957661 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c03f020 con 0x56324b901bb0 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa43dffb640 1 -- 172.21.15.73:0/3262957661 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fa44c02f400 con 0x56324b901bb0 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45eb14740 1 -- 172.21.15.73:0/3262957661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa45000cd90 con 0x56324b901bb0 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa43dffb640 1 -- 172.21.15.73:0/3262957661 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa44c02fe00 con 0x56324b901bb0 2024-09-05T12:57:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45eb14740 10 client.14991 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.907+0000 7fa45eb14740 1 -- 172.21.15.73:0/3262957661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56324b91a200 con 0x56324b901bb0 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa43dffb640 1 -- 172.21.15.73:0/3262957661 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa45000cd90 con 0x56324b901bb0 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa43dffb640 1 -- 172.21.15.73:0/3262957661 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa44c026040 con 0x56324b901bb0 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa45eb14740 10 client.14991 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa45eb14740 10 client.14991 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa45eb14740 20 client.14991 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa45eb14740 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x56324b985360 0x56324b984070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa45eb14740 4 client.14991 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa45eb14740 1 -- 172.21.15.73:0/3262957661 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "status"}) -- 0x56324b864b10 con 0x56324b985360 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa45a4da640 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x56324b985360 0x56324b984070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa45a4da640 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x56324b985360 0x56324b984070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6ff75f3af33e7326 server_cookie=c4d4e855d872439a in_seq=0 out_seq=0 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.908+0000 7fa43dffb640 10 client.14991 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa43dffb640 1 -- 172.21.15.73:0/3262957661 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56324b864b10 con 0x56324b985360 2024-09-05T12:57:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa43dffb640 10 client.14991 handle_command_reply: tid=0 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 client.14991 shutdown 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 -- 172.21.15.73:0/3262957661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 msgr2=0x56324b914ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b914ef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00a910 tx=0x7fa44c0046c0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 -- 172.21.15.73:0/3262957661 shutdown_connections 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x56324b985360 0x56324b984070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa43dffb640 0 client.14991 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56324b901bb0 0x56324b914ef0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56324b8f72f0 0x56324b91c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 --2- 172.21.15.73:0/3262957661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56324b8f69d0 0x56324b91bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 -- 172.21.15.73:0/3262957661 >> 172.21.15.73:0/3262957661 conn(0x56324b8f2f60 msgr2=0x56324b8f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 -- 172.21.15.73:0/3262957661 shutdown_connections 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 1 -- 172.21.15.73:0/3262957661 wait complete. 2024-09-05T12:57:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45eb14740 20 client.14991 trim_cache size 0 max 16384 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "febf1dd4-6b84-11ef-bcd6-c7b262605968", 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 1, 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24466, 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 69.132996356999996, 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 24, 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 80, 2024-09-05T12:57:02.923 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 78, 2024-09-05T12:57:02.924 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 95.715174731999994 2024-09-05T12:57:02.924 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45c73e640 1 -- 172.21.15.73:0/2256907603 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa4400a2c90 msgr2=0x7fa4400a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45c73e640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa4400a2c90 0x7fa4400a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa44c01e000 tx=0x7fa44c01b000 comp rx=0 tx=0).stop 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45c73e640 1 -- 172.21.15.73:0/2256907603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa454100a80 msgr2=0x7fa4541974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45c73e640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa454100a80 0x7fa4541974f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa45000ba50 tx=0x7fa45000bf10 comp rx=0 tx=0).stop 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45c73e640 1 -- 172.21.15.73:0/2256907603 shutdown_connections 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45c73e640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa4400a2c90 0x7fa4400a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45c73e640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa454106a80 0x7fa45419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45c73e640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa454101420 0x7fa454197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.909+0000 7fa45c73e640 1 --2- 172.21.15.73:0/2256907603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa454100a80 0x7fa4541974f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.910+0000 7fa45c73e640 1 -- 172.21.15.73:0/2256907603 >> 172.21.15.73:0/2256907603 conn(0x7fa4540fc7a0 msgr2=0x7fa4540fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.910+0000 7fa45c73e640 1 -- 172.21.15.73:0/2256907603 shutdown_connections 2024-09-05T12:57:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:02.910+0000 7fa45c73e640 1 -- 172.21.15.73:0/2256907603 wait complete. 2024-09-05T12:57:03.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.b status 2024-09-05T12:57:03.961 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:04.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.446+0000 7f52514a4640 1 -- 172.21.15.73:0/1192247979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f524c101df0 msgr2=0x7f524c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:04.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.446+0000 7f52514a4640 1 --2- 172.21.15.73:0/1192247979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f524c101df0 0x7f524c1021d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f523c009900 tx=0x7f523c02a410 comp rx=0 tx=0).stop 2024-09-05T12:57:04.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.446+0000 7f52514a4640 1 -- 172.21.15.73:0/1192247979 shutdown_connections 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.446+0000 7f52514a4640 1 --2- 172.21.15.73:0/1192247979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f524c106f20 0x7f524c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.446+0000 7f52514a4640 1 --2- 172.21.15.73:0/1192247979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c1027a0 0x7f524c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.446+0000 7f52514a4640 1 --2- 172.21.15.73:0/1192247979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f524c101df0 0x7f524c1021d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.446+0000 7f52514a4640 1 -- 172.21.15.73:0/1192247979 >> 172.21.15.73:0/1192247979 conn(0x7f524c0fd8b0 msgr2=0x7f524c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.446+0000 7f52514a4640 1 -- 172.21.15.73:0/1192247979 shutdown_connections 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.446+0000 7f52514a4640 1 -- 172.21.15.73:0/1192247979 wait complete. 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f52514a4640 1 Processor -- start 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f52514a4640 1 -- start start 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f52514a4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f524c101df0 0x7f524c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f52514a4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f524c1027a0 0x7f524c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f52514a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c106f20 0x7f524c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f52514a4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f524c111f40 con 0x7f524c1027a0 2024-09-05T12:57:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f52514a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f524c111dc0 con 0x7f524c106f20 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f52514a4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f524c1120c0 con 0x7f524c101df0 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f524a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f524c1027a0 0x7f524c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f524a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f524c1027a0 0x7f524c198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51678/0 (socket says 172.21.15.73:51678) 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f524a7fc640 1 -- 172.21.15.73:0/3763720616 learned_addr learned my addr 172.21.15.73:0/3763720616 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.447+0000 7f524b7fe640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c106f20 0x7f524c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f524affd640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f524c101df0 0x7f524c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f524a7fc640 1 -- 172.21.15.73:0/3763720616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f524c101df0 msgr2=0x7f524c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f524a7fc640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f524c101df0 0x7f524c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f524a7fc640 1 -- 172.21.15.73:0/3763720616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c106f20 msgr2=0x7f524c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f524a7fc640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c106f20 0x7f524c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f524a7fc640 1 -- 172.21.15.73:0/3763720616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524c19d4f0 con 0x7f524c1027a0 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f524a7fc640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f524c1027a0 0x7f524c198a80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f523400d950 tx=0x7f523400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f5243fff640 1 -- 172.21.15.73:0/3763720616 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234017070 con 0x7f524c1027a0 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f5243fff640 1 -- 172.21.15.73:0/3763720616 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5234009c30 con 0x7f524c1027a0 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f5243fff640 1 -- 172.21.15.73:0/3763720616 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523400f6b0 con 0x7f524c1027a0 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f52514a4640 1 -- 172.21.15.73:0/3763720616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524c19d7e0 con 0x7f524c1027a0 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.448+0000 7f52514a4640 1 -- 172.21.15.73:0/3763720616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524c1a50c0 con 0x7f524c1027a0 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.450+0000 7f5243fff640 1 -- 172.21.15.73:0/3763720616 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f52340109d0 con 0x7f524c1027a0 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f525387a740 1 Processor -- start 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f525387a740 1 -- start start 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f525387a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee678d0 0x55fd8ee67cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f525387a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee681f0 0x55fd8ee76a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f525387a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee793b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f525387a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fd8edce090 con 0x55fd8ee76fc0 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f525387a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ed75a70 con 0x55fd8ee678d0 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f525387a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fd8edca050 con 0x55fd8ee681f0 2024-09-05T12:57:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f5243fff640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f52380a2c10 0x7f52380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f524a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee793b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f524b7fe640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f52380a2c10 0x7f52380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f524a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee793b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51694/0 (socket says 172.21.15.73:51694) 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f524a7fc640 1 -- 172.21.15.73:0/677578735 learned_addr learned my addr 172.21.15.73:0/677578735 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.451+0000 7f524b7fe640 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee678d0 0x55fd8ee67cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f5243fff640 1 -- 172.21.15.73:0/3763720616 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f52340cee30 con 0x7f524c1027a0 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f524affd640 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee681f0 0x55fd8ee76a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f524a7fc640 1 -- 172.21.15.73:0/677578735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee681f0 msgr2=0x55fd8ee76a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f524a7fc640 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee681f0 0x55fd8ee76a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f524a7fc640 1 -- 172.21.15.73:0/677578735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee678d0 msgr2=0x55fd8ee67cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f524a7fc640 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee678d0 0x55fd8ee67cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f524a7fc640 1 -- 172.21.15.73:0/677578735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd8ed82130 con 0x55fd8ee76fc0 2024-09-05T12:57:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f524b7fe640 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee678d0 0x55fd8ee67cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f524affd640 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee681f0 0x55fd8ee76a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f524b7fe640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f52380a2c10 0x7f52380a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f52440098b0 tx=0x7f5244009d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f524a7fc640 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee793b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5234010fd0 tx=0x7f5234000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b666c5fad10773d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f52417fa640 1 -- 172.21.15.73:0/677578735 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234020040 con 0x55fd8ee76fc0 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f52417fa640 1 -- 172.21.15.73:0/677578735 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f523409bc60 con 0x55fd8ee76fc0 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.452+0000 7f52417fa640 1 -- 172.21.15.73:0/677578735 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52340cca60 con 0x55fd8ee76fc0 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 -- 172.21.15.73:0/677578735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 msgr2=0x55fd8ee793b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee793b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5234010fd0 tx=0x7f5234000bc0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 -- 172.21.15.73:0/677578735 shutdown_connections 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee793b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee681f0 0x55fd8ee76a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 --2- 172.21.15.73:0/677578735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee678d0 0x55fd8ee67cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 -- 172.21.15.73:0/677578735 >> 172.21.15.73:0/677578735 conn(0x55fd8ee63f60 msgr2=0x55fd8ee64340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 -- 172.21.15.73:0/677578735 shutdown_connections 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 -- 172.21.15.73:0/677578735 wait complete. 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 -- start start 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.453+0000 7f525387a740 1 Processor -- start 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f525387a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee768e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f525387a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee73c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f525387a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee74170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f525387a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ee79b90 con 0x55fd8ee76fc0 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f525387a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ed88f20 con 0x55fd8ee681f0 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f525387a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ee79d10 con 0x55fd8ee678d0 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f525387a740 10 client.0 _ll_register_callbacks cb 0x55fd8ed52030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee74170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee74170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51696/0 (socket says 172.21.15.73:51696) 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524b7fe640 1 -- 172.21.15.73:0/2827035458 learned_addr learned my addr 172.21.15.73:0/2827035458 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524a7fc640 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee73c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524affd640 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524b7fe640 1 -- 172.21.15.73:0/2827035458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 msgr2=0x55fd8ee768e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524b7fe640 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee768e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524b7fe640 1 -- 172.21.15.73:0/2827035458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 msgr2=0x55fd8ee73c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524b7fe640 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee73c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524b7fe640 1 -- 172.21.15.73:0/2827035458 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd8eb3f2b0 con 0x55fd8ee76fc0 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524a7fc640 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee73c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f524b7fe640 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee74170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5244010d20 tx=0x7f5244009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec907dbd52201612 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f52327fc640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.454+0000 7f52327fc640 1 -- 172.21.15.73:0/2827035458 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244026070 con 0x55fd8ee76fc0 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f52327fc640 1 -- 172.21.15.73:0/2827035458 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f52440045b0 con 0x55fd8ee76fc0 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f525387a740 1 -- 172.21.15.73:0/2827035458 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f523409bc60 con 0x55fd8ee76fc0 2024-09-05T12:57:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f52327fc640 1 -- 172.21.15.73:0/2827035458 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5244032050 con 0x55fd8ee76fc0 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f525387a740 10 client.15003 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f525387a740 1 -- 172.21.15.73:0/2827035458 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fd8ee85560 con 0x55fd8ee76fc0 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f52327fc640 1 -- 172.21.15.73:0/2827035458 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f523409bc60 con 0x55fd8ee76fc0 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f52327fc640 1 -- 172.21.15.73:0/2827035458 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f524401f070 con 0x55fd8ee76fc0 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f525387a740 10 client.15003 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f525387a740 10 client.15003 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f525387a740 20 client.15003 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f525387a740 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fd8ee87b50 0x55fd8ee88fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f525387a740 4 client.15003 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.455+0000 7f525387a740 1 -- 172.21.15.73:0/2827035458 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd8eddb600 con 0x55fd8ee87b50 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.456+0000 7f524affd640 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fd8ee87b50 0x55fd8ee88fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.456+0000 7f52327fc640 10 client.15003 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.456+0000 7f524affd640 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fd8ee87b50 0x55fd8ee88fc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f7e5acb02fd25c1 server_cookie=dfc23db093bade2d in_seq=0 out_seq=0 2024-09-05T12:57:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f52327fc640 1 -- 172.21.15.73:0/2827035458 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd8eddb600 con 0x55fd8ee87b50 2024-09-05T12:57:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f52327fc640 10 client.15003 handle_command_reply: tid=0 2024-09-05T12:57:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 client.15003 shutdown 2024-09-05T12:57:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 -- 172.21.15.73:0/2827035458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 msgr2=0x55fd8ee74170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee74170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5244010d20 tx=0x7f5244009600 comp rx=0 tx=0).stop 2024-09-05T12:57:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 -- 172.21.15.73:0/2827035458 shutdown_connections 2024-09-05T12:57:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fd8ee87b50 0x55fd8ee88fc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee74170 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee73c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f52327fc640 0 client.15003 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 --2- 172.21.15.73:0/2827035458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee768e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 -- 172.21.15.73:0/2827035458 >> 172.21.15.73:0/2827035458 conn(0x55fd8ee63f60 msgr2=0x55fd8ee69cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 -- 172.21.15.73:0/2827035458 shutdown_connections 2024-09-05T12:57:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 1 -- 172.21.15.73:0/2827035458 wait complete. 2024-09-05T12:57:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.457+0000 7f525387a740 20 client.15003 trim_cache size 0 max 16384 2024-09-05T12:57:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.475+0000 7f525387a740 1 Processor -- start 2024-09-05T12:57:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.475+0000 7f525387a740 1 -- start start 2024-09-05T12:57:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.475+0000 7f525387a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee88fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.475+0000 7f525387a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee72500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.475+0000 7f525387a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee72a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.475+0000 7f525387a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ee87300 con 0x55fd8ee76fc0 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.475+0000 7f525387a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ee879d0 con 0x55fd8ee681f0 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.475+0000 7f525387a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ee880a0 con 0x55fd8ee678d0 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee72a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee72a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51698/0 (socket says 172.21.15.73:51698) 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524b7fe640 1 -- 172.21.15.73:0/1261996010 learned_addr learned my addr 172.21.15.73:0/1261996010 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524affd640 1 --2- 172.21.15.73:0/1261996010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee88fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524a7fc640 1 --2- 172.21.15.73:0/1261996010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee72500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524b7fe640 1 -- 172.21.15.73:0/1261996010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 msgr2=0x55fd8ee88fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524b7fe640 1 --2- 172.21.15.73:0/1261996010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee88fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524b7fe640 1 -- 172.21.15.73:0/1261996010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 msgr2=0x55fd8ee72500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524b7fe640 1 --2- 172.21.15.73:0/1261996010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee72500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524b7fe640 1 -- 172.21.15.73:0/1261996010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd8ee74fb0 con 0x55fd8ee76fc0 2024-09-05T12:57:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524affd640 1 --2- 172.21.15.73:0/1261996010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee88fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f524b7fe640 1 --2- 172.21.15.73:0/1261996010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee72a40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f52440096e0 tx=0x7f524401e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165894f7c9d65043 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f5240ff9640 1 -- 172.21.15.73:0/1261996010 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524402f020 con 0x55fd8ee76fc0 2024-09-05T12:57:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f5240ff9640 1 -- 172.21.15.73:0/1261996010 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52440122b0 con 0x55fd8ee76fc0 2024-09-05T12:57:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.476+0000 7f5240ff9640 1 -- 172.21.15.73:0/1261996010 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244026070 con 0x55fd8ee76fc0 2024-09-05T12:57:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.477+0000 7f525387a740 1 -- 172.21.15.73:0/1261996010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 msgr2=0x55fd8ee72a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.477+0000 7f525387a740 1 --2- 172.21.15.73:0/1261996010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee72a40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f52440096e0 tx=0x7f524401e7d0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.477+0000 7f525387a740 1 -- 172.21.15.73:0/1261996010 shutdown_connections 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.477+0000 7f525387a740 1 --2- 172.21.15.73:0/1261996010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee72a40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.477+0000 7f525387a740 1 --2- 172.21.15.73:0/1261996010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee72500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.477+0000 7f525387a740 1 --2- 172.21.15.73:0/1261996010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee88fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.477+0000 7f525387a740 1 -- 172.21.15.73:0/1261996010 >> 172.21.15.73:0/1261996010 conn(0x55fd8ee63f60 msgr2=0x55fd8ee73bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.477+0000 7f525387a740 1 -- 172.21.15.73:0/1261996010 shutdown_connections 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.477+0000 7f525387a740 1 -- 172.21.15.73:0/1261996010 wait complete. 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.477+0000 7f525387a740 1 -- start start 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f525387a740 1 Processor -- start 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f525387a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee90230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f525387a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee90770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f525387a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee8a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f525387a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ee88e40 con 0x55fd8ee76fc0 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f525387a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ee88770 con 0x55fd8ee681f0 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f525387a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ee89510 con 0x55fd8ee678d0 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f525387a740 10 client.0 _ll_register_callbacks cb 0x7f52440125b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee8a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524a7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee90770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee8a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51710/0 (socket says 172.21.15.73:51710) 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524b7fe640 1 -- 172.21.15.73:0/357388244 learned_addr learned my addr 172.21.15.73:0/357388244 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524a7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee90770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:60148/0 (socket says 172.21.15.73:60148) 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524affd640 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee90230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524b7fe640 1 -- 172.21.15.73:0/357388244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 msgr2=0x55fd8ee90230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524b7fe640 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee90230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524b7fe640 1 -- 172.21.15.73:0/357388244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 msgr2=0x55fd8ee90770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524b7fe640 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee90770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524b7fe640 1 -- 172.21.15.73:0/357388244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd8ee8aec0 con 0x55fd8ee76fc0 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f524b7fe640 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee8a690 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f524401e9b0 tx=0x7f524401ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628dad797cbafef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.478+0000 7f52327fc640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f52327fc640 1 -- 172.21.15.73:0/357388244 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524402f030 con 0x55fd8ee76fc0 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f52327fc640 1 -- 172.21.15.73:0/357388244 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f5244004cc0 con 0x55fd8ee76fc0 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f525387a740 1 -- 172.21.15.73:0/357388244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52440122b0 con 0x55fd8ee76fc0 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f52327fc640 1 -- 172.21.15.73:0/357388244 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5244026070 con 0x55fd8ee76fc0 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f525387a740 10 client.15009 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f525387a740 1 -- 172.21.15.73:0/357388244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fd8ee8f750 con 0x55fd8ee76fc0 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f52327fc640 1 -- 172.21.15.73:0/357388244 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52440122b0 con 0x55fd8ee76fc0 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f52327fc640 1 -- 172.21.15.73:0/357388244 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f524400f040 con 0x55fd8ee76fc0 2024-09-05T12:57:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f525387a740 10 client.15009 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f525387a740 10 client.15009 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f525387a740 20 client.15009 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f525387a740 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fd8ee87b50 0x55fd8eef5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f525387a740 4 client.15009 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.479+0000 7f525387a740 1 -- 172.21.15.73:0/357388244 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "status"}) -- 0x55fd8edd5b10 con 0x55fd8ee87b50 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f524affd640 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fd8ee87b50 0x55fd8eef5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f52327fc640 10 client.15009 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f524affd640 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fd8ee87b50 0x55fd8eef5080 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80bb1f0f76fdf6ec server_cookie=59cc8a591fed2d15 in_seq=0 out_seq=0 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f52327fc640 1 -- 172.21.15.73:0/357388244 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55fd8edd5b10 con 0x55fd8ee87b50 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f52327fc640 10 client.15009 handle_command_reply: tid=0 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f525387a740 1 client.15009 shutdown 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f525387a740 1 -- 172.21.15.73:0/357388244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 msgr2=0x55fd8ee8a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f525387a740 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee8a690 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f524401e9b0 tx=0x7f524401ee40 comp rx=0 tx=0).stop 2024-09-05T12:57:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f525387a740 1 -- 172.21.15.73:0/357388244 shutdown_connections 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f525387a740 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fd8ee87b50 0x55fd8eef5080 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f525387a740 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fd8ee76fc0 0x55fd8ee8a690 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f525387a740 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8ee681f0 0x55fd8ee90770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.480+0000 7f525387a740 1 --2- 172.21.15.73:0/357388244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fd8ee678d0 0x55fd8ee90230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f525387a740 1 -- 172.21.15.73:0/357388244 >> 172.21.15.73:0/357388244 conn(0x55fd8ee63f60 msgr2=0x55fd8ee724c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52327fc640 0 client.15009 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f525387a740 1 -- 172.21.15.73:0/357388244 shutdown_connections 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f525387a740 1 -- 172.21.15.73:0/357388244 wait complete. 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f525387a740 20 client.15009 trim_cache size 0 max 16384 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:57:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "febf1dd4-6b84-11ef-bcd6-c7b262605968", 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24482, 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 77.742418813, 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 24, 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 80, 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 78, 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 88.543299785000002 2024-09-05T12:57:04.488 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:57:04.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52514a4640 1 -- 172.21.15.73:0/3763720616 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f52380a2c10 msgr2=0x7f52380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:04.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52514a4640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f52380a2c10 0x7f52380a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f52440098b0 tx=0x7f5244009d90 comp rx=0 tx=0).stop 2024-09-05T12:57:04.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52514a4640 1 -- 172.21.15.73:0/3763720616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f524c1027a0 msgr2=0x7f524c198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:04.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52514a4640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f524c1027a0 0x7f524c198a80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f523400d950 tx=0x7f523400de10 comp rx=0 tx=0).stop 2024-09-05T12:57:04.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52514a4640 1 -- 172.21.15.73:0/3763720616 shutdown_connections 2024-09-05T12:57:04.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52514a4640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f52380a2c10 0x7f52380a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52514a4640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c106f20 0x7f524c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52514a4640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f524c1027a0 0x7f524c198a80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52514a4640 1 --2- 172.21.15.73:0/3763720616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f524c101df0 0x7f524c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:04.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.481+0000 7f52514a4640 1 -- 172.21.15.73:0/3763720616 >> 172.21.15.73:0/3763720616 conn(0x7f524c0fd8b0 msgr2=0x7f524c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:04.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.482+0000 7f52514a4640 1 -- 172.21.15.73:0/3763720616 shutdown_connections 2024-09-05T12:57:04.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:04.482+0000 7f52514a4640 1 -- 172.21.15.73:0/3763720616 wait complete. 2024-09-05T12:57:05.205 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:05 smithi073 ceph-mon[30883]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:05.233 INFO:tasks.cephadm:Setup complete, yielding 2024-09-05T12:57:05.233 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-05T12:57:05.241 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2024-09-05T12:57:05.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch status' 2024-09-05T12:57:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:05 smithi162 ceph-mon[34220]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:05 smithi169 ceph-mon[34823]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:05.489 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:05.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.953+0000 7f0ef396a640 1 -- 172.21.15.73:0/1193352142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eec102df0 msgr2=0x7f0eec103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:05.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.953+0000 7f0ef396a640 1 --2- 172.21.15.73:0/1193352142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eec102df0 0x7f0eec103270 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009900 tx=0x7f0edc02a410 comp rx=0 tx=0).stop 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.953+0000 7f0ef396a640 1 -- 172.21.15.73:0/1193352142 shutdown_connections 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.953+0000 7f0ef396a640 1 --2- 172.21.15.73:0/1193352142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0eec1037b0 0x7f0eec10a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.953+0000 7f0ef396a640 1 --2- 172.21.15.73:0/1193352142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eec102df0 0x7f0eec103270 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.953+0000 7f0ef396a640 1 --2- 172.21.15.73:0/1193352142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0eec101bf0 0x7f0eec101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.953+0000 7f0ef396a640 1 -- 172.21.15.73:0/1193352142 >> 172.21.15.73:0/1193352142 conn(0x7f0eec0fd3c0 msgr2=0x7f0eec0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef396a640 1 -- 172.21.15.73:0/1193352142 shutdown_connections 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef396a640 1 -- 172.21.15.73:0/1193352142 wait complete. 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef396a640 1 Processor -- start 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef396a640 1 -- start start 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef396a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eec101bf0 0x7f0eec197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef396a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0eec102df0 0x7f0eec198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:05.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef396a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0eec1037b0 0x7f0eec19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef396a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec10d970 con 0x7f0eec101bf0 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef396a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec10d7f0 con 0x7f0eec102df0 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef396a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec10daf0 con 0x7f0eec1037b0 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef1706640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eec101bf0 0x7f0eec197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef1706640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eec101bf0 0x7f0eec197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51724/0 (socket says 172.21.15.73:51724) 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.954+0000 7f0ef1706640 1 -- 172.21.15.73:0/2131243792 learned_addr learned my addr 172.21.15.73:0/2131243792 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ef0f05640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0eec102df0 0x7f0eec198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ef1f07640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0eec1037b0 0x7f0eec19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ef1706640 1 -- 172.21.15.73:0/2131243792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0eec1037b0 msgr2=0x7f0eec19f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ef1706640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0eec1037b0 0x7f0eec19f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ef1706640 1 -- 172.21.15.73:0/2131243792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0eec102df0 msgr2=0x7f0eec198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:05.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ef1706640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0eec102df0 0x7f0eec198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ef1706640 1 -- 172.21.15.73:0/2131243792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec19fc20 con 0x7f0eec101bf0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ef1706640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eec101bf0 0x7f0eec197ff0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800b9c0 tx=0x7f0ee800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ee27fc640 1 -- 172.21.15.73:0/2131243792 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8019070 con 0x7f0eec101bf0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ee27fc640 1 -- 172.21.15.73:0/2131243792 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ee800cba0 con 0x7f0eec101bf0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ef396a640 1 -- 172.21.15.73:0/2131243792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eec19ff10 con 0x7f0eec101bf0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ee27fc640 1 -- 172.21.15.73:0/2131243792 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8012640 con 0x7f0eec101bf0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.955+0000 7f0ef396a640 1 -- 172.21.15.73:0/2131243792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eec1a03e0 con 0x7f0eec101bf0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.956+0000 7f0ef396a640 1 -- 172.21.15.73:0/2131243792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eec108f90 con 0x7f0eec101bf0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.957+0000 7f0ee27fc640 1 -- 172.21.15.73:0/2131243792 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0ee801c070 con 0x7f0eec101bf0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.958+0000 7f0ee27fc640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ed80a2c40 0x7f0ed80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.958+0000 7f0ef0f05640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ed80a2c40 0x7f0ed80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.958+0000 7f0ee27fc640 1 -- 172.21.15.73:0/2131243792 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0ee80cecc0 con 0x7f0eec101bf0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.958+0000 7f0ef0f05640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ed80a2c40 0x7f0ed80a5100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0edc000c00 tx=0x7f0edc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:05.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:05.961+0000 7f0ee27fc640 1 -- 172.21.15.73:0/2131243792 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ee809bc00 con 0x7f0eec101bf0 2024-09-05T12:57:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.146+0000 7f0ef396a640 1 -- 172.21.15.73:0/2131243792 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f0eec062630 con 0x7f0ed80a2c40 2024-09-05T12:57:06.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.147+0000 7f0ee27fc640 1 -- 172.21.15.73:0/2131243792 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f0eec062630 con 0x7f0ed80a2c40 2024-09-05T12:57:06.148 INFO:teuthology.orchestra.run.smithi073.stdout:Backend: cephadm 2024-09-05T12:57:06.148 INFO:teuthology.orchestra.run.smithi073.stdout:Available: Yes 2024-09-05T12:57:06.148 INFO:teuthology.orchestra.run.smithi073.stdout:Paused: No 2024-09-05T12:57:06.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 -- 172.21.15.73:0/2131243792 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ed80a2c40 msgr2=0x7f0ed80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:06.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ed80a2c40 0x7f0ed80a5100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0edc000c00 tx=0x7f0edc031400 comp rx=0 tx=0).stop 2024-09-05T12:57:06.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 -- 172.21.15.73:0/2131243792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eec101bf0 msgr2=0x7f0eec197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:06.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eec101bf0 0x7f0eec197ff0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800b9c0 tx=0x7f0ee800be80 comp rx=0 tx=0).stop 2024-09-05T12:57:06.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 -- 172.21.15.73:0/2131243792 shutdown_connections 2024-09-05T12:57:06.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0ed80a2c40 0x7f0ed80a5100 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:06.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0eec1037b0 0x7f0eec19f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:06.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0eec102df0 0x7f0eec198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:06.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 --2- 172.21.15.73:0/2131243792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eec101bf0 0x7f0eec197ff0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:06.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 -- 172.21.15.73:0/2131243792 >> 172.21.15.73:0/2131243792 conn(0x7f0eec0fd3c0 msgr2=0x7f0eec106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:06.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 -- 172.21.15.73:0/2131243792 shutdown_connections 2024-09-05T12:57:06.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:06.150+0000 7f0ef396a640 1 -- 172.21.15.73:0/2131243792 wait complete. 2024-09-05T12:57:06.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-05T12:57:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:07.210 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:07 smithi073 ceph-mon[30883]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:57:07.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:07 smithi162 ceph-mon[34220]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:57:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:07 smithi169 ceph-mon[34823]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:57:07.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.589+0000 7fd4787bf640 1 -- 172.21.15.73:0/1640923746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4701026d0 msgr2=0x7fd470108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:07.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.589+0000 7fd4787bf640 1 --2- 172.21.15.73:0/1640923746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4701026d0 0x7fd470108f60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd468009ca0 tx=0x7fd46802a8c0 comp rx=0 tx=0).stop 2024-09-05T12:57:07.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.589+0000 7fd4787bf640 1 -- 172.21.15.73:0/1640923746 shutdown_connections 2024-09-05T12:57:07.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.589+0000 7fd4787bf640 1 --2- 172.21.15.73:0/1640923746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4701026d0 0x7fd470108f60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:07.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.589+0000 7fd4787bf640 1 --2- 172.21.15.73:0/1640923746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd470101d10 0x7fd470102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:07.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.589+0000 7fd4787bf640 1 --2- 172.21.15.73:0/1640923746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd470100b10 0x7fd470100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:07.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.589+0000 7fd4787bf640 1 -- 172.21.15.73:0/1640923746 >> 172.21.15.73:0/1640923746 conn(0x7fd4700fc2a0 msgr2=0x7fd4700fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:07.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.589+0000 7fd4787bf640 1 -- 172.21.15.73:0/1640923746 shutdown_connections 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.589+0000 7fd4787bf640 1 -- 172.21.15.73:0/1640923746 wait complete. 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd4787bf640 1 Processor -- start 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd4787bf640 1 -- start start 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd4787bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd470100b10 0x7fd47006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd4787bf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd470101d10 0x7fd47019f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd4787bf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4701026d0 0x7fd4701a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd4787bf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd47010c7f0 con 0x7fd470101d10 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd4787bf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd47010c670 con 0x7fd4701026d0 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd4787bf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd47010c970 con 0x7fd470100b10 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd475d5a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd470101d10 0x7fd47019f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd475d5a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd470101d10 0x7fd47019f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51740/0 (socket says 172.21.15.73:51740) 2024-09-05T12:57:07.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd475d5a640 1 -- 172.21.15.73:0/2609914963 learned_addr learned my addr 172.21.15.73:0/2609914963 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd47655b640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd470100b10 0x7fd47006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd476d5c640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4701026d0 0x7fd4701a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd475d5a640 1 -- 172.21.15.73:0/2609914963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd470100b10 msgr2=0x7fd47006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd475d5a640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd470100b10 0x7fd47006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd475d5a640 1 -- 172.21.15.73:0/2609914963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4701026d0 msgr2=0x7fd4701a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd475d5a640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4701026d0 0x7fd4701a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd475d5a640 1 -- 172.21.15.73:0/2609914963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4701a1d90 con 0x7fd470101d10 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd475d5a640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd470101d10 0x7fd47019f050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd46000b4a0 tx=0x7fd46000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd4677fe640 1 -- 172.21.15.73:0/2609914963 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460014070 con 0x7fd470101d10 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.590+0000 7fd4677fe640 1 -- 172.21.15.73:0/2609914963 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd460010af0 con 0x7fd470101d10 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.591+0000 7fd4787bf640 1 -- 172.21.15.73:0/2609914963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4701a1fc0 con 0x7fd470101d10 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.591+0000 7fd4677fe640 1 -- 172.21.15.73:0/2609914963 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460017d10 con 0x7fd470101d10 2024-09-05T12:57:07.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.591+0000 7fd4787bf640 1 -- 172.21.15.73:0/2609914963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4701a2500 con 0x7fd470101d10 2024-09-05T12:57:07.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.592+0000 7fd4787bf640 1 -- 172.21.15.73:0/2609914963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd470107f10 con 0x7fd470101d10 2024-09-05T12:57:07.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.593+0000 7fd4677fe640 1 -- 172.21.15.73:0/2609914963 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd460017070 con 0x7fd470101d10 2024-09-05T12:57:07.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.593+0000 7fd4677fe640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd45c0a2c40 0x7fd45c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:07.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.593+0000 7fd47655b640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd45c0a2c40 0x7fd45c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:07.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.594+0000 7fd4677fe640 1 -- 172.21.15.73:0/2609914963 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd4600ce4d0 con 0x7fd470101d10 2024-09-05T12:57:07.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.594+0000 7fd47655b640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd45c0a2c40 0x7fd45c0a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd46c005db0 tx=0x7fd46c005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:07.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.598+0000 7fd4677fe640 1 -- 172.21.15.73:0/2609914963 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd46009b410 con 0x7fd470101d10 2024-09-05T12:57:07.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.773+0000 7fd4787bf640 1 -- 172.21.15.73:0/2609914963 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd470062630 con 0x7fd45c0a2c40 2024-09-05T12:57:07.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.785+0000 7fd4677fe640 1 -- 172.21.15.73:0/2609914963 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fd470062630 con 0x7fd45c0a2c40 2024-09-05T12:57:07.787 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-05T12:57:07.787 INFO:teuthology.orchestra.run.smithi073.stdout:mds.a smithi073 running (94s) 16s ago 94s 14.4M - 19.1.1-261-ge856d6b2 1d96423d1332 ccc4588bae30 2024-09-05T12:57:07.787 INFO:teuthology.orchestra.run.smithi073.stdout:mds.b smithi162 running (92s) 24s ago 91s 27.0M - 19.1.1-261-ge856d6b2 1d96423d1332 68348360e9b9 2024-09-05T12:57:07.787 INFO:teuthology.orchestra.run.smithi073.stdout:mds.c smithi169 running (106s) 24s ago 105s 17.6M - 19.1.1-261-ge856d6b2 1d96423d1332 7a9c6082eb02 2024-09-05T12:57:07.787 INFO:teuthology.orchestra.run.smithi073.stdout:mds.d smithi073 running (114s) 16s ago 113s 14.4M - 19.1.1-261-ge856d6b2 1d96423d1332 3e778f6db72d 2024-09-05T12:57:07.787 INFO:teuthology.orchestra.run.smithi073.stdout:mds.e smithi162 running (111s) 24s ago 111s 16.8M - 19.1.1-261-ge856d6b2 1d96423d1332 b83cd90ef665 2024-09-05T12:57:07.787 INFO:teuthology.orchestra.run.smithi073.stdout:mds.f smithi169 running (108s) 24s ago 108s 18.4M - 19.1.1-261-ge856d6b2 1d96423d1332 35c37a324c2d 2024-09-05T12:57:07.787 INFO:teuthology.orchestra.run.smithi073.stdout:mds.g smithi073 running (97s) 16s ago 97s 13.3M - 19.1.1-261-ge856d6b2 1d96423d1332 71933dfc691f 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mds.h smithi162 running (103s) 24s ago 103s 17.3M - 19.1.1-261-ge856d6b2 1d96423d1332 23d082947724 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mds.i smithi169 running (100s) 24s ago 100s 20.3M - 19.1.1-261-ge856d6b2 1d96423d1332 e155dbb3f4bb 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mds.j smithi073 running (117s) 16s ago 117s 14.4M - 19.1.1-261-ge856d6b2 1d96423d1332 eb660a2617c2 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mds.k smithi162 running (2m) 24s ago 2m 14.4M - 19.1.1-261-ge856d6b2 1d96423d1332 d3470ab6bf8e 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mds.l smithi169 running (2m) 24s ago 2m 15.9M - 19.1.1-261-ge856d6b2 1d96423d1332 285eb183f55a 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.x smithi073 *:9283,8765 running (8m) 16s ago 8m 510M - 19.1.1-261-ge856d6b2 1d96423d1332 f384e21e7493 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.y smithi162 *:8443,8765 running (7m) 24s ago 7m 443M - 19.1.1-261-ge856d6b2 1d96423d1332 ced4666a5ca3 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.z smithi169 *:8443,8765 running (7m) 24s ago 7m 444M - 19.1.1-261-ge856d6b2 1d96423d1332 87f7f5ba38ac 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mon.a smithi073 running (8m) 16s ago 8m 50.6M 2048M 19.1.1-261-ge856d6b2 1d96423d1332 d41793c84463 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mon.b smithi162 running (7m) 24s ago 7m 42.0M 2048M 19.1.1-261-ge856d6b2 1d96423d1332 af79306ec132 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:mon.c smithi169 running (7m) 24s ago 7m 46.3M 2048M 19.1.1-261-ge856d6b2 1d96423d1332 8912ea49fbb9 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (6m) 16s ago 6m 56.0M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 93c416a9ff5f 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi162 running (6m) 24s ago 6m 47.7M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 ef733c411d6a 2024-09-05T12:57:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi169 running (6m) 24s ago 6m 46.8M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 9ffe46af19ab 2024-09-05T12:57:07.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi073 running (5m) 16s ago 5m 54.5M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 42152ed41740 2024-09-05T12:57:07.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi162 running (5m) 24s ago 5m 43.1M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 ebe273ed6842 2024-09-05T12:57:07.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi169 running (4m) 24s ago 4m 42.7M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 9d87c2c30956 2024-09-05T12:57:07.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.6 smithi073 running (4m) 16s ago 4m 41.5M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 c842e325f259 2024-09-05T12:57:07.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.7 smithi162 running (4m) 24s ago 4m 43.7M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 c060ab3758a1 2024-09-05T12:57:07.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.8 smithi169 running (3m) 24s ago 3m 42.6M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 fff78702a260 2024-09-05T12:57:07.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.9 smithi073 running (3m) 16s ago 3m 54.1M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 059a449132c4 2024-09-05T12:57:07.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.10 smithi162 running (2m) 24s ago 2m 58.4M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 b3a0725099b6 2024-09-05T12:57:07.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.11 smithi169 running (2m) 24s ago 2m 40.5M 4272M 19.1.1-261-ge856d6b2 1d96423d1332 0e84e10a755c 2024-09-05T12:57:07.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.787+0000 7fd4787bf640 1 -- 172.21.15.73:0/2609914963 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd45c0a2c40 msgr2=0x7fd45c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:07.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.787+0000 7fd4787bf640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd45c0a2c40 0x7fd45c0a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd46c005db0 tx=0x7fd46c005d40 comp rx=0 tx=0).stop 2024-09-05T12:57:07.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.787+0000 7fd4787bf640 1 -- 172.21.15.73:0/2609914963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd470101d10 msgr2=0x7fd47019f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:07.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.787+0000 7fd4787bf640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd470101d10 0x7fd47019f050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd46000b4a0 tx=0x7fd46000b960 comp rx=0 tx=0).stop 2024-09-05T12:57:07.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.787+0000 7fd4787bf640 1 -- 172.21.15.73:0/2609914963 shutdown_connections 2024-09-05T12:57:07.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.787+0000 7fd4787bf640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd45c0a2c40 0x7fd45c0a5100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:07.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.787+0000 7fd4787bf640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4701026d0 0x7fd4701a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:07.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.787+0000 7fd4787bf640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd470101d10 0x7fd47019f050 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:07.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.787+0000 7fd4787bf640 1 --2- 172.21.15.73:0/2609914963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd470100b10 0x7fd47006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:07.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.787+0000 7fd4787bf640 1 -- 172.21.15.73:0/2609914963 >> 172.21.15.73:0/2609914963 conn(0x7fd4700fc2a0 msgr2=0x7fd4701050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:07.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.788+0000 7fd4787bf640 1 -- 172.21.15.73:0/2609914963 shutdown_connections 2024-09-05T12:57:07.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:07.788+0000 7fd4787bf640 1 -- 172.21.15.73:0/2609914963 wait complete. 2024-09-05T12:57:08.055 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:08 smithi073 ceph-mon[30883]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:08.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:08 smithi162 ceph-mon[34220]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:08.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:08 smithi169 ceph-mon[34823]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:08.477 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-05T12:57:08.722 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:09.104 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:09 smithi073 ceph-mon[30883]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:09.104 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:09 smithi073 ceph-mon[30883]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:57:09.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.183+0000 7fc3f5b71640 1 -- 172.21.15.73:0/1542060136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3f0102690 msgr2=0x7fc3f0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:09.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.183+0000 7fc3f5b71640 1 --2- 172.21.15.73:0/1542060136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3f0102690 0x7fc3f0108f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009ca0 tx=0x7fc3e802a8c0 comp rx=0 tx=0).stop 2024-09-05T12:57:09.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 -- 172.21.15.73:0/1542060136 shutdown_connections 2024-09-05T12:57:09.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 --2- 172.21.15.73:0/1542060136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3f0102690 0x7fc3f0108f20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 --2- 172.21.15.73:0/1542060136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3f0101cd0 0x7fc3f0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 --2- 172.21.15.73:0/1542060136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3f0100ad0 0x7fc3f0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 -- 172.21.15.73:0/1542060136 >> 172.21.15.73:0/1542060136 conn(0x7fc3f00fc280 msgr2=0x7fc3f00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 -- 172.21.15.73:0/1542060136 shutdown_connections 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 -- 172.21.15.73:0/1542060136 wait complete. 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 Processor -- start 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 -- start start 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3f0100ad0 0x7fc3f0198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3f0101cd0 0x7fc3f0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.184+0000 7fc3f5b71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3f0102690 0x7fc3f019f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3f5b71640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f010c850 con 0x7fc3f0101cd0 2024-09-05T12:57:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3f5b71640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f010c6d0 con 0x7fc3f0102690 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3f5b71640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f010c9d0 con 0x7fc3f0100ad0 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3f0101cd0 0x7fc3f0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3f0101cd0 0x7fc3f0198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51766/0 (socket says 172.21.15.73:51766) 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3eeffd640 1 -- 172.21.15.73:0/260731648 learned_addr learned my addr 172.21.15.73:0/260731648 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3ef7fe640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3f0100ad0 0x7fc3f0198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3effff640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3f0102690 0x7fc3f019f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3eeffd640 1 -- 172.21.15.73:0/260731648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3f0100ad0 msgr2=0x7fc3f0198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3eeffd640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3f0100ad0 0x7fc3f0198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3eeffd640 1 -- 172.21.15.73:0/260731648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3f0102690 msgr2=0x7fc3f019f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3eeffd640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3f0102690 0x7fc3f019f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3eeffd640 1 -- 172.21.15.73:0/260731648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f019fc50 con 0x7fc3f0101cd0 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3ef7fe640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3f0100ad0 0x7fc3f0198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:09.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3eeffd640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3f0101cd0 0x7fc3f0198560 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400b4a0 tx=0x7fc3e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3ecff9640 1 -- 172.21.15.73:0/260731648 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4014070 con 0x7fc3f0101cd0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3ecff9640 1 -- 172.21.15.73:0/260731648 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3e4010af0 con 0x7fc3f0101cd0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3f5b71640 1 -- 172.21.15.73:0/260731648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f019ff40 con 0x7fc3f0101cd0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3ecff9640 1 -- 172.21.15.73:0/260731648 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4017d10 con 0x7fc3f0101cd0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.185+0000 7fc3f5b71640 1 -- 172.21.15.73:0/260731648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f01a0470 con 0x7fc3f0101cd0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.186+0000 7fc3f5b71640 1 -- 172.21.15.73:0/260731648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f01a0700 con 0x7fc3f0101cd0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.188+0000 7fc3ecff9640 1 -- 172.21.15.73:0/260731648 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc3e4017070 con 0x7fc3f0101cd0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.189+0000 7fc3ecff9640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc3d80a2c40 0x7fc3d80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.189+0000 7fc3ef7fe640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc3d80a2c40 0x7fc3d80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.189+0000 7fc3ecff9640 1 -- 172.21.15.73:0/260731648 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc3e40ce810 con 0x7fc3f0101cd0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.189+0000 7fc3ef7fe640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc3d80a2c40 0x7fc3d80a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0101b30 tx=0x7fc3e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.192+0000 7fc3ecff9640 1 -- 172.21.15.73:0/260731648 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3e409b750 con 0x7fc3f0101cd0 2024-09-05T12:57:09.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:09 smithi162 ceph-mon[34220]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:09.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:09 smithi162 ceph-mon[34220]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:57:09.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.366+0000 7fc3f5b71640 1 -- 172.21.15.73:0/260731648 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fc3f01a08d0 con 0x7fc3d80a2c40 2024-09-05T12:57:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:09 smithi169 ceph-mon[34823]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:09 smithi169 ceph-mon[34823]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:57:09.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.371+0000 7fc3ecff9640 1 -- 172.21.15.73:0/260731648 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fc3f01a08d0 con 0x7fc3d80a2c40 2024-09-05T12:57:09.373 INFO:teuthology.orchestra.run.smithi073.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-05T12:57:09.373 INFO:teuthology.orchestra.run.smithi073.stdout:mds.all 12/12 26s ago 2m smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-05T12:57:09.373 INFO:teuthology.orchestra.run.smithi073.stdout:mgr 3/3 26s ago 7m smithi073=x;smithi162=y;smithi169=z;count:3 2024-09-05T12:57:09.373 INFO:teuthology.orchestra.run.smithi073.stdout:mon 3/3 26s ago 7m smithi073:172.21.15.73=a;smithi162:172.21.15.162=b;smithi169:172.21.15.169=c;count:3 2024-09-05T12:57:09.373 INFO:teuthology.orchestra.run.smithi073.stdout:osd 12 26s ago - 2024-09-05T12:57:09.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 -- 172.21.15.73:0/260731648 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc3d80a2c40 msgr2=0x7fc3d80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:09.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc3d80a2c40 0x7fc3d80a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0101b30 tx=0x7fc3e0008040 comp rx=0 tx=0).stop 2024-09-05T12:57:09.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 -- 172.21.15.73:0/260731648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3f0101cd0 msgr2=0x7fc3f0198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:09.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3f0101cd0 0x7fc3f0198560 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400b4a0 tx=0x7fc3e400b960 comp rx=0 tx=0).stop 2024-09-05T12:57:09.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 -- 172.21.15.73:0/260731648 shutdown_connections 2024-09-05T12:57:09.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc3d80a2c40 0x7fc3d80a5100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:09.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3f0102690 0x7fc3f019f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:09.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3f0101cd0 0x7fc3f0198560 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:09.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 --2- 172.21.15.73:0/260731648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3f0100ad0 0x7fc3f0198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:09.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 -- 172.21.15.73:0/260731648 >> 172.21.15.73:0/260731648 conn(0x7fc3f00fc280 msgr2=0x7fc3f0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:09.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 -- 172.21.15.73:0/260731648 shutdown_connections 2024-09-05T12:57:09.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:09.374+0000 7fc3f5b71640 1 -- 172.21.15.73:0/260731648 wait complete. 2024-09-05T12:57:10.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-05T12:57:10.368 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:10.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.817+0000 7f9d95c99640 1 -- 172.21.15.73:0/3597342753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90101c00 msgr2=0x7f9d90102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:10.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.817+0000 7f9d95c99640 1 --2- 172.21.15.73:0/3597342753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90101c00 0x7f9d90102000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009900 tx=0x7f9d8002a410 comp rx=0 tx=0).stop 2024-09-05T12:57:10.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.817+0000 7f9d95c99640 1 -- 172.21.15.73:0/3597342753 shutdown_connections 2024-09-05T12:57:10.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.817+0000 7f9d95c99640 1 --2- 172.21.15.73:0/3597342753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d901037c0 0x7f9d9010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:10.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.817+0000 7f9d95c99640 1 --2- 172.21.15.73:0/3597342753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d90102e00 0x7f9d90103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:10.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.817+0000 7f9d95c99640 1 --2- 172.21.15.73:0/3597342753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90101c00 0x7f9d90102000 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:10.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.817+0000 7f9d95c99640 1 -- 172.21.15.73:0/3597342753 >> 172.21.15.73:0/3597342753 conn(0x7f9d900fd390 msgr2=0x7f9d900ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:10.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.817+0000 7f9d95c99640 1 -- 172.21.15.73:0/3597342753 shutdown_connections 2024-09-05T12:57:10.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.817+0000 7f9d95c99640 1 -- 172.21.15.73:0/3597342753 wait complete. 2024-09-05T12:57:10.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d95c99640 1 Processor -- start 2024-09-05T12:57:10.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d95c99640 1 -- start start 2024-09-05T12:57:10.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d95c99640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90101c00 0x7f9d90075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:10.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d95c99640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d90102e00 0x7f9d900745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d95c99640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d901037c0 0x7f9d90074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d95c99640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9010d8e0 con 0x7f9d90101c00 2024-09-05T12:57:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d95c99640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9010d760 con 0x7f9d90102e00 2024-09-05T12:57:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d95c99640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9010da60 con 0x7f9d901037c0 2024-09-05T12:57:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90101c00 0x7f9d90075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90101c00 0x7f9d90075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51794/0 (socket says 172.21.15.73:51794) 2024-09-05T12:57:10.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/3467916129 learned_addr learned my addr 172.21.15.73:0/3467916129 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:10.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8effd640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d90102e00 0x7f9d900745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:10.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8ffff640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d901037c0 0x7f9d90074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:10.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/3467916129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d901037c0 msgr2=0x7f9d90074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:10.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8f7fe640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d901037c0 0x7f9d90074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:10.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/3467916129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d90102e00 msgr2=0x7f9d900745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8f7fe640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d90102e00 0x7f9d900745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/3467916129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d900753e0 con 0x7f9d90101c00 2024-09-05T12:57:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.818+0000 7f9d8effd640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d90102e00 0x7f9d900745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.819+0000 7f9d8f7fe640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90101c00 0x7f9d90075f90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9d80031610 tx=0x7f9d800043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.819+0000 7f9d8cff9640 1 -- 172.21.15.73:0/3467916129 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8003f030 con 0x7f9d90101c00 2024-09-05T12:57:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.819+0000 7f9d8cff9640 1 -- 172.21.15.73:0/3467916129 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d80003ce0 con 0x7f9d90101c00 2024-09-05T12:57:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.819+0000 7f9d95c99640 1 -- 172.21.15.73:0/3467916129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d901a2090 con 0x7f9d90101c00 2024-09-05T12:57:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.819+0000 7f9d8cff9640 1 -- 172.21.15.73:0/3467916129 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80035070 con 0x7f9d90101c00 2024-09-05T12:57:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.819+0000 7f9d95c99640 1 -- 172.21.15.73:0/3467916129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d901a2610 con 0x7f9d90101c00 2024-09-05T12:57:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.820+0000 7f9d95c99640 1 -- 172.21.15.73:0/3467916129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d90108fd0 con 0x7f9d90101c00 2024-09-05T12:57:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.821+0000 7f9d8cff9640 1 -- 172.21.15.73:0/3467916129 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9d80042030 con 0x7f9d90101c00 2024-09-05T12:57:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.822+0000 7f9d8cff9640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9d780a2c90 0x7f9d780a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.822+0000 7f9d8effd640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9d780a2c90 0x7f9d780a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.822+0000 7f9d8cff9640 1 -- 172.21.15.73:0/3467916129 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f9d800efa20 con 0x7f9d90101c00 2024-09-05T12:57:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.822+0000 7f9d8effd640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9d780a2c90 0x7f9d780a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d90075d10 tx=0x7f9d84005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.825+0000 7f9d8cff9640 1 -- 172.21.15.73:0/3467916129 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d800bc850 con 0x7f9d90101c00 2024-09-05T12:57:10.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.998+0000 7f9d95c99640 1 -- 172.21.15.73:0/3467916129 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f9d90062630 con 0x7f9d780a2c90 2024-09-05T12:57:11.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:10.999+0000 7f9d8cff9640 1 -- 172.21.15.73:0/3467916129 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f9d90062630 con 0x7f9d780a2c90 2024-09-05T12:57:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:HOST ADDR LABELS STATUS 2024-09-05T12:57:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 172.21.15.73 2024-09-05T12:57:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:smithi162 172.21.15.162 2024-09-05T12:57:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:smithi169 172.21.15.169 2024-09-05T12:57:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:3 hosts in cluster 2024-09-05T12:57:11.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 -- 172.21.15.73:0/3467916129 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9d780a2c90 msgr2=0x7f9d780a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:11.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9d780a2c90 0x7f9d780a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d90075d10 tx=0x7f9d84005ec0 comp rx=0 tx=0).stop 2024-09-05T12:57:11.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 -- 172.21.15.73:0/3467916129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90101c00 msgr2=0x7f9d90075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:11.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90101c00 0x7f9d90075f90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9d80031610 tx=0x7f9d800043b0 comp rx=0 tx=0).stop 2024-09-05T12:57:11.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 -- 172.21.15.73:0/3467916129 shutdown_connections 2024-09-05T12:57:11.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f9d780a2c90 0x7f9d780a5150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:11.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d901037c0 0x7f9d90074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:11.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d90102e00 0x7f9d900745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:11.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 --2- 172.21.15.73:0/3467916129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90101c00 0x7f9d90075f90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:11.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 -- 172.21.15.73:0/3467916129 >> 172.21.15.73:0/3467916129 conn(0x7f9d900fd390 msgr2=0x7f9d901061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:11.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 -- 172.21.15.73:0/3467916129 shutdown_connections 2024-09-05T12:57:11.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:11.001+0000 7f9d95c99640 1 -- 172.21.15.73:0/3467916129 wait complete. 2024-09-05T12:57:11.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:11 smithi073 ceph-mon[30883]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:11.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:11 smithi073 ceph-mon[30883]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:11 smithi162 ceph-mon[34220]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:11 smithi162 ceph-mon[34220]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:11.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:11 smithi169 ceph-mon[34823]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:11.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:11 smithi169 ceph-mon[34823]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:11.646 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-05T12:57:11.891 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:12.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:12 smithi073 ceph-mon[30883]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:12.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:12 smithi162 ceph-mon[34220]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:12.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:12 smithi169 ceph-mon[34823]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:12.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.434+0000 7f3b40a53640 1 -- 172.21.15.73:0/4027342193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b3c100ad0 msgr2=0x7f3b3c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:12.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.434+0000 7f3b40a53640 1 --2- 172.21.15.73:0/4027342193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b3c100ad0 0x7f3b3c100ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009900 tx=0x7f3b2c02a410 comp rx=0 tx=0).stop 2024-09-05T12:57:12.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.435+0000 7f3b40a53640 1 -- 172.21.15.73:0/4027342193 shutdown_connections 2024-09-05T12:57:12.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.435+0000 7f3b40a53640 1 --2- 172.21.15.73:0/4027342193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c102690 0x7f3b3c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:12.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.435+0000 7f3b40a53640 1 --2- 172.21.15.73:0/4027342193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b3c101cd0 0x7f3b3c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:12.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.435+0000 7f3b40a53640 1 --2- 172.21.15.73:0/4027342193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b3c100ad0 0x7f3b3c100ed0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:12.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.435+0000 7f3b40a53640 1 -- 172.21.15.73:0/4027342193 >> 172.21.15.73:0/4027342193 conn(0x7f3b3c0fc280 msgr2=0x7f3b3c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.435+0000 7f3b40a53640 1 -- 172.21.15.73:0/4027342193 shutdown_connections 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.435+0000 7f3b40a53640 1 -- 172.21.15.73:0/4027342193 wait complete. 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.435+0000 7f3b40a53640 1 Processor -- start 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b40a53640 1 -- start start 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b40a53640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c100ad0 0x7f3b3c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b40a53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b3c101cd0 0x7f3b3c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b40a53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b3c102690 0x7f3b3c19f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b40a53640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c10c750 con 0x7f3b3c101cd0 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b40a53640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c10c5d0 con 0x7f3b3c100ad0 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b40a53640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c10c8d0 con 0x7f3b3c102690 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b31d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b3c101cd0 0x7f3b3c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b31d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b3c101cd0 0x7f3b3c19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51810/0 (socket says 172.21.15.73:51810) 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b31d9b640 1 -- 172.21.15.73:0/2238063298 learned_addr learned my addr 172.21.15.73:0/2238063298 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b3a59c640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c100ad0 0x7f3b3c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b3ad9d640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b3c102690 0x7f3b3c19f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b31d9b640 1 -- 172.21.15.73:0/2238063298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b3c102690 msgr2=0x7f3b3c19f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b31d9b640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b3c102690 0x7f3b3c19f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b31d9b640 1 -- 172.21.15.73:0/2238063298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c100ad0 msgr2=0x7f3b3c06aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b31d9b640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c100ad0 0x7f3b3c06aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b31d9b640 1 -- 172.21.15.73:0/2238063298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c19fb90 con 0x7f3b3c101cd0 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b31d9b640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b3c101cd0 0x7f3b3c19cc60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400d770 tx=0x7f3b2400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.436+0000 7f3b33fff640 1 -- 172.21.15.73:0/2238063298 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24017070 con 0x7f3b3c101cd0 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.437+0000 7f3b40a53640 1 -- 172.21.15.73:0/2238063298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3c19fe20 con 0x7f3b3c101cd0 2024-09-05T12:57:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.437+0000 7f3b33fff640 1 -- 172.21.15.73:0/2238063298 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b24005500 con 0x7f3b3c101cd0 2024-09-05T12:57:12.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.437+0000 7f3b40a53640 1 -- 172.21.15.73:0/2238063298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3c1a02d0 con 0x7f3b3c101cd0 2024-09-05T12:57:12.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.437+0000 7f3b33fff640 1 -- 172.21.15.73:0/2238063298 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24004e00 con 0x7f3b3c101cd0 2024-09-05T12:57:12.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.437+0000 7f3b40a53640 1 -- 172.21.15.73:0/2238063298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b3c107f70 con 0x7f3b3c101cd0 2024-09-05T12:57:12.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.439+0000 7f3b33fff640 1 -- 172.21.15.73:0/2238063298 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3b24004fa0 con 0x7f3b3c101cd0 2024-09-05T12:57:12.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.439+0000 7f3b33fff640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3b280a2c10 0x7f3b280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:12.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.439+0000 7f3b3a59c640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3b280a2c10 0x7f3b280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:12.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.439+0000 7f3b33fff640 1 -- 172.21.15.73:0/2238063298 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3b240cef20 con 0x7f3b3c101cd0 2024-09-05T12:57:12.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.440+0000 7f3b3a59c640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3b280a2c10 0x7f3b280a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c005ab0 tx=0x7f3b2c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:12.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.443+0000 7f3b33fff640 1 -- 172.21.15.73:0/2238063298 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b2409b700 con 0x7f3b3c101cd0 2024-09-05T12:57:12.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.616+0000 7f3b40a53640 1 -- 172.21.15.73:0/2238063298 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f3b3c062630 con 0x7f3b280a2c10 2024-09-05T12:57:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.617+0000 7f3b33fff640 1 -- 172.21.15.73:0/2238063298 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f3b3c062630 con 0x7f3b280a2c10 2024-09-05T12:57:12.619 INFO:teuthology.orchestra.run.smithi073.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-05T12:57:12.620 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040115400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-05T12:57:12.620 INFO:teuthology.orchestra.run.smithi073.stdout:smithi162 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JU400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-05T12:57:12.620 INFO:teuthology.orchestra.run.smithi073.stdout:smithi169 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300LN400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-05T12:57:12.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.619+0000 7f3b40a53640 1 -- 172.21.15.73:0/2238063298 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3b280a2c10 msgr2=0x7f3b280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:12.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.619+0000 7f3b40a53640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3b280a2c10 0x7f3b280a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c005ab0 tx=0x7f3b2c000bc0 comp rx=0 tx=0).stop 2024-09-05T12:57:12.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.619+0000 7f3b40a53640 1 -- 172.21.15.73:0/2238063298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b3c101cd0 msgr2=0x7f3b3c19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:12.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.619+0000 7f3b40a53640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b3c101cd0 0x7f3b3c19cc60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400d770 tx=0x7f3b2400dc30 comp rx=0 tx=0).stop 2024-09-05T12:57:12.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.619+0000 7f3b40a53640 1 -- 172.21.15.73:0/2238063298 shutdown_connections 2024-09-05T12:57:12.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.619+0000 7f3b40a53640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3b280a2c10 0x7f3b280a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:12.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.619+0000 7f3b40a53640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b3c102690 0x7f3b3c19f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:12.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.619+0000 7f3b40a53640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b3c101cd0 0x7f3b3c19cc60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:12.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.619+0000 7f3b40a53640 1 --2- 172.21.15.73:0/2238063298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c100ad0 0x7f3b3c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:12.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.620+0000 7f3b40a53640 1 -- 172.21.15.73:0/2238063298 >> 172.21.15.73:0/2238063298 conn(0x7f3b3c0fc280 msgr2=0x7f3b3c105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:12.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.620+0000 7f3b40a53640 1 -- 172.21.15.73:0/2238063298 shutdown_connections 2024-09-05T12:57:12.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:12.620+0000 7f3b40a53640 1 -- 172.21.15.73:0/2238063298 wait complete. 2024-09-05T12:57:13.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:13 smithi073 ceph-mon[30883]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:13.349 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-05T12:57:13.357 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2024-09-05T12:57:13.357 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-05T12:57:13.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:13 smithi162 ceph-mon[34220]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:13.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:13 smithi169 ceph-mon[34823]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:13.603 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:14.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.085+0000 7ff14d6d3640 1 -- 172.21.15.73:0/1887674938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff148102690 msgr2=0x7ff148108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:14.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.085+0000 7ff14d6d3640 1 --2- 172.21.15.73:0/1887674938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff148102690 0x7ff148108f20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff140009ca0 tx=0x7ff14002a8c0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.085+0000 7ff14d6d3640 1 -- 172.21.15.73:0/1887674938 shutdown_connections 2024-09-05T12:57:14.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.085+0000 7ff14d6d3640 1 --2- 172.21.15.73:0/1887674938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff148102690 0x7ff148108f20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.085+0000 7ff14d6d3640 1 --2- 172.21.15.73:0/1887674938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff148101cd0 0x7ff148102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.085+0000 7ff14d6d3640 1 --2- 172.21.15.73:0/1887674938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff148100ad0 0x7ff148100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.085+0000 7ff14d6d3640 1 -- 172.21.15.73:0/1887674938 >> 172.21.15.73:0/1887674938 conn(0x7ff1480fc280 msgr2=0x7ff1480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.085+0000 7ff14d6d3640 1 -- 172.21.15.73:0/1887674938 shutdown_connections 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.085+0000 7ff14d6d3640 1 -- 172.21.15.73:0/1887674938 wait complete. 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff14d6d3640 1 Processor -- start 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff14d6d3640 1 -- start start 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff14d6d3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff148100ad0 0x7ff148197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff14d6d3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff148101cd0 0x7ff148198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff14d6d3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff148102690 0x7ff14819f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff14d6d3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff14810d8e0 con 0x7ff148101cd0 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff14d6d3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff14810d760 con 0x7ff148102690 2024-09-05T12:57:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff14d6d3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff14810da60 con 0x7ff148100ad0 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff13e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff148101cd0 0x7ff148198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff13e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff148101cd0 0x7ff148198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57016/0 (socket says 172.21.15.73:57016) 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.086+0000 7ff13e7fc640 1 -- 172.21.15.73:0/2514544771 learned_addr learned my addr 172.21.15.73:0/2514544771 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff146ffd640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff148100ad0 0x7ff148197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff13e7fc640 1 -- 172.21.15.73:0/2514544771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff148100ad0 msgr2=0x7ff148197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff13e7fc640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff148100ad0 0x7ff148197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff13e7fc640 1 -- 172.21.15.73:0/2514544771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff148102690 msgr2=0x7ff14819f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff1477fe640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff148102690 0x7ff14819f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff13e7fc640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff148102690 0x7ff14819f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff13e7fc640 1 -- 172.21.15.73:0/2514544771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14819fa80 con 0x7ff148101cd0 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff13e7fc640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff148101cd0 0x7ff148198390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff13000c920 tx=0x7ff13000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff144ff9640 1 -- 172.21.15.73:0/2514544771 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130007c70 con 0x7ff148101cd0 2024-09-05T12:57:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff144ff9640 1 -- 172.21.15.73:0/2514544771 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff130007e10 con 0x7ff148101cd0 2024-09-05T12:57:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff14d6d3640 1 -- 172.21.15.73:0/2514544771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14819fd70 con 0x7ff148101cd0 2024-09-05T12:57:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff144ff9640 1 -- 172.21.15.73:0/2514544771 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130018890 con 0x7ff148101cd0 2024-09-05T12:57:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.087+0000 7ff14d6d3640 1 -- 172.21.15.73:0/2514544771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1481a02d0 con 0x7ff148101cd0 2024-09-05T12:57:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.088+0000 7ff14d6d3640 1 -- 172.21.15.73:0/2514544771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff148107e80 con 0x7ff148101cd0 2024-09-05T12:57:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.089+0000 7ff144ff9640 1 -- 172.21.15.73:0/2514544771 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff130018af0 con 0x7ff148101cd0 2024-09-05T12:57:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.090+0000 7ff144ff9640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff1340a2c40 0x7ff1340a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.090+0000 7ff146ffd640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff1340a2c40 0x7ff1340a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.090+0000 7ff144ff9640 1 -- 172.21.15.73:0/2514544771 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ff1300cf390 con 0x7ff148101cd0 2024-09-05T12:57:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.090+0000 7ff146ffd640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff1340a2c40 0x7ff1340a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff148101b30 tx=0x7ff138008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.094+0000 7ff144ff9640 1 -- 172.21.15.73:0/2514544771 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff130014030 con 0x7ff148101cd0 2024-09-05T12:57:14.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:14 smithi073 ceph-mon[30883]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:14.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.296+0000 7ff14d6d3640 1 -- 172.21.15.73:0/2514544771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff14802d7c0 con 0x7ff148101cd0 2024-09-05T12:57:14.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.297+0000 7ff144ff9640 1 -- 172.21.15.73:0/2514544771 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3096 (secure 0 0 0) 0x7ff13009c1c0 con 0x7ff148101cd0 2024-09-05T12:57:14.299 INFO:teuthology.orchestra.run.smithi073.stdout:e24 2024-09-05T12:57:14.299 INFO:teuthology.orchestra.run.smithi073.stdout:btime 2024-09-05T12:55:57:797257+0000 2024-09-05T12:57:14.299 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-05T12:57:14.299 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T12:57:14.299 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-09-05T12:57:14.299 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:14.299 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-09-05T12:57:14.299 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 24 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-05T12:55:46.371642+0000 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-09-05T12:55:57.388420+0000 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 300 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 0 2024-09-05T12:57:14.300 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 3 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:in 0,1,2 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=24482,1=24466,2=24452} 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data disabled 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 0 2024-09-05T12:57:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 24482 members: 24452,24466,24482 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b{0:24482} state up:active seq 4 addr [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c{0:24448} state up:standby-replay seq 1 addr [v2:172.21.15.169:6836/2325276065,v1:172.21.15.169:6837/2325276065] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.i{1:24466} state up:active seq 8 addr [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f{1:24442} state up:standby-replay seq 1 addr [v2:172.21.15.169:6834/4085562536,v1:172.21.15.169:6835/4085562536] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.h{2:24452} state up:active seq 9 addr [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e{2:24428} state up:standby-replay seq 1 addr [v2:172.21.15.162:6834/3122717185,v1:172.21.15.162:6835/3122717185] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.j{-1:14535} state up:standby seq 1 addr [v2:172.21.15.73:6834/3381594379,v1:172.21.15.73:6835/3381594379] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d{-1:14547} state up:standby seq 1 addr [v2:172.21.15.73:6836/3164965523,v1:172.21.15.73:6837/3164965523] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.g{-1:14601} state up:standby seq 1 addr [v2:172.21.15.73:6838/3218139737,v1:172.21.15.73:6839/3218139737] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.302 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a{-1:14607} state up:standby seq 1 addr [v2:172.21.15.73:6840/2107729050,v1:172.21.15.73:6841/2107729050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.303 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.k{-1:24407} state up:standby seq 1 addr [v2:172.21.15.162:6832/1135530165,v1:172.21.15.162:6833/1135530165] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.303 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.l{-1:24412} state up:standby seq 1 addr [v2:172.21.15.169:6832/1381090054,v1:172.21.15.169:6833/1381090054] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T12:57:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-05T12:57:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 -- 172.21.15.73:0/2514544771 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff1340a2c40 msgr2=0x7ff1340a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff1340a2c40 0x7ff1340a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff148101b30 tx=0x7ff138008040 comp rx=0 tx=0).stop 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 -- 172.21.15.73:0/2514544771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff148101cd0 msgr2=0x7ff148198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff148101cd0 0x7ff148198390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff13000c920 tx=0x7ff13000cde0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 -- 172.21.15.73:0/2514544771 shutdown_connections 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff1340a2c40 0x7ff1340a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff148102690 0x7ff14819f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff148101cd0 0x7ff148198390 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 --2- 172.21.15.73:0/2514544771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff148100ad0 0x7ff148197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 -- 172.21.15.73:0/2514544771 >> 172.21.15.73:0/2514544771 conn(0x7ff1480fc280 msgr2=0x7ff148105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 -- 172.21.15.73:0/2514544771 shutdown_connections 2024-09-05T12:57:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:14.299+0000 7ff14d6d3640 1 -- 172.21.15.73:0/2514544771 wait complete. 2024-09-05T12:57:14.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:14 smithi162 ceph-mon[34220]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:14.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:14 smithi169 ceph-mon[34823]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T12:57:15.056 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-05T12:57:15.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:15 smithi073 ceph-mon[30883]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:15.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:15 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2514544771' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-05T12:57:15.300 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:15.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:15 smithi162 ceph-mon[34220]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:15.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:15 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2514544771' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-05T12:57:15.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:15 smithi169 ceph-mon[34823]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:15.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:15 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2514544771' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-05T12:57:15.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.776+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1357044469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a0105030 msgr2=0x7f75a0107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.776+0000 7f75a6bf6640 1 --2- 172.21.15.73:0/1357044469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a0105030 0x7f75a0107420 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7588009900 tx=0x7f758802a410 comp rx=0 tx=0).stop 2024-09-05T12:57:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1357044469 shutdown_connections 2024-09-05T12:57:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 --2- 172.21.15.73:0/1357044469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75a0107960 0x7f75a0109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 --2- 172.21.15.73:0/1357044469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a0105030 0x7f75a0107420 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 --2- 172.21.15.73:0/1357044469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75a0102700 0x7f75a0104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1357044469 >> 172.21.15.73:0/1357044469 conn(0x7f75a00fc2a0 msgr2=0x7f75a00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1357044469 shutdown_connections 2024-09-05T12:57:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1357044469 wait complete. 2024-09-05T12:57:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 Processor -- start 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 -- start start 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a0102700 0x7f75a0197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75a0105030 0x7f75a0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75a0107960 0x7f75a019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f75a010d890 con 0x7f75a0102700 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75a010d710 con 0x7f75a0105030 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a6bf6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f75a010da10 con 0x7f75a0107960 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a4992640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a0102700 0x7f75a0197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a4992640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a0102700 0x7f75a0197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57036/0 (socket says 172.21.15.73:57036) 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.777+0000 7f75a4992640 1 -- 172.21.15.73:0/1499160155 learned_addr learned my addr 172.21.15.73:0/1499160155 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f75a5193640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75a0107960 0x7f75a019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f75a4992640 1 -- 172.21.15.73:0/1499160155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75a0107960 msgr2=0x7f75a019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f75a4992640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75a0107960 0x7f75a019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f75a4992640 1 -- 172.21.15.73:0/1499160155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75a0105030 msgr2=0x7f75a0198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f75a4992640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75a0105030 0x7f75a0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f75a4992640 1 -- 172.21.15.73:0/1499160155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a019fb70 con 0x7f75a0102700 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f75a4992640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a0102700 0x7f75a0197f40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f759000eab0 tx=0x7f759000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f759dffb640 1 -- 172.21.15.73:0/1499160155 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759000ce40 con 0x7f75a0102700 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f759dffb640 1 -- 172.21.15.73:0/1499160155 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7590011950 con 0x7f75a0102700 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1499160155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a019fe60 con 0x7f75a0102700 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f759dffb640 1 -- 172.21.15.73:0/1499160155 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590010ae0 con 0x7f75a0102700 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.778+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1499160155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a01a0310 con 0x7f75a0102700 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.779+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1499160155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a00fdd90 con 0x7f75a0102700 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.780+0000 7f759dffb640 1 -- 172.21.15.73:0/1499160155 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7590011b00 con 0x7f75a0102700 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.781+0000 7f759dffb640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f758c0a2c40 0x7f758c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.781+0000 7f759ffff640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f758c0a2c40 0x7f758c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.781+0000 7f759dffb640 1 -- 172.21.15.73:0/1499160155 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f75900cf940 con 0x7f75a0102700 2024-09-05T12:57:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.781+0000 7f759ffff640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f758c0a2c40 0x7f758c0a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f75880096c0 tx=0x7f7588031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.785+0000 7f759dffb640 1 -- 172.21.15.73:0/1499160155 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7590016030 con 0x7f75a0102700 2024-09-05T12:57:15.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.953+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1499160155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f75a002d9b0 con 0x7f75a0102700 2024-09-05T12:57:15.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.954+0000 7f759dffb640 1 -- 172.21.15.73:0/1499160155 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v80) ==== 56+0+5265 (secure 0 0 0) 0x7f759009c770 con 0x7f75a0102700 2024-09-05T12:57:15.956 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 80 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-05T12:48:11.856424+0000 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-09-05T12:56:05.055165+0000 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:crush_version 26 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:full_ratio 0.95 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:backfillfull_ratio 0.9 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:nearfull_ratio 0.85 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:require_min_compat_client luminous 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:min_compat_client luminous 2024-09-05T12:57:15.957 INFO:teuthology.orchestra.run.smithi073.stdout:require_osd_release squid 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:stretch_mode_enabled false 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:max_osd 12 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 up in weight 1 up_from 8 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6802/1199952118,v1:172.21.15.73:6803/1199952118] [v2:172.21.15.73:6804/1199952118,v1:172.21.15.73:6805/1199952118] exists,up f66519cc-c789-455a-bb2a-a7872eeb6102 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 up in weight 1 up_from 12 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6800/1849982968,v1:172.21.15.162:6801/1849982968] [v2:172.21.15.162:6802/1849982968,v1:172.21.15.162:6803/1849982968] exists,up 0f31a701-6a71-46f4-b80e-0b3da55579f1 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 up in weight 1 up_from 17 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/2183957699,v1:172.21.15.169:6801/2183957699] [v2:172.21.15.169:6802/2183957699,v1:172.21.15.169:6803/2183957699] exists,up 4ca9a85b-64f2-42c6-89d8-5acf031950ca 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 up in weight 1 up_from 23 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6810/3192613076,v1:172.21.15.73:6811/3192613076] [v2:172.21.15.73:6812/3192613076,v1:172.21.15.73:6813/3192613076] exists,up 872dac25-184d-4a09-8f6f-05ed823cac56 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 up in weight 1 up_from 30 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6808/2879857832,v1:172.21.15.162:6809/2879857832] [v2:172.21.15.162:6810/2879857832,v1:172.21.15.162:6811/2879857832] exists,up 80300180-a992-4ec2-b072-5d87d9df1e07 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 up in weight 1 up_from 35 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6808/324340736,v1:172.21.15.169:6809/324340736] [v2:172.21.15.169:6810/324340736,v1:172.21.15.169:6811/324340736] exists,up dbfe5aa2-e557-4217-9a26-1bfb6c75e659 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:osd.6 up in weight 1 up_from 42 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6818/1759972661,v1:172.21.15.73:6819/1759972661] [v2:172.21.15.73:6820/1759972661,v1:172.21.15.73:6821/1759972661] exists,up 873c54c3-a55e-4994-b850-56c22cb1d92a 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:osd.7 up in weight 1 up_from 47 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6816/1574930675,v1:172.21.15.162:6817/1574930675] [v2:172.21.15.162:6818/1574930675,v1:172.21.15.162:6819/1574930675] exists,up ec604cbe-a213-4979-99bb-959531e665d6 2024-09-05T12:57:15.958 INFO:teuthology.orchestra.run.smithi073.stdout:osd.8 up in weight 1 up_from 54 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6816/3235960631,v1:172.21.15.169:6817/3235960631] [v2:172.21.15.169:6818/3235960631,v1:172.21.15.169:6819/3235960631] exists,up 1b840a9a-9ed0-497a-a83a-43fc27f0323f 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:osd.9 up in weight 1 up_from 61 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6826/3048419338,v1:172.21.15.73:6827/3048419338] [v2:172.21.15.73:6828/3048419338,v1:172.21.15.73:6829/3048419338] exists,up 249077c2-cf03-4aa8-83fd-0325ca397e07 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:osd.10 up in weight 1 up_from 65 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6824/3623867420,v1:172.21.15.162:6825/3623867420] [v2:172.21.15.162:6826/3623867420,v1:172.21.15.162:6827/3623867420] exists,up f745b0aa-839f-430b-a4af-a0f05f393cc6 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:osd.11 up in weight 1 up_from 72 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6824/1127339864,v1:172.21.15.169:6825/1127339864] [v2:172.21.15.169:6826/1127339864,v1:172.21.15.169:6827/1127339864] exists,up 4f508768-c586-4e4d-8ac6-0c2ffccd05a8 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 2.6 [8,11] 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 2.a [2,11] 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.6 [4,7] 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.11 [4,8] 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.18 [3,9] 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.25 [5,9] 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.36 [4,9] 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/164449765 expires 2024-09-06T12:49:03.895045+0000 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/3258347917 expires 2024-09-06T12:49:03.895045+0000 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/1727245409 expires 2024-09-06T12:49:03.895045+0000 2024-09-05T12:57:15.959 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6801/2037973546 expires 2024-09-06T12:49:03.895045+0000 2024-09-05T12:57:15.960 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/4065677028 expires 2024-09-06T12:48:40.645773+0000 2024-09-05T12:57:15.960 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6801/3437397159 expires 2024-09-06T12:48:40.645773+0000 2024-09-05T12:57:15.960 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6800/3437397159 expires 2024-09-06T12:48:40.645773+0000 2024-09-05T12:57:15.960 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6800/2037973546 expires 2024-09-06T12:49:03.895045+0000 2024-09-05T12:57:15.960 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/1582140576 expires 2024-09-06T12:48:40.645773+0000 2024-09-05T12:57:15.960 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/636038208 expires 2024-09-06T12:48:40.645773+0000 2024-09-05T12:57:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.956+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1499160155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f758c0a2c40 msgr2=0x7f758c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.956+0000 7f75a6bf6640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f758c0a2c40 0x7f758c0a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f75880096c0 tx=0x7f7588031400 comp rx=0 tx=0).stop 2024-09-05T12:57:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.956+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1499160155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a0102700 msgr2=0x7f75a0197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.956+0000 7f75a6bf6640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a0102700 0x7f75a0197f40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f759000eab0 tx=0x7f759000ef70 comp rx=0 tx=0).stop 2024-09-05T12:57:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.956+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1499160155 shutdown_connections 2024-09-05T12:57:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.956+0000 7f75a6bf6640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f758c0a2c40 0x7f758c0a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.956+0000 7f75a6bf6640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75a0107960 0x7f75a019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.956+0000 7f75a6bf6640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75a0105030 0x7f75a0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.956+0000 7f75a6bf6640 1 --2- 172.21.15.73:0/1499160155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a0102700 0x7f75a0197f40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.956+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1499160155 >> 172.21.15.73:0/1499160155 conn(0x7f75a00fc2a0 msgr2=0x7f75a01030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.957+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1499160155 shutdown_connections 2024-09-05T12:57:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:15.957+0000 7f75a6bf6640 1 -- 172.21.15.73:0/1499160155 wait complete. 2024-09-05T12:57:16.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:16 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1499160155' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-05T12:57:16.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:16 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1499160155' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-05T12:57:16.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:16 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1499160155' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-05T12:57:16.649 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-05T12:57:16.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:57:16.904 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:17.299 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:17 smithi073 ceph-mon[30883]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:57:17.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:17 smithi162 ceph-mon[34220]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:57:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:17 smithi169 ceph-mon[34823]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:57:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.375+0000 7f0c92f18640 1 -- 172.21.15.73:0/3071310618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8c101420 msgr2=0x7f0c8c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.375+0000 7f0c92f18640 1 --2- 172.21.15.73:0/3071310618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8c101420 0x7f0c8c10d950 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009cd0 tx=0x7f0c8402a8e0 comp rx=0 tx=0).stop 2024-09-05T12:57:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.375+0000 7f0c92f18640 1 -- 172.21.15.73:0/3071310618 shutdown_connections 2024-09-05T12:57:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.375+0000 7f0c92f18640 1 --2- 172.21.15.73:0/3071310618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8c101420 0x7f0c8c10d950 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.375+0000 7f0c92f18640 1 --2- 172.21.15.73:0/3071310618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c100a80 0x7f0c8c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.375+0000 7f0c92f18640 1 --2- 172.21.15.73:0/3071310618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c8c106a80 0x7f0c8c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.375+0000 7f0c92f18640 1 -- 172.21.15.73:0/3071310618 >> 172.21.15.73:0/3071310618 conn(0x7f0c8c0fc7a0 msgr2=0x7f0c8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.375+0000 7f0c92f18640 1 -- 172.21.15.73:0/3071310618 shutdown_connections 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.375+0000 7f0c92f18640 1 -- 172.21.15.73:0/3071310618 wait complete. 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c92f18640 1 Processor -- start 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c92f18640 1 -- start start 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c92f18640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8c100a80 0x7f0c8c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c92f18640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c8c101420 0x7f0c8c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c92f18640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c106a80 0x7f0c8c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c92f18640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c110f20 con 0x7f0c8c100a80 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c92f18640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c110da0 con 0x7f0c8c106a80 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c92f18640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c1110a0 con 0x7f0c8c101420 2024-09-05T12:57:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c90cb4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8c100a80 0x7f0c8c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c90cb4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8c100a80 0x7f0c8c198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57052/0 (socket says 172.21.15.73:57052) 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c90cb4640 1 -- 172.21.15.73:0/3213584956 learned_addr learned my addr 172.21.15.73:0/3213584956 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c914b5640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c106a80 0x7f0c8c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c8bfff640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c8c101420 0x7f0c8c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c90cb4640 1 -- 172.21.15.73:0/3213584956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c8c101420 msgr2=0x7f0c8c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c90cb4640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c8c101420 0x7f0c8c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c90cb4640 1 -- 172.21.15.73:0/3213584956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c106a80 msgr2=0x7f0c8c19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c90cb4640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c106a80 0x7f0c8c19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c90cb4640 1 -- 172.21.15.73:0/3213584956 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c19d510 con 0x7f0c8c100a80 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c8bfff640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c8c101420 0x7f0c8c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.376+0000 7f0c90cb4640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8c100a80 0x7f0c8c198560 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000b4a0 tx=0x7f0c8000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.377+0000 7f0c89ffb640 1 -- 172.21.15.73:0/3213584956 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80014070 con 0x7f0c8c100a80 2024-09-05T12:57:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.377+0000 7f0c92f18640 1 -- 172.21.15.73:0/3213584956 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8c19d800 con 0x7f0c8c100a80 2024-09-05T12:57:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.377+0000 7f0c89ffb640 1 -- 172.21.15.73:0/3213584956 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c80010af0 con 0x7f0c8c100a80 2024-09-05T12:57:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.377+0000 7f0c89ffb640 1 -- 172.21.15.73:0/3213584956 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80017d10 con 0x7f0c8c100a80 2024-09-05T12:57:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.377+0000 7f0c92f18640 1 -- 172.21.15.73:0/3213584956 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8c1a50e0 con 0x7f0c8c100a80 2024-09-05T12:57:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.378+0000 7f0c92f18640 1 -- 172.21.15.73:0/3213584956 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8c100f60 con 0x7f0c8c100a80 2024-09-05T12:57:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.379+0000 7f0c89ffb640 1 -- 172.21.15.73:0/3213584956 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0c80017070 con 0x7f0c8c100a80 2024-09-05T12:57:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.379+0000 7f0c89ffb640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c7c0a2c10 0x7f0c7c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.379+0000 7f0c8bfff640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c7c0a2c10 0x7f0c7c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.380+0000 7f0c89ffb640 1 -- 172.21.15.73:0/3213584956 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0c800ce4d0 con 0x7f0c8c100a80 2024-09-05T12:57:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.380+0000 7f0c8bfff640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c7c0a2c10 0x7f0c7c0a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c06b7e0 tx=0x7f0c78008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.384+0000 7f0c89ffb640 1 -- 172.21.15.73:0/3213584956 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c8009b410 con 0x7f0c8c100a80 2024-09-05T12:57:17.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.581+0000 7f0c92f18640 1 -- 172.21.15.73:0/3213584956 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c8c1a52b0 con 0x7f0c8c100a80 2024-09-05T12:57:17.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.581+0000 7f0c89ffb640 1 -- 172.21.15.73:0/3213584956 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11926 (secure 0 0 0) 0x7f0c8009ad10 con 0x7f0c8c100a80 2024-09-05T12:57:17.584 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:17.584 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-05T12:55:57:797257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:55:57.388420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24452,24466,24482]},"id":1}]} 2024-09-05T12:57:17.584 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-05T12:57:17.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 -- 172.21.15.73:0/3213584956 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c7c0a2c10 msgr2=0x7f0c7c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:17.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c7c0a2c10 0x7f0c7c0a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c06b7e0 tx=0x7f0c78008040 comp rx=0 tx=0).stop 2024-09-05T12:57:17.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 -- 172.21.15.73:0/3213584956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8c100a80 msgr2=0x7f0c8c198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:17.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8c100a80 0x7f0c8c198560 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000b4a0 tx=0x7f0c8000b960 comp rx=0 tx=0).stop 2024-09-05T12:57:17.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 -- 172.21.15.73:0/3213584956 shutdown_connections 2024-09-05T12:57:17.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c7c0a2c10 0x7f0c7c0a50d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:17.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c106a80 0x7f0c8c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:17.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c8c101420 0x7f0c8c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:17.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 --2- 172.21.15.73:0/3213584956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8c100a80 0x7f0c8c198560 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:17.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 -- 172.21.15.73:0/3213584956 >> 172.21.15.73:0/3213584956 conn(0x7f0c8c0fc7a0 msgr2=0x7f0c8c1048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:17.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.583+0000 7f0c92f18640 1 -- 172.21.15.73:0/3213584956 shutdown_connections 2024-09-05T12:57:17.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:17.584+0000 7f0c92f18640 1 -- 172.21.15.73:0/3213584956 wait complete. 2024-09-05T12:57:18.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:57:18.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:18 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3213584956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:18.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:18 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3213584956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:18 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3213584956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.993+0000 7f093119c640 1 -- 172.21.15.73:0/2082779220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092c100e20 msgr2=0x7f092c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.993+0000 7f093119c640 1 --2- 172.21.15.73:0/2082779220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092c100e20 0x7f092c101200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f091c009ca0 tx=0x7f091c02a950 comp rx=0 tx=0).stop 2024-09-05T12:57:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.993+0000 7f093119c640 1 -- 172.21.15.73:0/2082779220 shutdown_connections 2024-09-05T12:57:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.993+0000 7f093119c640 1 --2- 172.21.15.73:0/2082779220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092c102ef0 0x7f092c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.993+0000 7f093119c640 1 --2- 172.21.15.73:0/2082779220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f092c102570 0x7f092c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.994+0000 7f093119c640 1 --2- 172.21.15.73:0/2082779220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092c100e20 0x7f092c101200 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.994+0000 7f093119c640 1 -- 172.21.15.73:0/2082779220 >> 172.21.15.73:0/2082779220 conn(0x7f092c0fc7d0 msgr2=0x7f092c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.994+0000 7f093119c640 1 -- 172.21.15.73:0/2082779220 shutdown_connections 2024-09-05T12:57:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.994+0000 7f093119c640 1 -- 172.21.15.73:0/2082779220 wait complete. 2024-09-05T12:57:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.994+0000 7f093119c640 1 Processor -- start 2024-09-05T12:57:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.994+0000 7f093119c640 1 -- start start 2024-09-05T12:57:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f093119c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092c100e20 0x7f092c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f093119c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092c102570 0x7f092c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f093119c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f092c102ef0 0x7f092c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f093119c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f092c110f80 con 0x7f092c100e20 2024-09-05T12:57:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f093119c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f092c110e00 con 0x7f092c102570 2024-09-05T12:57:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f093119c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f092c111100 con 0x7f092c102ef0 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092c100e20 0x7f092c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092c100e20 0x7f092c198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57066/0 (socket says 172.21.15.73:57066) 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092ad9d640 1 -- 172.21.15.73:0/2218708760 learned_addr learned my addr 172.21.15.73:0/2218708760 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092a59c640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092c102570 0x7f092c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092b59e640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f092c102ef0 0x7f092c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092ad9d640 1 -- 172.21.15.73:0/2218708760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f092c102ef0 msgr2=0x7f092c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092ad9d640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f092c102ef0 0x7f092c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092ad9d640 1 -- 172.21.15.73:0/2218708760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092c102570 msgr2=0x7f092c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092ad9d640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092c102570 0x7f092c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092ad9d640 1 -- 172.21.15.73:0/2218708760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092c19d4f0 con 0x7f092c100e20 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092a59c640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092c102570 0x7f092c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092b59e640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f092c102ef0 0x7f092c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f092ad9d640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092c100e20 0x7f092c198540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f091c005cc0 tx=0x7f091c02f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:19.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f0913fff640 1 -- 172.21.15.73:0/2218708760 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c034040 con 0x7f092c100e20 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f093119c640 1 -- 172.21.15.73:0/2218708760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092c19d780 con 0x7f092c100e20 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.995+0000 7f0913fff640 1 -- 172.21.15.73:0/2218708760 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f091c030920 con 0x7f092c100e20 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.996+0000 7f093119c640 1 -- 172.21.15.73:0/2218708760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f092c103ba0 con 0x7f092c100e20 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.996+0000 7f0913fff640 1 -- 172.21.15.73:0/2218708760 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c004830 con 0x7f092c100e20 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.997+0000 7f093119c640 1 -- 172.21.15.73:0/2218708760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f092c1021b0 con 0x7f092c100e20 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.998+0000 7f0913fff640 1 -- 172.21.15.73:0/2218708760 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f091c037020 con 0x7f092c100e20 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.998+0000 7f0913fff640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f09140a2c10 0x7f09140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.998+0000 7f092a59c640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f09140a2c10 0x7f09140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.998+0000 7f0913fff640 1 -- 172.21.15.73:0/2218708760 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f091c0f0110 con 0x7f092c100e20 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:18.999+0000 7f092a59c640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f09140a2c10 0x7f09140a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f09200058c0 tx=0x7f0920005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.002+0000 7f0913fff640 1 -- 172.21.15.73:0/2218708760 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f091c0bd050 con 0x7f092c100e20 2024-09-05T12:57:19.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.209+0000 7f093119c640 1 -- 172.21.15.73:0/2218708760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f092c1998a0 con 0x7f092c100e20 2024-09-05T12:57:19.238 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:19 smithi073 ceph-mon[30883]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:57:19.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.210+0000 7f0913fff640 1 -- 172.21.15.73:0/2218708760 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11926 (secure 0 0 0) 0x7f091c0bc950 con 0x7f092c100e20 2024-09-05T12:57:19.239 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:19.239 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-05T12:55:57:797257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:55:57.388420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24452,24466,24482]},"id":1}]} 2024-09-05T12:57:19.240 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-05T12:57:19.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 -- 172.21.15.73:0/2218708760 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f09140a2c10 msgr2=0x7f09140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:19.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f09140a2c10 0x7f09140a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f09200058c0 tx=0x7f0920005850 comp rx=0 tx=0).stop 2024-09-05T12:57:19.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 -- 172.21.15.73:0/2218708760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092c100e20 msgr2=0x7f092c198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:19.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092c100e20 0x7f092c198540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f091c005cc0 tx=0x7f091c02f650 comp rx=0 tx=0).stop 2024-09-05T12:57:19.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 -- 172.21.15.73:0/2218708760 shutdown_connections 2024-09-05T12:57:19.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f09140a2c10 0x7f09140a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:19.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f092c102ef0 0x7f092c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:19.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092c102570 0x7f092c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:19.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 --2- 172.21.15.73:0/2218708760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092c100e20 0x7f092c198540 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:19.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 -- 172.21.15.73:0/2218708760 >> 172.21.15.73:0/2218708760 conn(0x7f092c0fc7d0 msgr2=0x7f092c105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:19.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 -- 172.21.15.73:0/2218708760 shutdown_connections 2024-09-05T12:57:19.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:19.212+0000 7f093119c640 1 -- 172.21.15.73:0/2218708760 wait complete. 2024-09-05T12:57:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:19 smithi162 ceph-mon[34220]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:57:19.375 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:19 smithi169 ceph-mon[34823]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:57:19.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T12:57:20.137 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:20.258 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:20 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2218708760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:20.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:20 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2218708760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:20.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:20 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2218708760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:20.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.628+0000 7f38a5e95640 1 -- 172.21.15.73:0/2063631774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101df0 msgr2=0x7f38a01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:20.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.628+0000 7f38a5e95640 1 --2- 172.21.15.73:0/2063631774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101df0 0x7f38a01021d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3888009900 tx=0x7f388802a410 comp rx=0 tx=0).stop 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.628+0000 7f38a5e95640 1 -- 172.21.15.73:0/2063631774 shutdown_connections 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.628+0000 7f38a5e95640 1 --2- 172.21.15.73:0/2063631774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a0106f20 0x7f38a010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.628+0000 7f38a5e95640 1 --2- 172.21.15.73:0/2063631774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a01027a0 0x7f38a01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.628+0000 7f38a5e95640 1 --2- 172.21.15.73:0/2063631774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101df0 0x7f38a01021d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.628+0000 7f38a5e95640 1 -- 172.21.15.73:0/2063631774 >> 172.21.15.73:0/2063631774 conn(0x7f38a00fd8b0 msgr2=0x7f38a00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.628+0000 7f38a5e95640 1 -- 172.21.15.73:0/2063631774 shutdown_connections 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.628+0000 7f38a5e95640 1 -- 172.21.15.73:0/2063631774 wait complete. 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.628+0000 7f38a5e95640 1 Processor -- start 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f38a5e95640 1 -- start start 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f38a5e95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101df0 0x7f38a0198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f38a5e95640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01027a0 0x7f38a0198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f38a5e95640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0106f20 0x7f38a019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f38a5e95640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f38a0112020 con 0x7f38a0101df0 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f38a5e95640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38a0111ea0 con 0x7f38a0106f20 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f38a5e95640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f38a01121a0 con 0x7f38a01027a0 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101df0 0x7f38a0198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101df0 0x7f38a0198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57086/0 (socket says 172.21.15.73:57086) 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389f7fe640 1 -- 172.21.15.73:0/1947130907 learned_addr learned my addr 172.21.15.73:0/1947130907 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389ffff640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0106f20 0x7f38a019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389effd640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01027a0 0x7f38a0198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389f7fe640 1 -- 172.21.15.73:0/1947130907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01027a0 msgr2=0x7f38a0198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389f7fe640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01027a0 0x7f38a0198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389f7fe640 1 -- 172.21.15.73:0/1947130907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0106f20 msgr2=0x7f38a019cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389f7fe640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0106f20 0x7f38a019cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389f7fe640 1 -- 172.21.15.73:0/1947130907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a019d630 con 0x7f38a0101df0 2024-09-05T12:57:20.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389ffff640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0106f20 0x7f38a019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389effd640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01027a0 0x7f38a0198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.629+0000 7f389f7fe640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101df0 0x7f38a0198680 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3888005ab0 tx=0x7f38880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.630+0000 7f389cff9640 1 -- 172.21.15.73:0/1947130907 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388803f030 con 0x7f38a0101df0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.630+0000 7f389cff9640 1 -- 172.21.15.73:0/1947130907 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3888003ce0 con 0x7f38a0101df0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.630+0000 7f389cff9640 1 -- 172.21.15.73:0/1947130907 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888035070 con 0x7f38a0101df0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.630+0000 7f38a5e95640 1 -- 172.21.15.73:0/1947130907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a019d8c0 con 0x7f38a0101df0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.630+0000 7f38a5e95640 1 -- 172.21.15.73:0/1947130907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a01a5200 con 0x7f38a0101df0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.631+0000 7f38a5e95640 1 -- 172.21.15.73:0/1947130907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a01032d0 con 0x7f38a0101df0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.632+0000 7f389cff9640 1 -- 172.21.15.73:0/1947130907 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3888042030 con 0x7f38a0101df0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.633+0000 7f389cff9640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f388c0a2c10 0x7f388c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.633+0000 7f389effd640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f388c0a2c10 0x7f388c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.633+0000 7f389cff9640 1 -- 172.21.15.73:0/1947130907 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f38880efd90 con 0x7f38a0101df0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.633+0000 7f389effd640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f388c0a2c10 0x7f388c0a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38a00ffee0 tx=0x7f3890008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:20.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.636+0000 7f389cff9640 1 -- 172.21.15.73:0/1947130907 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38880bcbc0 con 0x7f38a0101df0 2024-09-05T12:57:20.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.802+0000 7f38a5e95640 1 -- 172.21.15.73:0/1947130907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38a0102250 con 0x7f38a0101df0 2024-09-05T12:57:20.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.804+0000 7f389cff9640 1 -- 172.21.15.73:0/1947130907 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22645 (secure 0 0 0) 0x7f38880bc4c0 con 0x7f38a0101df0 2024-09-05T12:57:20.807 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:20.807 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":80,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T12:56:05.055165+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T12:57:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 -- 172.21.15.73:0/1947130907 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f388c0a2c10 msgr2=0x7f388c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f388c0a2c10 0x7f388c0a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38a00ffee0 tx=0x7f3890008040 comp rx=0 tx=0).stop 2024-09-05T12:57:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 -- 172.21.15.73:0/1947130907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101df0 msgr2=0x7f38a0198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101df0 0x7f38a0198680 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3888005ab0 tx=0x7f38880042f0 comp rx=0 tx=0).stop 2024-09-05T12:57:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 -- 172.21.15.73:0/1947130907 shutdown_connections 2024-09-05T12:57:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f388c0a2c10 0x7f388c0a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38a0106f20 0x7f38a019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38a01027a0 0x7f38a0198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 --2- 172.21.15.73:0/1947130907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38a0101df0 0x7f38a0198680 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 -- 172.21.15.73:0/1947130907 >> 172.21.15.73:0/1947130907 conn(0x7f38a00fd8b0 msgr2=0x7f38a00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 -- 172.21.15.73:0/1947130907 shutdown_connections 2024-09-05T12:57:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:20.807+0000 7f38a5e95640 1 -- 172.21.15.73:0/1947130907 wait complete. 2024-09-05T12:57:21.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:21 smithi162 ceph-mon[34220]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:21 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1947130907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:57:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:21 smithi169 ceph-mon[34823]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:21 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1947130907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:57:21.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:21 smithi073 ceph-mon[30883]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:21.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:21 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1947130907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:57:21.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-05T12:55:46.371642+0000', 'modified': '2024-09-05T12:55:57.388420+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24482, 'mds_1': 24466, 'mds_2': 24452}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/3122717185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 3122717185}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 3122717185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/4085562536', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 4085562536}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 4085562536}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6837/2325276065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 2325276065}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 2325276065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.162:6837/3027533309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 3027533309}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 3027533309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.169:6839/3351085082', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 3351085082}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 3351085082}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.162:6839/3413521160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 3413521160}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 3413521160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24482, 'qdb_cluster': [24452, 24466, 24482]} 2024-09-05T12:57:21.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-05T12:57:21.588 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.h status 2024-09-05T12:57:21.838 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:22.227 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:22 smithi073 ceph-mon[30883]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.305+0000 7f4921d23640 1 -- 172.21.15.73:0/158925204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f491c101de0 msgr2=0x7f491c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.305+0000 7f4921d23640 1 --2- 172.21.15.73:0/158925204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f491c101de0 0x7f491c1021c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f490c009900 tx=0x7f490c02a410 comp rx=0 tx=0).stop 2024-09-05T12:57:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.305+0000 7f4921d23640 1 -- 172.21.15.73:0/158925204 shutdown_connections 2024-09-05T12:57:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.305+0000 7f4921d23640 1 --2- 172.21.15.73:0/158925204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f491c106f10 0x7f491c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.305+0000 7f4921d23640 1 --2- 172.21.15.73:0/158925204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f491c102790 0x7f491c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.305+0000 7f4921d23640 1 --2- 172.21.15.73:0/158925204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f491c101de0 0x7f491c1021c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.305+0000 7f4921d23640 1 -- 172.21.15.73:0/158925204 >> 172.21.15.73:0/158925204 conn(0x7f491c0fd8c0 msgr2=0x7f491c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.305+0000 7f4921d23640 1 -- 172.21.15.73:0/158925204 shutdown_connections 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.305+0000 7f4921d23640 1 -- 172.21.15.73:0/158925204 wait complete. 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f4921d23640 1 Processor -- start 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f4921d23640 1 -- start start 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f4921d23640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f491c101de0 0x7f491c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f4921d23640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f491c102790 0x7f491c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f4921d23640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f491c106f10 0x7f491c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f4921d23640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f491c112010 con 0x7f491c101de0 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f4921d23640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f491c111e90 con 0x7f491c102790 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f4921d23640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f491c112190 con 0x7f491c106f10 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f491c101de0 0x7f491c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f491c101de0 0x7f491c1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57108/0 (socket says 172.21.15.73:57108) 2024-09-05T12:57:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491b7fe640 1 -- 172.21.15.73:0/3139880383 learned_addr learned my addr 172.21.15.73:0/3139880383 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f4913fff640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f491c102790 0x7f491c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491b7fe640 1 -- 172.21.15.73:0/3139880383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f491c106f10 msgr2=0x7f491c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491bfff640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f491c106f10 0x7f491c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491b7fe640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f491c106f10 0x7f491c19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491b7fe640 1 -- 172.21.15.73:0/3139880383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f491c102790 msgr2=0x7f491c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491b7fe640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f491c102790 0x7f491c198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491b7fe640 1 -- 172.21.15.73:0/3139880383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491c19d560 con 0x7f491c101de0 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491bfff640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f491c106f10 0x7f491c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.306+0000 7f491b7fe640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f491c101de0 0x7f491c1985b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f490c005ab0 tx=0x7f490c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.307+0000 7f49197fa640 1 -- 172.21.15.73:0/3139880383 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c03f030 con 0x7f491c101de0 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.307+0000 7f4921d23640 1 -- 172.21.15.73:0/3139880383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f491c19d7f0 con 0x7f491c101de0 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.307+0000 7f49197fa640 1 -- 172.21.15.73:0/3139880383 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f490c003ce0 con 0x7f491c101de0 2024-09-05T12:57:22.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.307+0000 7f4921d23640 1 -- 172.21.15.73:0/3139880383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f491c1a5130 con 0x7f491c101de0 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.307+0000 7f49197fa640 1 -- 172.21.15.73:0/3139880383 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c035070 con 0x7f491c101de0 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.309+0000 7f49197fa640 1 -- 172.21.15.73:0/3139880383 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f490c042030 con 0x7f491c101de0 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.309+0000 7f49240f9740 1 Processor -- start 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.309+0000 7f49240f9740 1 -- start start 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.309+0000 7f49240f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 0x55919fe57db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.309+0000 7f49240f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 0x55919fe62670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.309+0000 7f49240f9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe62bb0 0x55919fe64fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.309+0000 7f49240f9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55919fdbe090 con 0x55919fe62bb0 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.309+0000 7f49240f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55919fd65a70 con 0x55919fe582f0 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.309+0000 7f49240f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55919fdba050 con 0x55919fe579d0 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.309+0000 7f4913fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe62bb0 0x55919fe64fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4913fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe62bb0 0x55919fe64fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57118/0 (socket says 172.21.15.73:57118) 2024-09-05T12:57:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4913fff640 1 -- 172.21.15.73:0/3794166851 learned_addr learned my addr 172.21.15.73:0/3794166851 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:22.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f491bfff640 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 0x55919fe57db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f491b7fe640 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 0x55919fe62670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f49197fa640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49080a2c10 0x7f49080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4913fff640 1 -- 172.21.15.73:0/3794166851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 msgr2=0x55919fe57db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:22.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4913fff640 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 0x55919fe57db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4913fff640 1 -- 172.21.15.73:0/3794166851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 msgr2=0x55919fe62670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:22.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4913fff640 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 0x55919fe62670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4913fff640 1 -- 172.21.15.73:0/3794166851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55919fd72130 con 0x55919fe62bb0 2024-09-05T12:57:22.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f491bfff640 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 0x55919fe57db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:22.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f491b7fe640 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 0x55919fe62670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:22.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f491bfff640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49080a2c10 0x7f49080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f49197fa640 1 -- 172.21.15.73:0/3139880383 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f490c0ef830 con 0x7f491c101de0 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4913fff640 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe62bb0 0x55919fe64fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f490400b7f0 tx=0x7f490400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3349d0bd995a08b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4911ffb640 1 -- 172.21.15.73:0/3794166851 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490400d950 con 0x55919fe62bb0 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4911ffb640 1 -- 172.21.15.73:0/3794166851 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4904018070 con 0x55919fe62bb0 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.310+0000 7f4911ffb640 1 -- 172.21.15.73:0/3794166851 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49040123e0 con 0x55919fe62bb0 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f49240f9740 1 -- 172.21.15.73:0/3794166851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe62bb0 msgr2=0x55919fe64fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f491bfff640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49080a2c10 0x7f49080a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f491400a3c0 tx=0x7f4914004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f49240f9740 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe62bb0 0x55919fe64fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f490400b7f0 tx=0x7f490400bcb0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f49240f9740 1 -- 172.21.15.73:0/3794166851 shutdown_connections 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f49240f9740 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe62bb0 0x55919fe64fa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f49240f9740 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 0x55919fe62670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f49240f9740 1 --2- 172.21.15.73:0/3794166851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 0x55919fe57db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f49240f9740 1 -- 172.21.15.73:0/3794166851 >> 172.21.15.73:0/3794166851 conn(0x55919fe53f60 msgr2=0x55919fe54340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f49240f9740 1 -- 172.21.15.73:0/3794166851 shutdown_connections 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f49240f9740 1 -- 172.21.15.73:0/3794166851 wait complete. 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.311+0000 7f49240f9740 1 -- start start 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f49240f9740 1 Processor -- start 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f49240f9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f49240f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe582f0 0x55919fe5f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f49240f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 0x55919fe5fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f49240f9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55919fe65780 con 0x55919fe579d0 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f49240f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55919fd78f20 con 0x55919fe62bb0 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f49240f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55919fe65900 con 0x55919fe582f0 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f49240f9740 10 client.0 _ll_register_callbacks cb 0x55919fd42030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe624a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57134/0 (socket says 172.21.15.73:57134) 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491b7fe640 1 -- 172.21.15.73:0/1910826163 learned_addr learned my addr 172.21.15.73:0/1910826163 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491b7fe640 1 -- 172.21.15.73:0/1910826163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe582f0 msgr2=0x55919fe5f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491b7fe640 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe582f0 0x55919fe5f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491bfff640 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 0x55919fe5fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491b7fe640 1 -- 172.21.15.73:0/1910826163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 msgr2=0x55919fe5fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491b7fe640 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 0x55919fe5fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491b7fe640 1 -- 172.21.15.73:0/1910826163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55919fb2f2b0 con 0x55919fe579d0 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491bfff640 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 0x55919fe5fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f491b7fe640 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe624a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f490c0bbc00 tx=0x7f490c0b81a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36b14adc88c1b97 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.312+0000 7f48faffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f48faffd640 1 -- 172.21.15.73:0/1910826163 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c049050 con 0x55919fe579d0 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f48faffd640 1 -- 172.21.15.73:0/1910826163 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f490c0b8570 con 0x55919fe579d0 2024-09-05T12:57:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f49240f9740 1 -- 172.21.15.73:0/1910826163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4904018070 con 0x55919fe579d0 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f48faffd640 1 -- 172.21.15.73:0/1910826163 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f490c0bb860 con 0x55919fe579d0 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f49240f9740 10 client.15081 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f49240f9740 1 -- 172.21.15.73:0/1910826163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55919fe71060 con 0x55919fe579d0 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f48faffd640 1 -- 172.21.15.73:0/1910826163 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4904018070 con 0x55919fe579d0 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f48faffd640 1 -- 172.21.15.73:0/1910826163 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f490c0ed400 con 0x55919fe579d0 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f49240f9740 10 client.15081 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f49240f9740 10 client.15081 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f49240f9740 20 client.15081 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f49240f9740 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55919fe73260 0x55919fe74c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f49240f9740 4 client.15081 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.313+0000 7f49240f9740 1 -- 172.21.15.73:0/1910826163 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55919fdcb600 con 0x55919fe73260 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.314+0000 7f4913fff640 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55919fe73260 0x55919fe74c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.314+0000 7f4913fff640 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55919fe73260 0x55919fe74c00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9b6b4b9754b4cb42 server_cookie=de4a06d022e7669 in_seq=0 out_seq=0 2024-09-05T12:57:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.314+0000 7f48faffd640 10 client.15081 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T12:57:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f48faffd640 1 -- 172.21.15.73:0/1910826163 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55919fdcb600 con 0x55919fe73260 2024-09-05T12:57:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f48faffd640 10 client.15081 handle_command_reply: tid=0 2024-09-05T12:57:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 client.15081 shutdown 2024-09-05T12:57:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 -- 172.21.15.73:0/1910826163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 msgr2=0x55919fe624a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe624a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f490c0bbc00 tx=0x7f490c0b81a0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 -- 172.21.15.73:0/1910826163 shutdown_connections 2024-09-05T12:57:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 0x55919fe5fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55919fe73260 0x55919fe74c00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe582f0 0x55919fe5f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 --2- 172.21.15.73:0/1910826163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe624a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 -- 172.21.15.73:0/1910826163 >> 172.21.15.73:0/1910826163 conn(0x55919fe53f60 msgr2=0x55919fe59c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f48faffd640 0 client.15081 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 -- 172.21.15.73:0/1910826163 shutdown_connections 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 1 -- 172.21.15.73:0/1910826163 wait complete. 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.315+0000 7f49240f9740 20 client.15081 trim_cache size 0 max 16384 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f49240f9740 1 Processor -- start 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f49240f9740 1 -- start start 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f49240f9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe6f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f49240f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 0x55919fe5f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f49240f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe62bb0 0x55919fe5fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f49240f9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55919fe730e0 con 0x55919fe579d0 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f49240f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55919fe736c0 con 0x55919fe582f0 2024-09-05T12:57:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f49240f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55919fe73d10 con 0x55919fe62bb0 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f491b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe6f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f491b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe6f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57138/0 (socket says 172.21.15.73:57138) 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f491b7fe640 1 -- 172.21.15.73:0/448107712 learned_addr learned my addr 172.21.15.73:0/448107712 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f4913fff640 1 --2- 172.21.15.73:0/448107712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 0x55919fe5f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f491b7fe640 1 -- 172.21.15.73:0/448107712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe62bb0 msgr2=0x55919fe5fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f491b7fe640 1 --2- 172.21.15.73:0/448107712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe62bb0 0x55919fe5fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f491b7fe640 1 -- 172.21.15.73:0/448107712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 msgr2=0x55919fe5f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f491b7fe640 1 --2- 172.21.15.73:0/448107712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 0x55919fe5f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.333+0000 7f491b7fe640 1 -- 172.21.15.73:0/448107712 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55919fe58f50 con 0x55919fe579d0 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f491b7fe640 1 --2- 172.21.15.73:0/448107712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe6f0e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f490c006010 tx=0x7f490c0ba410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48411001ae00b5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f49117fa640 1 -- 172.21.15.73:0/448107712 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c049070 con 0x55919fe579d0 2024-09-05T12:57:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f49117fa640 1 -- 172.21.15.73:0/448107712 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f490c0bc600 con 0x55919fe579d0 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f49117fa640 1 -- 172.21.15.73:0/448107712 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c0c46e0 con 0x55919fe579d0 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f49240f9740 1 -- 172.21.15.73:0/448107712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 msgr2=0x55919fe6f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f49240f9740 1 --2- 172.21.15.73:0/448107712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe6f0e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f490c006010 tx=0x7f490c0ba410 comp rx=0 tx=0).stop 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f49240f9740 1 -- 172.21.15.73:0/448107712 shutdown_connections 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f49240f9740 1 --2- 172.21.15.73:0/448107712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe62bb0 0x55919fe5fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f49240f9740 1 --2- 172.21.15.73:0/448107712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe582f0 0x55919fe5f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f49240f9740 1 --2- 172.21.15.73:0/448107712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe579d0 0x55919fe6f0e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.334+0000 7f49240f9740 1 -- 172.21.15.73:0/448107712 >> 172.21.15.73:0/448107712 conn(0x55919fe53f60 msgr2=0x55919fe5f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 1 -- 172.21.15.73:0/448107712 shutdown_connections 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 1 -- 172.21.15.73:0/448107712 wait complete. 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 1 -- start start 2024-09-05T12:57:22.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 1 Processor -- start 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 0x55919fe784e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe582f0 0x55919fe78a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 0x55919fedbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55919fe74a80 con 0x55919fe582f0 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55919fe743b0 con 0x55919fe62bb0 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55919fe75150 con 0x55919fe579d0 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.335+0000 7f49240f9740 10 client.0 _ll_register_callbacks cb 0x7f490c005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f4913fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe582f0 0x55919fe78a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f4913fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe582f0 0x55919fe78a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57152/0 (socket says 172.21.15.73:57152) 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f4913fff640 1 -- 172.21.15.73:0/2847160768 learned_addr learned my addr 172.21.15.73:0/2847160768 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f491b7fe640 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 0x55919fe784e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f491bfff640 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 0x55919fedbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f4913fff640 1 -- 172.21.15.73:0/2847160768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 msgr2=0x55919fe784e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f4913fff640 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 0x55919fe784e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f4913fff640 1 -- 172.21.15.73:0/2847160768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 msgr2=0x55919fedbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f4913fff640 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 0x55919fedbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f4913fff640 1 -- 172.21.15.73:0/2847160768 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55919fedc400 con 0x55919fe582f0 2024-09-05T12:57:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f491b7fe640 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 0x55919fe784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f491bfff640 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 0x55919fedbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f4913fff640 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe582f0 0x55919fe78a20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f490400b7f0 tx=0x7f49040047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65deda4bfc21aeb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f48faffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f48faffd640 1 -- 172.21.15.73:0/2847160768 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490402b060 con 0x55919fe582f0 2024-09-05T12:57:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f48faffd640 1 -- 172.21.15.73:0/2847160768 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f490400d950 con 0x55919fe582f0 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f49240f9740 1 -- 172.21.15.73:0/2847160768 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f490c0bc600 con 0x55919fe582f0 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f48faffd640 1 -- 172.21.15.73:0/2847160768 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4904013b80 con 0x55919fe582f0 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f49240f9740 10 client.15087 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.336+0000 7f49240f9740 1 -- 172.21.15.73:0/2847160768 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55919fedd760 con 0x55919fe582f0 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.337+0000 7f48faffd640 1 -- 172.21.15.73:0/2847160768 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f490c0bc600 con 0x55919fe582f0 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.337+0000 7f48faffd640 1 -- 172.21.15.73:0/2847160768 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4904025030 con 0x55919fe582f0 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.337+0000 7f49240f9740 10 client.15087 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.337+0000 7f49240f9740 10 client.15087 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.337+0000 7f49240f9740 20 client.15087 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.337+0000 7f49240f9740 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55919fee2200 0x55919fee0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.337+0000 7f49240f9740 4 client.15087 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.337+0000 7f49240f9740 1 -- 172.21.15.73:0/2847160768 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "status"}) -- 0x55919fdc5b10 con 0x55919fee2200 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.337+0000 7f491b7fe640 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55919fee2200 0x55919fee0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f48faffd640 10 client.15087 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f491b7fe640 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55919fee2200 0x55919fee0f10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ef01e78a100c5330 server_cookie=6b5b76c056368b83 in_seq=0 out_seq=0 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f48faffd640 1 -- 172.21.15.73:0/2847160768 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55919fdc5b10 con 0x55919fee2200 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f48faffd640 10 client.15087 handle_command_reply: tid=0 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 client.15087 shutdown 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 -- 172.21.15.73:0/2847160768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe582f0 msgr2=0x55919fe78a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe582f0 0x55919fe78a20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f490400b7f0 tx=0x7f49040047d0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 -- 172.21.15.73:0/2847160768 shutdown_connections 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55919fe62bb0 0x55919fedbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55919fe582f0 0x55919fe78a20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55919fee2200 0x55919fee0f10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 --2- 172.21.15.73:0/2847160768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55919fe579d0 0x55919fe784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 -- 172.21.15.73:0/2847160768 >> 172.21.15.73:0/2847160768 conn(0x55919fe53f60 msgr2=0x55919fe5f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:22.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f48faffd640 0 client.15087 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T12:57:22.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 -- 172.21.15.73:0/2847160768 shutdown_connections 2024-09-05T12:57:22.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 1 -- 172.21.15.73:0/2847160768 wait complete. 2024-09-05T12:57:22.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.338+0000 7f49240f9740 20 client.15087 trim_cache size 0 max 16384 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "febf1dd4-6b84-11ef-bcd6-c7b262605968", 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 2, 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24452, 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 87.550514844000006, 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 24, 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 80, 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 78, 2024-09-05T12:57:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 117.807305361 2024-09-05T12:57:22.361 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 -- 172.21.15.73:0/3139880383 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49080a2c10 msgr2=0x7f49080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49080a2c10 0x7f49080a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f491400a3c0 tx=0x7f4914004b50 comp rx=0 tx=0).stop 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 -- 172.21.15.73:0/3139880383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f491c101de0 msgr2=0x7f491c1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f491c101de0 0x7f491c1985b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f490c005ab0 tx=0x7f490c0042f0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 -- 172.21.15.73:0/3139880383 shutdown_connections 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49080a2c10 0x7f49080a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f491c106f10 0x7f491c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f491c102790 0x7f491c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 --2- 172.21.15.73:0/3139880383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f491c101de0 0x7f491c1985b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 -- 172.21.15.73:0/3139880383 >> 172.21.15.73:0/3139880383 conn(0x7f491c0fd8c0 msgr2=0x7f491c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:22.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 -- 172.21.15.73:0/3139880383 shutdown_connections 2024-09-05T12:57:22.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:22.339+0000 7f4921d23640 1 -- 172.21.15.73:0/3139880383 wait complete. 2024-09-05T12:57:22.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:22 smithi162 ceph-mon[34220]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:22.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:22 smithi169 ceph-mon[34823]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:23.135 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.i status 2024-09-05T12:57:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:23.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.856+0000 7f2098085640 1 -- 172.21.15.73:0/562995049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2090106a80 msgr2=0x7f2090106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:23.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.856+0000 7f2098085640 1 --2- 172.21.15.73:0/562995049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2090106a80 0x7f2090106e60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f208c009930 tx=0x7f208c02a420 comp rx=0 tx=0).stop 2024-09-05T12:57:23.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.856+0000 7f2098085640 1 -- 172.21.15.73:0/562995049 shutdown_connections 2024-09-05T12:57:23.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.856+0000 7f2098085640 1 --2- 172.21.15.73:0/562995049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2090101420 0x7f209010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.856+0000 7f2098085640 1 --2- 172.21.15.73:0/562995049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2090100a80 0x7f2090100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.856+0000 7f2098085640 1 --2- 172.21.15.73:0/562995049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2090106a80 0x7f2090106e60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.856+0000 7f2098085640 1 -- 172.21.15.73:0/562995049 >> 172.21.15.73:0/562995049 conn(0x7f20900fc7a0 msgr2=0x7f20900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.856+0000 7f2098085640 1 -- 172.21.15.73:0/562995049 shutdown_connections 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.856+0000 7f2098085640 1 -- 172.21.15.73:0/562995049 wait complete. 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2098085640 1 Processor -- start 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2098085640 1 -- start start 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2098085640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2090100a80 0x7f2090199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2098085640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2090101420 0x7f2090199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2098085640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2090106a80 0x7f20901a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2098085640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2090110ef0 con 0x7f2090106a80 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2098085640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2090110d70 con 0x7f2090101420 2024-09-05T12:57:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2098085640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2090111070 con 0x7f2090100a80 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2096622640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2090106a80 0x7f20901a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2096622640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2090106a80 0x7f20901a43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32798/0 (socket says 172.21.15.73:32798) 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2096622640 1 -- 172.21.15.73:0/1847311795 learned_addr learned my addr 172.21.15.73:0/1847311795 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2095620640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2090101420 0x7f2090199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2095e21640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2090100a80 0x7f2090199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2096622640 1 -- 172.21.15.73:0/1847311795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2090100a80 msgr2=0x7f2090199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2096622640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2090100a80 0x7f2090199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2096622640 1 -- 172.21.15.73:0/1847311795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2090101420 msgr2=0x7f2090199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2096622640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2090101420 0x7f2090199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2096622640 1 -- 172.21.15.73:0/1847311795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20901a48f0 con 0x7f2090106a80 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2095620640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2090101420 0x7f2090199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.857+0000 7f2096622640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2090106a80 0x7f20901a43b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f208800eaa0 tx=0x7f208800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.858+0000 7f2086ffd640 1 -- 172.21.15.73:0/1847311795 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208800cdb0 con 0x7f2090106a80 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.858+0000 7f2098085640 1 -- 172.21.15.73:0/1847311795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20901a4ac0 con 0x7f2090106a80 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.858+0000 7f2086ffd640 1 -- 172.21.15.73:0/1847311795 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2088005020 con 0x7f2090106a80 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.858+0000 7f2086ffd640 1 -- 172.21.15.73:0/1847311795 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20880116b0 con 0x7f2090106a80 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.858+0000 7f2098085640 1 -- 172.21.15.73:0/1847311795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20901a4f80 con 0x7f2090106a80 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.860+0000 7f2086ffd640 1 -- 172.21.15.73:0/1847311795 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2088005560 con 0x7f2090106a80 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.860+0000 7f209a45b740 1 Processor -- start 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.860+0000 7f209a45b740 1 -- start start 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.860+0000 7f209a45b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e49d0 0x55e0ed3e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.860+0000 7f209a45b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3ef670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.860+0000 7f209a45b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.860+0000 7f209a45b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed34b090 con 0x55e0ed3e49d0 2024-09-05T12:57:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.860+0000 7f209a45b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed2f2a70 con 0x55e0ed3efbb0 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.860+0000 7f209a45b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed347050 con 0x55e0ed3e52f0 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2086ffd640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f207c0a2c10 0x7f207c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095620640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e49d0 0x55e0ed3e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095620640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e49d0 0x55e0ed3e4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32810/0 (socket says 172.21.15.73:32810) 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095620640 1 -- 172.21.15.73:0/4006840332 learned_addr learned my addr 172.21.15.73:0/4006840332 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095e21640 1 --2- 172.21.15.73:0/4006840332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3ef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2096622640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f207c0a2c10 0x7f207c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095620640 1 --2- 172.21.15.73:0/4006840332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2086ffd640 1 -- 172.21.15.73:0/1847311795 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f20880cf4d0 con 0x7f2090106a80 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095620640 1 -- 172.21.15.73:0/4006840332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e52f0 msgr2=0x55e0ed3ef670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095620640 1 --2- 172.21.15.73:0/4006840332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3ef670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095620640 1 -- 172.21.15.73:0/4006840332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3efbb0 msgr2=0x55e0ed3f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095620640 1 --2- 172.21.15.73:0/4006840332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095620640 1 -- 172.21.15.73:0/4006840332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ed2ff130 con 0x55e0ed3e49d0 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2095620640 1 --2- 172.21.15.73:0/4006840332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e49d0 0x55e0ed3e4db0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2080006fd0 tx=0x7f2080007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94edec224c9e4dc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f2096622640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f207c0a2c10 0x7f207c0a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f208809bb90 tx=0x7f2088056040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f207bfff640 1 -- 172.21.15.73:0/4006840332 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208001c070 con 0x55e0ed3e49d0 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f207bfff640 1 -- 172.21.15.73:0/4006840332 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2080010040 con 0x55e0ed3e49d0 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.861+0000 7f207bfff640 1 -- 172.21.15.73:0/4006840332 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080014730 con 0x55e0ed3e49d0 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.862+0000 7f209a45b740 1 -- 172.21.15.73:0/4006840332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e49d0 msgr2=0x55e0ed3e4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.862+0000 7f209a45b740 1 --2- 172.21.15.73:0/4006840332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e49d0 0x55e0ed3e4db0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2080006fd0 tx=0x7f2080007420 comp rx=0 tx=0).stop 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.862+0000 7f209a45b740 1 -- 172.21.15.73:0/4006840332 shutdown_connections 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.862+0000 7f209a45b740 1 --2- 172.21.15.73:0/4006840332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.862+0000 7f209a45b740 1 --2- 172.21.15.73:0/4006840332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3ef670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.862+0000 7f209a45b740 1 --2- 172.21.15.73:0/4006840332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e49d0 0x55e0ed3e4db0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.862+0000 7f209a45b740 1 -- 172.21.15.73:0/4006840332 >> 172.21.15.73:0/4006840332 conn(0x55e0ed3e0f60 msgr2=0x55e0ed3e1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.862+0000 7f209a45b740 1 -- 172.21.15.73:0/4006840332 shutdown_connections 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.862+0000 7f209a45b740 1 -- 172.21.15.73:0/4006840332 wait complete. 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.862+0000 7f209a45b740 1 -- start start 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f209a45b740 1 Processor -- start 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f209a45b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 0x55e0ed3ef420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f209a45b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3ec770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f209a45b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f209a45b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed3f2780 con 0x55e0ed3efbb0 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f209a45b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed305f20 con 0x55e0ed3e52f0 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f209a45b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed3f2900 con 0x55e0ed3e49d0 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f209a45b740 10 client.0 _ll_register_callbacks cb 0x55e0ed2cf030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095620640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095620640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3eccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32812/0 (socket says 172.21.15.73:32812) 2024-09-05T12:57:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095620640 1 -- 172.21.15.73:0/2195786187 learned_addr learned my addr 172.21.15.73:0/2195786187 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095620640 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 0x55e0ed3ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095e21640 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3ec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095620640 1 -- 172.21.15.73:0/2195786187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 msgr2=0x55e0ed3ef420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095620640 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 0x55e0ed3ef420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095620640 1 -- 172.21.15.73:0/2195786187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3e52f0 msgr2=0x55e0ed3ec770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095620640 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3ec770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095620640 1 -- 172.21.15.73:0/2195786187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0ed0bc2b0 con 0x55e0ed3efbb0 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f2095620640 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3eccb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2080006fa0 tx=0x7f2080017f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c875fba0d1e13c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.863+0000 7f20797fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f20797fa640 1 -- 172.21.15.73:0/2195786187 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208002a020 con 0x55e0ed3efbb0 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f20797fa640 1 -- 172.21.15.73:0/2195786187 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f20800146b0 con 0x55e0ed3efbb0 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f209a45b740 1 -- 172.21.15.73:0/2195786187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2080010040 con 0x55e0ed3efbb0 2024-09-05T12:57:23.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f20797fa640 1 -- 172.21.15.73:0/2195786187 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f208001c040 con 0x55e0ed3efbb0 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f209a45b740 10 client.15099 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f209a45b740 1 -- 172.21.15.73:0/2195786187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e0ed3fe080 con 0x55e0ed3efbb0 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f20797fa640 1 -- 172.21.15.73:0/2195786187 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2080010040 con 0x55e0ed3efbb0 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f20797fa640 1 -- 172.21.15.73:0/2195786187 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2080022040 con 0x55e0ed3efbb0 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f209a45b740 10 client.15099 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f209a45b740 10 client.15099 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f209a45b740 20 client.15099 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f209a45b740 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e0ed400460 0x55e0ed4018d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f209a45b740 4 client.15099 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.864+0000 7f209a45b740 1 -- 172.21.15.73:0/2195786187 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0ed358600 con 0x55e0ed400460 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.865+0000 7f2095e21640 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e0ed400460 0x55e0ed4018d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.865+0000 7f20797fa640 10 client.15099 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.865+0000 7f2095e21640 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e0ed400460 0x55e0ed4018d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4f225611722276c server_cookie=201632b4a25ef23 in_seq=0 out_seq=0 2024-09-05T12:57:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f20797fa640 1 -- 172.21.15.73:0/2195786187 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0ed358600 con 0x55e0ed400460 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f20797fa640 10 client.15099 handle_command_reply: tid=0 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 client.15099 shutdown 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 -- 172.21.15.73:0/2195786187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3efbb0 msgr2=0x55e0ed3eccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3eccb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2080006fa0 tx=0x7f2080017f50 comp rx=0 tx=0).stop 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 -- 172.21.15.73:0/2195786187 shutdown_connections 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e0ed400460 0x55e0ed4018d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3eccb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f20797fa640 0 client.15099 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3ec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 --2- 172.21.15.73:0/2195786187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 0x55e0ed3ef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 -- 172.21.15.73:0/2195786187 >> 172.21.15.73:0/2195786187 conn(0x55e0ed3e0f60 msgr2=0x55e0ed3e6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 -- 172.21.15.73:0/2195786187 shutdown_connections 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 1 -- 172.21.15.73:0/2195786187 wait complete. 2024-09-05T12:57:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.866+0000 7f209a45b740 20 client.15099 trim_cache size 0 max 16384 2024-09-05T12:57:23.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f209a45b740 1 Processor -- start 2024-09-05T12:57:23.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f209a45b740 1 -- start start 2024-09-05T12:57:23.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f209a45b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 0x55e0ed4018d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f209a45b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3e99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f209a45b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f209a45b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed3ffc10 con 0x55e0ed3e52f0 2024-09-05T12:57:23.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f209a45b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed4002e0 con 0x55e0ed3efbb0 2024-09-05T12:57:23.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f209a45b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed4009b0 con 0x55e0ed3e49d0 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f2095e21640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3e99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f2095e21640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3e99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32824/0 (socket says 172.21.15.73:32824) 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f2095e21640 1 -- 172.21.15.73:0/4220790311 learned_addr learned my addr 172.21.15.73:0/4220790311 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f2095620640 1 --2- 172.21.15.73:0/4220790311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 0x55e0ed4018d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f2095e21640 1 -- 172.21.15.73:0/4220790311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 msgr2=0x55e0ed4018d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f2095e21640 1 --2- 172.21.15.73:0/4220790311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 0x55e0ed4018d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f2095e21640 1 -- 172.21.15.73:0/4220790311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3efbb0 msgr2=0x55e0ed3e9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f2095e21640 1 --2- 172.21.15.73:0/4220790311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.885+0000 7f2095e21640 1 -- 172.21.15.73:0/4220790311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ed3e5f20 con 0x55e0ed3e52f0 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.886+0000 7f2095620640 1 --2- 172.21.15.73:0/4220790311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 0x55e0ed4018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.886+0000 7f2095e21640 1 --2- 172.21.15.73:0/4220790311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3e99d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f208c02aa10 tx=0x7f208c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1810657358e1398 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:23.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.886+0000 7f207b7fe640 1 -- 172.21.15.73:0/4220790311 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c047020 con 0x55e0ed3e52f0 2024-09-05T12:57:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.886+0000 7f207b7fe640 1 -- 172.21.15.73:0/4220790311 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f208c0046c0 con 0x55e0ed3e52f0 2024-09-05T12:57:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.886+0000 7f207b7fe640 1 -- 172.21.15.73:0/4220790311 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c035040 con 0x55e0ed3e52f0 2024-09-05T12:57:23.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 -- 172.21.15.73:0/4220790311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 msgr2=0x55e0ed3e99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:23.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 --2- 172.21.15.73:0/4220790311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3e99d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f208c02aa10 tx=0x7f208c02a420 comp rx=0 tx=0).stop 2024-09-05T12:57:23.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 -- 172.21.15.73:0/4220790311 shutdown_connections 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 --2- 172.21.15.73:0/4220790311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3efbb0 0x55e0ed3e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 --2- 172.21.15.73:0/4220790311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed3e99d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 --2- 172.21.15.73:0/4220790311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3e49d0 0x55e0ed4018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 -- 172.21.15.73:0/4220790311 >> 172.21.15.73:0/4220790311 conn(0x55e0ed3e0f60 msgr2=0x55e0ed3eb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 -- 172.21.15.73:0/4220790311 shutdown_connections 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 -- 172.21.15.73:0/4220790311 wait complete. 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 -- start start 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 Processor -- start 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.887+0000 7f209a45b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3e49d0 0x55e0ed405170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f209a45b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed4056b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f209a45b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3efbb0 0x55e0ed462b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f209a45b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed401750 con 0x55e0ed3e52f0 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f209a45b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed401080 con 0x55e0ed3e49d0 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f209a45b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e0ed401e20 con 0x55e0ed3efbb0 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f209a45b740 10 client.0 _ll_register_callbacks cb 0x7f208001a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095e21640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed4056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095e21640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed4056b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32832/0 (socket says 172.21.15.73:32832) 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095e21640 1 -- 172.21.15.73:0/3374968654 learned_addr learned my addr 172.21.15.73:0/3374968654 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095620640 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3e49d0 0x55e0ed405170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095620640 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3efbb0 0x55e0ed462b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095e21640 1 -- 172.21.15.73:0/3374968654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3efbb0 msgr2=0x55e0ed462b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095e21640 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3efbb0 0x55e0ed462b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095e21640 1 -- 172.21.15.73:0/3374968654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3e49d0 msgr2=0x55e0ed405170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095e21640 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3e49d0 0x55e0ed405170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095e21640 1 -- 172.21.15.73:0/3374968654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0ed4631d0 con 0x55e0ed3e52f0 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f2095e21640 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed4056b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f208c000c00 tx=0x7f208c0095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41242f7458f7c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f20797fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f20797fa640 1 -- 172.21.15.73:0/3374968654 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c047030 con 0x55e0ed3e52f0 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f20797fa640 1 -- 172.21.15.73:0/3374968654 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f208c005000 con 0x55e0ed3e52f0 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f209a45b740 1 -- 172.21.15.73:0/3374968654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f208c0046c0 con 0x55e0ed3e52f0 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f20797fa640 1 -- 172.21.15.73:0/3374968654 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f208c05c070 con 0x55e0ed3e52f0 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f209a45b740 10 client.15105 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.888+0000 7f209a45b740 1 -- 172.21.15.73:0/3374968654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e0ed46a560 con 0x55e0ed3e52f0 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.889+0000 7f20797fa640 1 -- 172.21.15.73:0/3374968654 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f208c0046c0 con 0x55e0ed3e52f0 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.889+0000 7f20797fa640 1 -- 172.21.15.73:0/3374968654 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f208c031cd0 con 0x55e0ed3e52f0 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.889+0000 7f209a45b740 10 client.15105 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.889+0000 7f209a45b740 10 client.15105 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.889+0000 7f209a45b740 20 client.15105 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:23.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.889+0000 7f209a45b740 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e0ed46ebe0 0x55e0ed46d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.889+0000 7f209a45b740 4 client.15105 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.889+0000 7f209a45b740 1 -- 172.21.15.73:0/3374968654 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "status"}) -- 0x55e0ed352b10 con 0x55e0ed46ebe0 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.889+0000 7f2095620640 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e0ed46ebe0 0x55e0ed46d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f2095620640 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e0ed46ebe0 0x55e0ed46d8f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3bdc256574c6808a server_cookie=576ab4ee5f6fb8b5 in_seq=0 out_seq=0 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f20797fa640 10 client.15105 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f20797fa640 1 -- 172.21.15.73:0/3374968654 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e0ed352b10 con 0x55e0ed46ebe0 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f20797fa640 10 client.15105 handle_command_reply: tid=0 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 client.15105 shutdown 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 -- 172.21.15.73:0/3374968654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 msgr2=0x55e0ed4056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed4056b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f208c000c00 tx=0x7f208c0095b0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 -- 172.21.15.73:0/3374968654 shutdown_connections 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e0ed46ebe0 0x55e0ed46d8f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0ed3efbb0 0x55e0ed462b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0ed3e52f0 0x55e0ed4056b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 --2- 172.21.15.73:0/3374968654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0ed3e49d0 0x55e0ed405170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f20797fa640 0 client.15105 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T12:57:23.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 -- 172.21.15.73:0/3374968654 >> 172.21.15.73:0/3374968654 conn(0x55e0ed3e0f60 msgr2=0x55e0ed3e0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:23.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 -- 172.21.15.73:0/3374968654 shutdown_connections 2024-09-05T12:57:23.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 1 -- 172.21.15.73:0/3374968654 wait complete. 2024-09-05T12:57:23.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.890+0000 7f209a45b740 20 client.15105 trim_cache size 0 max 16384 2024-09-05T12:57:23.897 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:57:23.897 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "febf1dd4-6b84-11ef-bcd6-c7b262605968", 2024-09-05T12:57:23.897 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 1, 2024-09-05T12:57:23.898 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24466, 2024-09-05T12:57:23.898 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-05T12:57:23.898 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-05T12:57:23.898 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-05T12:57:23.898 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 90.114085388000007, 2024-09-05T12:57:23.898 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 24, 2024-09-05T12:57:23.898 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 80, 2024-09-05T12:57:23.898 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 78, 2024-09-05T12:57:23.898 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 116.696263745 2024-09-05T12:57:23.898 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 -- 172.21.15.73:0/1847311795 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f207c0a2c10 msgr2=0x7f207c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f207c0a2c10 0x7f207c0a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f208809bb90 tx=0x7f2088056040 comp rx=0 tx=0).stop 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 -- 172.21.15.73:0/1847311795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2090106a80 msgr2=0x7f20901a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2090106a80 0x7f20901a43b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f208800eaa0 tx=0x7f208800ef60 comp rx=0 tx=0).stop 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 -- 172.21.15.73:0/1847311795 shutdown_connections 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f207c0a2c10 0x7f207c0a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2090106a80 0x7f20901a43b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2090101420 0x7f2090199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 --2- 172.21.15.73:0/1847311795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2090100a80 0x7f2090199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 -- 172.21.15.73:0/1847311795 >> 172.21.15.73:0/1847311795 conn(0x7f20900fc7a0 msgr2=0x7f20900fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 -- 172.21.15.73:0/1847311795 shutdown_connections 2024-09-05T12:57:23.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:23.891+0000 7f2098085640 1 -- 172.21.15.73:0/1847311795 wait complete. 2024-09-05T12:57:24.578 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.b status 2024-09-05T12:57:24.843 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:25.213 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:25 smithi073 ceph-mon[30883]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:25.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.294+0000 7f2001b2d640 1 -- 172.21.15.73:0/211786757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ffc102dd0 msgr2=0x7f1ffc1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.294+0000 7f2001b2d640 1 --2- 172.21.15.73:0/211786757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ffc102dd0 0x7f1ffc1031b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009930 tx=0x7f1fec02a440 comp rx=0 tx=0).stop 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.294+0000 7f2001b2d640 1 -- 172.21.15.73:0/211786757 shutdown_connections 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.294+0000 7f2001b2d640 1 --2- 172.21.15.73:0/211786757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ffc108300 0x7f1ffc10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.294+0000 7f2001b2d640 1 --2- 172.21.15.73:0/211786757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc103780 0x7f1ffc107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.294+0000 7f2001b2d640 1 --2- 172.21.15.73:0/211786757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ffc102dd0 0x7f1ffc1031b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.294+0000 7f2001b2d640 1 -- 172.21.15.73:0/211786757 >> 172.21.15.73:0/211786757 conn(0x7f1ffc0fc7d0 msgr2=0x7f1ffc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.294+0000 7f2001b2d640 1 -- 172.21.15.73:0/211786757 shutdown_connections 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.294+0000 7f2001b2d640 1 -- 172.21.15.73:0/211786757 wait complete. 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.295+0000 7f2001b2d640 1 Processor -- start 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.295+0000 7f2001b2d640 1 -- start start 2024-09-05T12:57:25.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.295+0000 7f2001b2d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc102dd0 0x7f1ffc198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.295+0000 7f2001b2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ffc103780 0x7f1ffc198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.295+0000 7f2001b2d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ffc108300 0x7f1ffc19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.295+0000 7f2001b2d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc112110 con 0x7f1ffc103780 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.295+0000 7f2001b2d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc111f90 con 0x7f1ffc102dd0 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.295+0000 7f2001b2d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc112290 con 0x7f1ffc108300 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.295+0000 7f1ffaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ffc103780 0x7f1ffc198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.295+0000 7f1ffaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ffc103780 0x7f1ffc198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32844/0 (socket says 172.21.15.73:32844) 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ffaffd640 1 -- 172.21.15.73:0/3830114845 learned_addr learned my addr 172.21.15.73:0/3830114845 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ffbfff640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ffc108300 0x7f1ffc19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc102dd0 0x7f1ffc198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ffaffd640 1 -- 172.21.15.73:0/3830114845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ffc108300 msgr2=0x7f1ffc19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ffc108300 0x7f1ffc19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ffaffd640 1 -- 172.21.15.73:0/3830114845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc102dd0 msgr2=0x7f1ffc198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc102dd0 0x7f1ffc198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ffaffd640 1 -- 172.21.15.73:0/3830114845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ffc19d5d0 con 0x7f1ffc103780 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ffc103780 0x7f1ffc198b60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0006fd0 tx=0x7f1ff000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ff8ff9640 1 -- 172.21.15.73:0/3830114845 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0011830 con 0x7f1ffc103780 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f2001b2d640 1 -- 172.21.15.73:0/3830114845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ffc19d8c0 con 0x7f1ffc103780 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ff8ff9640 1 -- 172.21.15.73:0/3830114845 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff0016070 con 0x7f1ffc103780 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f1ff8ff9640 1 -- 172.21.15.73:0/3830114845 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000f2e0 con 0x7f1ffc103780 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.296+0000 7f2001b2d640 1 -- 172.21.15.73:0/3830114845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ffc1a51a0 con 0x7f1ffc103780 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f1ff8ff9640 1 -- 172.21.15.73:0/3830114845 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1ff001b460 con 0x7f1ffc103780 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f2003f03740 1 Processor -- start 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f2003f03740 1 -- start start 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f2003f03740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c49510db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f2003f03740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495112f0 0x558c4951b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f2003f03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4951bbb0 0x558c4951dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f2003f03740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558c49477090 con 0x558c495109d0 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f2003f03740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558c4941ea70 con 0x558c495112f0 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f2003f03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c49473050 con 0x558c4951bbb0 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f1ff8ff9640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1fe40a2c10 0x7f1fe40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f1ffbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c49510db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f1ffbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c49510db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32854/0 (socket says 172.21.15.73:32854) 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f1ffbfff640 1 -- 172.21.15.73:0/1049650108 learned_addr learned my addr 172.21.15.73:0/1049650108 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.299+0000 7f1ffbfff640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1fe40a2c10 0x7f1fe40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ff8ff9640 1 -- 172.21.15.73:0/3830114845 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f1ff00ce730 con 0x7f1ffc103780 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4951bbb0 0x558c4951dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495112f0 0x558c4951b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffbfff640 1 -- 172.21.15.73:0/1049650108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4951bbb0 msgr2=0x558c4951dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffbfff640 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4951bbb0 0x558c4951dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffbfff640 1 -- 172.21.15.73:0/1049650108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495112f0 msgr2=0x558c4951b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffbfff640 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495112f0 0x558c4951b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffbfff640 1 -- 172.21.15.73:0/1049650108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4942b130 con 0x558c495109d0 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4951bbb0 0x558c4951dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495112f0 0x558c4951b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffbfff640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1fe40a2c10 0x7f1fe40a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400a780 tx=0x7f1ff400ab60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1ffbfff640 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c49510db0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4014f40 tx=0x7f1ff401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9517f28eda0daed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1fe1ffb640 1 -- 172.21.15.73:0/1049650108 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4024070 con 0x558c495109d0 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1fe1ffb640 1 -- 172.21.15.73:0/1049650108 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff4003e50 con 0x558c495109d0 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.300+0000 7f1fe1ffb640 1 -- 172.21.15.73:0/1049650108 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4020440 con 0x558c495109d0 2024-09-05T12:57:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.301+0000 7f2003f03740 1 -- 172.21.15.73:0/1049650108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 msgr2=0x558c49510db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.301+0000 7f2003f03740 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c49510db0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4014f40 tx=0x7f1ff401b000 comp rx=0 tx=0).stop 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.301+0000 7f2003f03740 1 -- 172.21.15.73:0/1049650108 shutdown_connections 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.301+0000 7f2003f03740 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4951bbb0 0x558c4951dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.301+0000 7f2003f03740 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495112f0 0x558c4951b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.301+0000 7f2003f03740 1 --2- 172.21.15.73:0/1049650108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c49510db0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.301+0000 7f2003f03740 1 -- 172.21.15.73:0/1049650108 >> 172.21.15.73:0/1049650108 conn(0x558c4950cf60 msgr2=0x558c4950d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.301+0000 7f2003f03740 1 -- 172.21.15.73:0/1049650108 shutdown_connections 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.301+0000 7f2003f03740 1 -- 172.21.15.73:0/1049650108 wait complete. 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.301+0000 7f2003f03740 1 -- start start 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f2003f03740 1 Processor -- start 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f2003f03740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495109d0 0x558c4951b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f2003f03740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c49518740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f2003f03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4951bbb0 0x558c49518c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f2003f03740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558c4951e720 con 0x558c495112f0 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f2003f03740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558c49431f20 con 0x558c495109d0 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f2003f03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c4951e8a0 con 0x558c4951bbb0 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f2003f03740 10 client.0 _ll_register_callbacks cb 0x558c493fb030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c49518740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c49518740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32858/0 (socket says 172.21.15.73:32858) 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffaffd640 1 -- 172.21.15.73:0/4236691336 learned_addr learned my addr 172.21.15.73:0/4236691336 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495109d0 0x558c4951b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffaffd640 1 -- 172.21.15.73:0/4236691336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4951bbb0 msgr2=0x558c49518c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4951bbb0 0x558c49518c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffaffd640 1 -- 172.21.15.73:0/4236691336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495109d0 msgr2=0x558c4951b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495109d0 0x558c4951b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffaffd640 1 -- 172.21.15.73:0/4236691336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c491e82b0 con 0x558c495112f0 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495109d0 0x558c4951b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c49518740 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1ff009ac70 tx=0x7f1ff001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc9ca4e92db5a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.302+0000 7f1fdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f1fdaffd640 1 -- 172.21.15.73:0/4236691336 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff009af70 con 0x558c495112f0 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f1fdaffd640 1 -- 172.21.15.73:0/4236691336 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f1ff00975e0 con 0x558c495112f0 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f2003f03740 1 -- 172.21.15.73:0/4236691336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ff4003e50 con 0x558c495112f0 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f1fdaffd640 1 -- 172.21.15.73:0/4236691336 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1ff00b5070 con 0x558c495112f0 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f2003f03740 10 client.15117 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f2003f03740 1 -- 172.21.15.73:0/4236691336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558c49529fa0 con 0x558c495112f0 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f1fdaffd640 1 -- 172.21.15.73:0/4236691336 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff4003e50 con 0x558c495112f0 2024-09-05T12:57:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f1fdaffd640 1 -- 172.21.15.73:0/4236691336 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1ff009a3c0 con 0x558c495112f0 2024-09-05T12:57:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f2003f03740 10 client.15117 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f2003f03740 10 client.15117 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T12:57:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f2003f03740 20 client.15117 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.303+0000 7f2003f03740 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558c4952c570 0x558c4952d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.304+0000 7f2003f03740 4 client.15117 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:57:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.304+0000 7f2003f03740 1 -- 172.21.15.73:0/4236691336 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c49484600 con 0x558c4952c570 2024-09-05T12:57:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.304+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558c4952c570 0x558c4952d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.304+0000 7f1fdaffd640 10 client.15117 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.304+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558c4952c570 0x558c4952d9e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b3b6b7ea731286d server_cookie=46998502f7724ae2 in_seq=0 out_seq=0 2024-09-05T12:57:25.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f1fdaffd640 1 -- 172.21.15.73:0/4236691336 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c49484600 con 0x558c4952c570 2024-09-05T12:57:25.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f1fdaffd640 10 client.15117 handle_command_reply: tid=0 2024-09-05T12:57:25.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 client.15117 shutdown 2024-09-05T12:57:25.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 -- 172.21.15.73:0/4236691336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 msgr2=0x558c49518740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c49518740 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1ff009ac70 tx=0x7f1ff001b000 comp rx=0 tx=0).stop 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 -- 172.21.15.73:0/4236691336 shutdown_connections 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558c4952c570 0x558c4952d9e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4951bbb0 0x558c49518c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c49518740 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 --2- 172.21.15.73:0/4236691336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c495109d0 0x558c4951b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 -- 172.21.15.73:0/4236691336 >> 172.21.15.73:0/4236691336 conn(0x558c4950cf60 msgr2=0x558c49512c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f1fdaffd640 0 client.15117 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 -- 172.21.15.73:0/4236691336 shutdown_connections 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.305+0000 7f2003f03740 1 -- 172.21.15.73:0/4236691336 wait complete. 2024-09-05T12:57:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.306+0000 7f2003f03740 20 client.15117 trim_cache size 0 max 16384 2024-09-05T12:57:25.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.323+0000 7f2003f03740 1 Processor -- start 2024-09-05T12:57:25.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.323+0000 7f2003f03740 1 -- start start 2024-09-05T12:57:25.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.323+0000 7f2003f03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c495109d0 0x558c4952bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.323+0000 7f2003f03740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c4952d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.323+0000 7f2003f03740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c4951bbb0 0x558c4950c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.323+0000 7f2003f03740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558c4952bd20 con 0x558c495112f0 2024-09-05T12:57:25.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.323+0000 7f2003f03740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558c4952c3f0 con 0x558c4951bbb0 2024-09-05T12:57:25.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.323+0000 7f2003f03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c4952cac0 con 0x558c495109d0 2024-09-05T12:57:25.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.323+0000 7f1ffaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c4952d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.323+0000 7f1ffaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c4952d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32868/0 (socket says 172.21.15.73:32868) 2024-09-05T12:57:25.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1ffaffd640 1 -- 172.21.15.73:0/1910188044 learned_addr learned my addr 172.21.15.73:0/1910188044 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:25.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/1910188044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c495109d0 0x558c4952bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1ffaffd640 1 -- 172.21.15.73:0/1910188044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c495109d0 msgr2=0x558c4952bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:25.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/1910188044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c495109d0 0x558c4952bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1ffaffd640 1 -- 172.21.15.73:0/1910188044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c4951bbb0 msgr2=0x558c4950c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:25.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/1910188044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c4951bbb0 0x558c4950c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1ffaffd640 1 -- 172.21.15.73:0/1910188044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c49516c90 con 0x558c495112f0 2024-09-05T12:57:25.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/1910188044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c4952d310 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00a36b0 tx=0x7f1ff0099480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e21d0b163a5fbe server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:25.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1fe17fa640 1 -- 172.21.15.73:0/1910188044 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff009af70 con 0x558c495112f0 2024-09-05T12:57:25.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1fe17fa640 1 -- 172.21.15.73:0/1910188044 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff009f320 con 0x558c495112f0 2024-09-05T12:57:25.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.324+0000 7f1fe17fa640 1 -- 172.21.15.73:0/1910188044 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff009a8d0 con 0x558c495112f0 2024-09-05T12:57:25.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.325+0000 7f2003f03740 1 -- 172.21.15.73:0/1910188044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 msgr2=0x558c4952d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:25.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.325+0000 7f2003f03740 1 --2- 172.21.15.73:0/1910188044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c4952d310 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00a36b0 tx=0x7f1ff0099480 comp rx=0 tx=0).stop 2024-09-05T12:57:25.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.325+0000 7f2003f03740 1 -- 172.21.15.73:0/1910188044 shutdown_connections 2024-09-05T12:57:25.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.325+0000 7f2003f03740 1 --2- 172.21.15.73:0/1910188044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c4951bbb0 0x558c4950c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.325+0000 7f2003f03740 1 --2- 172.21.15.73:0/1910188044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495112f0 0x558c4952d310 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.325+0000 7f2003f03740 1 --2- 172.21.15.73:0/1910188044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c495109d0 0x558c4952bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.325+0000 7f2003f03740 1 -- 172.21.15.73:0/1910188044 >> 172.21.15.73:0/1910188044 conn(0x558c4950cf60 msgr2=0x558c49507ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:25.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.325+0000 7f2003f03740 1 -- 172.21.15.73:0/1910188044 shutdown_connections 2024-09-05T12:57:25.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.325+0000 7f2003f03740 1 -- 172.21.15.73:0/1910188044 wait complete. 2024-09-05T12:57:25.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.325+0000 7f2003f03740 1 -- start start 2024-09-05T12:57:25.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f2003f03740 1 Processor -- start 2024-09-05T12:57:25.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f2003f03740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c4952ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f2003f03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c495112f0 0x558c4952f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f2003f03740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c4951bbb0 0x558c4952f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f2003f03740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558c4952d860 con 0x558c495109d0 2024-09-05T12:57:25.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f2003f03740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558c4952d190 con 0x558c4951bbb0 2024-09-05T12:57:25.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f2003f03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c4952df30 con 0x558c495112f0 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f2003f03740 10 client.0 _ll_register_callbacks cb 0x7f1ff0010380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f1ffb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c4952ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f1ffb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c4952ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32874/0 (socket says 172.21.15.73:32874) 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f1ffb7fe640 1 -- 172.21.15.73:0/323159901 learned_addr learned my addr 172.21.15.73:0/323159901 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f1ffbfff640 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c4951bbb0 0x558c4952f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c495112f0 0x558c4952f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f1ffb7fe640 1 -- 172.21.15.73:0/323159901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c495112f0 msgr2=0x558c4952f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c495112f0 0x558c4952f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f1ffb7fe640 1 -- 172.21.15.73:0/323159901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c4951bbb0 msgr2=0x558c4952f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c4951bbb0 0x558c4952f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.326+0000 7f1ffb7fe640 1 -- 172.21.15.73:0/323159901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c49594d40 con 0x558c495109d0 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f1ffb7fe640 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c4952ebe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1fec000c00 tx=0x7f1fec0318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8125d4c9b2b580 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f1fdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f1fdaffd640 1 -- 172.21.15.73:0/323159901 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec035040 con 0x558c495109d0 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f1fdaffd640 1 -- 172.21.15.73:0/323159901 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f1fec004240 con 0x558c495109d0 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f2003f03740 1 -- 172.21.15.73:0/323159901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ff009f320 con 0x558c495109d0 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f1fdaffd640 1 -- 172.21.15.73:0/323159901 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1fec004440 con 0x558c495109d0 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f2003f03740 10 client.15123 fetch_fsmap learned FSMap version 24 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f2003f03740 1 -- 172.21.15.73:0/323159901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558c495960a0 con 0x558c495109d0 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f1fdaffd640 1 -- 172.21.15.73:0/323159901 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff009f320 con 0x558c495109d0 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f1fdaffd640 1 -- 172.21.15.73:0/323159901 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1fec0035f0 con 0x558c495109d0 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f2003f03740 10 client.15123 fetch_fsmap finished waiting for FSMap version 24 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f2003f03740 10 client.15123 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f2003f03740 20 client.15123 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f2003f03740 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558c4959ac80 0x558c49599990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f2003f03740 4 client.15123 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T12:57:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.327+0000 7f2003f03740 1 -- 172.21.15.73:0/323159901 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "status"}) -- 0x558c4947eb10 con 0x558c4959ac80 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.328+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558c4959ac80 0x558c49599990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.328+0000 7f1ffaffd640 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558c4959ac80 0x558c49599990 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9678f56764b6d76 server_cookie=296c8fd206fab67e in_seq=0 out_seq=0 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.328+0000 7f1fdaffd640 10 client.15123 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.328+0000 7f1fdaffd640 1 -- 172.21.15.73:0/323159901 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558c4947eb10 con 0x558c4959ac80 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.328+0000 7f1fdaffd640 10 client.15123 handle_command_reply: tid=0 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.328+0000 7f2003f03740 1 client.15123 shutdown 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 1 -- 172.21.15.73:0/323159901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 msgr2=0x558c4952ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c4952ebe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1fec000c00 tx=0x7f1fec0318e0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 1 -- 172.21.15.73:0/323159901 shutdown_connections 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558c4959ac80 0x558c49599990 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c4951bbb0 0x558c4952f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c495112f0 0x558c4952f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f1fdaffd640 0 client.15123 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 1 --2- 172.21.15.73:0/323159901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558c495109d0 0x558c4952ebe0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 1 -- 172.21.15.73:0/323159901 >> 172.21.15.73:0/323159901 conn(0x558c4950cf60 msgr2=0x558c49518700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:25.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 1 -- 172.21.15.73:0/323159901 shutdown_connections 2024-09-05T12:57:25.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 1 -- 172.21.15.73:0/323159901 wait complete. 2024-09-05T12:57:25.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.329+0000 7f2003f03740 20 client.15123 trim_cache size 0 max 16384 2024-09-05T12:57:25.336 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:57:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "febf1dd4-6b84-11ef-bcd6-c7b262605968", 2024-09-05T12:57:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-05T12:57:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24482, 2024-09-05T12:57:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-05T12:57:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-05T12:57:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-05T12:57:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 98.590554585999996, 2024-09-05T12:57:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 24, 2024-09-05T12:57:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 80, 2024-09-05T12:57:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 78, 2024-09-05T12:57:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 109.39144783899999 2024-09-05T12:57:25.337 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:57:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 -- 172.21.15.73:0/3830114845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1fe40a2c10 msgr2=0x7f1fe40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1fe40a2c10 0x7f1fe40a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400a780 tx=0x7f1ff400ab60 comp rx=0 tx=0).stop 2024-09-05T12:57:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 -- 172.21.15.73:0/3830114845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ffc103780 msgr2=0x7f1ffc198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ffc103780 0x7f1ffc198b60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0006fd0 tx=0x7f1ff000b8e0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 -- 172.21.15.73:0/3830114845 shutdown_connections 2024-09-05T12:57:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1fe40a2c10 0x7f1fe40a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ffc108300 0x7f1ffc19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ffc103780 0x7f1ffc198b60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 --2- 172.21.15.73:0/3830114845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc102dd0 0x7f1ffc198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 -- 172.21.15.73:0/3830114845 >> 172.21.15.73:0/3830114845 conn(0x7f1ffc0fc7d0 msgr2=0x7f1ffc105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:25.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 -- 172.21.15.73:0/3830114845 shutdown_connections 2024-09-05T12:57:25.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:25.330+0000 7f2001b2d640 1 -- 172.21.15.73:0/3830114845 wait complete. 2024-09-05T12:57:25.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:25 smithi162 ceph-mon[34220]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:25 smithi169 ceph-mon[34823]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:26.155 INFO:teuthology.run_tasks:Running task sequential... 2024-09-05T12:57:26.164 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-05T12:57:26.164 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-05T12:57:26.165 INFO:teuthology.task.print:Enabling mgr modules 2024-09-05T12:57:26.165 INFO:teuthology.run_tasks:Running task kclient... 2024-09-05T12:57:26.190 INFO:tasks.kclient:Mounting kernel clients... 2024-09-05T12:57:26.190 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-05T12:57:26.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T12:57:26.190 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-05T12:57:26.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T12:57:26.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-09-05T12:57:26.277 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-09-05T12:57:26.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T12:57:26.278 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-05T12:57:26.279 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-05T12:57:26.279 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-05T12:57:26.279 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs ls 2024-09-05T12:57:26.565 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:27.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.017+0000 7f278c4b6640 1 -- 172.21.15.73:0/61933440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2784102ef0 msgr2=0x7f278410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:27.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.017+0000 7f278c4b6640 1 --2- 172.21.15.73:0/61933440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2784102ef0 0x7f278410da40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f277c009ca0 tx=0x7f277c02a950 comp rx=0 tx=0).stop 2024-09-05T12:57:27.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.018+0000 7f278c4b6640 1 -- 172.21.15.73:0/61933440 shutdown_connections 2024-09-05T12:57:27.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.018+0000 7f278c4b6640 1 --2- 172.21.15.73:0/61933440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2784102ef0 0x7f278410da40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:27.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.018+0000 7f278c4b6640 1 --2- 172.21.15.73:0/61933440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2784102570 0x7f27841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.018+0000 7f278c4b6640 1 --2- 172.21.15.73:0/61933440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784100e20 0x7f2784101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.018+0000 7f278c4b6640 1 -- 172.21.15.73:0/61933440 >> 172.21.15.73:0/61933440 conn(0x7f27840fc7d0 msgr2=0x7f27840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.018+0000 7f278c4b6640 1 -- 172.21.15.73:0/61933440 shutdown_connections 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.018+0000 7f278c4b6640 1 -- 172.21.15.73:0/61933440 wait complete. 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.018+0000 7f278c4b6640 1 Processor -- start 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.018+0000 7f278c4b6640 1 -- start start 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278c4b6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784100e20 0x7f2784199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278c4b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2784102570 0x7f2784199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278c4b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2784102ef0 0x7f27841a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278c4b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2784110fa0 con 0x7f2784102570 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278c4b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2784110e20 con 0x7f2784102ef0 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278c4b6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2784111120 con 0x7f2784100e20 2024-09-05T12:57:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f2789a51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2784102570 0x7f2784199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f2789a51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2784102570 0x7f2784199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32892/0 (socket says 172.21.15.73:32892) 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f2789a51640 1 -- 172.21.15.73:0/3297737982 learned_addr learned my addr 172.21.15.73:0/3297737982 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278a252640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784100e20 0x7f2784199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278aa53640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2784102ef0 0x7f27841a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f2789a51640 1 -- 172.21.15.73:0/3297737982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784100e20 msgr2=0x7f2784199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f2789a51640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784100e20 0x7f2784199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f2789a51640 1 -- 172.21.15.73:0/3297737982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2784102ef0 msgr2=0x7f27841a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f2789a51640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2784102ef0 0x7f27841a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f2789a51640 1 -- 172.21.15.73:0/3297737982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27841a48f0 con 0x7f2784102570 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278aa53640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2784102ef0 0x7f27841a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278a252640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784100e20 0x7f2784199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f2789a51640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2784102570 0x7f2784199870 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f277400b4a0 tx=0x7f277400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f277b7fe640 1 -- 172.21.15.73:0/3297737982 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774014070 con 0x7f2784102570 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f278c4b6640 1 -- 172.21.15.73:0/3297737982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27841a4ac0 con 0x7f2784102570 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f277b7fe640 1 -- 172.21.15.73:0/3297737982 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2774010af0 con 0x7f2784102570 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.019+0000 7f277b7fe640 1 -- 172.21.15.73:0/3297737982 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774017d10 con 0x7f2784102570 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.020+0000 7f278c4b6640 1 -- 172.21.15.73:0/3297737982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27841a4fd0 con 0x7f2784102570 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.020+0000 7f278c4b6640 1 -- 172.21.15.73:0/3297737982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2784101200 con 0x7f2784102570 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.022+0000 7f277b7fe640 1 -- 172.21.15.73:0/3297737982 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2774017070 con 0x7f2784102570 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.022+0000 7f277b7fe640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f27700a2c10 0x7f27700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.022+0000 7f278a252640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f27700a2c10 0x7f27700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.022+0000 7f277b7fe640 1 -- 172.21.15.73:0/3297737982 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f27740ce8a0 con 0x7f2784102570 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.023+0000 7f278a252640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f27700a2c10 0x7f27700a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f27800058c0 tx=0x7f2780005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:27.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.026+0000 7f277b7fe640 1 -- 172.21.15.73:0/3297737982 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f277409b7e0 con 0x7f2784102570 2024-09-05T12:57:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.232+0000 7f278c4b6640 1 -- 172.21.15.73:0/3297737982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f27841a5260 con 0x7f2784102570 2024-09-05T12:57:27.233 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:27 smithi073 ceph-mon[30883]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:57:27.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.232+0000 7f277b7fe640 1 -- 172.21.15.73:0/3297737982 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f277409b0e0 con 0x7f2784102570 2024-09-05T12:57:27.234 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-05T12:57:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 -- 172.21.15.73:0/3297737982 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f27700a2c10 msgr2=0x7f27700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f27700a2c10 0x7f27700a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f27800058c0 tx=0x7f2780005850 comp rx=0 tx=0).stop 2024-09-05T12:57:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 -- 172.21.15.73:0/3297737982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2784102570 msgr2=0x7f2784199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2784102570 0x7f2784199870 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f277400b4a0 tx=0x7f277400b960 comp rx=0 tx=0).stop 2024-09-05T12:57:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 -- 172.21.15.73:0/3297737982 shutdown_connections 2024-09-05T12:57:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f27700a2c10 0x7f27700a50d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2784102ef0 0x7f27841a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2784102570 0x7f2784199870 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 --2- 172.21.15.73:0/3297737982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784100e20 0x7f2784199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 -- 172.21.15.73:0/3297737982 >> 172.21.15.73:0/3297737982 conn(0x7f27840fc7d0 msgr2=0x7f2784106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 -- 172.21.15.73:0/3297737982 shutdown_connections 2024-09-05T12:57:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:27.235+0000 7f278c4b6640 1 -- 172.21.15.73:0/3297737982 wait complete. 2024-09-05T12:57:27.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:27 smithi162 ceph-mon[34220]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:57:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:27 smithi169 ceph-mon[34823]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T12:57:27.939 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-05T12:57:27.939 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-05T12:57:27.939 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-05T12:57:27.939 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-05T12:57:27.939 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-05T12:57:27.939 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-05T12:57:27.939 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-05T12:57:27.939 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-05T12:57:27.939 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-05T12:57:27.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T12:57:27.940 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-05T12:57:27.956 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-05T12:57:27.956 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-05T12:57:27.956 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-05T12:57:27.956 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-05T12:57:27.956 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-05T12:57:27.956 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-05T12:57:27.956 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42184sec preferred_lft 42184sec 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link noprefixroute 2024-09-05T12:57:27.957 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-05T12:57:27.958 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-05T12:57:27.958 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T12:57:27.958 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-05T12:57:27.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-09-05T12:57:27.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-09-05T12:57:27.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-09-05T12:57:27.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-05T12:57:27.958 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-05T12:57:28.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T12:57:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T12:57:28.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T12:57:28.154 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-05T12:57:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-05T12:57:28.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T12:57:28.181 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-05T12:57:28.251 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-05T12:57:28.251 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-05T12:57:28.251 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-05T12:57:28.251 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-05T12:57:28.251 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-05T12:57:28.252 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T12:57:28.252 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-05T12:57:28.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-05T12:57:28.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-05T12:57:28.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-05T12:57:28.252 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-05T12:57:28.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T12:57:28.346 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:28 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3297737982' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-05T12:57:28.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:28 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3297737982' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-05T12:57:28.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:28 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3297737982' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-05T12:57:28.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T12:57:28.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T12:57:28.531 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-05T12:57:28.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T12:57:28.547 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-09-05T12:57:28.603 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T12:57:28.604 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-05T12:57:28.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T12:57:28.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-05T12:57:28.604 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-05T12:57:28.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T12:57:28.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T12:57:28.721 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-05T12:57:28.721 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T12:57:28.721 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-05T12:57:28.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-05T12:57:28.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-05T12:57:28.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-05T12:57:28.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-05T12:57:28.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-05T12:57:28.722 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-05T12:57:28.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T12:57:28.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T12:57:28.873 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T12:57:28.874 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-05T12:57:28.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-05T12:57:28.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-09-05T12:57:28.874 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-05T12:57:28.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T12:57:28.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T12:57:28.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-05T12:57:28.951 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-05T12:57:28.966 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-05T12:57:28.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-05T12:57:28.966 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-05T12:57:29.021 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-05T12:57:29.021 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-05T12:57:29.021 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/6289379c-c20e-487a-9bfc-7bd76e17979c 2024-09-05T12:57:29.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T12:57:29.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/6289379c-c20e-487a-9bfc-7bd76e17979c /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-05T12:57:29.120 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-05T12:57:29.120 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-05T12:57:29.240 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-05T12:57:29.240 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-05T12:57:29.240 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.169:3300" 2024-09-05T12:57:29.241 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: 0@febf1dd4-6b84-11ef-bcd6-c7b262605968.cephfs=/volumes/qa/sv_1/6289379c-c20e-487a-9bfc-7bd76e17979c 2024-09-05T12:57:29.241 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.73:3300/172.21.15.162:3300/172.21.15.169:3300" will pass to kernel 2024-09-05T12:57:29.241 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-05T12:57:29.241 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2024-09-05T12:57:29.241 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-05T12:57:29.241 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2024-09-05T12:57:29.241 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-05T12:57:29.243 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-05T12:57:29.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T12:57:29.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-05T12:57:29.271 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-05T12:57:29.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:29 smithi162 ceph-mon[34220]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:57:29.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-05T12:57:29.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:29 smithi169 ceph-mon[34823]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:57:29.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T12:57:29.375 INFO:teuthology.orchestra.run.smithi073.stdout:client24784 2024-09-05T12:57:29.376 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:57:29.376 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T12:57:29.393 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-05T12:57:29.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-05T12:57:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T12:57:29.596 INFO:teuthology.orchestra.run.smithi073.stdout:client24784 2024-09-05T12:57:29.596 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-05T12:57:29.597 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:29 smithi073 ceph-mon[30883]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T12:57:29.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-05T12:57:29.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T12:57:29.663 INFO:teuthology.orchestra.run.smithi073.stdout:client24784 2024-09-05T12:57:29.664 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968.client24784/status') 2024-09-05T12:57:29.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T12:57:29.728 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.24784 (3)172.21.15.73:0/879435203 2024-09-05T12:57:29.728 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2024-09-05T12:57:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2024-09-05T12:57:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2024-09-05T12:57:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:70 bytes copied, 3.7307e-05 s, 1.9 MB/s 2024-09-05T12:57:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T12:57:29.735 INFO:teuthology.run_tasks:Running task exec... 2024-09-05T12:57:29.746 INFO:teuthology.task.exec:Executing custom commands... 2024-09-05T12:57:29.747 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2024-09-05T12:57:29.747 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-05T12:57:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.847+0000 7fa3eea42640 1 -- 172.21.15.73:0/1478614988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e8104ef0 msgr2=0x7fa3e81072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.847+0000 7fa3eea42640 1 --2- 172.21.15.73:0/1478614988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e8104ef0 0x7fa3e81072e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009900 tx=0x7fa3dc02a410 comp rx=0 tx=0).stop 2024-09-05T12:57:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.847+0000 7fa3eea42640 1 -- 172.21.15.73:0/1478614988 shutdown_connections 2024-09-05T12:57:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.847+0000 7fa3eea42640 1 --2- 172.21.15.73:0/1478614988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3e8107820 0x7fa3e8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.847+0000 7fa3eea42640 1 --2- 172.21.15.73:0/1478614988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e8104ef0 0x7fa3e81072e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.847+0000 7fa3eea42640 1 --2- 172.21.15.73:0/1478614988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e81025c0 0x7fa3e81049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.847+0000 7fa3eea42640 1 -- 172.21.15.73:0/1478614988 >> 172.21.15.73:0/1478614988 conn(0x7fa3e80fc1e0 msgr2=0x7fa3e80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.847+0000 7fa3eea42640 1 -- 172.21.15.73:0/1478614988 shutdown_connections 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.847+0000 7fa3eea42640 1 -- 172.21.15.73:0/1478614988 wait complete. 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3eea42640 1 Processor -- start 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3eea42640 1 -- start start 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3eea42640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3e81025c0 0x7fa3e8101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3eea42640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e8104ef0 0x7fa3e8100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3eea42640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e8107820 0x7fa3e8100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3eea42640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e810d850 con 0x7fa3e8104ef0 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3eea42640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e810d6d0 con 0x7fa3e8107820 2024-09-05T12:57:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3eea42640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e810d9d0 con 0x7fa3e81025c0 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3e77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e8104ef0 0x7fa3e8100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3e77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e8104ef0 0x7fa3e8100570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32914/0 (socket says 172.21.15.73:32914) 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3e77fe640 1 -- 172.21.15.73:0/163349114 learned_addr learned my addr 172.21.15.73:0/163349114 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3e7fff640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3e81025c0 0x7fa3e8101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3e77fe640 1 -- 172.21.15.73:0/163349114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3e81025c0 msgr2=0x7fa3e8101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.848+0000 7fa3ecfdf640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e8107820 0x7fa3e8100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.849+0000 7fa3e77fe640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3e81025c0 0x7fa3e8101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.849+0000 7fa3e77fe640 1 -- 172.21.15.73:0/163349114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e8107820 msgr2=0x7fa3e8100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.849+0000 7fa3e77fe640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e8107820 0x7fa3e8100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.849+0000 7fa3e77fe640 1 -- 172.21.15.73:0/163349114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e8101340 con 0x7fa3e8104ef0 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.849+0000 7fa3e77fe640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e8104ef0 0x7fa3e8100570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc031610 tx=0x7fa3dc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.849+0000 7fa3e57fa640 1 -- 172.21.15.73:0/163349114 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc03f030 con 0x7fa3e8104ef0 2024-09-05T12:57:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.849+0000 7fa3e57fa640 1 -- 172.21.15.73:0/163349114 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3dc003ce0 con 0x7fa3e8104ef0 2024-09-05T12:57:29.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.849+0000 7fa3eea42640 1 -- 172.21.15.73:0/163349114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e81a1f40 con 0x7fa3e8104ef0 2024-09-05T12:57:29.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.849+0000 7fa3e57fa640 1 -- 172.21.15.73:0/163349114 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc035070 con 0x7fa3e8104ef0 2024-09-05T12:57:29.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.849+0000 7fa3eea42640 1 -- 172.21.15.73:0/163349114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e81a23a0 con 0x7fa3e8104ef0 2024-09-05T12:57:29.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.850+0000 7fa3eea42640 1 -- 172.21.15.73:0/163349114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e80fdcd0 con 0x7fa3e8104ef0 2024-09-05T12:57:29.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.851+0000 7fa3e57fa640 1 -- 172.21.15.73:0/163349114 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa3dc042030 con 0x7fa3e8104ef0 2024-09-05T12:57:29.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.852+0000 7fa3e57fa640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa3d00a2cd0 0x7fa3d00a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:29.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.852+0000 7fa3e7fff640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa3d00a2cd0 0x7fa3d00a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:29.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.852+0000 7fa3e57fa640 1 -- 172.21.15.73:0/163349114 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fa3dc0ef970 con 0x7fa3e8104ef0 2024-09-05T12:57:29.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.852+0000 7fa3e7fff640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa3d00a2cd0 0x7fa3d00a5190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005d00 tx=0x7fa3d8005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:29.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:29.855+0000 7fa3e57fa640 1 -- 172.21.15.73:0/163349114 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3dc0bc7a0 con 0x7fa3e8104ef0 2024-09-05T12:57:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.059+0000 7fa3eea42640 1 -- 172.21.15.73:0/163349114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fa3e802d7c0 con 0x7fa3e8104ef0 2024-09-05T12:57:30.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.113+0000 7fa3e57fa640 1 -- 172.21.15.73:0/163349114 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7fa3dc0bc0a0 con 0x7fa3e8104ef0 2024-09-05T12:57:30.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 -- 172.21.15.73:0/163349114 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa3d00a2cd0 msgr2=0x7fa3d00a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa3d00a2cd0 0x7fa3d00a5190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005d00 tx=0x7fa3d8005c50 comp rx=0 tx=0).stop 2024-09-05T12:57:30.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 -- 172.21.15.73:0/163349114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e8104ef0 msgr2=0x7fa3e8100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e8104ef0 0x7fa3e8100570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc031610 tx=0x7fa3dc0043b0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 -- 172.21.15.73:0/163349114 shutdown_connections 2024-09-05T12:57:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa3d00a2cd0 0x7fa3d00a5190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e8107820 0x7fa3e8100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e8104ef0 0x7fa3e8100570 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 --2- 172.21.15.73:0/163349114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3e81025c0 0x7fa3e8101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 -- 172.21.15.73:0/163349114 >> 172.21.15.73:0/163349114 conn(0x7fa3e80fc1e0 msgr2=0x7fa3e8102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 -- 172.21.15.73:0/163349114 shutdown_connections 2024-09-05T12:57:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.115+0000 7fa3eea42640 1 -- 172.21.15.73:0/163349114 wait complete. 2024-09-05T12:57:30.127 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-05T12:57:30.139 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-05T12:57:30.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T12:57:30.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.250+0000 7ffb089cb640 1 -- 172.21.15.73:0/2793482625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb04101b30 msgr2=0x7ffb04101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.250+0000 7ffb089cb640 1 --2- 172.21.15.73:0/2793482625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb04101b30 0x7ffb04101f30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009900 tx=0x7ffaf802a410 comp rx=0 tx=0).stop 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.250+0000 7ffb089cb640 1 -- 172.21.15.73:0/2793482625 shutdown_connections 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.250+0000 7ffb089cb640 1 --2- 172.21.15.73:0/2793482625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb041036e0 0x7ffb04109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.250+0000 7ffb089cb640 1 --2- 172.21.15.73:0/2793482625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb04102d20 0x7ffb041031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.250+0000 7ffb089cb640 1 --2- 172.21.15.73:0/2793482625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb04101b30 0x7ffb04101f30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.250+0000 7ffb089cb640 1 -- 172.21.15.73:0/2793482625 >> 172.21.15.73:0/2793482625 conn(0x7ffb040fd2b0 msgr2=0x7ffb040ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.250+0000 7ffb089cb640 1 -- 172.21.15.73:0/2793482625 shutdown_connections 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.250+0000 7ffb089cb640 1 -- 172.21.15.73:0/2793482625 wait complete. 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb089cb640 1 Processor -- start 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb089cb640 1 -- start start 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb089cb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb04101b30 0x7ffb04197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb089cb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb04102d20 0x7ffb041983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb089cb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb041036e0 0x7ffb0419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb089cb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0410d7b0 con 0x7ffb04101b30 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb089cb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0410d630 con 0x7ffb04102d20 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb089cb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0410d930 con 0x7ffb041036e0 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb0259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb04101b30 0x7ffb04197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb0259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb04101b30 0x7ffb04197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32938/0 (socket says 172.21.15.73:32938) 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb0259c640 1 -- 172.21.15.73:0/1235387971 learned_addr learned my addr 172.21.15.73:0/1235387971 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.251+0000 7ffb02d9d640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb041036e0 0x7ffb0419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffb0259c640 1 -- 172.21.15.73:0/1235387971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb041036e0 msgr2=0x7ffb0419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffb0259c640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb041036e0 0x7ffb0419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffb0259c640 1 -- 172.21.15.73:0/1235387971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb04102d20 msgr2=0x7ffb041983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffb0259c640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb04102d20 0x7ffb041983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffb0259c640 1 -- 172.21.15.73:0/1235387971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0419fa80 con 0x7ffb04101b30 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffb0259c640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb04101b30 0x7ffb04197e60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8031610 tx=0x7ffaf8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffaf37fe640 1 -- 172.21.15.73:0/1235387971 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf803f030 con 0x7ffb04101b30 2024-09-05T12:57:30.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffaf37fe640 1 -- 172.21.15.73:0/1235387971 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf8003ad0 con 0x7ffb04101b30 2024-09-05T12:57:30.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffb089cb640 1 -- 172.21.15.73:0/1235387971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0419fd10 con 0x7ffb04101b30 2024-09-05T12:57:30.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffaf37fe640 1 -- 172.21.15.73:0/1235387971 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8035070 con 0x7ffb04101b30 2024-09-05T12:57:30.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.252+0000 7ffb089cb640 1 -- 172.21.15.73:0/1235387971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb041a01b0 con 0x7ffb04101b30 2024-09-05T12:57:30.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.253+0000 7ffb089cb640 1 -- 172.21.15.73:0/1235387971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb04108f70 con 0x7ffb04101b30 2024-09-05T12:57:30.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.254+0000 7ffaf37fe640 1 -- 172.21.15.73:0/1235387971 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffaf8042030 con 0x7ffb04101b30 2024-09-05T12:57:30.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.255+0000 7ffaf37fe640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffaec0a2c20 0x7ffaec0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.255+0000 7ffb01d9b640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffaec0a2c20 0x7ffaec0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.255+0000 7ffaf37fe640 1 -- 172.21.15.73:0/1235387971 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ffaf80ef9d0 con 0x7ffb04101b30 2024-09-05T12:57:30.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.255+0000 7ffb01d9b640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffaec0a2c20 0x7ffaec0a50e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40058c0 tx=0x7ffaf4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.259+0000 7ffaf37fe640 1 -- 172.21.15.73:0/1235387971 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffaf80bc800 con 0x7ffb04101b30 2024-09-05T12:57:30.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.426+0000 7ffb089cb640 1 -- 172.21.15.73:0/1235387971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb0402d9c0 con 0x7ffb04101b30 2024-09-05T12:57:30.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.427+0000 7ffaf37fe640 1 -- 172.21.15.73:0/1235387971 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22645 (secure 0 0 0) 0x7ffaf80bc100 con 0x7ffb04101b30 2024-09-05T12:57:30.428 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":80,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T12:56:05.055165+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T12:57:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.429+0000 7ffb089cb640 1 -- 172.21.15.73:0/1235387971 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffaec0a2c20 msgr2=0x7ffaec0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.429+0000 7ffb089cb640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffaec0a2c20 0x7ffaec0a50e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40058c0 tx=0x7ffaf4005850 comp rx=0 tx=0).stop 2024-09-05T12:57:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.429+0000 7ffb089cb640 1 -- 172.21.15.73:0/1235387971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb04101b30 msgr2=0x7ffb04197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.429+0000 7ffb089cb640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb04101b30 0x7ffb04197e60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8031610 tx=0x7ffaf8004270 comp rx=0 tx=0).stop 2024-09-05T12:57:30.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.429+0000 7ffb089cb640 1 -- 172.21.15.73:0/1235387971 shutdown_connections 2024-09-05T12:57:30.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.429+0000 7ffb089cb640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffaec0a2c20 0x7ffaec0a50e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.429+0000 7ffb089cb640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb041036e0 0x7ffb0419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.429+0000 7ffb089cb640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb04102d20 0x7ffb041983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.429+0000 7ffb089cb640 1 --2- 172.21.15.73:0/1235387971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb04101b30 0x7ffb04197e60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.429+0000 7ffb089cb640 1 -- 172.21.15.73:0/1235387971 >> 172.21.15.73:0/1235387971 conn(0x7ffb040fd2b0 msgr2=0x7ffb04106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:30.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.430+0000 7ffb089cb640 1 -- 172.21.15.73:0/1235387971 shutdown_connections 2024-09-05T12:57:30.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.430+0000 7ffb089cb640 1 -- 172.21.15.73:0/1235387971 wait complete. 2024-09-05T12:57:30.442 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T12:51:12.204701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-05T12:55:42.305439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-05T12:55:44.548796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-05T12:57:30.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-05T12:57:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.544+0000 7f5d835df640 1 -- 172.21.15.73:0/2497205619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c1025e0 msgr2=0x7f5d7c108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.544+0000 7f5d835df640 1 --2- 172.21.15.73:0/2497205619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c1025e0 0x7f5d7c108e70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009ca0 tx=0x7f5d7402a8c0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.544+0000 7f5d835df640 1 -- 172.21.15.73:0/2497205619 shutdown_connections 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.544+0000 7f5d835df640 1 --2- 172.21.15.73:0/2497205619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c1025e0 0x7f5d7c108e70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.544+0000 7f5d835df640 1 --2- 172.21.15.73:0/2497205619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d7c101c20 0x7f5d7c1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.544+0000 7f5d835df640 1 --2- 172.21.15.73:0/2497205619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d7c100a30 0x7f5d7c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.544+0000 7f5d835df640 1 -- 172.21.15.73:0/2497205619 >> 172.21.15.73:0/2497205619 conn(0x7f5d7c0fc1b0 msgr2=0x7f5d7c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.544+0000 7f5d835df640 1 -- 172.21.15.73:0/2497205619 shutdown_connections 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.544+0000 7f5d835df640 1 -- 172.21.15.73:0/2497205619 wait complete. 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d835df640 1 Processor -- start 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d835df640 1 -- start start 2024-09-05T12:57:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d835df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c100a30 0x7f5d7c197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d835df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d7c101c20 0x7f5d7c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d835df640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d7c1025e0 0x7f5d7c19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d835df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c10c6b0 con 0x7f5d7c100a30 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d835df640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c10c530 con 0x7f5d7c101c20 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d835df640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c10c830 con 0x7f5d7c1025e0 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d8137b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c100a30 0x7f5d7c197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d8137b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c100a30 0x7f5d7c197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32960/0 (socket says 172.21.15.73:32960) 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d8137b640 1 -- 172.21.15.73:0/2142464030 learned_addr learned my addr 172.21.15.73:0/2142464030 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d80b7a640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d7c101c20 0x7f5d7c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d8137b640 1 -- 172.21.15.73:0/2142464030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d7c1025e0 msgr2=0x7f5d7c19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d81b7c640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d7c1025e0 0x7f5d7c19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d8137b640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d7c1025e0 0x7f5d7c19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d8137b640 1 -- 172.21.15.73:0/2142464030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d7c101c20 msgr2=0x7f5d7c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d8137b640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d7c101c20 0x7f5d7c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d8137b640 1 -- 172.21.15.73:0/2142464030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c19fab0 con 0x7f5d7c100a30 2024-09-05T12:57:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d81b7c640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d7c1025e0 0x7f5d7c19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d8137b640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c100a30 0x7f5d7c197e90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800d950 tx=0x7f5d7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d727fc640 1 -- 172.21.15.73:0/2142464030 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78017070 con 0x7f5d7c100a30 2024-09-05T12:57:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.545+0000 7f5d727fc640 1 -- 172.21.15.73:0/2142464030 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d78009c30 con 0x7f5d7c100a30 2024-09-05T12:57:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.546+0000 7f5d835df640 1 -- 172.21.15.73:0/2142464030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7c19fda0 con 0x7f5d7c100a30 2024-09-05T12:57:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.546+0000 7f5d727fc640 1 -- 172.21.15.73:0/2142464030 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800f600 con 0x7f5d7c100a30 2024-09-05T12:57:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.546+0000 7f5d835df640 1 -- 172.21.15.73:0/2142464030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7c1a0210 con 0x7f5d7c100a30 2024-09-05T12:57:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.546+0000 7f5d835df640 1 -- 172.21.15.73:0/2142464030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7c1a0440 con 0x7f5d7c100a30 2024-09-05T12:57:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.548+0000 7f5d727fc640 1 -- 172.21.15.73:0/2142464030 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5d7801a070 con 0x7f5d7c100a30 2024-09-05T12:57:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.549+0000 7f5d727fc640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5d680a2c20 0x7f5d680a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.549+0000 7f5d80b7a640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5d680a2c20 0x7f5d680a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.549+0000 7f5d727fc640 1 -- 172.21.15.73:0/2142464030 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f5d780cec60 con 0x7f5d7c100a30 2024-09-05T12:57:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.549+0000 7f5d80b7a640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5d680a2c20 0x7f5d680a50e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005fd0 tx=0x7f5d6c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:30.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.552+0000 7f5d727fc640 1 -- 172.21.15.73:0/2142464030 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d78009de0 con 0x7f5d7c100a30 2024-09-05T12:57:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.717+0000 7f5d835df640 1 -- 172.21.15.73:0/2142464030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5d7c1a07f0 con 0x7f5d7c100a30 2024-09-05T12:57:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.718+0000 7f5d727fc640 1 -- 172.21.15.73:0/2142464030 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f5d7809ba90 con 0x7f5d7c100a30 2024-09-05T12:57:30.719 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-05T12:57:30.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 -- 172.21.15.73:0/2142464030 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5d680a2c20 msgr2=0x7f5d680a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5d680a2c20 0x7f5d680a50e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005fd0 tx=0x7f5d6c005850 comp rx=0 tx=0).stop 2024-09-05T12:57:30.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 -- 172.21.15.73:0/2142464030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c100a30 msgr2=0x7f5d7c197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c100a30 0x7f5d7c197e90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800d950 tx=0x7f5d7800de10 comp rx=0 tx=0).stop 2024-09-05T12:57:30.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 -- 172.21.15.73:0/2142464030 shutdown_connections 2024-09-05T12:57:30.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5d680a2c20 0x7f5d680a50e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d7c1025e0 0x7f5d7c19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d7c101c20 0x7f5d7c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 --2- 172.21.15.73:0/2142464030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c100a30 0x7f5d7c197e90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 -- 172.21.15.73:0/2142464030 >> 172.21.15.73:0/2142464030 conn(0x7f5d7c0fc1b0 msgr2=0x7f5d7c06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:30.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 -- 172.21.15.73:0/2142464030 shutdown_connections 2024-09-05T12:57:30.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.720+0000 7f5d835df640 1 -- 172.21.15.73:0/2142464030 wait complete. 2024-09-05T12:57:30.732 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-05T12:57:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.834+0000 7fc279986640 1 -- 172.21.15.73:0/3524529113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc274101b00 msgr2=0x7fc274101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.834+0000 7fc279986640 1 --2- 172.21.15.73:0/3524529113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc274101b00 0x7fc274101f00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc264009900 tx=0x7fc26402a410 comp rx=0 tx=0).stop 2024-09-05T12:57:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.834+0000 7fc279986640 1 -- 172.21.15.73:0/3524529113 shutdown_connections 2024-09-05T12:57:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.834+0000 7fc279986640 1 --2- 172.21.15.73:0/3524529113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2741036b0 0x7fc274109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.834+0000 7fc279986640 1 --2- 172.21.15.73:0/3524529113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc274102cf0 0x7fc274103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.834+0000 7fc279986640 1 --2- 172.21.15.73:0/3524529113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc274101b00 0x7fc274101f00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.834+0000 7fc279986640 1 -- 172.21.15.73:0/3524529113 >> 172.21.15.73:0/3524529113 conn(0x7fc2740fd2a0 msgr2=0x7fc2740ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.834+0000 7fc279986640 1 -- 172.21.15.73:0/3524529113 shutdown_connections 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.834+0000 7fc279986640 1 -- 172.21.15.73:0/3524529113 wait complete. 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.834+0000 7fc279986640 1 Processor -- start 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc279986640 1 -- start start 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc279986640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc274101b00 0x7fc274075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc279986640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc274102cf0 0x7fc2740745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc279986640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2741036b0 0x7fc274074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc279986640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc27410d780 con 0x7fc2741036b0 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc279986640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc27410d600 con 0x7fc274101b00 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc279986640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc27410d900 con 0x7fc274102cf0 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2741036b0 0x7fc274074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2741036b0 0x7fc274074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32984/0 (socket says 172.21.15.73:32984) 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2737fe640 1 -- 172.21.15.73:0/1604865449 learned_addr learned my addr 172.21.15.73:0/1604865449 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc272ffd640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc274101b00 0x7fc274075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2727fc640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc274102cf0 0x7fc2740745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2737fe640 1 -- 172.21.15.73:0/1604865449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc274102cf0 msgr2=0x7fc2740745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2737fe640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc274102cf0 0x7fc2740745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2737fe640 1 -- 172.21.15.73:0/1604865449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc274101b00 msgr2=0x7fc274075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2737fe640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc274101b00 0x7fc274075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2737fe640 1 -- 172.21.15.73:0/1604865449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2740753b0 con 0x7fc2741036b0 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2727fc640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc274102cf0 0x7fc2740745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc272ffd640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc274101b00 0x7fc274075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.835+0000 7fc2737fe640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2741036b0 0x7fc274074b20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00eaa0 tx=0x7fc26c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.836+0000 7fc278984640 1 -- 172.21.15.73:0/1604865449 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c00cdb0 con 0x7fc2741036b0 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.836+0000 7fc278984640 1 -- 172.21.15.73:0/1604865449 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc26c005020 con 0x7fc2741036b0 2024-09-05T12:57:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.836+0000 7fc279986640 1 -- 172.21.15.73:0/1604865449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2741a1f90 con 0x7fc2741036b0 2024-09-05T12:57:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.836+0000 7fc278984640 1 -- 172.21.15.73:0/1604865449 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0116b0 con 0x7fc2741036b0 2024-09-05T12:57:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.836+0000 7fc279986640 1 -- 172.21.15.73:0/1604865449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2741a23a0 con 0x7fc2741036b0 2024-09-05T12:57:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.837+0000 7fc279986640 1 -- 172.21.15.73:0/1604865449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc274108fe0 con 0x7fc2741036b0 2024-09-05T12:57:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.838+0000 7fc278984640 1 -- 172.21.15.73:0/1604865449 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc26c005560 con 0x7fc2741036b0 2024-09-05T12:57:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.838+0000 7fc278984640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc25c0a2c20 0x7fc25c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.839+0000 7fc272ffd640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc25c0a2c20 0x7fc25c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.839+0000 7fc278984640 1 -- 172.21.15.73:0/1604865449 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc26c0cf890 con 0x7fc2741036b0 2024-09-05T12:57:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.839+0000 7fc272ffd640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc25c0a2c20 0x7fc25c0a50e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc264006010 tx=0x7fc264032cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:30.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:30.842+0000 7fc278984640 1 -- 172.21.15.73:0/1604865449 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc26c016030 con 0x7fc2741036b0 2024-09-05T12:57:31.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.010+0000 7fc279986640 1 -- 172.21.15.73:0/1604865449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc274062e90 con 0x7fc2741036b0 2024-09-05T12:57:31.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.011+0000 7fc278984640 1 -- 172.21.15.73:0/1604865449 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7fc26c09c6c0 con 0x7fc2741036b0 2024-09-05T12:57:31.012 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-09-05T12:57:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.012+0000 7fc279986640 1 -- 172.21.15.73:0/1604865449 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc25c0a2c20 msgr2=0x7fc25c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.012+0000 7fc279986640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc25c0a2c20 0x7fc25c0a50e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc264006010 tx=0x7fc264032cf0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.013+0000 7fc279986640 1 -- 172.21.15.73:0/1604865449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2741036b0 msgr2=0x7fc274074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.013+0000 7fc279986640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2741036b0 0x7fc274074b20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00eaa0 tx=0x7fc26c00ef60 comp rx=0 tx=0).stop 2024-09-05T12:57:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.013+0000 7fc279986640 1 -- 172.21.15.73:0/1604865449 shutdown_connections 2024-09-05T12:57:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.013+0000 7fc279986640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc25c0a2c20 0x7fc25c0a50e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.013+0000 7fc279986640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2741036b0 0x7fc274074b20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.013+0000 7fc279986640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc274102cf0 0x7fc2740745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.013+0000 7fc279986640 1 --2- 172.21.15.73:0/1604865449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc274101b00 0x7fc274075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.013+0000 7fc279986640 1 -- 172.21.15.73:0/1604865449 >> 172.21.15.73:0/1604865449 conn(0x7fc2740fd2a0 msgr2=0x7fc2741061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.013+0000 7fc279986640 1 -- 172.21.15.73:0/1604865449 shutdown_connections 2024-09-05T12:57:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.013+0000 7fc279986640 1 -- 172.21.15.73:0/1604865449 wait complete. 2024-09-05T12:57:31.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-05T12:57:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.127+0000 7ff66f4f8640 1 -- 172.21.15.73:0/287256866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff668101c00 msgr2=0x7ff668102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.127+0000 7ff66f4f8640 1 --2- 172.21.15.73:0/287256866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff668101c00 0x7ff668102080 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff658009900 tx=0x7ff65802a410 comp rx=0 tx=0).stop 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.127+0000 7ff66f4f8640 1 -- 172.21.15.73:0/287256866 shutdown_connections 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.127+0000 7ff66f4f8640 1 --2- 172.21.15.73:0/287256866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6681025c0 0x7ff668108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.127+0000 7ff66f4f8640 1 --2- 172.21.15.73:0/287256866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff668101c00 0x7ff668102080 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.127+0000 7ff66f4f8640 1 --2- 172.21.15.73:0/287256866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff668100a10 0x7ff668100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.127+0000 7ff66f4f8640 1 -- 172.21.15.73:0/287256866 >> 172.21.15.73:0/287256866 conn(0x7ff6680fc190 msgr2=0x7ff6680fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.127+0000 7ff66f4f8640 1 -- 172.21.15.73:0/287256866 shutdown_connections 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66f4f8640 1 -- 172.21.15.73:0/287256866 wait complete. 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66f4f8640 1 Processor -- start 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66f4f8640 1 -- start start 2024-09-05T12:57:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66f4f8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff668100a10 0x7ff6681049a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66f4f8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff668101c00 0x7ff668102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66f4f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6681025c0 0x7ff668103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66f4f8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff66810c710 con 0x7ff668101c00 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66f4f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff66810c590 con 0x7ff6681025c0 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66f4f8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff66810c890 con 0x7ff668100a10 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66ca93640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff668101c00 0x7ff668102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66ca93640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff668101c00 0x7ff668102fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33000/0 (socket says 172.21.15.73:33000) 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.128+0000 7ff66ca93640 1 -- 172.21.15.73:0/1575562306 learned_addr learned my addr 172.21.15.73:0/1575562306 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff66d294640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff668100a10 0x7ff6681049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff66ca93640 1 -- 172.21.15.73:0/1575562306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff668100a10 msgr2=0x7ff6681049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff66ca93640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff668100a10 0x7ff6681049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff66ca93640 1 -- 172.21.15.73:0/1575562306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6681025c0 msgr2=0x7ff668103520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff66ca93640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6681025c0 0x7ff668103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff66ca93640 1 -- 172.21.15.73:0/1575562306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff668103db0 con 0x7ff668101c00 2024-09-05T12:57:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff66d294640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff668100a10 0x7ff6681049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff66ca93640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff668101c00 0x7ff668102fe0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff658009230 tx=0x7ff658004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff65e7fc640 1 -- 172.21.15.73:0/1575562306 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65803f030 con 0x7ff668101c00 2024-09-05T12:57:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff65e7fc640 1 -- 172.21.15.73:0/1575562306 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff658003ce0 con 0x7ff668101c00 2024-09-05T12:57:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff66f4f8640 1 -- 172.21.15.73:0/1575562306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6681a1ff0 con 0x7ff668101c00 2024-09-05T12:57:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff65e7fc640 1 -- 172.21.15.73:0/1575562306 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658035070 con 0x7ff668101c00 2024-09-05T12:57:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.129+0000 7ff66f4f8640 1 -- 172.21.15.73:0/1575562306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6681a2450 con 0x7ff668101c00 2024-09-05T12:57:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.130+0000 7ff66f4f8640 1 -- 172.21.15.73:0/1575562306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6681a2680 con 0x7ff668101c00 2024-09-05T12:57:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.131+0000 7ff65e7fc640 1 -- 172.21.15.73:0/1575562306 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff658042030 con 0x7ff668101c00 2024-09-05T12:57:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.132+0000 7ff65e7fc640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff6540a2c20 0x7ff6540a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.132+0000 7ff66d294640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff6540a2c20 0x7ff6540a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.132+0000 7ff65e7fc640 1 -- 172.21.15.73:0/1575562306 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ff6580efc60 con 0x7ff668101c00 2024-09-05T12:57:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.132+0000 7ff66d294640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff6540a2c20 0x7ff6540a50e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff664006fd0 tx=0x7ff664008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:31.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.135+0000 7ff65e7fc640 1 -- 172.21.15.73:0/1575562306 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6580bca90 con 0x7ff668101c00 2024-09-05T12:57:31.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.298+0000 7ff66f4f8640 1 -- 172.21.15.73:0/1575562306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff6681a2850 con 0x7ff668101c00 2024-09-05T12:57:31.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.299+0000 7ff65e7fc640 1 -- 172.21.15.73:0/1575562306 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7ff6580bc390 con 0x7ff668101c00 2024-09-05T12:57:31.300 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-09-05T12:57:31.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 -- 172.21.15.73:0/1575562306 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff6540a2c20 msgr2=0x7ff6540a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:31.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff6540a2c20 0x7ff6540a50e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff664006fd0 tx=0x7ff664008040 comp rx=0 tx=0).stop 2024-09-05T12:57:31.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 -- 172.21.15.73:0/1575562306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff668101c00 msgr2=0x7ff668102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:31.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff668101c00 0x7ff668102fe0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff658009230 tx=0x7ff658004360 comp rx=0 tx=0).stop 2024-09-05T12:57:31.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 -- 172.21.15.73:0/1575562306 shutdown_connections 2024-09-05T12:57:31.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff6540a2c20 0x7ff6540a50e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6681025c0 0x7ff668103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff668101c00 0x7ff668102fe0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 --2- 172.21.15.73:0/1575562306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff668100a10 0x7ff6681049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:31.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 -- 172.21.15.73:0/1575562306 >> 172.21.15.73:0/1575562306 conn(0x7ff6680fc190 msgr2=0x7ff66806a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:31.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 -- 172.21.15.73:0/1575562306 shutdown_connections 2024-09-05T12:57:31.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:31.301+0000 7ff66f4f8640 1 -- 172.21.15.73:0/1575562306 wait complete. 2024-09-05T12:57:31.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:31 smithi073 ceph-mon[30883]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:31.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:31 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/163349114' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-05T12:57:31.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:31 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/163349114' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-05T12:57:31.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:31 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:57:31.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:31 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1235387971' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:57:31.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:31 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2142464030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T12:57:31.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:31 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1604865449' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T12:57:31.313 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-05T12:57:31.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:57:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:31 smithi162 ceph-mon[34220]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:31 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/163349114' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-05T12:57:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:31 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/163349114' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-05T12:57:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:31 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:57:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:31 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1235387971' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:57:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:31 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2142464030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T12:57:31.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:31 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1604865449' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T12:57:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:31 smithi169 ceph-mon[34823]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T12:57:31.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:31 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/163349114' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-05T12:57:31.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:31 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/163349114' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-05T12:57:31.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:31 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:57:31.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:31 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1235387971' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:57:31.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:31 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2142464030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T12:57:31.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:31 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1604865449' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T12:57:31.560 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 -- 172.21.15.73:0/2226643540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe30c108290 msgr2=0x7fe30c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 --2- 172.21.15.73:0/2226643540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe30c108290 0x7fe30c10ec30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009930 tx=0x7fe2fc02a420 comp rx=0 tx=0).stop 2024-09-05T12:57:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 -- 172.21.15.73:0/2226643540 shutdown_connections 2024-09-05T12:57:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 --2- 172.21.15.73:0/2226643540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe30c108290 0x7fe30c10ec30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 --2- 172.21.15.73:0/2226643540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c103740 0x7fe30c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 --2- 172.21.15.73:0/2226643540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe30c102d90 0x7fe30c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 -- 172.21.15.73:0/2226643540 >> 172.21.15.73:0/2226643540 conn(0x7fe30c0fc7d0 msgr2=0x7fe30c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 -- 172.21.15.73:0/2226643540 shutdown_connections 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 -- 172.21.15.73:0/2226643540 wait complete. 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 Processor -- start 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 -- start start 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c102d90 0x7fe30c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe30c103740 0x7fe30c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe30c108290 0x7fe30c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.081+0000 7fe31426c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c112090 con 0x7fe30c103740 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe31426c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c111f10 con 0x7fe30c108290 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe31426c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c112210 con 0x7fe30c102d90 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe311807640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe30c103740 0x7fe30c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe311807640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe30c103740 0x7fe30c198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33010/0 (socket says 172.21.15.73:33010) 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe311807640 1 -- 172.21.15.73:0/308230080 learned_addr learned my addr 172.21.15.73:0/308230080 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe312008640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c102d90 0x7fe30c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe312809640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe30c108290 0x7fe30c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe311807640 1 -- 172.21.15.73:0/308230080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c102d90 msgr2=0x7fe30c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe311807640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c102d90 0x7fe30c198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe311807640 1 -- 172.21.15.73:0/308230080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe30c108290 msgr2=0x7fe30c19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe311807640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe30c108290 0x7fe30c19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe311807640 1 -- 172.21.15.73:0/308230080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c19d510 con 0x7fe30c103740 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe312809640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe30c108290 0x7fe30c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe311807640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe30c103740 0x7fe30c198aa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe300005fd0 tx=0x7fe30000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe30b7fe640 1 -- 172.21.15.73:0/308230080 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300017070 con 0x7fe30c103740 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe30b7fe640 1 -- 172.21.15.73:0/308230080 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe300009c30 con 0x7fe30c103740 2024-09-05T12:57:32.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe31426c640 1 -- 172.21.15.73:0/308230080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c19d800 con 0x7fe30c103740 2024-09-05T12:57:32.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe30b7fe640 1 -- 172.21.15.73:0/308230080 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300010460 con 0x7fe30c103740 2024-09-05T12:57:32.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.082+0000 7fe31426c640 1 -- 172.21.15.73:0/308230080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c1a50e0 con 0x7fe30c103740 2024-09-05T12:57:32.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.083+0000 7fe31426c640 1 -- 172.21.15.73:0/308230080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c103170 con 0x7fe30c103740 2024-09-05T12:57:32.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.085+0000 7fe30b7fe640 1 -- 172.21.15.73:0/308230080 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe300003e70 con 0x7fe30c103740 2024-09-05T12:57:32.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.085+0000 7fe30b7fe640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe2f40a2c90 0x7fe2f40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:32.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.086+0000 7fe312008640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe2f40a2c90 0x7fe2f40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:32.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.086+0000 7fe30b7fe640 1 -- 172.21.15.73:0/308230080 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe3000ced20 con 0x7fe30c103740 2024-09-05T12:57:32.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.086+0000 7fe312008640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe2f40a2c90 0x7fe2f40a5150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe304005fd0 tx=0x7fe304009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:32.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.090+0000 7fe30b7fe640 1 -- 172.21.15.73:0/308230080 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe300020030 con 0x7fe30c103740 2024-09-05T12:57:32.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:32 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1575562306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T12:57:32.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.292+0000 7fe31426c640 1 -- 172.21.15.73:0/308230080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe30c10a2d0 con 0x7fe30c103740 2024-09-05T12:57:32.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.293+0000 7fe30b7fe640 1 -- 172.21.15.73:0/308230080 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11926 (secure 0 0 0) 0x7fe30009bb50 con 0x7fe30c103740 2024-09-05T12:57:32.294 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:32.294 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"btime":"2024-09-05T12:57:30:110632+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:57:30.060424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T12:57:32.294 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 25 2024-09-05T12:57:32.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 -- 172.21.15.73:0/308230080 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe2f40a2c90 msgr2=0x7fe2f40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:32.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe2f40a2c90 0x7fe2f40a5150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe304005fd0 tx=0x7fe304009680 comp rx=0 tx=0).stop 2024-09-05T12:57:32.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 -- 172.21.15.73:0/308230080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe30c103740 msgr2=0x7fe30c198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:32.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe30c103740 0x7fe30c198aa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe300005fd0 tx=0x7fe30000dde0 comp rx=0 tx=0).stop 2024-09-05T12:57:32.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 -- 172.21.15.73:0/308230080 shutdown_connections 2024-09-05T12:57:32.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe2f40a2c90 0x7fe2f40a5150 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:32.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe30c108290 0x7fe30c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:32.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe30c103740 0x7fe30c198aa0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:32.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 --2- 172.21.15.73:0/308230080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c102d90 0x7fe30c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:32.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 -- 172.21.15.73:0/308230080 >> 172.21.15.73:0/308230080 conn(0x7fe30c0fc7d0 msgr2=0x7fe30c106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:32.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 -- 172.21.15.73:0/308230080 shutdown_connections 2024-09-05T12:57:32.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:32.295+0000 7fe31426c640 1 -- 172.21.15.73:0/308230080 wait complete. 2024-09-05T12:57:32.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:32 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1575562306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T12:57:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:32 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1575562306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T12:57:33.085 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-05T12:57:33.085 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-05T12:57:33.085 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T12:57:33.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 -- 172.21.15.73:0/3802865378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f940c100b50 msgr2=0x7f940c100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 --2- 172.21.15.73:0/3802865378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f940c100b50 0x7f940c100fd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009900 tx=0x7f93fc02a410 comp rx=0 tx=0).stop 2024-09-05T12:57:33.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 -- 172.21.15.73:0/3802865378 shutdown_connections 2024-09-05T12:57:33.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 --2- 172.21.15.73:0/3802865378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f940c101510 0x7f940c105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 --2- 172.21.15.73:0/3802865378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f940c100b50 0x7f940c100fd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 --2- 172.21.15.73:0/3802865378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f940c0ffdf0 0x7f940c1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 -- 172.21.15.73:0/3802865378 >> 172.21.15.73:0/3802865378 conn(0x7f940c0fb910 msgr2=0x7f940c0fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:33.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 -- 172.21.15.73:0/3802865378 shutdown_connections 2024-09-05T12:57:33.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 -- 172.21.15.73:0/3802865378 wait complete. 2024-09-05T12:57:33.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 Processor -- start 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.187+0000 7f9413fd8640 1 -- start start 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9413fd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f940c0ffdf0 0x7f940c19e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9413fd8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f940c100b50 0x7f940c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9413fd8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f940c101510 0x7f940c1a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9413fd8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f940c113df0 con 0x7f940c100b50 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9413fd8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f940c113c70 con 0x7f940c0ffdf0 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9413fd8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f940c113f70 con 0x7f940c101510 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411573640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f940c100b50 0x7f940c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411573640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f940c100b50 0x7f940c19ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33030/0 (socket says 172.21.15.73:33030) 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411573640 1 -- 172.21.15.73:0/350435513 learned_addr learned my addr 172.21.15.73:0/350435513 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9412575640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f940c101510 0x7f940c1a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411d74640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f940c0ffdf0 0x7f940c19e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411573640 1 -- 172.21.15.73:0/350435513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f940c101510 msgr2=0x7f940c1a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411573640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f940c101510 0x7f940c1a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411573640 1 -- 172.21.15.73:0/350435513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f940c0ffdf0 msgr2=0x7f940c19e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411573640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f940c0ffdf0 0x7f940c19e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411573640 1 -- 172.21.15.73:0/350435513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c1a60e0 con 0x7f940c100b50 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411d74640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f940c0ffdf0 0x7f940c19e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9411573640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f940c100b50 0x7f940c19ea00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f93fc031610 tx=0x7f93fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9402ffd640 1 -- 172.21.15.73:0/350435513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc03f030 con 0x7f940c100b50 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9402ffd640 1 -- 172.21.15.73:0/350435513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93fc003ad0 con 0x7f940c100b50 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9413fd8640 1 -- 172.21.15.73:0/350435513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940c1a6370 con 0x7f940c100b50 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9402ffd640 1 -- 172.21.15.73:0/350435513 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc035070 con 0x7f940c100b50 2024-09-05T12:57:33.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.188+0000 7f9413fd8640 1 -- 172.21.15.73:0/350435513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940c1a6860 con 0x7f940c100b50 2024-09-05T12:57:33.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.190+0000 7f9413fd8640 1 -- 172.21.15.73:0/350435513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f940c104bc0 con 0x7f940c100b50 2024-09-05T12:57:33.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.191+0000 7f9402ffd640 1 -- 172.21.15.73:0/350435513 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f93fc042030 con 0x7f940c100b50 2024-09-05T12:57:33.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.192+0000 7f9402ffd640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93f80a2c20 0x7f93f80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.192+0000 7f9411d74640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93f80a2c20 0x7f93f80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.192+0000 7f9402ffd640 1 -- 172.21.15.73:0/350435513 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f93fc0efa90 con 0x7f940c100b50 2024-09-05T12:57:33.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.192+0000 7f9411d74640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93f80a2c20 0x7f93f80a50e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9408009c20 tx=0x7f9408005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:33.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.195+0000 7f9402ffd640 1 -- 172.21.15.73:0/350435513 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93fc0bc8c0 con 0x7f940c100b50 2024-09-05T12:57:33.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.359+0000 7f9413fd8640 1 -- 172.21.15.73:0/350435513 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f940c062630 con 0x7f93f80a2c20 2024-09-05T12:57:33.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:33 smithi162 ceph-mon[34220]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:33.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:33 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/308230080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:33.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.365+0000 7f9402ffd640 1 -- 172.21.15.73:0/350435513 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258875 (secure 0 0 0) 0x7f940c062630 con 0x7f93f80a2c20 2024-09-05T12:57:33.369 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:33.370 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-05T12:57:33.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 -- 172.21.15.73:0/350435513 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93f80a2c20 msgr2=0x7f93f80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93f80a2c20 0x7f93f80a50e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9408009c20 tx=0x7f9408005f90 comp rx=0 tx=0).stop 2024-09-05T12:57:33.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 -- 172.21.15.73:0/350435513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f940c100b50 msgr2=0x7f940c19ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f940c100b50 0x7f940c19ea00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f93fc031610 tx=0x7f93fc004270 comp rx=0 tx=0).stop 2024-09-05T12:57:33.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 -- 172.21.15.73:0/350435513 shutdown_connections 2024-09-05T12:57:33.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93f80a2c20 0x7f93f80a50e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f940c101510 0x7f940c1a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f940c100b50 0x7f940c19ea00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 --2- 172.21.15.73:0/350435513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f940c0ffdf0 0x7f940c19e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 -- 172.21.15.73:0/350435513 >> 172.21.15.73:0/350435513 conn(0x7f940c0fb910 msgr2=0x7f940c101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:33.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 -- 172.21.15.73:0/350435513 shutdown_connections 2024-09-05T12:57:33.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.368+0000 7f9413fd8640 1 -- 172.21.15.73:0/350435513 wait complete. 2024-09-05T12:57:33.374 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:33 smithi169 ceph-mon[34823]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:33.375 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:33 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/308230080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:33.379 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:33 smithi073 ceph-mon[30883]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-05T12:57:33.379 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:33 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/308230080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:33.380 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-05T12:57:31.999000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":723,"num_read_kb":473,"num_write":344,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351668,"kb_used_data":10708,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590156,"statfs":{"total":1151940427776,"available":1151580319744,"internally_reserved":0,"allocated":10964992,"data_stored":7066469,"data_compressed":107439,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003202"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059332+0000","last_change":"2024-09-05T12:55:45.753801+0000","last_active":"2024-09-05T12:56:05.059332+0000","last_peered":"2024-09-05T12:56:05.059332+0000","last_clean":"2024-09-05T12:56:05.059332+0000","last_became_active":"2024-09-05T12:55:45.753480+0000","last_became_peered":"2024-09-05T12:55:45.753480+0000","last_unstale":"2024-09-05T12:56:05.059332+0000","last_undegraded":"2024-09-05T12:56:05.059332+0000","last_fullsized":"2024-09-05T12:56:05.059332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:34.806083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063464+0000","last_change":"2024-09-05T12:55:45.744629+0000","last_active":"2024-09-05T12:56:05.063464+0000","last_peered":"2024-09-05T12:56:05.063464+0000","last_clean":"2024-09-05T12:56:05.063464+0000","last_became_active":"2024-09-05T12:55:45.744311+0000","last_became_peered":"2024-09-05T12:55:45.744311+0000","last_unstale":"2024-09-05T12:56:05.063464+0000","last_undegraded":"2024-09-05T12:56:05.063464+0000","last_fullsized":"2024-09-05T12:56:05.063464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:08:57.032929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063504+0000","last_change":"2024-09-05T12:55:45.745128+0000","last_active":"2024-09-05T12:56:05.063504+0000","last_peered":"2024-09-05T12:56:05.063504+0000","last_clean":"2024-09-05T12:56:05.063504+0000","last_became_active":"2024-09-05T12:55:45.744799+0000","last_became_peered":"2024-09-05T12:55:45.744799+0000","last_unstale":"2024-09-05T12:56:05.063504+0000","last_undegraded":"2024-09-05T12:56:05.063504+0000","last_fullsized":"2024-09-05T12:56:05.063504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:35:48.528336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201949+0000","last_change":"2024-09-05T12:55:45.749471+0000","last_active":"2024-09-05T12:56:05.201949+0000","last_peered":"2024-09-05T12:56:05.201949+0000","last_clean":"2024-09-05T12:56:05.201949+0000","last_became_active":"2024-09-05T12:55:45.749126+0000","last_became_peered":"2024-09-05T12:55:45.749126+0000","last_unstale":"2024-09-05T12:56:05.201949+0000","last_undegraded":"2024-09-05T12:56:05.201949+0000","last_fullsized":"2024-09-05T12:56:05.201949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:36.152934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061325+0000","last_change":"2024-09-05T12:55:45.741243+0000","last_active":"2024-09-05T12:56:05.061325+0000","last_peered":"2024-09-05T12:56:05.061325+0000","last_clean":"2024-09-05T12:56:05.061325+0000","last_became_active":"2024-09-05T12:55:45.740849+0000","last_became_peered":"2024-09-05T12:55:45.740849+0000","last_unstale":"2024-09-05T12:56:05.061325+0000","last_undegraded":"2024-09-05T12:56:05.061325+0000","last_fullsized":"2024-09-05T12:56:05.061325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:01.323875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061912+0000","last_change":"2024-09-05T12:55:45.744599+0000","last_active":"2024-09-05T12:56:05.061912+0000","last_peered":"2024-09-05T12:56:05.061912+0000","last_clean":"2024-09-05T12:56:05.061912+0000","last_became_active":"2024-09-05T12:55:45.744304+0000","last_became_peered":"2024-09-05T12:55:45.744304+0000","last_unstale":"2024-09-05T12:56:05.061912+0000","last_undegraded":"2024-09-05T12:56:05.061912+0000","last_fullsized":"2024-09-05T12:56:05.061912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:15:55.340505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676096+0000","last_change":"2024-09-05T12:55:45.744802+0000","last_active":"2024-09-05T12:56:05.676096+0000","last_peered":"2024-09-05T12:56:05.676096+0000","last_clean":"2024-09-05T12:56:05.676096+0000","last_became_active":"2024-09-05T12:55:45.744525+0000","last_became_peered":"2024-09-05T12:55:45.744525+0000","last_unstale":"2024-09-05T12:56:05.676096+0000","last_undegraded":"2024-09-05T12:56:05.676096+0000","last_fullsized":"2024-09-05T12:56:05.676096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:03:04.047389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060470+0000","last_change":"2024-09-05T12:55:45.742141+0000","last_active":"2024-09-05T12:56:05.060470+0000","last_peered":"2024-09-05T12:56:05.060470+0000","last_clean":"2024-09-05T12:56:05.060470+0000","last_became_active":"2024-09-05T12:55:45.741445+0000","last_became_peered":"2024-09-05T12:55:45.741445+0000","last_unstale":"2024-09-05T12:56:05.060470+0000","last_undegraded":"2024-09-05T12:56:05.060470+0000","last_fullsized":"2024-09-05T12:56:05.060470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:38:28.859589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.852099+0000","last_change":"2024-09-05T12:55:45.747321+0000","last_active":"2024-09-05T12:56:05.852099+0000","last_peered":"2024-09-05T12:56:05.852099+0000","last_clean":"2024-09-05T12:56:05.852099+0000","last_became_active":"2024-09-05T12:55:45.747013+0000","last_became_peered":"2024-09-05T12:55:45.747013+0000","last_unstale":"2024-09-05T12:56:05.852099+0000","last_undegraded":"2024-09-05T12:56:05.852099+0000","last_fullsized":"2024-09-05T12:56:05.852099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:42:00.402789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064498+0000","last_change":"2024-09-05T12:56:05.064498+0000","last_active":"2024-09-05T12:56:05.064498+0000","last_peered":"2024-09-05T12:56:05.064498+0000","last_clean":"2024-09-05T12:56:05.064498+0000","last_became_active":"2024-09-05T12:56:05.064200+0000","last_became_peered":"2024-09-05T12:56:05.064200+0000","last_unstale":"2024-09-05T12:56:05.064498+0000","last_undegraded":"2024-09-05T12:56:05.064498+0000","last_fullsized":"2024-09-05T12:56:05.064498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:37:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676376+0000","last_change":"2024-09-05T12:55:45.748372+0000","last_active":"2024-09-05T12:56:05.676376+0000","last_peered":"2024-09-05T12:56:05.676376+0000","last_clean":"2024-09-05T12:56:05.676376+0000","last_became_active":"2024-09-05T12:55:45.748093+0000","last_became_peered":"2024-09-05T12:55:45.748093+0000","last_unstale":"2024-09-05T12:56:05.676376+0000","last_undegraded":"2024-09-05T12:56:05.676376+0000","last_fullsized":"2024-09-05T12:56:05.676376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:32:25.938128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201978+0000","last_change":"2024-09-05T12:55:45.749433+0000","last_active":"2024-09-05T12:56:05.201978+0000","last_peered":"2024-09-05T12:56:05.201978+0000","last_clean":"2024-09-05T12:56:05.201978+0000","last_became_active":"2024-09-05T12:55:45.748677+0000","last_became_peered":"2024-09-05T12:55:45.748677+0000","last_unstale":"2024-09-05T12:56:05.201978+0000","last_undegraded":"2024-09-05T12:56:05.201978+0000","last_fullsized":"2024-09-05T12:56:05.201978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:27:57.896752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819602+0000","last_change":"2024-09-05T12:55:45.743212+0000","last_active":"2024-09-05T12:56:05.819602+0000","last_peered":"2024-09-05T12:56:05.819602+0000","last_clean":"2024-09-05T12:56:05.819602+0000","last_became_active":"2024-09-05T12:55:45.742918+0000","last_became_peered":"2024-09-05T12:55:45.742918+0000","last_unstale":"2024-09-05T12:56:05.819602+0000","last_undegraded":"2024-09-05T12:56:05.819602+0000","last_fullsized":"2024-09-05T12:56:05.819602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:21:18.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063680+0000","last_change":"2024-09-05T12:55:45.745058+0000","last_active":"2024-09-05T12:56:05.063680+0000","last_peered":"2024-09-05T12:56:05.063680+0000","last_clean":"2024-09-05T12:56:05.063680+0000","last_became_active":"2024-09-05T12:55:45.744349+0000","last_became_peered":"2024-09-05T12:55:45.744349+0000","last_unstale":"2024-09-05T12:56:05.063680+0000","last_undegraded":"2024-09-05T12:56:05.063680+0000","last_fullsized":"2024-09-05T12:56:05.063680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:26:21.034864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063126+0000","last_change":"2024-09-05T12:55:45.748387+0000","last_active":"2024-09-05T12:56:05.063126+0000","last_peered":"2024-09-05T12:56:05.063126+0000","last_clean":"2024-09-05T12:56:05.063126+0000","last_became_active":"2024-09-05T12:55:45.748082+0000","last_became_peered":"2024-09-05T12:55:45.748082+0000","last_unstale":"2024-09-05T12:56:05.063126+0000","last_undegraded":"2024-09-05T12:56:05.063126+0000","last_fullsized":"2024-09-05T12:56:05.063126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:51:23.835278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851526+0000","last_change":"2024-09-05T12:55:45.742195+0000","last_active":"2024-09-05T12:56:05.851526+0000","last_peered":"2024-09-05T12:56:05.851526+0000","last_clean":"2024-09-05T12:56:05.851526+0000","last_became_active":"2024-09-05T12:55:45.741888+0000","last_became_peered":"2024-09-05T12:55:45.741888+0000","last_unstale":"2024-09-05T12:56:05.851526+0000","last_undegraded":"2024-09-05T12:56:05.851526+0000","last_fullsized":"2024-09-05T12:56:05.851526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:19:17.556164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059394+0000","last_change":"2024-09-05T12:55:45.755255+0000","last_active":"2024-09-05T12:56:05.059394+0000","last_peered":"2024-09-05T12:56:05.059394+0000","last_clean":"2024-09-05T12:56:05.059394+0000","last_became_active":"2024-09-05T12:55:45.754939+0000","last_became_peered":"2024-09-05T12:55:45.754939+0000","last_unstale":"2024-09-05T12:56:05.059394+0000","last_undegraded":"2024-09-05T12:56:05.059394+0000","last_fullsized":"2024-09-05T12:56:05.059394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:48:34.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061596+0000","last_change":"2024-09-05T12:55:45.745496+0000","last_active":"2024-09-05T12:56:05.061596+0000","last_peered":"2024-09-05T12:56:05.061596+0000","last_clean":"2024-09-05T12:56:05.061596+0000","last_became_active":"2024-09-05T12:55:45.745153+0000","last_became_peered":"2024-09-05T12:55:45.745153+0000","last_unstale":"2024-09-05T12:56:05.061596+0000","last_undegraded":"2024-09-05T12:56:05.061596+0000","last_fullsized":"2024-09-05T12:56:05.061596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:16:52.255227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062235+0000","last_change":"2024-09-05T12:55:45.747353+0000","last_active":"2024-09-05T12:56:05.062235+0000","last_peered":"2024-09-05T12:56:05.062235+0000","last_clean":"2024-09-05T12:56:05.062235+0000","last_became_active":"2024-09-05T12:55:45.747018+0000","last_became_peered":"2024-09-05T12:55:45.747018+0000","last_unstale":"2024-09-05T12:56:05.062235+0000","last_undegraded":"2024-09-05T12:56:05.062235+0000","last_fullsized":"2024-09-05T12:56:05.062235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:12:25.217057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059013+0000","last_change":"2024-09-05T12:55:45.754023+0000","last_active":"2024-09-05T12:56:05.059013+0000","last_peered":"2024-09-05T12:56:05.059013+0000","last_clean":"2024-09-05T12:56:05.059013+0000","last_became_active":"2024-09-05T12:55:45.753723+0000","last_became_peered":"2024-09-05T12:55:45.753723+0000","last_unstale":"2024-09-05T12:56:05.059013+0000","last_undegraded":"2024-09-05T12:56:05.059013+0000","last_fullsized":"2024-09-05T12:56:05.059013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:16:01.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819690+0000","last_change":"2024-09-05T12:55:45.742627+0000","last_active":"2024-09-05T12:56:05.819690+0000","last_peered":"2024-09-05T12:56:05.819690+0000","last_clean":"2024-09-05T12:56:05.819690+0000","last_became_active":"2024-09-05T12:55:45.742252+0000","last_became_peered":"2024-09-05T12:55:45.742252+0000","last_unstale":"2024-09-05T12:56:05.819690+0000","last_undegraded":"2024-09-05T12:56:05.819690+0000","last_fullsized":"2024-09-05T12:56:05.819690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:14:34.476156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851781+0000","last_change":"2024-09-05T12:55:45.743587+0000","last_active":"2024-09-05T12:56:05.851781+0000","last_peered":"2024-09-05T12:56:05.851781+0000","last_clean":"2024-09-05T12:56:05.851781+0000","last_became_active":"2024-09-05T12:55:45.742624+0000","last_became_peered":"2024-09-05T12:55:45.742624+0000","last_unstale":"2024-09-05T12:56:05.851781+0000","last_undegraded":"2024-09-05T12:56:05.851781+0000","last_fullsized":"2024-09-05T12:56:05.851781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:15.981929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060563+0000","last_change":"2024-09-05T12:55:45.747430+0000","last_active":"2024-09-05T12:56:05.060563+0000","last_peered":"2024-09-05T12:56:05.060563+0000","last_clean":"2024-09-05T12:56:05.060563+0000","last_became_active":"2024-09-05T12:55:45.747049+0000","last_became_peered":"2024-09-05T12:55:45.747049+0000","last_unstale":"2024-09-05T12:56:05.060563+0000","last_undegraded":"2024-09-05T12:56:05.060563+0000","last_fullsized":"2024-09-05T12:56:05.060563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:31:08.388375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065470+0000","last_change":"2024-09-05T12:55:45.741645+0000","last_active":"2024-09-05T12:56:05.065470+0000","last_peered":"2024-09-05T12:56:05.065470+0000","last_clean":"2024-09-05T12:56:05.065470+0000","last_became_active":"2024-09-05T12:55:45.741341+0000","last_became_peered":"2024-09-05T12:55:45.741341+0000","last_unstale":"2024-09-05T12:56:05.065470+0000","last_undegraded":"2024-09-05T12:56:05.065470+0000","last_fullsized":"2024-09-05T12:56:05.065470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:24:11.896491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061589+0000","last_change":"2024-09-05T12:55:45.747609+0000","last_active":"2024-09-05T12:56:05.061589+0000","last_peered":"2024-09-05T12:56:05.061589+0000","last_clean":"2024-09-05T12:56:05.061589+0000","last_became_active":"2024-09-05T12:55:45.745899+0000","last_became_peered":"2024-09-05T12:55:45.745899+0000","last_unstale":"2024-09-05T12:56:05.061589+0000","last_undegraded":"2024-09-05T12:56:05.061589+0000","last_fullsized":"2024-09-05T12:56:05.061589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:21:42.224663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061958+0000","last_change":"2024-09-05T12:55:45.744974+0000","last_active":"2024-09-05T12:56:05.061958+0000","last_peered":"2024-09-05T12:56:05.061958+0000","last_clean":"2024-09-05T12:56:05.061958+0000","last_became_active":"2024-09-05T12:55:45.744538+0000","last_became_peered":"2024-09-05T12:55:45.744538+0000","last_unstale":"2024-09-05T12:56:05.061958+0000","last_undegraded":"2024-09-05T12:56:05.061958+0000","last_fullsized":"2024-09-05T12:56:05.061958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:48:46.695178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064626+0000","last_change":"2024-09-05T12:56:05.064626+0000","last_active":"2024-09-05T12:56:05.064626+0000","last_peered":"2024-09-05T12:56:05.064626+0000","last_clean":"2024-09-05T12:56:05.064626+0000","last_became_active":"2024-09-05T12:56:05.063972+0000","last_became_peered":"2024-09-05T12:56:05.063972+0000","last_unstale":"2024-09-05T12:56:05.064626+0000","last_undegraded":"2024-09-05T12:56:05.064626+0000","last_fullsized":"2024-09-05T12:56:05.064626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:57.345008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819769+0000","last_change":"2024-09-05T12:55:45.753630+0000","last_active":"2024-09-05T12:56:05.819769+0000","last_peered":"2024-09-05T12:56:05.819769+0000","last_clean":"2024-09-05T12:56:05.819769+0000","last_became_active":"2024-09-05T12:55:45.753328+0000","last_became_peered":"2024-09-05T12:55:45.753328+0000","last_unstale":"2024-09-05T12:56:05.819769+0000","last_undegraded":"2024-09-05T12:56:05.819769+0000","last_fullsized":"2024-09-05T12:56:05.819769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:55:39.064374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063372+0000","last_change":"2024-09-05T12:55:45.749596+0000","last_active":"2024-09-05T12:56:05.063372+0000","last_peered":"2024-09-05T12:56:05.063372+0000","last_clean":"2024-09-05T12:56:05.063372+0000","last_became_active":"2024-09-05T12:55:45.749150+0000","last_became_peered":"2024-09-05T12:55:45.749150+0000","last_unstale":"2024-09-05T12:56:05.063372+0000","last_undegraded":"2024-09-05T12:56:05.063372+0000","last_fullsized":"2024-09-05T12:56:05.063372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:14:06.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062144+0000","last_change":"2024-09-05T12:55:45.748414+0000","last_active":"2024-09-05T12:56:05.062144+0000","last_peered":"2024-09-05T12:56:05.062144+0000","last_clean":"2024-09-05T12:56:05.062144+0000","last_became_active":"2024-09-05T12:55:45.747952+0000","last_became_peered":"2024-09-05T12:55:45.747952+0000","last_unstale":"2024-09-05T12:56:05.062144+0000","last_undegraded":"2024-09-05T12:56:05.062144+0000","last_fullsized":"2024-09-05T12:56:05.062144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:45:04.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061467+0000","last_change":"2024-09-05T12:55:45.754145+0000","last_active":"2024-09-05T12:56:05.061467+0000","last_peered":"2024-09-05T12:56:05.061467+0000","last_clean":"2024-09-05T12:56:05.061467+0000","last_became_active":"2024-09-05T12:55:45.753833+0000","last_became_peered":"2024-09-05T12:55:45.753833+0000","last_unstale":"2024-09-05T12:56:05.061467+0000","last_undegraded":"2024-09-05T12:56:05.061467+0000","last_fullsized":"2024-09-05T12:56:05.061467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:45:24.606506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.058922+0000","last_change":"2024-09-05T12:55:45.750283+0000","last_active":"2024-09-05T12:56:05.058922+0000","last_peered":"2024-09-05T12:56:05.058922+0000","last_clean":"2024-09-05T12:56:05.058922+0000","last_became_active":"2024-09-05T12:55:45.749901+0000","last_became_peered":"2024-09-05T12:55:45.749901+0000","last_unstale":"2024-09-05T12:56:05.058922+0000","last_undegraded":"2024-09-05T12:56:05.058922+0000","last_fullsized":"2024-09-05T12:56:05.058922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:45:57.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061784+0000","last_change":"2024-09-05T12:55:45.743239+0000","last_active":"2024-09-05T12:56:05.061784+0000","last_peered":"2024-09-05T12:56:05.061784+0000","last_clean":"2024-09-05T12:56:05.061784+0000","last_became_active":"2024-09-05T12:55:45.742926+0000","last_became_peered":"2024-09-05T12:55:45.742926+0000","last_unstale":"2024-09-05T12:56:05.061784+0000","last_undegraded":"2024-09-05T12:56:05.061784+0000","last_fullsized":"2024-09-05T12:56:05.061784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:26:05.559405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:29.948209+0000","last_change":"2024-09-05T12:55:43.727301+0000","last_active":"2024-09-05T12:57:29.948209+0000","last_peered":"2024-09-05T12:57:29.948209+0000","last_clean":"2024-09-05T12:57:29.948209+0000","last_became_active":"2024-09-05T12:55:43.727006+0000","last_became_peered":"2024-09-05T12:55:43.727006+0000","last_unstale":"2024-09-05T12:57:29.948209+0000","last_undegraded":"2024-09-05T12:57:29.948209+0000","last_fullsized":"2024-09-05T12:57:29.948209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:54:32.725098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066620+0000","last_change":"2024-09-05T12:55:45.735835+0000","last_active":"2024-09-05T12:56:05.066620+0000","last_peered":"2024-09-05T12:56:05.066620+0000","last_clean":"2024-09-05T12:56:05.066620+0000","last_became_active":"2024-09-05T12:55:45.735404+0000","last_became_peered":"2024-09-05T12:55:45.735404+0000","last_unstale":"2024-09-05T12:56:05.066620+0000","last_undegraded":"2024-09-05T12:56:05.066620+0000","last_fullsized":"2024-09-05T12:56:05.066620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:06:47.174441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062007+0000","last_change":"2024-09-05T12:55:43.724561+0000","last_active":"2024-09-05T12:56:05.062007+0000","last_peered":"2024-09-05T12:56:05.062007+0000","last_clean":"2024-09-05T12:56:05.062007+0000","last_became_active":"2024-09-05T12:55:43.722704+0000","last_became_peered":"2024-09-05T12:55:43.722704+0000","last_unstale":"2024-09-05T12:56:05.062007+0000","last_undegraded":"2024-09-05T12:56:05.062007+0000","last_fullsized":"2024-09-05T12:56:05.062007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:20:20.692844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819297+0000","last_change":"2024-09-05T12:55:43.722937+0000","last_active":"2024-09-05T12:56:05.819297+0000","last_peered":"2024-09-05T12:56:05.819297+0000","last_clean":"2024-09-05T12:56:05.819297+0000","last_became_active":"2024-09-05T12:55:43.722606+0000","last_became_peered":"2024-09-05T12:55:43.722606+0000","last_unstale":"2024-09-05T12:56:05.819297+0000","last_undegraded":"2024-09-05T12:56:05.819297+0000","last_fullsized":"2024-09-05T12:56:05.819297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:47:38.448865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.820632+0000","last_change":"2024-09-05T12:56:05.820632+0000","last_active":"2024-09-05T12:56:05.820632+0000","last_peered":"2024-09-05T12:56:05.820632+0000","last_clean":"2024-09-05T12:56:05.820632+0000","last_became_active":"2024-09-05T12:56:05.820239+0000","last_became_peered":"2024-09-05T12:56:05.820239+0000","last_unstale":"2024-09-05T12:56:05.820632+0000","last_undegraded":"2024-09-05T12:56:05.820632+0000","last_fullsized":"2024-09-05T12:56:05.820632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:36:59.659783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065764+0000","last_change":"2024-09-05T12:55:43.725546+0000","last_active":"2024-09-05T12:56:05.065764+0000","last_peered":"2024-09-05T12:56:05.065764+0000","last_clean":"2024-09-05T12:56:05.065764+0000","last_became_active":"2024-09-05T12:55:43.725252+0000","last_became_peered":"2024-09-05T12:55:43.725252+0000","last_unstale":"2024-09-05T12:56:05.065764+0000","last_undegraded":"2024-09-05T12:56:05.065764+0000","last_fullsized":"2024-09-05T12:56:05.065764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:49:16.085799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060968+0000","last_change":"2024-09-05T12:55:45.745358+0000","last_active":"2024-09-05T12:56:05.060968+0000","last_peered":"2024-09-05T12:56:05.060968+0000","last_clean":"2024-09-05T12:56:05.060968+0000","last_became_active":"2024-09-05T12:55:45.745040+0000","last_became_peered":"2024-09-05T12:55:45.745040+0000","last_unstale":"2024-09-05T12:56:05.060968+0000","last_undegraded":"2024-09-05T12:56:05.060968+0000","last_fullsized":"2024-09-05T12:56:05.060968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:42:42.906745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:27.944124+0000","last_change":"2024-09-05T12:55:43.726138+0000","last_active":"2024-09-05T12:57:27.944124+0000","last_peered":"2024-09-05T12:57:27.944124+0000","last_clean":"2024-09-05T12:57:27.944124+0000","last_became_active":"2024-09-05T12:55:43.725815+0000","last_became_peered":"2024-09-05T12:55:43.725815+0000","last_unstale":"2024-09-05T12:57:27.944124+0000","last_undegraded":"2024-09-05T12:57:27.944124+0000","last_fullsized":"2024-09-05T12:57:27.944124+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:35:38.041757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851996+0000","last_change":"2024-09-05T12:55:45.743580+0000","last_active":"2024-09-05T12:56:05.851996+0000","last_peered":"2024-09-05T12:56:05.851996+0000","last_clean":"2024-09-05T12:56:05.851996+0000","last_became_active":"2024-09-05T12:55:45.743307+0000","last_became_peered":"2024-09-05T12:55:45.743307+0000","last_unstale":"2024-09-05T12:56:05.851996+0000","last_undegraded":"2024-09-05T12:56:05.851996+0000","last_fullsized":"2024-09-05T12:56:05.851996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:15:13.898218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676632+0000","last_change":"2024-09-05T12:55:43.725373+0000","last_active":"2024-09-05T12:56:05.676632+0000","last_peered":"2024-09-05T12:56:05.676632+0000","last_clean":"2024-09-05T12:56:05.676632+0000","last_became_active":"2024-09-05T12:55:43.725062+0000","last_became_peered":"2024-09-05T12:55:43.725062+0000","last_unstale":"2024-09-05T12:56:05.676632+0000","last_undegraded":"2024-09-05T12:56:05.676632+0000","last_fullsized":"2024-09-05T12:56:05.676632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:42:27.994499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063879+0000","last_change":"2024-09-05T12:55:45.750265+0000","last_active":"2024-09-05T12:56:05.063879+0000","last_peered":"2024-09-05T12:56:05.063879+0000","last_clean":"2024-09-05T12:56:05.063879+0000","last_became_active":"2024-09-05T12:55:45.749928+0000","last_became_peered":"2024-09-05T12:55:45.749928+0000","last_unstale":"2024-09-05T12:56:05.063879+0000","last_undegraded":"2024-09-05T12:56:05.063879+0000","last_fullsized":"2024-09-05T12:56:05.063879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:56:19.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065937+0000","last_change":"2024-09-05T12:55:43.736248+0000","last_active":"2024-09-05T12:56:05.065937+0000","last_peered":"2024-09-05T12:56:05.065937+0000","last_clean":"2024-09-05T12:56:05.065937+0000","last_became_active":"2024-09-05T12:55:43.735928+0000","last_became_peered":"2024-09-05T12:55:43.735928+0000","last_unstale":"2024-09-05T12:56:05.065937+0000","last_undegraded":"2024-09-05T12:56:05.065937+0000","last_fullsized":"2024-09-05T12:56:05.065937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:04:43.215616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851777+0000","last_change":"2024-09-05T12:55:45.739178+0000","last_active":"2024-09-05T12:56:05.851777+0000","last_peered":"2024-09-05T12:56:05.851777+0000","last_clean":"2024-09-05T12:56:05.851777+0000","last_became_active":"2024-09-05T12:55:45.738863+0000","last_became_peered":"2024-09-05T12:55:45.738863+0000","last_unstale":"2024-09-05T12:56:05.851777+0000","last_undegraded":"2024-09-05T12:56:05.851777+0000","last_fullsized":"2024-09-05T12:56:05.851777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:08.273036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":247,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:28.945735+0000","last_change":"2024-09-05T12:55:43.725380+0000","last_active":"2024-09-05T12:57:28.945735+0000","last_peered":"2024-09-05T12:57:28.945735+0000","last_clean":"2024-09-05T12:57:28.945735+0000","last_became_active":"2024-09-05T12:55:43.725000+0000","last_became_peered":"2024-09-05T12:55:43.725000+0000","last_unstale":"2024-09-05T12:57:28.945735+0000","last_undegraded":"2024-09-05T12:57:28.945735+0000","last_fullsized":"2024-09-05T12:57:28.945735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:34:13.288894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":156,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061405+0000","last_change":"2024-09-05T12:55:45.742269+0000","last_active":"2024-09-05T12:56:05.061405+0000","last_peered":"2024-09-05T12:56:05.061405+0000","last_clean":"2024-09-05T12:56:05.061405+0000","last_became_active":"2024-09-05T12:55:45.741723+0000","last_became_peered":"2024-09-05T12:55:45.741723+0000","last_unstale":"2024-09-05T12:56:05.061405+0000","last_undegraded":"2024-09-05T12:56:05.061405+0000","last_fullsized":"2024-09-05T12:56:05.061405+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:39.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061771+0000","last_change":"2024-09-05T12:55:43.723725+0000","last_active":"2024-09-05T12:56:05.061771+0000","last_peered":"2024-09-05T12:56:05.061771+0000","last_clean":"2024-09-05T12:56:05.061771+0000","last_became_active":"2024-09-05T12:55:43.723351+0000","last_became_peered":"2024-09-05T12:55:43.723351+0000","last_unstale":"2024-09-05T12:56:05.061771+0000","last_undegraded":"2024-09-05T12:56:05.061771+0000","last_fullsized":"2024-09-05T12:56:05.061771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:15:40.485461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819355+0000","last_change":"2024-09-05T12:55:45.742293+0000","last_active":"2024-09-05T12:56:05.819355+0000","last_peered":"2024-09-05T12:56:05.819355+0000","last_clean":"2024-09-05T12:56:05.819355+0000","last_became_active":"2024-09-05T12:55:45.741998+0000","last_became_peered":"2024-09-05T12:55:45.741998+0000","last_unstale":"2024-09-05T12:56:05.819355+0000","last_undegraded":"2024-09-05T12:56:05.819355+0000","last_fullsized":"2024-09-05T12:56:05.819355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:25:23.731384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065615+0000","last_change":"2024-09-05T12:55:43.726519+0000","last_active":"2024-09-05T12:56:05.065615+0000","last_peered":"2024-09-05T12:56:05.065615+0000","last_clean":"2024-09-05T12:56:05.065615+0000","last_became_active":"2024-09-05T12:55:43.726231+0000","last_became_peered":"2024-09-05T12:55:43.726231+0000","last_unstale":"2024-09-05T12:56:05.065615+0000","last_undegraded":"2024-09-05T12:56:05.065615+0000","last_fullsized":"2024-09-05T12:56:05.065615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:22:55.460814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676243+0000","last_change":"2024-09-05T12:55:45.739359+0000","last_active":"2024-09-05T12:56:05.676243+0000","last_peered":"2024-09-05T12:56:05.676243+0000","last_clean":"2024-09-05T12:56:05.676243+0000","last_became_active":"2024-09-05T12:55:45.738358+0000","last_became_peered":"2024-09-05T12:55:45.738358+0000","last_unstale":"2024-09-05T12:56:05.676243+0000","last_undegraded":"2024-09-05T12:56:05.676243+0000","last_fullsized":"2024-09-05T12:56:05.676243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:11:37.144174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:29.952545+0000","last_change":"2024-09-05T12:55:43.726623+0000","last_active":"2024-09-05T12:57:29.952545+0000","last_peered":"2024-09-05T12:57:29.952545+0000","last_clean":"2024-09-05T12:57:29.952545+0000","last_became_active":"2024-09-05T12:55:43.726281+0000","last_became_peered":"2024-09-05T12:55:43.726281+0000","last_unstale":"2024-09-05T12:57:29.952545+0000","last_undegraded":"2024-09-05T12:57:29.952545+0000","last_fullsized":"2024-09-05T12:57:29.952545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:59:07.503458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676010+0000","last_change":"2024-09-05T12:55:45.745731+0000","last_active":"2024-09-05T12:56:05.676010+0000","last_peered":"2024-09-05T12:56:05.676010+0000","last_clean":"2024-09-05T12:56:05.676010+0000","last_became_active":"2024-09-05T12:55:45.745399+0000","last_became_peered":"2024-09-05T12:55:45.745399+0000","last_unstale":"2024-09-05T12:56:05.676010+0000","last_undegraded":"2024-09-05T12:56:05.676010+0000","last_fullsized":"2024-09-05T12:56:05.676010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:47:44.737335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061012+0000","last_change":"2024-09-05T12:55:43.736527+0000","last_active":"2024-09-05T12:56:05.061012+0000","last_peered":"2024-09-05T12:56:05.061012+0000","last_clean":"2024-09-05T12:56:05.061012+0000","last_became_active":"2024-09-05T12:55:43.736088+0000","last_became_peered":"2024-09-05T12:55:43.736088+0000","last_unstale":"2024-09-05T12:56:05.061012+0000","last_undegraded":"2024-09-05T12:56:05.061012+0000","last_fullsized":"2024-09-05T12:56:05.061012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:14.570503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.853150+0000","last_change":"2024-09-05T12:56:05.853150+0000","last_active":"2024-09-05T12:56:05.853150+0000","last_peered":"2024-09-05T12:56:05.853150+0000","last_clean":"2024-09-05T12:56:05.853150+0000","last_became_active":"2024-09-05T12:56:05.852728+0000","last_became_peered":"2024-09-05T12:56:05.852728+0000","last_unstale":"2024-09-05T12:56:05.853150+0000","last_undegraded":"2024-09-05T12:56:05.853150+0000","last_fullsized":"2024-09-05T12:56:05.853150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:58:49.654402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062050+0000","last_change":"2024-09-05T12:55:43.726989+0000","last_active":"2024-09-05T12:56:05.062050+0000","last_peered":"2024-09-05T12:56:05.062050+0000","last_clean":"2024-09-05T12:56:05.062050+0000","last_became_active":"2024-09-05T12:55:43.726690+0000","last_became_peered":"2024-09-05T12:55:43.726690+0000","last_unstale":"2024-09-05T12:56:05.062050+0000","last_undegraded":"2024-09-05T12:56:05.062050+0000","last_fullsized":"2024-09-05T12:56:05.062050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:15:31.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059176+0000","last_change":"2024-09-05T12:55:45.754849+0000","last_active":"2024-09-05T12:56:05.059176+0000","last_peered":"2024-09-05T12:56:05.059176+0000","last_clean":"2024-09-05T12:56:05.059176+0000","last_became_active":"2024-09-05T12:55:45.754539+0000","last_became_peered":"2024-09-05T12:55:45.754539+0000","last_unstale":"2024-09-05T12:56:05.059176+0000","last_undegraded":"2024-09-05T12:56:05.059176+0000","last_fullsized":"2024-09-05T12:56:05.059176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:14:17.628561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819674+0000","last_change":"2024-09-05T12:55:43.723140+0000","last_active":"2024-09-05T12:56:05.819674+0000","last_peered":"2024-09-05T12:56:05.819674+0000","last_clean":"2024-09-05T12:56:05.819674+0000","last_became_active":"2024-09-05T12:55:43.722806+0000","last_became_peered":"2024-09-05T12:55:43.722806+0000","last_unstale":"2024-09-05T12:56:05.819674+0000","last_undegraded":"2024-09-05T12:56:05.819674+0000","last_fullsized":"2024-09-05T12:56:05.819674+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:00:30.041237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676678+0000","last_change":"2024-09-05T12:55:45.750948+0000","last_active":"2024-09-05T12:56:05.676678+0000","last_peered":"2024-09-05T12:56:05.676678+0000","last_clean":"2024-09-05T12:56:05.676678+0000","last_became_active":"2024-09-05T12:55:45.750642+0000","last_became_peered":"2024-09-05T12:55:45.750642+0000","last_unstale":"2024-09-05T12:56:05.676678+0000","last_undegraded":"2024-09-05T12:56:05.676678+0000","last_fullsized":"2024-09-05T12:56:05.676678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:17:48.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066001+0000","last_change":"2024-09-05T12:55:43.724847+0000","last_active":"2024-09-05T12:56:05.066001+0000","last_peered":"2024-09-05T12:56:05.066001+0000","last_clean":"2024-09-05T12:56:05.066001+0000","last_became_active":"2024-09-05T12:55:43.724538+0000","last_became_peered":"2024-09-05T12:55:43.724538+0000","last_unstale":"2024-09-05T12:56:05.066001+0000","last_undegraded":"2024-09-05T12:56:05.066001+0000","last_fullsized":"2024-09-05T12:56:05.066001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:13:46.011992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676407+0000","last_change":"2024-09-05T12:55:45.742080+0000","last_active":"2024-09-05T12:56:05.676407+0000","last_peered":"2024-09-05T12:56:05.676407+0000","last_clean":"2024-09-05T12:56:05.676407+0000","last_became_active":"2024-09-05T12:55:45.741749+0000","last_became_peered":"2024-09-05T12:55:45.741749+0000","last_unstale":"2024-09-05T12:56:05.676407+0000","last_undegraded":"2024-09-05T12:56:05.676407+0000","last_fullsized":"2024-09-05T12:56:05.676407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:20.597209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061670+0000","last_change":"2024-09-05T12:55:43.736856+0000","last_active":"2024-09-05T12:56:05.061670+0000","last_peered":"2024-09-05T12:56:05.061670+0000","last_clean":"2024-09-05T12:56:05.061670+0000","last_became_active":"2024-09-05T12:55:43.736490+0000","last_became_peered":"2024-09-05T12:55:43.736490+0000","last_unstale":"2024-09-05T12:56:05.061670+0000","last_undegraded":"2024-09-05T12:56:05.061670+0000","last_fullsized":"2024-09-05T12:56:05.061670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:36:55.286932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676384+0000","last_change":"2024-09-05T12:55:45.750667+0000","last_active":"2024-09-05T12:56:05.676384+0000","last_peered":"2024-09-05T12:56:05.676384+0000","last_clean":"2024-09-05T12:56:05.676384+0000","last_became_active":"2024-09-05T12:55:45.750386+0000","last_became_peered":"2024-09-05T12:55:45.750386+0000","last_unstale":"2024-09-05T12:56:05.676384+0000","last_undegraded":"2024-09-05T12:56:05.676384+0000","last_fullsized":"2024-09-05T12:56:05.676384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:32:41.443471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":333,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676394+0000","last_change":"2024-09-05T12:54:31.534043+0000","last_active":"2024-09-05T12:56:05.676394+0000","last_peered":"2024-09-05T12:56:05.676394+0000","last_clean":"2024-09-05T12:56:05.676394+0000","last_became_active":"2024-09-05T12:54:31.533610+0000","last_became_peered":"2024-09-05T12:54:31.533610+0000","last_unstale":"2024-09-05T12:56:05.676394+0000","last_undegraded":"2024-09-05T12:56:05.676394+0000","last_fullsized":"2024-09-05T12:56:05.676394+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_clean_scrub_stamp":"2024-09-05T12:51:12.506567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:30:50.399925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201941+0000","last_change":"2024-09-05T12:55:43.727743+0000","last_active":"2024-09-05T12:56:05.201941+0000","last_peered":"2024-09-05T12:56:05.201941+0000","last_clean":"2024-09-05T12:56:05.201941+0000","last_became_active":"2024-09-05T12:55:43.727333+0000","last_became_peered":"2024-09-05T12:55:43.727333+0000","last_unstale":"2024-09-05T12:56:05.201941+0000","last_undegraded":"2024-09-05T12:56:05.201941+0000","last_fullsized":"2024-09-05T12:56:05.201941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:41:21.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061274+0000","last_change":"2024-09-05T12:55:45.744268+0000","last_active":"2024-09-05T12:56:05.061274+0000","last_peered":"2024-09-05T12:56:05.061274+0000","last_clean":"2024-09-05T12:56:05.061274+0000","last_became_active":"2024-09-05T12:55:45.743976+0000","last_became_peered":"2024-09-05T12:55:45.743976+0000","last_unstale":"2024-09-05T12:56:05.061274+0000","last_undegraded":"2024-09-05T12:56:05.061274+0000","last_fullsized":"2024-09-05T12:56:05.061274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:02.568293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676247+0000","last_change":"2024-09-05T12:55:43.728853+0000","last_active":"2024-09-05T12:56:05.676247+0000","last_peered":"2024-09-05T12:56:05.676247+0000","last_clean":"2024-09-05T12:56:05.676247+0000","last_became_active":"2024-09-05T12:55:43.728559+0000","last_became_peered":"2024-09-05T12:55:43.728559+0000","last_unstale":"2024-09-05T12:56:05.676247+0000","last_undegraded":"2024-09-05T12:56:05.676247+0000","last_fullsized":"2024-09-05T12:56:05.676247+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:16:53.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819290+0000","last_change":"2024-09-05T12:55:45.748445+0000","last_active":"2024-09-05T12:56:05.819290+0000","last_peered":"2024-09-05T12:56:05.819290+0000","last_clean":"2024-09-05T12:56:05.819290+0000","last_became_active":"2024-09-05T12:55:45.748152+0000","last_became_peered":"2024-09-05T12:55:45.748152+0000","last_unstale":"2024-09-05T12:56:05.819290+0000","last_undegraded":"2024-09-05T12:56:05.819290+0000","last_fullsized":"2024-09-05T12:56:05.819290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:37:35.842555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:28.950297+0000","last_change":"2024-09-05T12:55:43.734607+0000","last_active":"2024-09-05T12:57:28.950297+0000","last_peered":"2024-09-05T12:57:28.950297+0000","last_clean":"2024-09-05T12:57:28.950297+0000","last_became_active":"2024-09-05T12:55:43.734288+0000","last_became_peered":"2024-09-05T12:55:43.734288+0000","last_unstale":"2024-09-05T12:57:28.950297+0000","last_undegraded":"2024-09-05T12:57:28.950297+0000","last_fullsized":"2024-09-05T12:57:28.950297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:40:40.350335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065590+0000","last_change":"2024-09-05T12:55:45.745622+0000","last_active":"2024-09-05T12:56:05.065590+0000","last_peered":"2024-09-05T12:56:05.065590+0000","last_clean":"2024-09-05T12:56:05.065590+0000","last_became_active":"2024-09-05T12:55:45.745282+0000","last_became_peered":"2024-09-05T12:55:45.745282+0000","last_unstale":"2024-09-05T12:56:05.065590+0000","last_undegraded":"2024-09-05T12:56:05.065590+0000","last_fullsized":"2024-09-05T12:56:05.065590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:50:19.657275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676337+0000","last_change":"2024-09-05T12:55:43.723985+0000","last_active":"2024-09-05T12:56:05.676337+0000","last_peered":"2024-09-05T12:56:05.676337+0000","last_clean":"2024-09-05T12:56:05.676337+0000","last_became_active":"2024-09-05T12:55:43.723651+0000","last_became_peered":"2024-09-05T12:55:43.723651+0000","last_unstale":"2024-09-05T12:56:05.676337+0000","last_undegraded":"2024-09-05T12:56:05.676337+0000","last_fullsized":"2024-09-05T12:56:05.676337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:10:45.723258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062115+0000","last_change":"2024-09-05T12:55:45.738603+0000","last_active":"2024-09-05T12:56:05.062115+0000","last_peered":"2024-09-05T12:56:05.062115+0000","last_clean":"2024-09-05T12:56:05.062115+0000","last_became_active":"2024-09-05T12:55:45.738299+0000","last_became_peered":"2024-09-05T12:55:45.738299+0000","last_unstale":"2024-09-05T12:56:05.062115+0000","last_undegraded":"2024-09-05T12:56:05.062115+0000","last_fullsized":"2024-09-05T12:56:05.062115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:05:28.174555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061144+0000","last_change":"2024-09-05T12:55:43.734587+0000","last_active":"2024-09-05T12:56:05.061144+0000","last_peered":"2024-09-05T12:56:05.061144+0000","last_clean":"2024-09-05T12:56:05.061144+0000","last_became_active":"2024-09-05T12:55:43.734260+0000","last_became_peered":"2024-09-05T12:55:43.734260+0000","last_unstale":"2024-09-05T12:56:05.061144+0000","last_undegraded":"2024-09-05T12:56:05.061144+0000","last_fullsized":"2024-09-05T12:56:05.061144+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:37:00.235234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062195+0000","last_change":"2024-09-05T12:55:45.740516+0000","last_active":"2024-09-05T12:56:05.062195+0000","last_peered":"2024-09-05T12:56:05.062195+0000","last_clean":"2024-09-05T12:56:05.062195+0000","last_became_active":"2024-09-05T12:55:45.740227+0000","last_became_peered":"2024-09-05T12:55:45.740227+0000","last_unstale":"2024-09-05T12:56:05.062195+0000","last_undegraded":"2024-09-05T12:56:05.062195+0000","last_fullsized":"2024-09-05T12:56:05.062195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:34:44.922326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061647+0000","last_change":"2024-09-05T12:55:43.734592+0000","last_active":"2024-09-05T12:56:05.061647+0000","last_peered":"2024-09-05T12:56:05.061647+0000","last_clean":"2024-09-05T12:56:05.061647+0000","last_became_active":"2024-09-05T12:55:43.734243+0000","last_became_peered":"2024-09-05T12:55:43.734243+0000","last_unstale":"2024-09-05T12:56:05.061647+0000","last_undegraded":"2024-09-05T12:56:05.061647+0000","last_fullsized":"2024-09-05T12:56:05.061647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:14.368806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819567+0000","last_change":"2024-09-05T12:55:45.748201+0000","last_active":"2024-09-05T12:56:05.819567+0000","last_peered":"2024-09-05T12:56:05.819567+0000","last_clean":"2024-09-05T12:56:05.819567+0000","last_became_active":"2024-09-05T12:55:45.747906+0000","last_became_peered":"2024-09-05T12:55:45.747906+0000","last_unstale":"2024-09-05T12:56:05.819567+0000","last_undegraded":"2024-09-05T12:56:05.819567+0000","last_fullsized":"2024-09-05T12:56:05.819567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:07.984589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:09.748332+0000","last_change":"2024-09-05T12:56:05.071328+0000","last_active":"2024-09-05T12:56:09.748332+0000","last_peered":"2024-09-05T12:56:09.748332+0000","last_clean":"2024-09-05T12:56:09.748332+0000","last_became_active":"2024-09-05T12:56:05.064345+0000","last_became_peered":"2024-09-05T12:56:05.064345+0000","last_unstale":"2024-09-05T12:56:09.748332+0000","last_undegraded":"2024-09-05T12:56:09.748332+0000","last_fullsized":"2024-09-05T12:56:09.748332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:30:31.850824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061601+0000","last_change":"2024-09-05T12:55:45.743225+0000","last_active":"2024-09-05T12:56:05.061601+0000","last_peered":"2024-09-05T12:56:05.061601+0000","last_clean":"2024-09-05T12:56:05.061601+0000","last_became_active":"2024-09-05T12:55:45.742923+0000","last_became_peered":"2024-09-05T12:55:45.742923+0000","last_unstale":"2024-09-05T12:56:05.061601+0000","last_undegraded":"2024-09-05T12:56:05.061601+0000","last_fullsized":"2024-09-05T12:56:05.061601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:50:09.056893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.202275+0000","last_change":"2024-09-05T12:55:43.723420+0000","last_active":"2024-09-05T12:56:05.202275+0000","last_peered":"2024-09-05T12:56:05.202275+0000","last_clean":"2024-09-05T12:56:05.202275+0000","last_became_active":"2024-09-05T12:55:43.723100+0000","last_became_peered":"2024-09-05T12:55:43.723100+0000","last_unstale":"2024-09-05T12:56:05.202275+0000","last_undegraded":"2024-09-05T12:56:05.202275+0000","last_fullsized":"2024-09-05T12:56:05.202275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:21:33.307826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.678039+0000","last_change":"2024-09-05T12:56:05.678039+0000","last_active":"2024-09-05T12:56:05.678039+0000","last_peered":"2024-09-05T12:56:05.678039+0000","last_clean":"2024-09-05T12:56:05.678039+0000","last_became_active":"2024-09-05T12:56:05.677749+0000","last_became_peered":"2024-09-05T12:56:05.677749+0000","last_unstale":"2024-09-05T12:56:05.678039+0000","last_undegraded":"2024-09-05T12:56:05.678039+0000","last_fullsized":"2024-09-05T12:56:05.678039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:47:12.770873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851620+0000","last_change":"2024-09-05T12:55:43.736075+0000","last_active":"2024-09-05T12:56:05.851620+0000","last_peered":"2024-09-05T12:56:05.851620+0000","last_clean":"2024-09-05T12:56:05.851620+0000","last_became_active":"2024-09-05T12:55:43.735808+0000","last_became_peered":"2024-09-05T12:55:43.735808+0000","last_unstale":"2024-09-05T12:56:05.851620+0000","last_undegraded":"2024-09-05T12:56:05.851620+0000","last_fullsized":"2024-09-05T12:56:05.851620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:52:25.842728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061815+0000","last_change":"2024-09-05T12:55:45.747180+0000","last_active":"2024-09-05T12:56:05.061815+0000","last_peered":"2024-09-05T12:56:05.061815+0000","last_clean":"2024-09-05T12:56:05.061815+0000","last_became_active":"2024-09-05T12:55:45.746297+0000","last_became_peered":"2024-09-05T12:55:45.746297+0000","last_unstale":"2024-09-05T12:56:05.061815+0000","last_undegraded":"2024-09-05T12:56:05.061815+0000","last_fullsized":"2024-09-05T12:56:05.061815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:24:33.657861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060711+0000","last_change":"2024-09-05T12:55:43.720054+0000","last_active":"2024-09-05T12:56:05.060711+0000","last_peered":"2024-09-05T12:56:05.060711+0000","last_clean":"2024-09-05T12:56:05.060711+0000","last_became_active":"2024-09-05T12:55:43.719762+0000","last_became_peered":"2024-09-05T12:55:43.719762+0000","last_unstale":"2024-09-05T12:56:05.060711+0000","last_undegraded":"2024-09-05T12:56:05.060711+0000","last_fullsized":"2024-09-05T12:56:05.060711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:07:57.623333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059189+0000","last_change":"2024-09-05T12:55:45.756031+0000","last_active":"2024-09-05T12:56:05.059189+0000","last_peered":"2024-09-05T12:56:05.059189+0000","last_clean":"2024-09-05T12:56:05.059189+0000","last_became_active":"2024-09-05T12:55:45.755723+0000","last_became_peered":"2024-09-05T12:55:45.755723+0000","last_unstale":"2024-09-05T12:56:05.059189+0000","last_undegraded":"2024-09-05T12:56:05.059189+0000","last_fullsized":"2024-09-05T12:56:05.059189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:26.760307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.069746+0000","last_change":"2024-09-05T12:56:05.069208+0000","last_active":"2024-09-05T12:56:05.069746+0000","last_peered":"2024-09-05T12:56:05.069746+0000","last_clean":"2024-09-05T12:56:05.069746+0000","last_became_active":"2024-09-05T12:56:05.063698+0000","last_became_peered":"2024-09-05T12:56:05.063698+0000","last_unstale":"2024-09-05T12:56:05.069746+0000","last_undegraded":"2024-09-05T12:56:05.069746+0000","last_fullsized":"2024-09-05T12:56:05.069746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:55:54.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061163+0000","last_change":"2024-09-05T12:55:45.743108+0000","last_active":"2024-09-05T12:56:05.061163+0000","last_peered":"2024-09-05T12:56:05.061163+0000","last_clean":"2024-09-05T12:56:05.061163+0000","last_became_active":"2024-09-05T12:55:45.742197+0000","last_became_peered":"2024-09-05T12:55:45.742197+0000","last_unstale":"2024-09-05T12:56:05.061163+0000","last_undegraded":"2024-09-05T12:56:05.061163+0000","last_fullsized":"2024-09-05T12:56:05.061163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:13:15.192298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061447+0000","last_change":"2024-09-05T12:55:43.725893+0000","last_active":"2024-09-05T12:56:05.061447+0000","last_peered":"2024-09-05T12:56:05.061447+0000","last_clean":"2024-09-05T12:56:05.061447+0000","last_became_active":"2024-09-05T12:55:43.725578+0000","last_became_peered":"2024-09-05T12:55:43.725578+0000","last_unstale":"2024-09-05T12:56:05.061447+0000","last_undegraded":"2024-09-05T12:56:05.061447+0000","last_fullsized":"2024-09-05T12:56:05.061447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:39.101167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676363+0000","last_change":"2024-09-05T12:55:45.746727+0000","last_active":"2024-09-05T12:56:05.676363+0000","last_peered":"2024-09-05T12:56:05.676363+0000","last_clean":"2024-09-05T12:56:05.676363+0000","last_became_active":"2024-09-05T12:55:45.746446+0000","last_became_peered":"2024-09-05T12:55:45.746446+0000","last_unstale":"2024-09-05T12:56:05.676363+0000","last_undegraded":"2024-09-05T12:56:05.676363+0000","last_fullsized":"2024-09-05T12:56:05.676363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:56:51.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065862+0000","last_change":"2024-09-05T12:55:45.750253+0000","last_active":"2024-09-05T12:56:05.065862+0000","last_peered":"2024-09-05T12:56:05.065862+0000","last_clean":"2024-09-05T12:56:05.065862+0000","last_became_active":"2024-09-05T12:55:45.749911+0000","last_became_peered":"2024-09-05T12:55:45.749911+0000","last_unstale":"2024-09-05T12:56:05.065862+0000","last_undegraded":"2024-09-05T12:56:05.065862+0000","last_fullsized":"2024-09-05T12:56:05.065862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:04:04.164858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061563+0000","last_change":"2024-09-05T12:55:43.728597+0000","last_active":"2024-09-05T12:56:05.061563+0000","last_peered":"2024-09-05T12:56:05.061563+0000","last_clean":"2024-09-05T12:56:05.061563+0000","last_became_active":"2024-09-05T12:55:43.727633+0000","last_became_peered":"2024-09-05T12:55:43.727633+0000","last_unstale":"2024-09-05T12:56:05.061563+0000","last_undegraded":"2024-09-05T12:56:05.061563+0000","last_fullsized":"2024-09-05T12:56:05.061563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:50:04.775603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851671+0000","last_change":"2024-09-05T12:55:45.741539+0000","last_active":"2024-09-05T12:56:05.851671+0000","last_peered":"2024-09-05T12:56:05.851671+0000","last_clean":"2024-09-05T12:56:05.851671+0000","last_became_active":"2024-09-05T12:55:45.741247+0000","last_became_peered":"2024-09-05T12:55:45.741247+0000","last_unstale":"2024-09-05T12:56:05.851671+0000","last_undegraded":"2024-09-05T12:56:05.851671+0000","last_fullsized":"2024-09-05T12:56:05.851671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:57:23.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061516+0000","last_change":"2024-09-05T12:55:43.725085+0000","last_active":"2024-09-05T12:56:05.061516+0000","last_peered":"2024-09-05T12:56:05.061516+0000","last_clean":"2024-09-05T12:56:05.061516+0000","last_became_active":"2024-09-05T12:55:43.724772+0000","last_became_peered":"2024-09-05T12:55:43.724772+0000","last_unstale":"2024-09-05T12:56:05.061516+0000","last_undegraded":"2024-09-05T12:56:05.061516+0000","last_fullsized":"2024-09-05T12:56:05.061516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:48:16.567841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063834+0000","last_change":"2024-09-05T12:55:45.745635+0000","last_active":"2024-09-05T12:56:05.063834+0000","last_peered":"2024-09-05T12:56:05.063834+0000","last_clean":"2024-09-05T12:56:05.063834+0000","last_became_active":"2024-09-05T12:55:45.745331+0000","last_became_peered":"2024-09-05T12:55:45.745331+0000","last_unstale":"2024-09-05T12:56:05.063834+0000","last_undegraded":"2024-09-05T12:56:05.063834+0000","last_fullsized":"2024-09-05T12:56:05.063834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:15:58.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061048+0000","last_change":"2024-09-05T12:55:43.734466+0000","last_active":"2024-09-05T12:56:05.061048+0000","last_peered":"2024-09-05T12:56:05.061048+0000","last_clean":"2024-09-05T12:56:05.061048+0000","last_became_active":"2024-09-05T12:55:43.734147+0000","last_became_peered":"2024-09-05T12:55:43.734147+0000","last_unstale":"2024-09-05T12:56:05.061048+0000","last_undegraded":"2024-09-05T12:56:05.061048+0000","last_fullsized":"2024-09-05T12:56:05.061048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:53:22.588471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060906+0000","last_change":"2024-09-05T12:55:45.746328+0000","last_active":"2024-09-05T12:56:05.060906+0000","last_peered":"2024-09-05T12:56:05.060906+0000","last_clean":"2024-09-05T12:56:05.060906+0000","last_became_active":"2024-09-05T12:55:45.746012+0000","last_became_peered":"2024-09-05T12:55:45.746012+0000","last_unstale":"2024-09-05T12:56:05.060906+0000","last_undegraded":"2024-09-05T12:56:05.060906+0000","last_fullsized":"2024-09-05T12:56:05.060906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:23:12.886759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061386+0000","last_change":"2024-09-05T12:55:43.722519+0000","last_active":"2024-09-05T12:56:05.061386+0000","last_peered":"2024-09-05T12:56:05.061386+0000","last_clean":"2024-09-05T12:56:05.061386+0000","last_became_active":"2024-09-05T12:55:43.722220+0000","last_became_peered":"2024-09-05T12:55:43.722220+0000","last_unstale":"2024-09-05T12:56:05.061386+0000","last_undegraded":"2024-09-05T12:56:05.061386+0000","last_fullsized":"2024-09-05T12:56:05.061386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:15.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":597,"num_read_kb":364,"num_write":161,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":195923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281587,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":425477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":1076722,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":425713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234034,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":1017565,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":425102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855425,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1017249,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":425539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":425413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":491024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":484659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":426373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T12:57:33.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T12:57:33.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1422741780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6ec0ffdf0 msgr2=0x7fd6ec1001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 --2- 172.21.15.73:0/1422741780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6ec0ffdf0 0x7fd6ec1001f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009900 tx=0x7fd6e002a410 comp rx=0 tx=0).stop 2024-09-05T12:57:33.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1422741780 shutdown_connections 2024-09-05T12:57:33.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 --2- 172.21.15.73:0/1422741780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec103780 0x7fd6ec10a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 --2- 172.21.15.73:0/1422741780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ec102dc0 0x7fd6ec103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 --2- 172.21.15.73:0/1422741780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6ec0ffdf0 0x7fd6ec1001f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1422741780 >> 172.21.15.73:0/1422741780 conn(0x7fd6ec0fb910 msgr2=0x7fd6ec0fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1422741780 shutdown_connections 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1422741780 wait complete. 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 Processor -- start 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.519+0000 7fd6f2aa6640 1 -- start start 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f2aa6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ec0ffdf0 0x7fd6ec19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f2aa6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec102dc0 0x7fd6ec19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f2aa6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6ec103780 0x7fd6ec1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f2aa6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec10d7c0 con 0x7fd6ec103780 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f2aa6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec10d640 con 0x7fd6ec0ffdf0 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f2aa6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec10d940 con 0x7fd6ec102dc0 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f1043640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6ec103780 0x7fd6ec1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f1043640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6ec103780 0x7fd6ec1a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35908/0 (socket says 172.21.15.73:35908) 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f1043640 1 -- 172.21.15.73:0/1119229529 learned_addr learned my addr 172.21.15.73:0/1119229529 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:33.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6ebfff640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec102dc0 0x7fd6ec19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f0842640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ec0ffdf0 0x7fd6ec19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f1043640 1 -- 172.21.15.73:0/1119229529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec102dc0 msgr2=0x7fd6ec19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f1043640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec102dc0 0x7fd6ec19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f1043640 1 -- 172.21.15.73:0/1119229529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ec0ffdf0 msgr2=0x7fd6ec19a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f1043640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ec0ffdf0 0x7fd6ec19a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f1043640 1 -- 172.21.15.73:0/1119229529 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ec1a1d10 con 0x7fd6ec103780 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f1043640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6ec103780 0x7fd6ec1a16a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400eaa0 tx=0x7fd6e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6e9ffb640 1 -- 172.21.15.73:0/1119229529 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e400cdb0 con 0x7fd6ec103780 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6e9ffb640 1 -- 172.21.15.73:0/1119229529 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6e4005020 con 0x7fd6ec103780 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1119229529 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ec1a1fa0 con 0x7fd6ec103780 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.520+0000 7fd6e9ffb640 1 -- 172.21.15.73:0/1119229529 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40116b0 con 0x7fd6ec103780 2024-09-05T12:57:33.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.521+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1119229529 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ec1a2510 con 0x7fd6ec103780 2024-09-05T12:57:33.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.522+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1119229529 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6ec1a27d0 con 0x7fd6ec103780 2024-09-05T12:57:33.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.523+0000 7fd6e9ffb640 1 -- 172.21.15.73:0/1119229529 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd6e4005560 con 0x7fd6ec103780 2024-09-05T12:57:33.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.523+0000 7fd6e9ffb640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6dc0a2ca0 0x7fd6dc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.523+0000 7fd6f0842640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6dc0a2ca0 0x7fd6dc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.523+0000 7fd6e9ffb640 1 -- 172.21.15.73:0/1119229529 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd6e40cf2a0 con 0x7fd6ec103780 2024-09-05T12:57:33.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.524+0000 7fd6f0842640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6dc0a2ca0 0x7fd6dc0a5160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009230 tx=0x7fd6e00315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:33.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.527+0000 7fd6e9ffb640 1 -- 172.21.15.73:0/1119229529 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6e4016030 con 0x7fd6ec103780 2024-09-05T12:57:33.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.694+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1119229529 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6ec1a29a0 con 0x7fd6dc0a2ca0 2024-09-05T12:57:33.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.700+0000 7fd6e9ffb640 1 -- 172.21.15.73:0/1119229529 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258875 (secure 0 0 0) 0x7fd6ec1a29a0 con 0x7fd6dc0a2ca0 2024-09-05T12:57:33.704 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:33.705 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1119229529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6dc0a2ca0 msgr2=0x7fd6dc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6dc0a2ca0 0x7fd6dc0a5160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009230 tx=0x7fd6e00315b0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1119229529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6ec103780 msgr2=0x7fd6ec1a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6ec103780 0x7fd6ec1a16a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400eaa0 tx=0x7fd6e400ef60 comp rx=0 tx=0).stop 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1119229529 shutdown_connections 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6dc0a2ca0 0x7fd6dc0a5160 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6ec103780 0x7fd6ec1a16a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec102dc0 0x7fd6ec19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 --2- 172.21.15.73:0/1119229529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ec0ffdf0 0x7fd6ec19a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1119229529 >> 172.21.15.73:0/1119229529 conn(0x7fd6ec0fb910 msgr2=0x7fd6ec108630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1119229529 shutdown_connections 2024-09-05T12:57:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.703+0000 7fd6f2aa6640 1 -- 172.21.15.73:0/1119229529 wait complete. 2024-09-05T12:57:33.716 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-05T12:57:31.999000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":723,"num_read_kb":473,"num_write":344,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351668,"kb_used_data":10708,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590156,"statfs":{"total":1151940427776,"available":1151580319744,"internally_reserved":0,"allocated":10964992,"data_stored":7066469,"data_compressed":107439,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003202"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059332+0000","last_change":"2024-09-05T12:55:45.753801+0000","last_active":"2024-09-05T12:56:05.059332+0000","last_peered":"2024-09-05T12:56:05.059332+0000","last_clean":"2024-09-05T12:56:05.059332+0000","last_became_active":"2024-09-05T12:55:45.753480+0000","last_became_peered":"2024-09-05T12:55:45.753480+0000","last_unstale":"2024-09-05T12:56:05.059332+0000","last_undegraded":"2024-09-05T12:56:05.059332+0000","last_fullsized":"2024-09-05T12:56:05.059332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:34.806083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063464+0000","last_change":"2024-09-05T12:55:45.744629+0000","last_active":"2024-09-05T12:56:05.063464+0000","last_peered":"2024-09-05T12:56:05.063464+0000","last_clean":"2024-09-05T12:56:05.063464+0000","last_became_active":"2024-09-05T12:55:45.744311+0000","last_became_peered":"2024-09-05T12:55:45.744311+0000","last_unstale":"2024-09-05T12:56:05.063464+0000","last_undegraded":"2024-09-05T12:56:05.063464+0000","last_fullsized":"2024-09-05T12:56:05.063464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:08:57.032929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063504+0000","last_change":"2024-09-05T12:55:45.745128+0000","last_active":"2024-09-05T12:56:05.063504+0000","last_peered":"2024-09-05T12:56:05.063504+0000","last_clean":"2024-09-05T12:56:05.063504+0000","last_became_active":"2024-09-05T12:55:45.744799+0000","last_became_peered":"2024-09-05T12:55:45.744799+0000","last_unstale":"2024-09-05T12:56:05.063504+0000","last_undegraded":"2024-09-05T12:56:05.063504+0000","last_fullsized":"2024-09-05T12:56:05.063504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:35:48.528336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201949+0000","last_change":"2024-09-05T12:55:45.749471+0000","last_active":"2024-09-05T12:56:05.201949+0000","last_peered":"2024-09-05T12:56:05.201949+0000","last_clean":"2024-09-05T12:56:05.201949+0000","last_became_active":"2024-09-05T12:55:45.749126+0000","last_became_peered":"2024-09-05T12:55:45.749126+0000","last_unstale":"2024-09-05T12:56:05.201949+0000","last_undegraded":"2024-09-05T12:56:05.201949+0000","last_fullsized":"2024-09-05T12:56:05.201949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:36.152934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061325+0000","last_change":"2024-09-05T12:55:45.741243+0000","last_active":"2024-09-05T12:56:05.061325+0000","last_peered":"2024-09-05T12:56:05.061325+0000","last_clean":"2024-09-05T12:56:05.061325+0000","last_became_active":"2024-09-05T12:55:45.740849+0000","last_became_peered":"2024-09-05T12:55:45.740849+0000","last_unstale":"2024-09-05T12:56:05.061325+0000","last_undegraded":"2024-09-05T12:56:05.061325+0000","last_fullsized":"2024-09-05T12:56:05.061325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:01.323875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061912+0000","last_change":"2024-09-05T12:55:45.744599+0000","last_active":"2024-09-05T12:56:05.061912+0000","last_peered":"2024-09-05T12:56:05.061912+0000","last_clean":"2024-09-05T12:56:05.061912+0000","last_became_active":"2024-09-05T12:55:45.744304+0000","last_became_peered":"2024-09-05T12:55:45.744304+0000","last_unstale":"2024-09-05T12:56:05.061912+0000","last_undegraded":"2024-09-05T12:56:05.061912+0000","last_fullsized":"2024-09-05T12:56:05.061912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:15:55.340505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676096+0000","last_change":"2024-09-05T12:55:45.744802+0000","last_active":"2024-09-05T12:56:05.676096+0000","last_peered":"2024-09-05T12:56:05.676096+0000","last_clean":"2024-09-05T12:56:05.676096+0000","last_became_active":"2024-09-05T12:55:45.744525+0000","last_became_peered":"2024-09-05T12:55:45.744525+0000","last_unstale":"2024-09-05T12:56:05.676096+0000","last_undegraded":"2024-09-05T12:56:05.676096+0000","last_fullsized":"2024-09-05T12:56:05.676096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:03:04.047389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060470+0000","last_change":"2024-09-05T12:55:45.742141+0000","last_active":"2024-09-05T12:56:05.060470+0000","last_peered":"2024-09-05T12:56:05.060470+0000","last_clean":"2024-09-05T12:56:05.060470+0000","last_became_active":"2024-09-05T12:55:45.741445+0000","last_became_peered":"2024-09-05T12:55:45.741445+0000","last_unstale":"2024-09-05T12:56:05.060470+0000","last_undegraded":"2024-09-05T12:56:05.060470+0000","last_fullsized":"2024-09-05T12:56:05.060470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:38:28.859589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.852099+0000","last_change":"2024-09-05T12:55:45.747321+0000","last_active":"2024-09-05T12:56:05.852099+0000","last_peered":"2024-09-05T12:56:05.852099+0000","last_clean":"2024-09-05T12:56:05.852099+0000","last_became_active":"2024-09-05T12:55:45.747013+0000","last_became_peered":"2024-09-05T12:55:45.747013+0000","last_unstale":"2024-09-05T12:56:05.852099+0000","last_undegraded":"2024-09-05T12:56:05.852099+0000","last_fullsized":"2024-09-05T12:56:05.852099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:42:00.402789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064498+0000","last_change":"2024-09-05T12:56:05.064498+0000","last_active":"2024-09-05T12:56:05.064498+0000","last_peered":"2024-09-05T12:56:05.064498+0000","last_clean":"2024-09-05T12:56:05.064498+0000","last_became_active":"2024-09-05T12:56:05.064200+0000","last_became_peered":"2024-09-05T12:56:05.064200+0000","last_unstale":"2024-09-05T12:56:05.064498+0000","last_undegraded":"2024-09-05T12:56:05.064498+0000","last_fullsized":"2024-09-05T12:56:05.064498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:37:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676376+0000","last_change":"2024-09-05T12:55:45.748372+0000","last_active":"2024-09-05T12:56:05.676376+0000","last_peered":"2024-09-05T12:56:05.676376+0000","last_clean":"2024-09-05T12:56:05.676376+0000","last_became_active":"2024-09-05T12:55:45.748093+0000","last_became_peered":"2024-09-05T12:55:45.748093+0000","last_unstale":"2024-09-05T12:56:05.676376+0000","last_undegraded":"2024-09-05T12:56:05.676376+0000","last_fullsized":"2024-09-05T12:56:05.676376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:32:25.938128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201978+0000","last_change":"2024-09-05T12:55:45.749433+0000","last_active":"2024-09-05T12:56:05.201978+0000","last_peered":"2024-09-05T12:56:05.201978+0000","last_clean":"2024-09-05T12:56:05.201978+0000","last_became_active":"2024-09-05T12:55:45.748677+0000","last_became_peered":"2024-09-05T12:55:45.748677+0000","last_unstale":"2024-09-05T12:56:05.201978+0000","last_undegraded":"2024-09-05T12:56:05.201978+0000","last_fullsized":"2024-09-05T12:56:05.201978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:27:57.896752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819602+0000","last_change":"2024-09-05T12:55:45.743212+0000","last_active":"2024-09-05T12:56:05.819602+0000","last_peered":"2024-09-05T12:56:05.819602+0000","last_clean":"2024-09-05T12:56:05.819602+0000","last_became_active":"2024-09-05T12:55:45.742918+0000","last_became_peered":"2024-09-05T12:55:45.742918+0000","last_unstale":"2024-09-05T12:56:05.819602+0000","last_undegraded":"2024-09-05T12:56:05.819602+0000","last_fullsized":"2024-09-05T12:56:05.819602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:21:18.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063680+0000","last_change":"2024-09-05T12:55:45.745058+0000","last_active":"2024-09-05T12:56:05.063680+0000","last_peered":"2024-09-05T12:56:05.063680+0000","last_clean":"2024-09-05T12:56:05.063680+0000","last_became_active":"2024-09-05T12:55:45.744349+0000","last_became_peered":"2024-09-05T12:55:45.744349+0000","last_unstale":"2024-09-05T12:56:05.063680+0000","last_undegraded":"2024-09-05T12:56:05.063680+0000","last_fullsized":"2024-09-05T12:56:05.063680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:26:21.034864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063126+0000","last_change":"2024-09-05T12:55:45.748387+0000","last_active":"2024-09-05T12:56:05.063126+0000","last_peered":"2024-09-05T12:56:05.063126+0000","last_clean":"2024-09-05T12:56:05.063126+0000","last_became_active":"2024-09-05T12:55:45.748082+0000","last_became_peered":"2024-09-05T12:55:45.748082+0000","last_unstale":"2024-09-05T12:56:05.063126+0000","last_undegraded":"2024-09-05T12:56:05.063126+0000","last_fullsized":"2024-09-05T12:56:05.063126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:51:23.835278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851526+0000","last_change":"2024-09-05T12:55:45.742195+0000","last_active":"2024-09-05T12:56:05.851526+0000","last_peered":"2024-09-05T12:56:05.851526+0000","last_clean":"2024-09-05T12:56:05.851526+0000","last_became_active":"2024-09-05T12:55:45.741888+0000","last_became_peered":"2024-09-05T12:55:45.741888+0000","last_unstale":"2024-09-05T12:56:05.851526+0000","last_undegraded":"2024-09-05T12:56:05.851526+0000","last_fullsized":"2024-09-05T12:56:05.851526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:19:17.556164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059394+0000","last_change":"2024-09-05T12:55:45.755255+0000","last_active":"2024-09-05T12:56:05.059394+0000","last_peered":"2024-09-05T12:56:05.059394+0000","last_clean":"2024-09-05T12:56:05.059394+0000","last_became_active":"2024-09-05T12:55:45.754939+0000","last_became_peered":"2024-09-05T12:55:45.754939+0000","last_unstale":"2024-09-05T12:56:05.059394+0000","last_undegraded":"2024-09-05T12:56:05.059394+0000","last_fullsized":"2024-09-05T12:56:05.059394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:48:34.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061596+0000","last_change":"2024-09-05T12:55:45.745496+0000","last_active":"2024-09-05T12:56:05.061596+0000","last_peered":"2024-09-05T12:56:05.061596+0000","last_clean":"2024-09-05T12:56:05.061596+0000","last_became_active":"2024-09-05T12:55:45.745153+0000","last_became_peered":"2024-09-05T12:55:45.745153+0000","last_unstale":"2024-09-05T12:56:05.061596+0000","last_undegraded":"2024-09-05T12:56:05.061596+0000","last_fullsized":"2024-09-05T12:56:05.061596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:16:52.255227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062235+0000","last_change":"2024-09-05T12:55:45.747353+0000","last_active":"2024-09-05T12:56:05.062235+0000","last_peered":"2024-09-05T12:56:05.062235+0000","last_clean":"2024-09-05T12:56:05.062235+0000","last_became_active":"2024-09-05T12:55:45.747018+0000","last_became_peered":"2024-09-05T12:55:45.747018+0000","last_unstale":"2024-09-05T12:56:05.062235+0000","last_undegraded":"2024-09-05T12:56:05.062235+0000","last_fullsized":"2024-09-05T12:56:05.062235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:12:25.217057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059013+0000","last_change":"2024-09-05T12:55:45.754023+0000","last_active":"2024-09-05T12:56:05.059013+0000","last_peered":"2024-09-05T12:56:05.059013+0000","last_clean":"2024-09-05T12:56:05.059013+0000","last_became_active":"2024-09-05T12:55:45.753723+0000","last_became_peered":"2024-09-05T12:55:45.753723+0000","last_unstale":"2024-09-05T12:56:05.059013+0000","last_undegraded":"2024-09-05T12:56:05.059013+0000","last_fullsized":"2024-09-05T12:56:05.059013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:16:01.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819690+0000","last_change":"2024-09-05T12:55:45.742627+0000","last_active":"2024-09-05T12:56:05.819690+0000","last_peered":"2024-09-05T12:56:05.819690+0000","last_clean":"2024-09-05T12:56:05.819690+0000","last_became_active":"2024-09-05T12:55:45.742252+0000","last_became_peered":"2024-09-05T12:55:45.742252+0000","last_unstale":"2024-09-05T12:56:05.819690+0000","last_undegraded":"2024-09-05T12:56:05.819690+0000","last_fullsized":"2024-09-05T12:56:05.819690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:14:34.476156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851781+0000","last_change":"2024-09-05T12:55:45.743587+0000","last_active":"2024-09-05T12:56:05.851781+0000","last_peered":"2024-09-05T12:56:05.851781+0000","last_clean":"2024-09-05T12:56:05.851781+0000","last_became_active":"2024-09-05T12:55:45.742624+0000","last_became_peered":"2024-09-05T12:55:45.742624+0000","last_unstale":"2024-09-05T12:56:05.851781+0000","last_undegraded":"2024-09-05T12:56:05.851781+0000","last_fullsized":"2024-09-05T12:56:05.851781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:15.981929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060563+0000","last_change":"2024-09-05T12:55:45.747430+0000","last_active":"2024-09-05T12:56:05.060563+0000","last_peered":"2024-09-05T12:56:05.060563+0000","last_clean":"2024-09-05T12:56:05.060563+0000","last_became_active":"2024-09-05T12:55:45.747049+0000","last_became_peered":"2024-09-05T12:55:45.747049+0000","last_unstale":"2024-09-05T12:56:05.060563+0000","last_undegraded":"2024-09-05T12:56:05.060563+0000","last_fullsized":"2024-09-05T12:56:05.060563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:31:08.388375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065470+0000","last_change":"2024-09-05T12:55:45.741645+0000","last_active":"2024-09-05T12:56:05.065470+0000","last_peered":"2024-09-05T12:56:05.065470+0000","last_clean":"2024-09-05T12:56:05.065470+0000","last_became_active":"2024-09-05T12:55:45.741341+0000","last_became_peered":"2024-09-05T12:55:45.741341+0000","last_unstale":"2024-09-05T12:56:05.065470+0000","last_undegraded":"2024-09-05T12:56:05.065470+0000","last_fullsized":"2024-09-05T12:56:05.065470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:24:11.896491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061589+0000","last_change":"2024-09-05T12:55:45.747609+0000","last_active":"2024-09-05T12:56:05.061589+0000","last_peered":"2024-09-05T12:56:05.061589+0000","last_clean":"2024-09-05T12:56:05.061589+0000","last_became_active":"2024-09-05T12:55:45.745899+0000","last_became_peered":"2024-09-05T12:55:45.745899+0000","last_unstale":"2024-09-05T12:56:05.061589+0000","last_undegraded":"2024-09-05T12:56:05.061589+0000","last_fullsized":"2024-09-05T12:56:05.061589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:21:42.224663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061958+0000","last_change":"2024-09-05T12:55:45.744974+0000","last_active":"2024-09-05T12:56:05.061958+0000","last_peered":"2024-09-05T12:56:05.061958+0000","last_clean":"2024-09-05T12:56:05.061958+0000","last_became_active":"2024-09-05T12:55:45.744538+0000","last_became_peered":"2024-09-05T12:55:45.744538+0000","last_unstale":"2024-09-05T12:56:05.061958+0000","last_undegraded":"2024-09-05T12:56:05.061958+0000","last_fullsized":"2024-09-05T12:56:05.061958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:48:46.695178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064626+0000","last_change":"2024-09-05T12:56:05.064626+0000","last_active":"2024-09-05T12:56:05.064626+0000","last_peered":"2024-09-05T12:56:05.064626+0000","last_clean":"2024-09-05T12:56:05.064626+0000","last_became_active":"2024-09-05T12:56:05.063972+0000","last_became_peered":"2024-09-05T12:56:05.063972+0000","last_unstale":"2024-09-05T12:56:05.064626+0000","last_undegraded":"2024-09-05T12:56:05.064626+0000","last_fullsized":"2024-09-05T12:56:05.064626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:57.345008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819769+0000","last_change":"2024-09-05T12:55:45.753630+0000","last_active":"2024-09-05T12:56:05.819769+0000","last_peered":"2024-09-05T12:56:05.819769+0000","last_clean":"2024-09-05T12:56:05.819769+0000","last_became_active":"2024-09-05T12:55:45.753328+0000","last_became_peered":"2024-09-05T12:55:45.753328+0000","last_unstale":"2024-09-05T12:56:05.819769+0000","last_undegraded":"2024-09-05T12:56:05.819769+0000","last_fullsized":"2024-09-05T12:56:05.819769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:55:39.064374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063372+0000","last_change":"2024-09-05T12:55:45.749596+0000","last_active":"2024-09-05T12:56:05.063372+0000","last_peered":"2024-09-05T12:56:05.063372+0000","last_clean":"2024-09-05T12:56:05.063372+0000","last_became_active":"2024-09-05T12:55:45.749150+0000","last_became_peered":"2024-09-05T12:55:45.749150+0000","last_unstale":"2024-09-05T12:56:05.063372+0000","last_undegraded":"2024-09-05T12:56:05.063372+0000","last_fullsized":"2024-09-05T12:56:05.063372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:14:06.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062144+0000","last_change":"2024-09-05T12:55:45.748414+0000","last_active":"2024-09-05T12:56:05.062144+0000","last_peered":"2024-09-05T12:56:05.062144+0000","last_clean":"2024-09-05T12:56:05.062144+0000","last_became_active":"2024-09-05T12:55:45.747952+0000","last_became_peered":"2024-09-05T12:55:45.747952+0000","last_unstale":"2024-09-05T12:56:05.062144+0000","last_undegraded":"2024-09-05T12:56:05.062144+0000","last_fullsized":"2024-09-05T12:56:05.062144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:45:04.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061467+0000","last_change":"2024-09-05T12:55:45.754145+0000","last_active":"2024-09-05T12:56:05.061467+0000","last_peered":"2024-09-05T12:56:05.061467+0000","last_clean":"2024-09-05T12:56:05.061467+0000","last_became_active":"2024-09-05T12:55:45.753833+0000","last_became_peered":"2024-09-05T12:55:45.753833+0000","last_unstale":"2024-09-05T12:56:05.061467+0000","last_undegraded":"2024-09-05T12:56:05.061467+0000","last_fullsized":"2024-09-05T12:56:05.061467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:45:24.606506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.058922+0000","last_change":"2024-09-05T12:55:45.750283+0000","last_active":"2024-09-05T12:56:05.058922+0000","last_peered":"2024-09-05T12:56:05.058922+0000","last_clean":"2024-09-05T12:56:05.058922+0000","last_became_active":"2024-09-05T12:55:45.749901+0000","last_became_peered":"2024-09-05T12:55:45.749901+0000","last_unstale":"2024-09-05T12:56:05.058922+0000","last_undegraded":"2024-09-05T12:56:05.058922+0000","last_fullsized":"2024-09-05T12:56:05.058922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:45:57.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061784+0000","last_change":"2024-09-05T12:55:45.743239+0000","last_active":"2024-09-05T12:56:05.061784+0000","last_peered":"2024-09-05T12:56:05.061784+0000","last_clean":"2024-09-05T12:56:05.061784+0000","last_became_active":"2024-09-05T12:55:45.742926+0000","last_became_peered":"2024-09-05T12:55:45.742926+0000","last_unstale":"2024-09-05T12:56:05.061784+0000","last_undegraded":"2024-09-05T12:56:05.061784+0000","last_fullsized":"2024-09-05T12:56:05.061784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:26:05.559405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:29.948209+0000","last_change":"2024-09-05T12:55:43.727301+0000","last_active":"2024-09-05T12:57:29.948209+0000","last_peered":"2024-09-05T12:57:29.948209+0000","last_clean":"2024-09-05T12:57:29.948209+0000","last_became_active":"2024-09-05T12:55:43.727006+0000","last_became_peered":"2024-09-05T12:55:43.727006+0000","last_unstale":"2024-09-05T12:57:29.948209+0000","last_undegraded":"2024-09-05T12:57:29.948209+0000","last_fullsized":"2024-09-05T12:57:29.948209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:54:32.725098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066620+0000","last_change":"2024-09-05T12:55:45.735835+0000","last_active":"2024-09-05T12:56:05.066620+0000","last_peered":"2024-09-05T12:56:05.066620+0000","last_clean":"2024-09-05T12:56:05.066620+0000","last_became_active":"2024-09-05T12:55:45.735404+0000","last_became_peered":"2024-09-05T12:55:45.735404+0000","last_unstale":"2024-09-05T12:56:05.066620+0000","last_undegraded":"2024-09-05T12:56:05.066620+0000","last_fullsized":"2024-09-05T12:56:05.066620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:06:47.174441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062007+0000","last_change":"2024-09-05T12:55:43.724561+0000","last_active":"2024-09-05T12:56:05.062007+0000","last_peered":"2024-09-05T12:56:05.062007+0000","last_clean":"2024-09-05T12:56:05.062007+0000","last_became_active":"2024-09-05T12:55:43.722704+0000","last_became_peered":"2024-09-05T12:55:43.722704+0000","last_unstale":"2024-09-05T12:56:05.062007+0000","last_undegraded":"2024-09-05T12:56:05.062007+0000","last_fullsized":"2024-09-05T12:56:05.062007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:20:20.692844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819297+0000","last_change":"2024-09-05T12:55:43.722937+0000","last_active":"2024-09-05T12:56:05.819297+0000","last_peered":"2024-09-05T12:56:05.819297+0000","last_clean":"2024-09-05T12:56:05.819297+0000","last_became_active":"2024-09-05T12:55:43.722606+0000","last_became_peered":"2024-09-05T12:55:43.722606+0000","last_unstale":"2024-09-05T12:56:05.819297+0000","last_undegraded":"2024-09-05T12:56:05.819297+0000","last_fullsized":"2024-09-05T12:56:05.819297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:47:38.448865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.820632+0000","last_change":"2024-09-05T12:56:05.820632+0000","last_active":"2024-09-05T12:56:05.820632+0000","last_peered":"2024-09-05T12:56:05.820632+0000","last_clean":"2024-09-05T12:56:05.820632+0000","last_became_active":"2024-09-05T12:56:05.820239+0000","last_became_peered":"2024-09-05T12:56:05.820239+0000","last_unstale":"2024-09-05T12:56:05.820632+0000","last_undegraded":"2024-09-05T12:56:05.820632+0000","last_fullsized":"2024-09-05T12:56:05.820632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:36:59.659783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065764+0000","last_change":"2024-09-05T12:55:43.725546+0000","last_active":"2024-09-05T12:56:05.065764+0000","last_peered":"2024-09-05T12:56:05.065764+0000","last_clean":"2024-09-05T12:56:05.065764+0000","last_became_active":"2024-09-05T12:55:43.725252+0000","last_became_peered":"2024-09-05T12:55:43.725252+0000","last_unstale":"2024-09-05T12:56:05.065764+0000","last_undegraded":"2024-09-05T12:56:05.065764+0000","last_fullsized":"2024-09-05T12:56:05.065764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:49:16.085799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060968+0000","last_change":"2024-09-05T12:55:45.745358+0000","last_active":"2024-09-05T12:56:05.060968+0000","last_peered":"2024-09-05T12:56:05.060968+0000","last_clean":"2024-09-05T12:56:05.060968+0000","last_became_active":"2024-09-05T12:55:45.745040+0000","last_became_peered":"2024-09-05T12:55:45.745040+0000","last_unstale":"2024-09-05T12:56:05.060968+0000","last_undegraded":"2024-09-05T12:56:05.060968+0000","last_fullsized":"2024-09-05T12:56:05.060968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:42:42.906745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:27.944124+0000","last_change":"2024-09-05T12:55:43.726138+0000","last_active":"2024-09-05T12:57:27.944124+0000","last_peered":"2024-09-05T12:57:27.944124+0000","last_clean":"2024-09-05T12:57:27.944124+0000","last_became_active":"2024-09-05T12:55:43.725815+0000","last_became_peered":"2024-09-05T12:55:43.725815+0000","last_unstale":"2024-09-05T12:57:27.944124+0000","last_undegraded":"2024-09-05T12:57:27.944124+0000","last_fullsized":"2024-09-05T12:57:27.944124+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:35:38.041757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851996+0000","last_change":"2024-09-05T12:55:45.743580+0000","last_active":"2024-09-05T12:56:05.851996+0000","last_peered":"2024-09-05T12:56:05.851996+0000","last_clean":"2024-09-05T12:56:05.851996+0000","last_became_active":"2024-09-05T12:55:45.743307+0000","last_became_peered":"2024-09-05T12:55:45.743307+0000","last_unstale":"2024-09-05T12:56:05.851996+0000","last_undegraded":"2024-09-05T12:56:05.851996+0000","last_fullsized":"2024-09-05T12:56:05.851996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:15:13.898218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676632+0000","last_change":"2024-09-05T12:55:43.725373+0000","last_active":"2024-09-05T12:56:05.676632+0000","last_peered":"2024-09-05T12:56:05.676632+0000","last_clean":"2024-09-05T12:56:05.676632+0000","last_became_active":"2024-09-05T12:55:43.725062+0000","last_became_peered":"2024-09-05T12:55:43.725062+0000","last_unstale":"2024-09-05T12:56:05.676632+0000","last_undegraded":"2024-09-05T12:56:05.676632+0000","last_fullsized":"2024-09-05T12:56:05.676632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:42:27.994499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063879+0000","last_change":"2024-09-05T12:55:45.750265+0000","last_active":"2024-09-05T12:56:05.063879+0000","last_peered":"2024-09-05T12:56:05.063879+0000","last_clean":"2024-09-05T12:56:05.063879+0000","last_became_active":"2024-09-05T12:55:45.749928+0000","last_became_peered":"2024-09-05T12:55:45.749928+0000","last_unstale":"2024-09-05T12:56:05.063879+0000","last_undegraded":"2024-09-05T12:56:05.063879+0000","last_fullsized":"2024-09-05T12:56:05.063879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:56:19.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065937+0000","last_change":"2024-09-05T12:55:43.736248+0000","last_active":"2024-09-05T12:56:05.065937+0000","last_peered":"2024-09-05T12:56:05.065937+0000","last_clean":"2024-09-05T12:56:05.065937+0000","last_became_active":"2024-09-05T12:55:43.735928+0000","last_became_peered":"2024-09-05T12:55:43.735928+0000","last_unstale":"2024-09-05T12:56:05.065937+0000","last_undegraded":"2024-09-05T12:56:05.065937+0000","last_fullsized":"2024-09-05T12:56:05.065937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:04:43.215616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851777+0000","last_change":"2024-09-05T12:55:45.739178+0000","last_active":"2024-09-05T12:56:05.851777+0000","last_peered":"2024-09-05T12:56:05.851777+0000","last_clean":"2024-09-05T12:56:05.851777+0000","last_became_active":"2024-09-05T12:55:45.738863+0000","last_became_peered":"2024-09-05T12:55:45.738863+0000","last_unstale":"2024-09-05T12:56:05.851777+0000","last_undegraded":"2024-09-05T12:56:05.851777+0000","last_fullsized":"2024-09-05T12:56:05.851777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:08.273036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":247,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:28.945735+0000","last_change":"2024-09-05T12:55:43.725380+0000","last_active":"2024-09-05T12:57:28.945735+0000","last_peered":"2024-09-05T12:57:28.945735+0000","last_clean":"2024-09-05T12:57:28.945735+0000","last_became_active":"2024-09-05T12:55:43.725000+0000","last_became_peered":"2024-09-05T12:55:43.725000+0000","last_unstale":"2024-09-05T12:57:28.945735+0000","last_undegraded":"2024-09-05T12:57:28.945735+0000","last_fullsized":"2024-09-05T12:57:28.945735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:34:13.288894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":156,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061405+0000","last_change":"2024-09-05T12:55:45.742269+0000","last_active":"2024-09-05T12:56:05.061405+0000","last_peered":"2024-09-05T12:56:05.061405+0000","last_clean":"2024-09-05T12:56:05.061405+0000","last_became_active":"2024-09-05T12:55:45.741723+0000","last_became_peered":"2024-09-05T12:55:45.741723+0000","last_unstale":"2024-09-05T12:56:05.061405+0000","last_undegraded":"2024-09-05T12:56:05.061405+0000","last_fullsized":"2024-09-05T12:56:05.061405+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:39.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061771+0000","last_change":"2024-09-05T12:55:43.723725+0000","last_active":"2024-09-05T12:56:05.061771+0000","last_peered":"2024-09-05T12:56:05.061771+0000","last_clean":"2024-09-05T12:56:05.061771+0000","last_became_active":"2024-09-05T12:55:43.723351+0000","last_became_peered":"2024-09-05T12:55:43.723351+0000","last_unstale":"2024-09-05T12:56:05.061771+0000","last_undegraded":"2024-09-05T12:56:05.061771+0000","last_fullsized":"2024-09-05T12:56:05.061771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:15:40.485461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819355+0000","last_change":"2024-09-05T12:55:45.742293+0000","last_active":"2024-09-05T12:56:05.819355+0000","last_peered":"2024-09-05T12:56:05.819355+0000","last_clean":"2024-09-05T12:56:05.819355+0000","last_became_active":"2024-09-05T12:55:45.741998+0000","last_became_peered":"2024-09-05T12:55:45.741998+0000","last_unstale":"2024-09-05T12:56:05.819355+0000","last_undegraded":"2024-09-05T12:56:05.819355+0000","last_fullsized":"2024-09-05T12:56:05.819355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:25:23.731384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065615+0000","last_change":"2024-09-05T12:55:43.726519+0000","last_active":"2024-09-05T12:56:05.065615+0000","last_peered":"2024-09-05T12:56:05.065615+0000","last_clean":"2024-09-05T12:56:05.065615+0000","last_became_active":"2024-09-05T12:55:43.726231+0000","last_became_peered":"2024-09-05T12:55:43.726231+0000","last_unstale":"2024-09-05T12:56:05.065615+0000","last_undegraded":"2024-09-05T12:56:05.065615+0000","last_fullsized":"2024-09-05T12:56:05.065615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:22:55.460814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676243+0000","last_change":"2024-09-05T12:55:45.739359+0000","last_active":"2024-09-05T12:56:05.676243+0000","last_peered":"2024-09-05T12:56:05.676243+0000","last_clean":"2024-09-05T12:56:05.676243+0000","last_became_active":"2024-09-05T12:55:45.738358+0000","last_became_peered":"2024-09-05T12:55:45.738358+0000","last_unstale":"2024-09-05T12:56:05.676243+0000","last_undegraded":"2024-09-05T12:56:05.676243+0000","last_fullsized":"2024-09-05T12:56:05.676243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:11:37.144174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:29.952545+0000","last_change":"2024-09-05T12:55:43.726623+0000","last_active":"2024-09-05T12:57:29.952545+0000","last_peered":"2024-09-05T12:57:29.952545+0000","last_clean":"2024-09-05T12:57:29.952545+0000","last_became_active":"2024-09-05T12:55:43.726281+0000","last_became_peered":"2024-09-05T12:55:43.726281+0000","last_unstale":"2024-09-05T12:57:29.952545+0000","last_undegraded":"2024-09-05T12:57:29.952545+0000","last_fullsized":"2024-09-05T12:57:29.952545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:59:07.503458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676010+0000","last_change":"2024-09-05T12:55:45.745731+0000","last_active":"2024-09-05T12:56:05.676010+0000","last_peered":"2024-09-05T12:56:05.676010+0000","last_clean":"2024-09-05T12:56:05.676010+0000","last_became_active":"2024-09-05T12:55:45.745399+0000","last_became_peered":"2024-09-05T12:55:45.745399+0000","last_unstale":"2024-09-05T12:56:05.676010+0000","last_undegraded":"2024-09-05T12:56:05.676010+0000","last_fullsized":"2024-09-05T12:56:05.676010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:47:44.737335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061012+0000","last_change":"2024-09-05T12:55:43.736527+0000","last_active":"2024-09-05T12:56:05.061012+0000","last_peered":"2024-09-05T12:56:05.061012+0000","last_clean":"2024-09-05T12:56:05.061012+0000","last_became_active":"2024-09-05T12:55:43.736088+0000","last_became_peered":"2024-09-05T12:55:43.736088+0000","last_unstale":"2024-09-05T12:56:05.061012+0000","last_undegraded":"2024-09-05T12:56:05.061012+0000","last_fullsized":"2024-09-05T12:56:05.061012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:14.570503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.853150+0000","last_change":"2024-09-05T12:56:05.853150+0000","last_active":"2024-09-05T12:56:05.853150+0000","last_peered":"2024-09-05T12:56:05.853150+0000","last_clean":"2024-09-05T12:56:05.853150+0000","last_became_active":"2024-09-05T12:56:05.852728+0000","last_became_peered":"2024-09-05T12:56:05.852728+0000","last_unstale":"2024-09-05T12:56:05.853150+0000","last_undegraded":"2024-09-05T12:56:05.853150+0000","last_fullsized":"2024-09-05T12:56:05.853150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:58:49.654402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062050+0000","last_change":"2024-09-05T12:55:43.726989+0000","last_active":"2024-09-05T12:56:05.062050+0000","last_peered":"2024-09-05T12:56:05.062050+0000","last_clean":"2024-09-05T12:56:05.062050+0000","last_became_active":"2024-09-05T12:55:43.726690+0000","last_became_peered":"2024-09-05T12:55:43.726690+0000","last_unstale":"2024-09-05T12:56:05.062050+0000","last_undegraded":"2024-09-05T12:56:05.062050+0000","last_fullsized":"2024-09-05T12:56:05.062050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:15:31.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059176+0000","last_change":"2024-09-05T12:55:45.754849+0000","last_active":"2024-09-05T12:56:05.059176+0000","last_peered":"2024-09-05T12:56:05.059176+0000","last_clean":"2024-09-05T12:56:05.059176+0000","last_became_active":"2024-09-05T12:55:45.754539+0000","last_became_peered":"2024-09-05T12:55:45.754539+0000","last_unstale":"2024-09-05T12:56:05.059176+0000","last_undegraded":"2024-09-05T12:56:05.059176+0000","last_fullsized":"2024-09-05T12:56:05.059176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:14:17.628561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819674+0000","last_change":"2024-09-05T12:55:43.723140+0000","last_active":"2024-09-05T12:56:05.819674+0000","last_peered":"2024-09-05T12:56:05.819674+0000","last_clean":"2024-09-05T12:56:05.819674+0000","last_became_active":"2024-09-05T12:55:43.722806+0000","last_became_peered":"2024-09-05T12:55:43.722806+0000","last_unstale":"2024-09-05T12:56:05.819674+0000","last_undegraded":"2024-09-05T12:56:05.819674+0000","last_fullsized":"2024-09-05T12:56:05.819674+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:00:30.041237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676678+0000","last_change":"2024-09-05T12:55:45.750948+0000","last_active":"2024-09-05T12:56:05.676678+0000","last_peered":"2024-09-05T12:56:05.676678+0000","last_clean":"2024-09-05T12:56:05.676678+0000","last_became_active":"2024-09-05T12:55:45.750642+0000","last_became_peered":"2024-09-05T12:55:45.750642+0000","last_unstale":"2024-09-05T12:56:05.676678+0000","last_undegraded":"2024-09-05T12:56:05.676678+0000","last_fullsized":"2024-09-05T12:56:05.676678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:17:48.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066001+0000","last_change":"2024-09-05T12:55:43.724847+0000","last_active":"2024-09-05T12:56:05.066001+0000","last_peered":"2024-09-05T12:56:05.066001+0000","last_clean":"2024-09-05T12:56:05.066001+0000","last_became_active":"2024-09-05T12:55:43.724538+0000","last_became_peered":"2024-09-05T12:55:43.724538+0000","last_unstale":"2024-09-05T12:56:05.066001+0000","last_undegraded":"2024-09-05T12:56:05.066001+0000","last_fullsized":"2024-09-05T12:56:05.066001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:13:46.011992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676407+0000","last_change":"2024-09-05T12:55:45.742080+0000","last_active":"2024-09-05T12:56:05.676407+0000","last_peered":"2024-09-05T12:56:05.676407+0000","last_clean":"2024-09-05T12:56:05.676407+0000","last_became_active":"2024-09-05T12:55:45.741749+0000","last_became_peered":"2024-09-05T12:55:45.741749+0000","last_unstale":"2024-09-05T12:56:05.676407+0000","last_undegraded":"2024-09-05T12:56:05.676407+0000","last_fullsized":"2024-09-05T12:56:05.676407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:20.597209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061670+0000","last_change":"2024-09-05T12:55:43.736856+0000","last_active":"2024-09-05T12:56:05.061670+0000","last_peered":"2024-09-05T12:56:05.061670+0000","last_clean":"2024-09-05T12:56:05.061670+0000","last_became_active":"2024-09-05T12:55:43.736490+0000","last_became_peered":"2024-09-05T12:55:43.736490+0000","last_unstale":"2024-09-05T12:56:05.061670+0000","last_undegraded":"2024-09-05T12:56:05.061670+0000","last_fullsized":"2024-09-05T12:56:05.061670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:36:55.286932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676384+0000","last_change":"2024-09-05T12:55:45.750667+0000","last_active":"2024-09-05T12:56:05.676384+0000","last_peered":"2024-09-05T12:56:05.676384+0000","last_clean":"2024-09-05T12:56:05.676384+0000","last_became_active":"2024-09-05T12:55:45.750386+0000","last_became_peered":"2024-09-05T12:55:45.750386+0000","last_unstale":"2024-09-05T12:56:05.676384+0000","last_undegraded":"2024-09-05T12:56:05.676384+0000","last_fullsized":"2024-09-05T12:56:05.676384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:32:41.443471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":333,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676394+0000","last_change":"2024-09-05T12:54:31.534043+0000","last_active":"2024-09-05T12:56:05.676394+0000","last_peered":"2024-09-05T12:56:05.676394+0000","last_clean":"2024-09-05T12:56:05.676394+0000","last_became_active":"2024-09-05T12:54:31.533610+0000","last_became_peered":"2024-09-05T12:54:31.533610+0000","last_unstale":"2024-09-05T12:56:05.676394+0000","last_undegraded":"2024-09-05T12:56:05.676394+0000","last_fullsized":"2024-09-05T12:56:05.676394+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_clean_scrub_stamp":"2024-09-05T12:51:12.506567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:30:50.399925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201941+0000","last_change":"2024-09-05T12:55:43.727743+0000","last_active":"2024-09-05T12:56:05.201941+0000","last_peered":"2024-09-05T12:56:05.201941+0000","last_clean":"2024-09-05T12:56:05.201941+0000","last_became_active":"2024-09-05T12:55:43.727333+0000","last_became_peered":"2024-09-05T12:55:43.727333+0000","last_unstale":"2024-09-05T12:56:05.201941+0000","last_undegraded":"2024-09-05T12:56:05.201941+0000","last_fullsized":"2024-09-05T12:56:05.201941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:41:21.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061274+0000","last_change":"2024-09-05T12:55:45.744268+0000","last_active":"2024-09-05T12:56:05.061274+0000","last_peered":"2024-09-05T12:56:05.061274+0000","last_clean":"2024-09-05T12:56:05.061274+0000","last_became_active":"2024-09-05T12:55:45.743976+0000","last_became_peered":"2024-09-05T12:55:45.743976+0000","last_unstale":"2024-09-05T12:56:05.061274+0000","last_undegraded":"2024-09-05T12:56:05.061274+0000","last_fullsized":"2024-09-05T12:56:05.061274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:02.568293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676247+0000","last_change":"2024-09-05T12:55:43.728853+0000","last_active":"2024-09-05T12:56:05.676247+0000","last_peered":"2024-09-05T12:56:05.676247+0000","last_clean":"2024-09-05T12:56:05.676247+0000","last_became_active":"2024-09-05T12:55:43.728559+0000","last_became_peered":"2024-09-05T12:55:43.728559+0000","last_unstale":"2024-09-05T12:56:05.676247+0000","last_undegraded":"2024-09-05T12:56:05.676247+0000","last_fullsized":"2024-09-05T12:56:05.676247+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:16:53.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819290+0000","last_change":"2024-09-05T12:55:45.748445+0000","last_active":"2024-09-05T12:56:05.819290+0000","last_peered":"2024-09-05T12:56:05.819290+0000","last_clean":"2024-09-05T12:56:05.819290+0000","last_became_active":"2024-09-05T12:55:45.748152+0000","last_became_peered":"2024-09-05T12:55:45.748152+0000","last_unstale":"2024-09-05T12:56:05.819290+0000","last_undegraded":"2024-09-05T12:56:05.819290+0000","last_fullsized":"2024-09-05T12:56:05.819290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:37:35.842555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:28.950297+0000","last_change":"2024-09-05T12:55:43.734607+0000","last_active":"2024-09-05T12:57:28.950297+0000","last_peered":"2024-09-05T12:57:28.950297+0000","last_clean":"2024-09-05T12:57:28.950297+0000","last_became_active":"2024-09-05T12:55:43.734288+0000","last_became_peered":"2024-09-05T12:55:43.734288+0000","last_unstale":"2024-09-05T12:57:28.950297+0000","last_undegraded":"2024-09-05T12:57:28.950297+0000","last_fullsized":"2024-09-05T12:57:28.950297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:40:40.350335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065590+0000","last_change":"2024-09-05T12:55:45.745622+0000","last_active":"2024-09-05T12:56:05.065590+0000","last_peered":"2024-09-05T12:56:05.065590+0000","last_clean":"2024-09-05T12:56:05.065590+0000","last_became_active":"2024-09-05T12:55:45.745282+0000","last_became_peered":"2024-09-05T12:55:45.745282+0000","last_unstale":"2024-09-05T12:56:05.065590+0000","last_undegraded":"2024-09-05T12:56:05.065590+0000","last_fullsized":"2024-09-05T12:56:05.065590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:50:19.657275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676337+0000","last_change":"2024-09-05T12:55:43.723985+0000","last_active":"2024-09-05T12:56:05.676337+0000","last_peered":"2024-09-05T12:56:05.676337+0000","last_clean":"2024-09-05T12:56:05.676337+0000","last_became_active":"2024-09-05T12:55:43.723651+0000","last_became_peered":"2024-09-05T12:55:43.723651+0000","last_unstale":"2024-09-05T12:56:05.676337+0000","last_undegraded":"2024-09-05T12:56:05.676337+0000","last_fullsized":"2024-09-05T12:56:05.676337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:10:45.723258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062115+0000","last_change":"2024-09-05T12:55:45.738603+0000","last_active":"2024-09-05T12:56:05.062115+0000","last_peered":"2024-09-05T12:56:05.062115+0000","last_clean":"2024-09-05T12:56:05.062115+0000","last_became_active":"2024-09-05T12:55:45.738299+0000","last_became_peered":"2024-09-05T12:55:45.738299+0000","last_unstale":"2024-09-05T12:56:05.062115+0000","last_undegraded":"2024-09-05T12:56:05.062115+0000","last_fullsized":"2024-09-05T12:56:05.062115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:05:28.174555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061144+0000","last_change":"2024-09-05T12:55:43.734587+0000","last_active":"2024-09-05T12:56:05.061144+0000","last_peered":"2024-09-05T12:56:05.061144+0000","last_clean":"2024-09-05T12:56:05.061144+0000","last_became_active":"2024-09-05T12:55:43.734260+0000","last_became_peered":"2024-09-05T12:55:43.734260+0000","last_unstale":"2024-09-05T12:56:05.061144+0000","last_undegraded":"2024-09-05T12:56:05.061144+0000","last_fullsized":"2024-09-05T12:56:05.061144+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:37:00.235234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062195+0000","last_change":"2024-09-05T12:55:45.740516+0000","last_active":"2024-09-05T12:56:05.062195+0000","last_peered":"2024-09-05T12:56:05.062195+0000","last_clean":"2024-09-05T12:56:05.062195+0000","last_became_active":"2024-09-05T12:55:45.740227+0000","last_became_peered":"2024-09-05T12:55:45.740227+0000","last_unstale":"2024-09-05T12:56:05.062195+0000","last_undegraded":"2024-09-05T12:56:05.062195+0000","last_fullsized":"2024-09-05T12:56:05.062195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:34:44.922326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061647+0000","last_change":"2024-09-05T12:55:43.734592+0000","last_active":"2024-09-05T12:56:05.061647+0000","last_peered":"2024-09-05T12:56:05.061647+0000","last_clean":"2024-09-05T12:56:05.061647+0000","last_became_active":"2024-09-05T12:55:43.734243+0000","last_became_peered":"2024-09-05T12:55:43.734243+0000","last_unstale":"2024-09-05T12:56:05.061647+0000","last_undegraded":"2024-09-05T12:56:05.061647+0000","last_fullsized":"2024-09-05T12:56:05.061647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:14.368806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819567+0000","last_change":"2024-09-05T12:55:45.748201+0000","last_active":"2024-09-05T12:56:05.819567+0000","last_peered":"2024-09-05T12:56:05.819567+0000","last_clean":"2024-09-05T12:56:05.819567+0000","last_became_active":"2024-09-05T12:55:45.747906+0000","last_became_peered":"2024-09-05T12:55:45.747906+0000","last_unstale":"2024-09-05T12:56:05.819567+0000","last_undegraded":"2024-09-05T12:56:05.819567+0000","last_fullsized":"2024-09-05T12:56:05.819567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:07.984589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:09.748332+0000","last_change":"2024-09-05T12:56:05.071328+0000","last_active":"2024-09-05T12:56:09.748332+0000","last_peered":"2024-09-05T12:56:09.748332+0000","last_clean":"2024-09-05T12:56:09.748332+0000","last_became_active":"2024-09-05T12:56:05.064345+0000","last_became_peered":"2024-09-05T12:56:05.064345+0000","last_unstale":"2024-09-05T12:56:09.748332+0000","last_undegraded":"2024-09-05T12:56:09.748332+0000","last_fullsized":"2024-09-05T12:56:09.748332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:30:31.850824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061601+0000","last_change":"2024-09-05T12:55:45.743225+0000","last_active":"2024-09-05T12:56:05.061601+0000","last_peered":"2024-09-05T12:56:05.061601+0000","last_clean":"2024-09-05T12:56:05.061601+0000","last_became_active":"2024-09-05T12:55:45.742923+0000","last_became_peered":"2024-09-05T12:55:45.742923+0000","last_unstale":"2024-09-05T12:56:05.061601+0000","last_undegraded":"2024-09-05T12:56:05.061601+0000","last_fullsized":"2024-09-05T12:56:05.061601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:50:09.056893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.202275+0000","last_change":"2024-09-05T12:55:43.723420+0000","last_active":"2024-09-05T12:56:05.202275+0000","last_peered":"2024-09-05T12:56:05.202275+0000","last_clean":"2024-09-05T12:56:05.202275+0000","last_became_active":"2024-09-05T12:55:43.723100+0000","last_became_peered":"2024-09-05T12:55:43.723100+0000","last_unstale":"2024-09-05T12:56:05.202275+0000","last_undegraded":"2024-09-05T12:56:05.202275+0000","last_fullsized":"2024-09-05T12:56:05.202275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:21:33.307826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.678039+0000","last_change":"2024-09-05T12:56:05.678039+0000","last_active":"2024-09-05T12:56:05.678039+0000","last_peered":"2024-09-05T12:56:05.678039+0000","last_clean":"2024-09-05T12:56:05.678039+0000","last_became_active":"2024-09-05T12:56:05.677749+0000","last_became_peered":"2024-09-05T12:56:05.677749+0000","last_unstale":"2024-09-05T12:56:05.678039+0000","last_undegraded":"2024-09-05T12:56:05.678039+0000","last_fullsized":"2024-09-05T12:56:05.678039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:47:12.770873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851620+0000","last_change":"2024-09-05T12:55:43.736075+0000","last_active":"2024-09-05T12:56:05.851620+0000","last_peered":"2024-09-05T12:56:05.851620+0000","last_clean":"2024-09-05T12:56:05.851620+0000","last_became_active":"2024-09-05T12:55:43.735808+0000","last_became_peered":"2024-09-05T12:55:43.735808+0000","last_unstale":"2024-09-05T12:56:05.851620+0000","last_undegraded":"2024-09-05T12:56:05.851620+0000","last_fullsized":"2024-09-05T12:56:05.851620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:52:25.842728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061815+0000","last_change":"2024-09-05T12:55:45.747180+0000","last_active":"2024-09-05T12:56:05.061815+0000","last_peered":"2024-09-05T12:56:05.061815+0000","last_clean":"2024-09-05T12:56:05.061815+0000","last_became_active":"2024-09-05T12:55:45.746297+0000","last_became_peered":"2024-09-05T12:55:45.746297+0000","last_unstale":"2024-09-05T12:56:05.061815+0000","last_undegraded":"2024-09-05T12:56:05.061815+0000","last_fullsized":"2024-09-05T12:56:05.061815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:24:33.657861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060711+0000","last_change":"2024-09-05T12:55:43.720054+0000","last_active":"2024-09-05T12:56:05.060711+0000","last_peered":"2024-09-05T12:56:05.060711+0000","last_clean":"2024-09-05T12:56:05.060711+0000","last_became_active":"2024-09-05T12:55:43.719762+0000","last_became_peered":"2024-09-05T12:55:43.719762+0000","last_unstale":"2024-09-05T12:56:05.060711+0000","last_undegraded":"2024-09-05T12:56:05.060711+0000","last_fullsized":"2024-09-05T12:56:05.060711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:07:57.623333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059189+0000","last_change":"2024-09-05T12:55:45.756031+0000","last_active":"2024-09-05T12:56:05.059189+0000","last_peered":"2024-09-05T12:56:05.059189+0000","last_clean":"2024-09-05T12:56:05.059189+0000","last_became_active":"2024-09-05T12:55:45.755723+0000","last_became_peered":"2024-09-05T12:55:45.755723+0000","last_unstale":"2024-09-05T12:56:05.059189+0000","last_undegraded":"2024-09-05T12:56:05.059189+0000","last_fullsized":"2024-09-05T12:56:05.059189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:26.760307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.069746+0000","last_change":"2024-09-05T12:56:05.069208+0000","last_active":"2024-09-05T12:56:05.069746+0000","last_peered":"2024-09-05T12:56:05.069746+0000","last_clean":"2024-09-05T12:56:05.069746+0000","last_became_active":"2024-09-05T12:56:05.063698+0000","last_became_peered":"2024-09-05T12:56:05.063698+0000","last_unstale":"2024-09-05T12:56:05.069746+0000","last_undegraded":"2024-09-05T12:56:05.069746+0000","last_fullsized":"2024-09-05T12:56:05.069746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:55:54.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061163+0000","last_change":"2024-09-05T12:55:45.743108+0000","last_active":"2024-09-05T12:56:05.061163+0000","last_peered":"2024-09-05T12:56:05.061163+0000","last_clean":"2024-09-05T12:56:05.061163+0000","last_became_active":"2024-09-05T12:55:45.742197+0000","last_became_peered":"2024-09-05T12:55:45.742197+0000","last_unstale":"2024-09-05T12:56:05.061163+0000","last_undegraded":"2024-09-05T12:56:05.061163+0000","last_fullsized":"2024-09-05T12:56:05.061163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:13:15.192298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061447+0000","last_change":"2024-09-05T12:55:43.725893+0000","last_active":"2024-09-05T12:56:05.061447+0000","last_peered":"2024-09-05T12:56:05.061447+0000","last_clean":"2024-09-05T12:56:05.061447+0000","last_became_active":"2024-09-05T12:55:43.725578+0000","last_became_peered":"2024-09-05T12:55:43.725578+0000","last_unstale":"2024-09-05T12:56:05.061447+0000","last_undegraded":"2024-09-05T12:56:05.061447+0000","last_fullsized":"2024-09-05T12:56:05.061447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:39.101167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676363+0000","last_change":"2024-09-05T12:55:45.746727+0000","last_active":"2024-09-05T12:56:05.676363+0000","last_peered":"2024-09-05T12:56:05.676363+0000","last_clean":"2024-09-05T12:56:05.676363+0000","last_became_active":"2024-09-05T12:55:45.746446+0000","last_became_peered":"2024-09-05T12:55:45.746446+0000","last_unstale":"2024-09-05T12:56:05.676363+0000","last_undegraded":"2024-09-05T12:56:05.676363+0000","last_fullsized":"2024-09-05T12:56:05.676363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:56:51.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065862+0000","last_change":"2024-09-05T12:55:45.750253+0000","last_active":"2024-09-05T12:56:05.065862+0000","last_peered":"2024-09-05T12:56:05.065862+0000","last_clean":"2024-09-05T12:56:05.065862+0000","last_became_active":"2024-09-05T12:55:45.749911+0000","last_became_peered":"2024-09-05T12:55:45.749911+0000","last_unstale":"2024-09-05T12:56:05.065862+0000","last_undegraded":"2024-09-05T12:56:05.065862+0000","last_fullsized":"2024-09-05T12:56:05.065862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:04:04.164858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061563+0000","last_change":"2024-09-05T12:55:43.728597+0000","last_active":"2024-09-05T12:56:05.061563+0000","last_peered":"2024-09-05T12:56:05.061563+0000","last_clean":"2024-09-05T12:56:05.061563+0000","last_became_active":"2024-09-05T12:55:43.727633+0000","last_became_peered":"2024-09-05T12:55:43.727633+0000","last_unstale":"2024-09-05T12:56:05.061563+0000","last_undegraded":"2024-09-05T12:56:05.061563+0000","last_fullsized":"2024-09-05T12:56:05.061563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:50:04.775603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851671+0000","last_change":"2024-09-05T12:55:45.741539+0000","last_active":"2024-09-05T12:56:05.851671+0000","last_peered":"2024-09-05T12:56:05.851671+0000","last_clean":"2024-09-05T12:56:05.851671+0000","last_became_active":"2024-09-05T12:55:45.741247+0000","last_became_peered":"2024-09-05T12:55:45.741247+0000","last_unstale":"2024-09-05T12:56:05.851671+0000","last_undegraded":"2024-09-05T12:56:05.851671+0000","last_fullsized":"2024-09-05T12:56:05.851671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:57:23.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061516+0000","last_change":"2024-09-05T12:55:43.725085+0000","last_active":"2024-09-05T12:56:05.061516+0000","last_peered":"2024-09-05T12:56:05.061516+0000","last_clean":"2024-09-05T12:56:05.061516+0000","last_became_active":"2024-09-05T12:55:43.724772+0000","last_became_peered":"2024-09-05T12:55:43.724772+0000","last_unstale":"2024-09-05T12:56:05.061516+0000","last_undegraded":"2024-09-05T12:56:05.061516+0000","last_fullsized":"2024-09-05T12:56:05.061516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:48:16.567841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063834+0000","last_change":"2024-09-05T12:55:45.745635+0000","last_active":"2024-09-05T12:56:05.063834+0000","last_peered":"2024-09-05T12:56:05.063834+0000","last_clean":"2024-09-05T12:56:05.063834+0000","last_became_active":"2024-09-05T12:55:45.745331+0000","last_became_peered":"2024-09-05T12:55:45.745331+0000","last_unstale":"2024-09-05T12:56:05.063834+0000","last_undegraded":"2024-09-05T12:56:05.063834+0000","last_fullsized":"2024-09-05T12:56:05.063834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:15:58.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061048+0000","last_change":"2024-09-05T12:55:43.734466+0000","last_active":"2024-09-05T12:56:05.061048+0000","last_peered":"2024-09-05T12:56:05.061048+0000","last_clean":"2024-09-05T12:56:05.061048+0000","last_became_active":"2024-09-05T12:55:43.734147+0000","last_became_peered":"2024-09-05T12:55:43.734147+0000","last_unstale":"2024-09-05T12:56:05.061048+0000","last_undegraded":"2024-09-05T12:56:05.061048+0000","last_fullsized":"2024-09-05T12:56:05.061048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:53:22.588471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060906+0000","last_change":"2024-09-05T12:55:45.746328+0000","last_active":"2024-09-05T12:56:05.060906+0000","last_peered":"2024-09-05T12:56:05.060906+0000","last_clean":"2024-09-05T12:56:05.060906+0000","last_became_active":"2024-09-05T12:55:45.746012+0000","last_became_peered":"2024-09-05T12:55:45.746012+0000","last_unstale":"2024-09-05T12:56:05.060906+0000","last_undegraded":"2024-09-05T12:56:05.060906+0000","last_fullsized":"2024-09-05T12:56:05.060906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:23:12.886759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061386+0000","last_change":"2024-09-05T12:55:43.722519+0000","last_active":"2024-09-05T12:56:05.061386+0000","last_peered":"2024-09-05T12:56:05.061386+0000","last_clean":"2024-09-05T12:56:05.061386+0000","last_became_active":"2024-09-05T12:55:43.722220+0000","last_became_peered":"2024-09-05T12:55:43.722220+0000","last_unstale":"2024-09-05T12:56:05.061386+0000","last_undegraded":"2024-09-05T12:56:05.061386+0000","last_fullsized":"2024-09-05T12:56:05.061386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:15.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":597,"num_read_kb":364,"num_write":161,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":195923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281587,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":425477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":1076722,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":425713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234034,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":1017565,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":425102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855425,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1017249,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":425539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":425413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":491024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":484659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":426373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T12:57:33.721 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-05T12:57:33.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T12:57:33.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.856+0000 7f0d26fdd640 1 -- 172.21.15.73:0/3375784423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d201025e0 msgr2=0x7f0d20108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.856+0000 7f0d26fdd640 1 --2- 172.21.15.73:0/3375784423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d201025e0 0x7f0d20108e70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009ca0 tx=0x7f0d1802a8c0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.856+0000 7f0d26fdd640 1 -- 172.21.15.73:0/3375784423 shutdown_connections 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.856+0000 7f0d26fdd640 1 --2- 172.21.15.73:0/3375784423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d201025e0 0x7f0d20108e70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.856+0000 7f0d26fdd640 1 --2- 172.21.15.73:0/3375784423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d20101c20 0x7f0d201020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.856+0000 7f0d26fdd640 1 --2- 172.21.15.73:0/3375784423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20100a30 0x7f0d20100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.856+0000 7f0d26fdd640 1 -- 172.21.15.73:0/3375784423 >> 172.21.15.73:0/3375784423 conn(0x7f0d200fc190 msgr2=0x7f0d200fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.856+0000 7f0d26fdd640 1 -- 172.21.15.73:0/3375784423 shutdown_connections 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.856+0000 7f0d26fdd640 1 -- 172.21.15.73:0/3375784423 wait complete. 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d26fdd640 1 Processor -- start 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d26fdd640 1 -- start start 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d26fdd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d20100a30 0x7f0d20196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d26fdd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20101c20 0x7f0d201972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d26fdd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d201025e0 0x7f0d2019e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d26fdd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2010c6b0 con 0x7f0d201025e0 2024-09-05T12:57:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d26fdd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2010c530 con 0x7f0d20101c20 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d26fdd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2010c830 con 0x7f0d20100a30 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d2557a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d201025e0 0x7f0d2019e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d2557a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d201025e0 0x7f0d2019e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35916/0 (socket says 172.21.15.73:35916) 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d2557a640 1 -- 172.21.15.73:0/719564595 learned_addr learned my addr 172.21.15.73:0/719564595 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d24d79640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d20100a30 0x7f0d20196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d1ffff640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20101c20 0x7f0d201972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d2557a640 1 -- 172.21.15.73:0/719564595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d20100a30 msgr2=0x7f0d20196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d2557a640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d20100a30 0x7f0d20196d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d2557a640 1 -- 172.21.15.73:0/719564595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20101c20 msgr2=0x7f0d201972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d2557a640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20101c20 0x7f0d201972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d2557a640 1 -- 172.21.15.73:0/719564595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2019e980 con 0x7f0d201025e0 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.857+0000 7f0d2557a640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d201025e0 0x7f0d2019e310 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0d18005e30 tx=0x7f0d18004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.858+0000 7f0d1dffb640 1 -- 172.21.15.73:0/719564595 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18049070 con 0x7f0d201025e0 2024-09-05T12:57:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.858+0000 7f0d1dffb640 1 -- 172.21.15.73:0/719564595 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d18003b80 con 0x7f0d201025e0 2024-09-05T12:57:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.858+0000 7f0d26fdd640 1 -- 172.21.15.73:0/719564595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2006a3c0 con 0x7f0d201025e0 2024-09-05T12:57:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.858+0000 7f0d1dffb640 1 -- 172.21.15.73:0/719564595 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1802fa30 con 0x7f0d201025e0 2024-09-05T12:57:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.858+0000 7f0d26fdd640 1 -- 172.21.15.73:0/719564595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2006a960 con 0x7f0d201025e0 2024-09-05T12:57:33.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.859+0000 7f0d26fdd640 1 -- 172.21.15.73:0/719564595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d201078b0 con 0x7f0d201025e0 2024-09-05T12:57:33.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.860+0000 7f0d1dffb640 1 -- 172.21.15.73:0/719564595 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0d1804c070 con 0x7f0d201025e0 2024-09-05T12:57:33.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.861+0000 7f0d1dffb640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d100a2ca0 0x7f0d100a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:33.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.861+0000 7f0d24d79640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d100a2ca0 0x7f0d100a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:33.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.861+0000 7f0d1dffb640 1 -- 172.21.15.73:0/719564595 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0d180f1750 con 0x7f0d201025e0 2024-09-05T12:57:33.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.861+0000 7f0d24d79640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d100a2ca0 0x7f0d100a5160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d20101a80 tx=0x7f0d14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:33.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:33.864+0000 7f0d1dffb640 1 -- 172.21.15.73:0/719564595 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d180811b0 con 0x7f0d201025e0 2024-09-05T12:57:34.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.057+0000 7f0d26fdd640 1 -- 172.21.15.73:0/719564595 --> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d2006ac80 con 0x7f0d100a2ca0 2024-09-05T12:57:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.063+0000 7f0d1dffb640 1 -- 172.21.15.73:0/719564595 <== mgr.14150 v2:172.21.15.73:6800/3294068694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258907 (secure 0 0 0) 0x7f0d2006ac80 con 0x7f0d100a2ca0 2024-09-05T12:57:34.066 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-05T12:57:34.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 -- 172.21.15.73:0/719564595 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d100a2ca0 msgr2=0x7f0d100a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:34.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d100a2ca0 0x7f0d100a5160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d20101a80 tx=0x7f0d14005f90 comp rx=0 tx=0).stop 2024-09-05T12:57:34.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 -- 172.21.15.73:0/719564595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d201025e0 msgr2=0x7f0d2019e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:34.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d201025e0 0x7f0d2019e310 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0d18005e30 tx=0x7f0d18004ab0 comp rx=0 tx=0).stop 2024-09-05T12:57:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 -- 172.21.15.73:0/719564595 shutdown_connections 2024-09-05T12:57:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d100a2ca0 0x7f0d100a5160 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d201025e0 0x7f0d2019e310 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20101c20 0x7f0d201972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 --2- 172.21.15.73:0/719564595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d20100a30 0x7f0d20196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 -- 172.21.15.73:0/719564595 >> 172.21.15.73:0/719564595 conn(0x7f0d200fc190 msgr2=0x7f0d20105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 -- 172.21.15.73:0/719564595 shutdown_connections 2024-09-05T12:57:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.066+0000 7f0d26fdd640 1 -- 172.21.15.73:0/719564595 wait complete. 2024-09-05T12:57:34.079 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-09-05T12:57:33.999617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659164,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":741,"num_read_kb":490,"num_write":349,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351672,"kb_used_data":10712,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590152,"statfs":{"total":1151940427776,"available":1151580315648,"internally_reserved":0,"allocated":10969088,"data_stored":7071091,"data_compressed":107439,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4795,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":47,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003280"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059332+0000","last_change":"2024-09-05T12:55:45.753801+0000","last_active":"2024-09-05T12:56:05.059332+0000","last_peered":"2024-09-05T12:56:05.059332+0000","last_clean":"2024-09-05T12:56:05.059332+0000","last_became_active":"2024-09-05T12:55:45.753480+0000","last_became_peered":"2024-09-05T12:55:45.753480+0000","last_unstale":"2024-09-05T12:56:05.059332+0000","last_undegraded":"2024-09-05T12:56:05.059332+0000","last_fullsized":"2024-09-05T12:56:05.059332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:34.806083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063464+0000","last_change":"2024-09-05T12:55:45.744629+0000","last_active":"2024-09-05T12:56:05.063464+0000","last_peered":"2024-09-05T12:56:05.063464+0000","last_clean":"2024-09-05T12:56:05.063464+0000","last_became_active":"2024-09-05T12:55:45.744311+0000","last_became_peered":"2024-09-05T12:55:45.744311+0000","last_unstale":"2024-09-05T12:56:05.063464+0000","last_undegraded":"2024-09-05T12:56:05.063464+0000","last_fullsized":"2024-09-05T12:56:05.063464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:08:57.032929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063504+0000","last_change":"2024-09-05T12:55:45.745128+0000","last_active":"2024-09-05T12:56:05.063504+0000","last_peered":"2024-09-05T12:56:05.063504+0000","last_clean":"2024-09-05T12:56:05.063504+0000","last_became_active":"2024-09-05T12:55:45.744799+0000","last_became_peered":"2024-09-05T12:55:45.744799+0000","last_unstale":"2024-09-05T12:56:05.063504+0000","last_undegraded":"2024-09-05T12:56:05.063504+0000","last_fullsized":"2024-09-05T12:56:05.063504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:35:48.528336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201949+0000","last_change":"2024-09-05T12:55:45.749471+0000","last_active":"2024-09-05T12:56:05.201949+0000","last_peered":"2024-09-05T12:56:05.201949+0000","last_clean":"2024-09-05T12:56:05.201949+0000","last_became_active":"2024-09-05T12:55:45.749126+0000","last_became_peered":"2024-09-05T12:55:45.749126+0000","last_unstale":"2024-09-05T12:56:05.201949+0000","last_undegraded":"2024-09-05T12:56:05.201949+0000","last_fullsized":"2024-09-05T12:56:05.201949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:36.152934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061325+0000","last_change":"2024-09-05T12:55:45.741243+0000","last_active":"2024-09-05T12:56:05.061325+0000","last_peered":"2024-09-05T12:56:05.061325+0000","last_clean":"2024-09-05T12:56:05.061325+0000","last_became_active":"2024-09-05T12:55:45.740849+0000","last_became_peered":"2024-09-05T12:55:45.740849+0000","last_unstale":"2024-09-05T12:56:05.061325+0000","last_undegraded":"2024-09-05T12:56:05.061325+0000","last_fullsized":"2024-09-05T12:56:05.061325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:01.323875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062003+0000","last_change":"2024-09-05T12:55:45.744599+0000","last_active":"2024-09-05T12:56:05.062003+0000","last_peered":"2024-09-05T12:56:05.062003+0000","last_clean":"2024-09-05T12:56:05.062003+0000","last_became_active":"2024-09-05T12:55:45.744304+0000","last_became_peered":"2024-09-05T12:55:45.744304+0000","last_unstale":"2024-09-05T12:56:05.062003+0000","last_undegraded":"2024-09-05T12:56:05.062003+0000","last_fullsized":"2024-09-05T12:56:05.062003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:15:55.340505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676096+0000","last_change":"2024-09-05T12:55:45.744802+0000","last_active":"2024-09-05T12:56:05.676096+0000","last_peered":"2024-09-05T12:56:05.676096+0000","last_clean":"2024-09-05T12:56:05.676096+0000","last_became_active":"2024-09-05T12:55:45.744525+0000","last_became_peered":"2024-09-05T12:55:45.744525+0000","last_unstale":"2024-09-05T12:56:05.676096+0000","last_undegraded":"2024-09-05T12:56:05.676096+0000","last_fullsized":"2024-09-05T12:56:05.676096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:03:04.047389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060470+0000","last_change":"2024-09-05T12:55:45.742141+0000","last_active":"2024-09-05T12:56:05.060470+0000","last_peered":"2024-09-05T12:56:05.060470+0000","last_clean":"2024-09-05T12:56:05.060470+0000","last_became_active":"2024-09-05T12:55:45.741445+0000","last_became_peered":"2024-09-05T12:55:45.741445+0000","last_unstale":"2024-09-05T12:56:05.060470+0000","last_undegraded":"2024-09-05T12:56:05.060470+0000","last_fullsized":"2024-09-05T12:56:05.060470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:38:28.859589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.852099+0000","last_change":"2024-09-05T12:55:45.747321+0000","last_active":"2024-09-05T12:56:05.852099+0000","last_peered":"2024-09-05T12:56:05.852099+0000","last_clean":"2024-09-05T12:56:05.852099+0000","last_became_active":"2024-09-05T12:55:45.747013+0000","last_became_peered":"2024-09-05T12:55:45.747013+0000","last_unstale":"2024-09-05T12:56:05.852099+0000","last_undegraded":"2024-09-05T12:56:05.852099+0000","last_fullsized":"2024-09-05T12:56:05.852099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:42:00.402789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064498+0000","last_change":"2024-09-05T12:56:05.064498+0000","last_active":"2024-09-05T12:56:05.064498+0000","last_peered":"2024-09-05T12:56:05.064498+0000","last_clean":"2024-09-05T12:56:05.064498+0000","last_became_active":"2024-09-05T12:56:05.064200+0000","last_became_peered":"2024-09-05T12:56:05.064200+0000","last_unstale":"2024-09-05T12:56:05.064498+0000","last_undegraded":"2024-09-05T12:56:05.064498+0000","last_fullsized":"2024-09-05T12:56:05.064498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:37:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676376+0000","last_change":"2024-09-05T12:55:45.748372+0000","last_active":"2024-09-05T12:56:05.676376+0000","last_peered":"2024-09-05T12:56:05.676376+0000","last_clean":"2024-09-05T12:56:05.676376+0000","last_became_active":"2024-09-05T12:55:45.748093+0000","last_became_peered":"2024-09-05T12:55:45.748093+0000","last_unstale":"2024-09-05T12:56:05.676376+0000","last_undegraded":"2024-09-05T12:56:05.676376+0000","last_fullsized":"2024-09-05T12:56:05.676376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:32:25.938128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201978+0000","last_change":"2024-09-05T12:55:45.749433+0000","last_active":"2024-09-05T12:56:05.201978+0000","last_peered":"2024-09-05T12:56:05.201978+0000","last_clean":"2024-09-05T12:56:05.201978+0000","last_became_active":"2024-09-05T12:55:45.748677+0000","last_became_peered":"2024-09-05T12:55:45.748677+0000","last_unstale":"2024-09-05T12:56:05.201978+0000","last_undegraded":"2024-09-05T12:56:05.201978+0000","last_fullsized":"2024-09-05T12:56:05.201978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:27:57.896752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819602+0000","last_change":"2024-09-05T12:55:45.743212+0000","last_active":"2024-09-05T12:56:05.819602+0000","last_peered":"2024-09-05T12:56:05.819602+0000","last_clean":"2024-09-05T12:56:05.819602+0000","last_became_active":"2024-09-05T12:55:45.742918+0000","last_became_peered":"2024-09-05T12:55:45.742918+0000","last_unstale":"2024-09-05T12:56:05.819602+0000","last_undegraded":"2024-09-05T12:56:05.819602+0000","last_fullsized":"2024-09-05T12:56:05.819602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:21:18.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063680+0000","last_change":"2024-09-05T12:55:45.745058+0000","last_active":"2024-09-05T12:56:05.063680+0000","last_peered":"2024-09-05T12:56:05.063680+0000","last_clean":"2024-09-05T12:56:05.063680+0000","last_became_active":"2024-09-05T12:55:45.744349+0000","last_became_peered":"2024-09-05T12:55:45.744349+0000","last_unstale":"2024-09-05T12:56:05.063680+0000","last_undegraded":"2024-09-05T12:56:05.063680+0000","last_fullsized":"2024-09-05T12:56:05.063680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:26:21.034864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063126+0000","last_change":"2024-09-05T12:55:45.748387+0000","last_active":"2024-09-05T12:56:05.063126+0000","last_peered":"2024-09-05T12:56:05.063126+0000","last_clean":"2024-09-05T12:56:05.063126+0000","last_became_active":"2024-09-05T12:55:45.748082+0000","last_became_peered":"2024-09-05T12:55:45.748082+0000","last_unstale":"2024-09-05T12:56:05.063126+0000","last_undegraded":"2024-09-05T12:56:05.063126+0000","last_fullsized":"2024-09-05T12:56:05.063126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:51:23.835278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851526+0000","last_change":"2024-09-05T12:55:45.742195+0000","last_active":"2024-09-05T12:56:05.851526+0000","last_peered":"2024-09-05T12:56:05.851526+0000","last_clean":"2024-09-05T12:56:05.851526+0000","last_became_active":"2024-09-05T12:55:45.741888+0000","last_became_peered":"2024-09-05T12:55:45.741888+0000","last_unstale":"2024-09-05T12:56:05.851526+0000","last_undegraded":"2024-09-05T12:56:05.851526+0000","last_fullsized":"2024-09-05T12:56:05.851526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:19:17.556164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059394+0000","last_change":"2024-09-05T12:55:45.755255+0000","last_active":"2024-09-05T12:56:05.059394+0000","last_peered":"2024-09-05T12:56:05.059394+0000","last_clean":"2024-09-05T12:56:05.059394+0000","last_became_active":"2024-09-05T12:55:45.754939+0000","last_became_peered":"2024-09-05T12:55:45.754939+0000","last_unstale":"2024-09-05T12:56:05.059394+0000","last_undegraded":"2024-09-05T12:56:05.059394+0000","last_fullsized":"2024-09-05T12:56:05.059394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:48:34.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061596+0000","last_change":"2024-09-05T12:55:45.745496+0000","last_active":"2024-09-05T12:56:05.061596+0000","last_peered":"2024-09-05T12:56:05.061596+0000","last_clean":"2024-09-05T12:56:05.061596+0000","last_became_active":"2024-09-05T12:55:45.745153+0000","last_became_peered":"2024-09-05T12:55:45.745153+0000","last_unstale":"2024-09-05T12:56:05.061596+0000","last_undegraded":"2024-09-05T12:56:05.061596+0000","last_fullsized":"2024-09-05T12:56:05.061596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:16:52.255227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062235+0000","last_change":"2024-09-05T12:55:45.747353+0000","last_active":"2024-09-05T12:56:05.062235+0000","last_peered":"2024-09-05T12:56:05.062235+0000","last_clean":"2024-09-05T12:56:05.062235+0000","last_became_active":"2024-09-05T12:55:45.747018+0000","last_became_peered":"2024-09-05T12:55:45.747018+0000","last_unstale":"2024-09-05T12:56:05.062235+0000","last_undegraded":"2024-09-05T12:56:05.062235+0000","last_fullsized":"2024-09-05T12:56:05.062235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:12:25.217057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059013+0000","last_change":"2024-09-05T12:55:45.754023+0000","last_active":"2024-09-05T12:56:05.059013+0000","last_peered":"2024-09-05T12:56:05.059013+0000","last_clean":"2024-09-05T12:56:05.059013+0000","last_became_active":"2024-09-05T12:55:45.753723+0000","last_became_peered":"2024-09-05T12:55:45.753723+0000","last_unstale":"2024-09-05T12:56:05.059013+0000","last_undegraded":"2024-09-05T12:56:05.059013+0000","last_fullsized":"2024-09-05T12:56:05.059013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:16:01.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819690+0000","last_change":"2024-09-05T12:55:45.742627+0000","last_active":"2024-09-05T12:56:05.819690+0000","last_peered":"2024-09-05T12:56:05.819690+0000","last_clean":"2024-09-05T12:56:05.819690+0000","last_became_active":"2024-09-05T12:55:45.742252+0000","last_became_peered":"2024-09-05T12:55:45.742252+0000","last_unstale":"2024-09-05T12:56:05.819690+0000","last_undegraded":"2024-09-05T12:56:05.819690+0000","last_fullsized":"2024-09-05T12:56:05.819690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:14:34.476156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851781+0000","last_change":"2024-09-05T12:55:45.743587+0000","last_active":"2024-09-05T12:56:05.851781+0000","last_peered":"2024-09-05T12:56:05.851781+0000","last_clean":"2024-09-05T12:56:05.851781+0000","last_became_active":"2024-09-05T12:55:45.742624+0000","last_became_peered":"2024-09-05T12:55:45.742624+0000","last_unstale":"2024-09-05T12:56:05.851781+0000","last_undegraded":"2024-09-05T12:56:05.851781+0000","last_fullsized":"2024-09-05T12:56:05.851781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:15.981929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060563+0000","last_change":"2024-09-05T12:55:45.747430+0000","last_active":"2024-09-05T12:56:05.060563+0000","last_peered":"2024-09-05T12:56:05.060563+0000","last_clean":"2024-09-05T12:56:05.060563+0000","last_became_active":"2024-09-05T12:55:45.747049+0000","last_became_peered":"2024-09-05T12:55:45.747049+0000","last_unstale":"2024-09-05T12:56:05.060563+0000","last_undegraded":"2024-09-05T12:56:05.060563+0000","last_fullsized":"2024-09-05T12:56:05.060563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:31:08.388375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065470+0000","last_change":"2024-09-05T12:55:45.741645+0000","last_active":"2024-09-05T12:56:05.065470+0000","last_peered":"2024-09-05T12:56:05.065470+0000","last_clean":"2024-09-05T12:56:05.065470+0000","last_became_active":"2024-09-05T12:55:45.741341+0000","last_became_peered":"2024-09-05T12:55:45.741341+0000","last_unstale":"2024-09-05T12:56:05.065470+0000","last_undegraded":"2024-09-05T12:56:05.065470+0000","last_fullsized":"2024-09-05T12:56:05.065470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:24:11.896491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061589+0000","last_change":"2024-09-05T12:55:45.747609+0000","last_active":"2024-09-05T12:56:05.061589+0000","last_peered":"2024-09-05T12:56:05.061589+0000","last_clean":"2024-09-05T12:56:05.061589+0000","last_became_active":"2024-09-05T12:55:45.745899+0000","last_became_peered":"2024-09-05T12:55:45.745899+0000","last_unstale":"2024-09-05T12:56:05.061589+0000","last_undegraded":"2024-09-05T12:56:05.061589+0000","last_fullsized":"2024-09-05T12:56:05.061589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:21:42.224663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061958+0000","last_change":"2024-09-05T12:55:45.744974+0000","last_active":"2024-09-05T12:56:05.061958+0000","last_peered":"2024-09-05T12:56:05.061958+0000","last_clean":"2024-09-05T12:56:05.061958+0000","last_became_active":"2024-09-05T12:55:45.744538+0000","last_became_peered":"2024-09-05T12:55:45.744538+0000","last_unstale":"2024-09-05T12:56:05.061958+0000","last_undegraded":"2024-09-05T12:56:05.061958+0000","last_fullsized":"2024-09-05T12:56:05.061958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:48:46.695178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.064626+0000","last_change":"2024-09-05T12:56:05.064626+0000","last_active":"2024-09-05T12:56:05.064626+0000","last_peered":"2024-09-05T12:56:05.064626+0000","last_clean":"2024-09-05T12:56:05.064626+0000","last_became_active":"2024-09-05T12:56:05.063972+0000","last_became_peered":"2024-09-05T12:56:05.063972+0000","last_unstale":"2024-09-05T12:56:05.064626+0000","last_undegraded":"2024-09-05T12:56:05.064626+0000","last_fullsized":"2024-09-05T12:56:05.064626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:57.345008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819769+0000","last_change":"2024-09-05T12:55:45.753630+0000","last_active":"2024-09-05T12:56:05.819769+0000","last_peered":"2024-09-05T12:56:05.819769+0000","last_clean":"2024-09-05T12:56:05.819769+0000","last_became_active":"2024-09-05T12:55:45.753328+0000","last_became_peered":"2024-09-05T12:55:45.753328+0000","last_unstale":"2024-09-05T12:56:05.819769+0000","last_undegraded":"2024-09-05T12:56:05.819769+0000","last_fullsized":"2024-09-05T12:56:05.819769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:55:39.064374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063372+0000","last_change":"2024-09-05T12:55:45.749596+0000","last_active":"2024-09-05T12:56:05.063372+0000","last_peered":"2024-09-05T12:56:05.063372+0000","last_clean":"2024-09-05T12:56:05.063372+0000","last_became_active":"2024-09-05T12:55:45.749150+0000","last_became_peered":"2024-09-05T12:55:45.749150+0000","last_unstale":"2024-09-05T12:56:05.063372+0000","last_undegraded":"2024-09-05T12:56:05.063372+0000","last_fullsized":"2024-09-05T12:56:05.063372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:14:06.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062144+0000","last_change":"2024-09-05T12:55:45.748414+0000","last_active":"2024-09-05T12:56:05.062144+0000","last_peered":"2024-09-05T12:56:05.062144+0000","last_clean":"2024-09-05T12:56:05.062144+0000","last_became_active":"2024-09-05T12:55:45.747952+0000","last_became_peered":"2024-09-05T12:55:45.747952+0000","last_unstale":"2024-09-05T12:56:05.062144+0000","last_undegraded":"2024-09-05T12:56:05.062144+0000","last_fullsized":"2024-09-05T12:56:05.062144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:45:04.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061467+0000","last_change":"2024-09-05T12:55:45.754145+0000","last_active":"2024-09-05T12:56:05.061467+0000","last_peered":"2024-09-05T12:56:05.061467+0000","last_clean":"2024-09-05T12:56:05.061467+0000","last_became_active":"2024-09-05T12:55:45.753833+0000","last_became_peered":"2024-09-05T12:55:45.753833+0000","last_unstale":"2024-09-05T12:56:05.061467+0000","last_undegraded":"2024-09-05T12:56:05.061467+0000","last_fullsized":"2024-09-05T12:56:05.061467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:45:24.606506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.058922+0000","last_change":"2024-09-05T12:55:45.750283+0000","last_active":"2024-09-05T12:56:05.058922+0000","last_peered":"2024-09-05T12:56:05.058922+0000","last_clean":"2024-09-05T12:56:05.058922+0000","last_became_active":"2024-09-05T12:55:45.749901+0000","last_became_peered":"2024-09-05T12:55:45.749901+0000","last_unstale":"2024-09-05T12:56:05.058922+0000","last_undegraded":"2024-09-05T12:56:05.058922+0000","last_fullsized":"2024-09-05T12:56:05.058922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:45:57.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061784+0000","last_change":"2024-09-05T12:55:45.743239+0000","last_active":"2024-09-05T12:56:05.061784+0000","last_peered":"2024-09-05T12:56:05.061784+0000","last_clean":"2024-09-05T12:56:05.061784+0000","last_became_active":"2024-09-05T12:55:45.742926+0000","last_became_peered":"2024-09-05T12:55:45.742926+0000","last_unstale":"2024-09-05T12:56:05.061784+0000","last_undegraded":"2024-09-05T12:56:05.061784+0000","last_fullsized":"2024-09-05T12:56:05.061784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:26:05.559405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:29.948209+0000","last_change":"2024-09-05T12:55:43.727301+0000","last_active":"2024-09-05T12:57:29.948209+0000","last_peered":"2024-09-05T12:57:29.948209+0000","last_clean":"2024-09-05T12:57:29.948209+0000","last_became_active":"2024-09-05T12:55:43.727006+0000","last_became_peered":"2024-09-05T12:55:43.727006+0000","last_unstale":"2024-09-05T12:57:29.948209+0000","last_undegraded":"2024-09-05T12:57:29.948209+0000","last_fullsized":"2024-09-05T12:57:29.948209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:54:32.725098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066620+0000","last_change":"2024-09-05T12:55:45.735835+0000","last_active":"2024-09-05T12:56:05.066620+0000","last_peered":"2024-09-05T12:56:05.066620+0000","last_clean":"2024-09-05T12:56:05.066620+0000","last_became_active":"2024-09-05T12:55:45.735404+0000","last_became_peered":"2024-09-05T12:55:45.735404+0000","last_unstale":"2024-09-05T12:56:05.066620+0000","last_undegraded":"2024-09-05T12:56:05.066620+0000","last_fullsized":"2024-09-05T12:56:05.066620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:06:47.174441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062007+0000","last_change":"2024-09-05T12:55:43.724561+0000","last_active":"2024-09-05T12:56:05.062007+0000","last_peered":"2024-09-05T12:56:05.062007+0000","last_clean":"2024-09-05T12:56:05.062007+0000","last_became_active":"2024-09-05T12:55:43.722704+0000","last_became_peered":"2024-09-05T12:55:43.722704+0000","last_unstale":"2024-09-05T12:56:05.062007+0000","last_undegraded":"2024-09-05T12:56:05.062007+0000","last_fullsized":"2024-09-05T12:56:05.062007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:20:20.692844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819297+0000","last_change":"2024-09-05T12:55:43.722937+0000","last_active":"2024-09-05T12:56:05.819297+0000","last_peered":"2024-09-05T12:56:05.819297+0000","last_clean":"2024-09-05T12:56:05.819297+0000","last_became_active":"2024-09-05T12:55:43.722606+0000","last_became_peered":"2024-09-05T12:55:43.722606+0000","last_unstale":"2024-09-05T12:56:05.819297+0000","last_undegraded":"2024-09-05T12:56:05.819297+0000","last_fullsized":"2024-09-05T12:56:05.819297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:47:38.448865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.820632+0000","last_change":"2024-09-05T12:56:05.820632+0000","last_active":"2024-09-05T12:56:05.820632+0000","last_peered":"2024-09-05T12:56:05.820632+0000","last_clean":"2024-09-05T12:56:05.820632+0000","last_became_active":"2024-09-05T12:56:05.820239+0000","last_became_peered":"2024-09-05T12:56:05.820239+0000","last_unstale":"2024-09-05T12:56:05.820632+0000","last_undegraded":"2024-09-05T12:56:05.820632+0000","last_fullsized":"2024-09-05T12:56:05.820632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:36:59.659783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065764+0000","last_change":"2024-09-05T12:55:43.725546+0000","last_active":"2024-09-05T12:56:05.065764+0000","last_peered":"2024-09-05T12:56:05.065764+0000","last_clean":"2024-09-05T12:56:05.065764+0000","last_became_active":"2024-09-05T12:55:43.725252+0000","last_became_peered":"2024-09-05T12:55:43.725252+0000","last_unstale":"2024-09-05T12:56:05.065764+0000","last_undegraded":"2024-09-05T12:56:05.065764+0000","last_fullsized":"2024-09-05T12:56:05.065764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:49:16.085799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060968+0000","last_change":"2024-09-05T12:55:45.745358+0000","last_active":"2024-09-05T12:56:05.060968+0000","last_peered":"2024-09-05T12:56:05.060968+0000","last_clean":"2024-09-05T12:56:05.060968+0000","last_became_active":"2024-09-05T12:55:45.745040+0000","last_became_peered":"2024-09-05T12:55:45.745040+0000","last_unstale":"2024-09-05T12:56:05.060968+0000","last_undegraded":"2024-09-05T12:56:05.060968+0000","last_fullsized":"2024-09-05T12:56:05.060968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:42:42.906745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:33.951127+0000","last_change":"2024-09-05T12:55:43.726138+0000","last_active":"2024-09-05T12:57:33.951127+0000","last_peered":"2024-09-05T12:57:33.951127+0000","last_clean":"2024-09-05T12:57:33.951127+0000","last_became_active":"2024-09-05T12:55:43.725815+0000","last_became_peered":"2024-09-05T12:55:43.725815+0000","last_unstale":"2024-09-05T12:57:33.951127+0000","last_undegraded":"2024-09-05T12:57:33.951127+0000","last_fullsized":"2024-09-05T12:57:33.951127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:35:38.041757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851996+0000","last_change":"2024-09-05T12:55:45.743580+0000","last_active":"2024-09-05T12:56:05.851996+0000","last_peered":"2024-09-05T12:56:05.851996+0000","last_clean":"2024-09-05T12:56:05.851996+0000","last_became_active":"2024-09-05T12:55:45.743307+0000","last_became_peered":"2024-09-05T12:55:45.743307+0000","last_unstale":"2024-09-05T12:56:05.851996+0000","last_undegraded":"2024-09-05T12:56:05.851996+0000","last_fullsized":"2024-09-05T12:56:05.851996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:15:13.898218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676632+0000","last_change":"2024-09-05T12:55:43.725373+0000","last_active":"2024-09-05T12:56:05.676632+0000","last_peered":"2024-09-05T12:56:05.676632+0000","last_clean":"2024-09-05T12:56:05.676632+0000","last_became_active":"2024-09-05T12:55:43.725062+0000","last_became_peered":"2024-09-05T12:55:43.725062+0000","last_unstale":"2024-09-05T12:56:05.676632+0000","last_undegraded":"2024-09-05T12:56:05.676632+0000","last_fullsized":"2024-09-05T12:56:05.676632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:42:27.994499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063879+0000","last_change":"2024-09-05T12:55:45.750265+0000","last_active":"2024-09-05T12:56:05.063879+0000","last_peered":"2024-09-05T12:56:05.063879+0000","last_clean":"2024-09-05T12:56:05.063879+0000","last_became_active":"2024-09-05T12:55:45.749928+0000","last_became_peered":"2024-09-05T12:55:45.749928+0000","last_unstale":"2024-09-05T12:56:05.063879+0000","last_undegraded":"2024-09-05T12:56:05.063879+0000","last_fullsized":"2024-09-05T12:56:05.063879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:56:19.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065937+0000","last_change":"2024-09-05T12:55:43.736248+0000","last_active":"2024-09-05T12:56:05.065937+0000","last_peered":"2024-09-05T12:56:05.065937+0000","last_clean":"2024-09-05T12:56:05.065937+0000","last_became_active":"2024-09-05T12:55:43.735928+0000","last_became_peered":"2024-09-05T12:55:43.735928+0000","last_unstale":"2024-09-05T12:56:05.065937+0000","last_undegraded":"2024-09-05T12:56:05.065937+0000","last_fullsized":"2024-09-05T12:56:05.065937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:04:43.215616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851777+0000","last_change":"2024-09-05T12:55:45.739178+0000","last_active":"2024-09-05T12:56:05.851777+0000","last_peered":"2024-09-05T12:56:05.851777+0000","last_clean":"2024-09-05T12:56:05.851777+0000","last_became_active":"2024-09-05T12:55:45.738863+0000","last_became_peered":"2024-09-05T12:55:45.738863+0000","last_unstale":"2024-09-05T12:56:05.851777+0000","last_undegraded":"2024-09-05T12:56:05.851777+0000","last_fullsized":"2024-09-05T12:56:05.851777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:08.273036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'32","reported_seq":264,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:33.969399+0000","last_change":"2024-09-05T12:55:43.725380+0000","last_active":"2024-09-05T12:57:33.969399+0000","last_peered":"2024-09-05T12:57:33.969399+0000","last_clean":"2024-09-05T12:57:33.969399+0000","last_became_active":"2024-09-05T12:55:43.725000+0000","last_became_peered":"2024-09-05T12:55:43.725000+0000","last_unstale":"2024-09-05T12:57:33.969399+0000","last_undegraded":"2024-09-05T12:57:33.969399+0000","last_fullsized":"2024-09-05T12:57:33.969399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:34:13.288894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64559,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":168,"num_write":33,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061405+0000","last_change":"2024-09-05T12:55:45.742269+0000","last_active":"2024-09-05T12:56:05.061405+0000","last_peered":"2024-09-05T12:56:05.061405+0000","last_clean":"2024-09-05T12:56:05.061405+0000","last_became_active":"2024-09-05T12:55:45.741723+0000","last_became_peered":"2024-09-05T12:55:45.741723+0000","last_unstale":"2024-09-05T12:56:05.061405+0000","last_undegraded":"2024-09-05T12:56:05.061405+0000","last_fullsized":"2024-09-05T12:56:05.061405+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:39.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061771+0000","last_change":"2024-09-05T12:55:43.723725+0000","last_active":"2024-09-05T12:56:05.061771+0000","last_peered":"2024-09-05T12:56:05.061771+0000","last_clean":"2024-09-05T12:56:05.061771+0000","last_became_active":"2024-09-05T12:55:43.723351+0000","last_became_peered":"2024-09-05T12:55:43.723351+0000","last_unstale":"2024-09-05T12:56:05.061771+0000","last_undegraded":"2024-09-05T12:56:05.061771+0000","last_fullsized":"2024-09-05T12:56:05.061771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:15:40.485461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819355+0000","last_change":"2024-09-05T12:55:45.742293+0000","last_active":"2024-09-05T12:56:05.819355+0000","last_peered":"2024-09-05T12:56:05.819355+0000","last_clean":"2024-09-05T12:56:05.819355+0000","last_became_active":"2024-09-05T12:55:45.741998+0000","last_became_peered":"2024-09-05T12:55:45.741998+0000","last_unstale":"2024-09-05T12:56:05.819355+0000","last_undegraded":"2024-09-05T12:56:05.819355+0000","last_fullsized":"2024-09-05T12:56:05.819355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:25:23.731384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065615+0000","last_change":"2024-09-05T12:55:43.726519+0000","last_active":"2024-09-05T12:56:05.065615+0000","last_peered":"2024-09-05T12:56:05.065615+0000","last_clean":"2024-09-05T12:56:05.065615+0000","last_became_active":"2024-09-05T12:55:43.726231+0000","last_became_peered":"2024-09-05T12:55:43.726231+0000","last_unstale":"2024-09-05T12:56:05.065615+0000","last_undegraded":"2024-09-05T12:56:05.065615+0000","last_fullsized":"2024-09-05T12:56:05.065615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:22:55.460814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676243+0000","last_change":"2024-09-05T12:55:45.739359+0000","last_active":"2024-09-05T12:56:05.676243+0000","last_peered":"2024-09-05T12:56:05.676243+0000","last_clean":"2024-09-05T12:56:05.676243+0000","last_became_active":"2024-09-05T12:55:45.738358+0000","last_became_peered":"2024-09-05T12:55:45.738358+0000","last_unstale":"2024-09-05T12:56:05.676243+0000","last_undegraded":"2024-09-05T12:56:05.676243+0000","last_fullsized":"2024-09-05T12:56:05.676243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:11:37.144174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:29.952545+0000","last_change":"2024-09-05T12:55:43.726623+0000","last_active":"2024-09-05T12:57:29.952545+0000","last_peered":"2024-09-05T12:57:29.952545+0000","last_clean":"2024-09-05T12:57:29.952545+0000","last_became_active":"2024-09-05T12:55:43.726281+0000","last_became_peered":"2024-09-05T12:55:43.726281+0000","last_unstale":"2024-09-05T12:57:29.952545+0000","last_undegraded":"2024-09-05T12:57:29.952545+0000","last_fullsized":"2024-09-05T12:57:29.952545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:59:07.503458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676010+0000","last_change":"2024-09-05T12:55:45.745731+0000","last_active":"2024-09-05T12:56:05.676010+0000","last_peered":"2024-09-05T12:56:05.676010+0000","last_clean":"2024-09-05T12:56:05.676010+0000","last_became_active":"2024-09-05T12:55:45.745399+0000","last_became_peered":"2024-09-05T12:55:45.745399+0000","last_unstale":"2024-09-05T12:56:05.676010+0000","last_undegraded":"2024-09-05T12:56:05.676010+0000","last_fullsized":"2024-09-05T12:56:05.676010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:47:44.737335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061012+0000","last_change":"2024-09-05T12:55:43.736527+0000","last_active":"2024-09-05T12:56:05.061012+0000","last_peered":"2024-09-05T12:56:05.061012+0000","last_clean":"2024-09-05T12:56:05.061012+0000","last_became_active":"2024-09-05T12:55:43.736088+0000","last_became_peered":"2024-09-05T12:55:43.736088+0000","last_unstale":"2024-09-05T12:56:05.061012+0000","last_undegraded":"2024-09-05T12:56:05.061012+0000","last_fullsized":"2024-09-05T12:56:05.061012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:14.570503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.853150+0000","last_change":"2024-09-05T12:56:05.853150+0000","last_active":"2024-09-05T12:56:05.853150+0000","last_peered":"2024-09-05T12:56:05.853150+0000","last_clean":"2024-09-05T12:56:05.853150+0000","last_became_active":"2024-09-05T12:56:05.852728+0000","last_became_peered":"2024-09-05T12:56:05.852728+0000","last_unstale":"2024-09-05T12:56:05.853150+0000","last_undegraded":"2024-09-05T12:56:05.853150+0000","last_fullsized":"2024-09-05T12:56:05.853150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:58:49.654402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062050+0000","last_change":"2024-09-05T12:55:43.726989+0000","last_active":"2024-09-05T12:56:05.062050+0000","last_peered":"2024-09-05T12:56:05.062050+0000","last_clean":"2024-09-05T12:56:05.062050+0000","last_became_active":"2024-09-05T12:55:43.726690+0000","last_became_peered":"2024-09-05T12:55:43.726690+0000","last_unstale":"2024-09-05T12:56:05.062050+0000","last_undegraded":"2024-09-05T12:56:05.062050+0000","last_fullsized":"2024-09-05T12:56:05.062050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:15:31.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059176+0000","last_change":"2024-09-05T12:55:45.754849+0000","last_active":"2024-09-05T12:56:05.059176+0000","last_peered":"2024-09-05T12:56:05.059176+0000","last_clean":"2024-09-05T12:56:05.059176+0000","last_became_active":"2024-09-05T12:55:45.754539+0000","last_became_peered":"2024-09-05T12:55:45.754539+0000","last_unstale":"2024-09-05T12:56:05.059176+0000","last_undegraded":"2024-09-05T12:56:05.059176+0000","last_fullsized":"2024-09-05T12:56:05.059176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:14:17.628561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819674+0000","last_change":"2024-09-05T12:55:43.723140+0000","last_active":"2024-09-05T12:56:05.819674+0000","last_peered":"2024-09-05T12:56:05.819674+0000","last_clean":"2024-09-05T12:56:05.819674+0000","last_became_active":"2024-09-05T12:55:43.722806+0000","last_became_peered":"2024-09-05T12:55:43.722806+0000","last_unstale":"2024-09-05T12:56:05.819674+0000","last_undegraded":"2024-09-05T12:56:05.819674+0000","last_fullsized":"2024-09-05T12:56:05.819674+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:00:30.041237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676678+0000","last_change":"2024-09-05T12:55:45.750948+0000","last_active":"2024-09-05T12:56:05.676678+0000","last_peered":"2024-09-05T12:56:05.676678+0000","last_clean":"2024-09-05T12:56:05.676678+0000","last_became_active":"2024-09-05T12:55:45.750642+0000","last_became_peered":"2024-09-05T12:55:45.750642+0000","last_unstale":"2024-09-05T12:56:05.676678+0000","last_undegraded":"2024-09-05T12:56:05.676678+0000","last_fullsized":"2024-09-05T12:56:05.676678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:17:48.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.066001+0000","last_change":"2024-09-05T12:55:43.724847+0000","last_active":"2024-09-05T12:56:05.066001+0000","last_peered":"2024-09-05T12:56:05.066001+0000","last_clean":"2024-09-05T12:56:05.066001+0000","last_became_active":"2024-09-05T12:55:43.724538+0000","last_became_peered":"2024-09-05T12:55:43.724538+0000","last_unstale":"2024-09-05T12:56:05.066001+0000","last_undegraded":"2024-09-05T12:56:05.066001+0000","last_fullsized":"2024-09-05T12:56:05.066001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:13:46.011992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676407+0000","last_change":"2024-09-05T12:55:45.742080+0000","last_active":"2024-09-05T12:56:05.676407+0000","last_peered":"2024-09-05T12:56:05.676407+0000","last_clean":"2024-09-05T12:56:05.676407+0000","last_became_active":"2024-09-05T12:55:45.741749+0000","last_became_peered":"2024-09-05T12:55:45.741749+0000","last_unstale":"2024-09-05T12:56:05.676407+0000","last_undegraded":"2024-09-05T12:56:05.676407+0000","last_fullsized":"2024-09-05T12:56:05.676407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:20.597209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061670+0000","last_change":"2024-09-05T12:55:43.736856+0000","last_active":"2024-09-05T12:56:05.061670+0000","last_peered":"2024-09-05T12:56:05.061670+0000","last_clean":"2024-09-05T12:56:05.061670+0000","last_became_active":"2024-09-05T12:55:43.736490+0000","last_became_peered":"2024-09-05T12:55:43.736490+0000","last_unstale":"2024-09-05T12:56:05.061670+0000","last_undegraded":"2024-09-05T12:56:05.061670+0000","last_fullsized":"2024-09-05T12:56:05.061670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:36:55.286932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676384+0000","last_change":"2024-09-05T12:55:45.750667+0000","last_active":"2024-09-05T12:56:05.676384+0000","last_peered":"2024-09-05T12:56:05.676384+0000","last_clean":"2024-09-05T12:56:05.676384+0000","last_became_active":"2024-09-05T12:55:45.750386+0000","last_became_peered":"2024-09-05T12:55:45.750386+0000","last_unstale":"2024-09-05T12:56:05.676384+0000","last_undegraded":"2024-09-05T12:56:05.676384+0000","last_fullsized":"2024-09-05T12:56:05.676384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:32:41.443471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":333,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676394+0000","last_change":"2024-09-05T12:54:31.534043+0000","last_active":"2024-09-05T12:56:05.676394+0000","last_peered":"2024-09-05T12:56:05.676394+0000","last_clean":"2024-09-05T12:56:05.676394+0000","last_became_active":"2024-09-05T12:54:31.533610+0000","last_became_peered":"2024-09-05T12:54:31.533610+0000","last_unstale":"2024-09-05T12:56:05.676394+0000","last_undegraded":"2024-09-05T12:56:05.676394+0000","last_fullsized":"2024-09-05T12:56:05.676394+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:51:12.506567+0000","last_clean_scrub_stamp":"2024-09-05T12:51:12.506567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:30:50.399925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.201941+0000","last_change":"2024-09-05T12:55:43.727743+0000","last_active":"2024-09-05T12:56:05.201941+0000","last_peered":"2024-09-05T12:56:05.201941+0000","last_clean":"2024-09-05T12:56:05.201941+0000","last_became_active":"2024-09-05T12:55:43.727333+0000","last_became_peered":"2024-09-05T12:55:43.727333+0000","last_unstale":"2024-09-05T12:56:05.201941+0000","last_undegraded":"2024-09-05T12:56:05.201941+0000","last_fullsized":"2024-09-05T12:56:05.201941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:41:21.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061274+0000","last_change":"2024-09-05T12:55:45.744268+0000","last_active":"2024-09-05T12:56:05.061274+0000","last_peered":"2024-09-05T12:56:05.061274+0000","last_clean":"2024-09-05T12:56:05.061274+0000","last_became_active":"2024-09-05T12:55:45.743976+0000","last_became_peered":"2024-09-05T12:55:45.743976+0000","last_unstale":"2024-09-05T12:56:05.061274+0000","last_undegraded":"2024-09-05T12:56:05.061274+0000","last_fullsized":"2024-09-05T12:56:05.061274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:02.568293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676247+0000","last_change":"2024-09-05T12:55:43.728853+0000","last_active":"2024-09-05T12:56:05.676247+0000","last_peered":"2024-09-05T12:56:05.676247+0000","last_clean":"2024-09-05T12:56:05.676247+0000","last_became_active":"2024-09-05T12:55:43.728559+0000","last_became_peered":"2024-09-05T12:55:43.728559+0000","last_unstale":"2024-09-05T12:56:05.676247+0000","last_undegraded":"2024-09-05T12:56:05.676247+0000","last_fullsized":"2024-09-05T12:56:05.676247+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:16:53.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819290+0000","last_change":"2024-09-05T12:55:45.748445+0000","last_active":"2024-09-05T12:56:05.819290+0000","last_peered":"2024-09-05T12:56:05.819290+0000","last_clean":"2024-09-05T12:56:05.819290+0000","last_became_active":"2024-09-05T12:55:45.748152+0000","last_became_peered":"2024-09-05T12:55:45.748152+0000","last_unstale":"2024-09-05T12:56:05.819290+0000","last_undegraded":"2024-09-05T12:56:05.819290+0000","last_fullsized":"2024-09-05T12:56:05.819290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:37:35.842555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:28.950297+0000","last_change":"2024-09-05T12:55:43.734607+0000","last_active":"2024-09-05T12:57:28.950297+0000","last_peered":"2024-09-05T12:57:28.950297+0000","last_clean":"2024-09-05T12:57:28.950297+0000","last_became_active":"2024-09-05T12:55:43.734288+0000","last_became_peered":"2024-09-05T12:55:43.734288+0000","last_unstale":"2024-09-05T12:57:28.950297+0000","last_undegraded":"2024-09-05T12:57:28.950297+0000","last_fullsized":"2024-09-05T12:57:28.950297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:40:40.350335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065590+0000","last_change":"2024-09-05T12:55:45.745622+0000","last_active":"2024-09-05T12:56:05.065590+0000","last_peered":"2024-09-05T12:56:05.065590+0000","last_clean":"2024-09-05T12:56:05.065590+0000","last_became_active":"2024-09-05T12:55:45.745282+0000","last_became_peered":"2024-09-05T12:55:45.745282+0000","last_unstale":"2024-09-05T12:56:05.065590+0000","last_undegraded":"2024-09-05T12:56:05.065590+0000","last_fullsized":"2024-09-05T12:56:05.065590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:50:19.657275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676337+0000","last_change":"2024-09-05T12:55:43.723985+0000","last_active":"2024-09-05T12:56:05.676337+0000","last_peered":"2024-09-05T12:56:05.676337+0000","last_clean":"2024-09-05T12:56:05.676337+0000","last_became_active":"2024-09-05T12:55:43.723651+0000","last_became_peered":"2024-09-05T12:55:43.723651+0000","last_unstale":"2024-09-05T12:56:05.676337+0000","last_undegraded":"2024-09-05T12:56:05.676337+0000","last_fullsized":"2024-09-05T12:56:05.676337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:10:45.723258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.062160+0000","last_change":"2024-09-05T12:55:45.738603+0000","last_active":"2024-09-05T12:56:05.062160+0000","last_peered":"2024-09-05T12:56:05.062160+0000","last_clean":"2024-09-05T12:56:05.062160+0000","last_became_active":"2024-09-05T12:55:45.738299+0000","last_became_peered":"2024-09-05T12:55:45.738299+0000","last_unstale":"2024-09-05T12:56:05.062160+0000","last_undegraded":"2024-09-05T12:56:05.062160+0000","last_fullsized":"2024-09-05T12:56:05.062160+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:05:28.174555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061144+0000","last_change":"2024-09-05T12:55:43.734587+0000","last_active":"2024-09-05T12:56:05.061144+0000","last_peered":"2024-09-05T12:56:05.061144+0000","last_clean":"2024-09-05T12:56:05.061144+0000","last_became_active":"2024-09-05T12:55:43.734260+0000","last_became_peered":"2024-09-05T12:55:43.734260+0000","last_unstale":"2024-09-05T12:56:05.061144+0000","last_undegraded":"2024-09-05T12:56:05.061144+0000","last_fullsized":"2024-09-05T12:56:05.061144+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:37:00.235234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:57:33.960947+0000","last_change":"2024-09-05T12:55:45.740516+0000","last_active":"2024-09-05T12:57:33.960947+0000","last_peered":"2024-09-05T12:57:33.960947+0000","last_clean":"2024-09-05T12:57:33.960947+0000","last_became_active":"2024-09-05T12:55:45.740227+0000","last_became_peered":"2024-09-05T12:55:45.740227+0000","last_unstale":"2024-09-05T12:57:33.960947+0000","last_undegraded":"2024-09-05T12:57:33.960947+0000","last_fullsized":"2024-09-05T12:57:33.960947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:34:44.922326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061647+0000","last_change":"2024-09-05T12:55:43.734592+0000","last_active":"2024-09-05T12:56:05.061647+0000","last_peered":"2024-09-05T12:56:05.061647+0000","last_clean":"2024-09-05T12:56:05.061647+0000","last_became_active":"2024-09-05T12:55:43.734243+0000","last_became_peered":"2024-09-05T12:55:43.734243+0000","last_unstale":"2024-09-05T12:56:05.061647+0000","last_undegraded":"2024-09-05T12:56:05.061647+0000","last_fullsized":"2024-09-05T12:56:05.061647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:14.368806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.819567+0000","last_change":"2024-09-05T12:55:45.748201+0000","last_active":"2024-09-05T12:56:05.819567+0000","last_peered":"2024-09-05T12:56:05.819567+0000","last_clean":"2024-09-05T12:56:05.819567+0000","last_became_active":"2024-09-05T12:55:45.747906+0000","last_became_peered":"2024-09-05T12:55:45.747906+0000","last_unstale":"2024-09-05T12:56:05.819567+0000","last_undegraded":"2024-09-05T12:56:05.819567+0000","last_fullsized":"2024-09-05T12:56:05.819567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:07.984589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:09.748332+0000","last_change":"2024-09-05T12:56:05.071328+0000","last_active":"2024-09-05T12:56:09.748332+0000","last_peered":"2024-09-05T12:56:09.748332+0000","last_clean":"2024-09-05T12:56:09.748332+0000","last_became_active":"2024-09-05T12:56:05.064345+0000","last_became_peered":"2024-09-05T12:56:05.064345+0000","last_unstale":"2024-09-05T12:56:09.748332+0000","last_undegraded":"2024-09-05T12:56:09.748332+0000","last_fullsized":"2024-09-05T12:56:09.748332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:30:31.850824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061601+0000","last_change":"2024-09-05T12:55:45.743225+0000","last_active":"2024-09-05T12:56:05.061601+0000","last_peered":"2024-09-05T12:56:05.061601+0000","last_clean":"2024-09-05T12:56:05.061601+0000","last_became_active":"2024-09-05T12:55:45.742923+0000","last_became_peered":"2024-09-05T12:55:45.742923+0000","last_unstale":"2024-09-05T12:56:05.061601+0000","last_undegraded":"2024-09-05T12:56:05.061601+0000","last_fullsized":"2024-09-05T12:56:05.061601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:50:09.056893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.202275+0000","last_change":"2024-09-05T12:55:43.723420+0000","last_active":"2024-09-05T12:56:05.202275+0000","last_peered":"2024-09-05T12:56:05.202275+0000","last_clean":"2024-09-05T12:56:05.202275+0000","last_became_active":"2024-09-05T12:55:43.723100+0000","last_became_peered":"2024-09-05T12:55:43.723100+0000","last_unstale":"2024-09-05T12:56:05.202275+0000","last_undegraded":"2024-09-05T12:56:05.202275+0000","last_fullsized":"2024-09-05T12:56:05.202275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:21:33.307826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.678039+0000","last_change":"2024-09-05T12:56:05.678039+0000","last_active":"2024-09-05T12:56:05.678039+0000","last_peered":"2024-09-05T12:56:05.678039+0000","last_clean":"2024-09-05T12:56:05.678039+0000","last_became_active":"2024-09-05T12:56:05.677749+0000","last_became_peered":"2024-09-05T12:56:05.677749+0000","last_unstale":"2024-09-05T12:56:05.678039+0000","last_undegraded":"2024-09-05T12:56:05.678039+0000","last_fullsized":"2024-09-05T12:56:05.678039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:47:12.770873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851620+0000","last_change":"2024-09-05T12:55:43.736075+0000","last_active":"2024-09-05T12:56:05.851620+0000","last_peered":"2024-09-05T12:56:05.851620+0000","last_clean":"2024-09-05T12:56:05.851620+0000","last_became_active":"2024-09-05T12:55:43.735808+0000","last_became_peered":"2024-09-05T12:55:43.735808+0000","last_unstale":"2024-09-05T12:56:05.851620+0000","last_undegraded":"2024-09-05T12:56:05.851620+0000","last_fullsized":"2024-09-05T12:56:05.851620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:52:25.842728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061815+0000","last_change":"2024-09-05T12:55:45.747180+0000","last_active":"2024-09-05T12:56:05.061815+0000","last_peered":"2024-09-05T12:56:05.061815+0000","last_clean":"2024-09-05T12:56:05.061815+0000","last_became_active":"2024-09-05T12:55:45.746297+0000","last_became_peered":"2024-09-05T12:55:45.746297+0000","last_unstale":"2024-09-05T12:56:05.061815+0000","last_undegraded":"2024-09-05T12:56:05.061815+0000","last_fullsized":"2024-09-05T12:56:05.061815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:24:33.657861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060711+0000","last_change":"2024-09-05T12:55:43.720054+0000","last_active":"2024-09-05T12:56:05.060711+0000","last_peered":"2024-09-05T12:56:05.060711+0000","last_clean":"2024-09-05T12:56:05.060711+0000","last_became_active":"2024-09-05T12:55:43.719762+0000","last_became_peered":"2024-09-05T12:55:43.719762+0000","last_unstale":"2024-09-05T12:56:05.060711+0000","last_undegraded":"2024-09-05T12:56:05.060711+0000","last_fullsized":"2024-09-05T12:56:05.060711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:07:57.623333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.059189+0000","last_change":"2024-09-05T12:55:45.756031+0000","last_active":"2024-09-05T12:56:05.059189+0000","last_peered":"2024-09-05T12:56:05.059189+0000","last_clean":"2024-09-05T12:56:05.059189+0000","last_became_active":"2024-09-05T12:55:45.755723+0000","last_became_peered":"2024-09-05T12:55:45.755723+0000","last_unstale":"2024-09-05T12:56:05.059189+0000","last_undegraded":"2024-09-05T12:56:05.059189+0000","last_fullsized":"2024-09-05T12:56:05.059189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:27:26.760307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.069746+0000","last_change":"2024-09-05T12:56:05.069208+0000","last_active":"2024-09-05T12:56:05.069746+0000","last_peered":"2024-09-05T12:56:05.069746+0000","last_clean":"2024-09-05T12:56:05.069746+0000","last_became_active":"2024-09-05T12:56:05.063698+0000","last_became_peered":"2024-09-05T12:56:05.063698+0000","last_unstale":"2024-09-05T12:56:05.069746+0000","last_undegraded":"2024-09-05T12:56:05.069746+0000","last_fullsized":"2024-09-05T12:56:05.069746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:55:54.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061163+0000","last_change":"2024-09-05T12:55:45.743108+0000","last_active":"2024-09-05T12:56:05.061163+0000","last_peered":"2024-09-05T12:56:05.061163+0000","last_clean":"2024-09-05T12:56:05.061163+0000","last_became_active":"2024-09-05T12:55:45.742197+0000","last_became_peered":"2024-09-05T12:55:45.742197+0000","last_unstale":"2024-09-05T12:56:05.061163+0000","last_undegraded":"2024-09-05T12:56:05.061163+0000","last_fullsized":"2024-09-05T12:56:05.061163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:13:15.192298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061447+0000","last_change":"2024-09-05T12:55:43.725893+0000","last_active":"2024-09-05T12:56:05.061447+0000","last_peered":"2024-09-05T12:56:05.061447+0000","last_clean":"2024-09-05T12:56:05.061447+0000","last_became_active":"2024-09-05T12:55:43.725578+0000","last_became_peered":"2024-09-05T12:55:43.725578+0000","last_unstale":"2024-09-05T12:56:05.061447+0000","last_undegraded":"2024-09-05T12:56:05.061447+0000","last_fullsized":"2024-09-05T12:56:05.061447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:39.101167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.676363+0000","last_change":"2024-09-05T12:55:45.746727+0000","last_active":"2024-09-05T12:56:05.676363+0000","last_peered":"2024-09-05T12:56:05.676363+0000","last_clean":"2024-09-05T12:56:05.676363+0000","last_became_active":"2024-09-05T12:55:45.746446+0000","last_became_peered":"2024-09-05T12:55:45.746446+0000","last_unstale":"2024-09-05T12:56:05.676363+0000","last_undegraded":"2024-09-05T12:56:05.676363+0000","last_fullsized":"2024-09-05T12:56:05.676363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:56:51.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.065862+0000","last_change":"2024-09-05T12:55:45.750253+0000","last_active":"2024-09-05T12:56:05.065862+0000","last_peered":"2024-09-05T12:56:05.065862+0000","last_clean":"2024-09-05T12:56:05.065862+0000","last_became_active":"2024-09-05T12:55:45.749911+0000","last_became_peered":"2024-09-05T12:55:45.749911+0000","last_unstale":"2024-09-05T12:56:05.065862+0000","last_undegraded":"2024-09-05T12:56:05.065862+0000","last_fullsized":"2024-09-05T12:56:05.065862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:04:04.164858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061563+0000","last_change":"2024-09-05T12:55:43.728597+0000","last_active":"2024-09-05T12:56:05.061563+0000","last_peered":"2024-09-05T12:56:05.061563+0000","last_clean":"2024-09-05T12:56:05.061563+0000","last_became_active":"2024-09-05T12:55:43.727633+0000","last_became_peered":"2024-09-05T12:55:43.727633+0000","last_unstale":"2024-09-05T12:56:05.061563+0000","last_undegraded":"2024-09-05T12:56:05.061563+0000","last_fullsized":"2024-09-05T12:56:05.061563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:50:04.775603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.851671+0000","last_change":"2024-09-05T12:55:45.741539+0000","last_active":"2024-09-05T12:56:05.851671+0000","last_peered":"2024-09-05T12:56:05.851671+0000","last_clean":"2024-09-05T12:56:05.851671+0000","last_became_active":"2024-09-05T12:55:45.741247+0000","last_became_peered":"2024-09-05T12:55:45.741247+0000","last_unstale":"2024-09-05T12:56:05.851671+0000","last_undegraded":"2024-09-05T12:56:05.851671+0000","last_fullsized":"2024-09-05T12:56:05.851671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:57:23.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061516+0000","last_change":"2024-09-05T12:55:43.725085+0000","last_active":"2024-09-05T12:56:05.061516+0000","last_peered":"2024-09-05T12:56:05.061516+0000","last_clean":"2024-09-05T12:56:05.061516+0000","last_became_active":"2024-09-05T12:55:43.724772+0000","last_became_peered":"2024-09-05T12:55:43.724772+0000","last_unstale":"2024-09-05T12:56:05.061516+0000","last_undegraded":"2024-09-05T12:56:05.061516+0000","last_fullsized":"2024-09-05T12:56:05.061516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:48:16.567841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.063834+0000","last_change":"2024-09-05T12:55:45.745635+0000","last_active":"2024-09-05T12:56:05.063834+0000","last_peered":"2024-09-05T12:56:05.063834+0000","last_clean":"2024-09-05T12:56:05.063834+0000","last_became_active":"2024-09-05T12:55:45.745331+0000","last_became_peered":"2024-09-05T12:55:45.745331+0000","last_unstale":"2024-09-05T12:56:05.063834+0000","last_undegraded":"2024-09-05T12:56:05.063834+0000","last_fullsized":"2024-09-05T12:56:05.063834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:15:58.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061048+0000","last_change":"2024-09-05T12:55:43.734466+0000","last_active":"2024-09-05T12:56:05.061048+0000","last_peered":"2024-09-05T12:56:05.061048+0000","last_clean":"2024-09-05T12:56:05.061048+0000","last_became_active":"2024-09-05T12:55:43.734147+0000","last_became_peered":"2024-09-05T12:55:43.734147+0000","last_unstale":"2024-09-05T12:56:05.061048+0000","last_undegraded":"2024-09-05T12:56:05.061048+0000","last_fullsized":"2024-09-05T12:56:05.061048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:53:22.588471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.060906+0000","last_change":"2024-09-05T12:55:45.746328+0000","last_active":"2024-09-05T12:56:05.060906+0000","last_peered":"2024-09-05T12:56:05.060906+0000","last_clean":"2024-09-05T12:56:05.060906+0000","last_became_active":"2024-09-05T12:55:45.746012+0000","last_became_peered":"2024-09-05T12:55:45.746012+0000","last_unstale":"2024-09-05T12:56:05.060906+0000","last_undegraded":"2024-09-05T12:56:05.060906+0000","last_fullsized":"2024-09-05T12:56:05.060906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:44.713577+0000","last_clean_scrub_stamp":"2024-09-05T12:55:44.713577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:23:12.886759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T12:56:05.061386+0000","last_change":"2024-09-05T12:55:43.722519+0000","last_active":"2024-09-05T12:56:05.061386+0000","last_peered":"2024-09-05T12:56:05.061386+0000","last_clean":"2024-09-05T12:56:05.061386+0000","last_became_active":"2024-09-05T12:55:43.722220+0000","last_became_peered":"2024-09-05T12:55:43.722220+0000","last_unstale":"2024-09-05T12:56:05.061386+0000","last_undegraded":"2024-09-05T12:56:05.061386+0000","last_fullsized":"2024-09-05T12:56:05.061386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T12:55:42.706570+0000","last_clean_scrub_stamp":"2024-09-05T12:55:42.706570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:15.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68562,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":615,"num_read_kb":381,"num_write":166,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":200718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281587,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":425477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874281,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":1081344,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":425713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234034,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":1017565,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":425102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855425,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1017249,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":425539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":425413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":491024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":484659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":426373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35813,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T12:57:34.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:57:34.365 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.839+0000 7fd5dd576640 1 -- 172.21.15.73:0/1907390650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d810c170 msgr2=0x7fd5d810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.839+0000 7fd5dd576640 1 --2- 172.21.15.73:0/1907390650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d810c170 0x7fd5d810e610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009ca0 tx=0x7fd5d002a950 comp rx=0 tx=0).stop 2024-09-05T12:57:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.839+0000 7fd5dd576640 1 -- 172.21.15.73:0/1907390650 shutdown_connections 2024-09-05T12:57:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.839+0000 7fd5dd576640 1 --2- 172.21.15.73:0/1907390650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d810c170 0x7fd5d810e610 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.839+0000 7fd5dd576640 1 --2- 172.21.15.73:0/1907390650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d8103660 0x7fd5d810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.839+0000 7fd5dd576640 1 --2- 172.21.15.73:0/1907390650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d8102d40 0x7fd5d8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.839+0000 7fd5dd576640 1 -- 172.21.15.73:0/1907390650 >> 172.21.15.73:0/1907390650 conn(0x7fd5d80fc7a0 msgr2=0x7fd5d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.839+0000 7fd5dd576640 1 -- 172.21.15.73:0/1907390650 shutdown_connections 2024-09-05T12:57:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.839+0000 7fd5dd576640 1 -- 172.21.15.73:0/1907390650 wait complete. 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.839+0000 7fd5dd576640 1 Processor -- start 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5dd576640 1 -- start start 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5dd576640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d8102d40 0x7fd5d81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5dd576640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d8103660 0x7fd5d8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5dd576640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d810c170 0x7fd5d8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5dd576640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8111f70 con 0x7fd5d8103660 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5dd576640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8111df0 con 0x7fd5d810c170 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5dd576640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d81120f0 con 0x7fd5d8102d40 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5d67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d8103660 0x7fd5d8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5d67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d8103660 0x7fd5d8100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35942/0 (socket says 172.21.15.73:35942) 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5d67fc640 1 -- 172.21.15.73:0/142956586 learned_addr learned my addr 172.21.15.73:0/142956586 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:34.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5d6ffd640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d8102d40 0x7fd5d81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5d77fe640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d810c170 0x7fd5d8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5d67fc640 1 -- 172.21.15.73:0/142956586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d8102d40 msgr2=0x7fd5d81009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5d67fc640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d8102d40 0x7fd5d81009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5d67fc640 1 -- 172.21.15.73:0/142956586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d810c170 msgr2=0x7fd5d8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5d67fc640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d810c170 0x7fd5d8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.840+0000 7fd5d67fc640 1 -- 172.21.15.73:0/142956586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d81a6850 con 0x7fd5d8103660 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.841+0000 7fd5d67fc640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d8103660 0x7fd5d8100ee0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c970 tx=0x7fd5c800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.841+0000 7fd5bffff640 1 -- 172.21.15.73:0/142956586 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8007bb0 con 0x7fd5d8103660 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.841+0000 7fd5bffff640 1 -- 172.21.15.73:0/142956586 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5c8007d50 con 0x7fd5d8103660 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.841+0000 7fd5dd576640 1 -- 172.21.15.73:0/142956586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d81a6b40 con 0x7fd5d8103660 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.841+0000 7fd5bffff640 1 -- 172.21.15.73:0/142956586 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8018820 con 0x7fd5d8103660 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.841+0000 7fd5dd576640 1 -- 172.21.15.73:0/142956586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d81a7080 con 0x7fd5d8103660 2024-09-05T12:57:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.842+0000 7fd5dd576640 1 -- 172.21.15.73:0/142956586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d8103120 con 0x7fd5d8103660 2024-09-05T12:57:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.843+0000 7fd5bffff640 1 -- 172.21.15.73:0/142956586 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd5c80189c0 con 0x7fd5d8103660 2024-09-05T12:57:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.843+0000 7fd5bffff640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd5c00a2b80 0x7fd5c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.844+0000 7fd5d6ffd640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd5c00a2b80 0x7fd5c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.844+0000 7fd5bffff640 1 -- 172.21.15.73:0/142956586 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd5c80cefa0 con 0x7fd5d8103660 2024-09-05T12:57:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.844+0000 7fd5d6ffd640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd5c00a2b80 0x7fd5c00a5040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc005fd0 tx=0x7fd5cc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:34.848+0000 7fd5bffff640 1 -- 172.21.15.73:0/142956586 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5c8014030 con 0x7fd5d8103660 2024-09-05T12:57:35.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.050+0000 7fd5dd576640 1 -- 172.21.15.73:0/142956586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5d8106c80 con 0x7fd5d8103660 2024-09-05T12:57:35.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.050+0000 7fd5bffff640 1 -- 172.21.15.73:0/142956586 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11926 (secure 0 0 0) 0x7fd5c809bfd0 con 0x7fd5d8103660 2024-09-05T12:57:35.052 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:35.052 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"btime":"2024-09-05T12:57:30:110632+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:57:30.060424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T12:57:35.052 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 25 2024-09-05T12:57:35.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.052+0000 7fd5dd576640 1 -- 172.21.15.73:0/142956586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd5c00a2b80 msgr2=0x7fd5c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:35.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.052+0000 7fd5dd576640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd5c00a2b80 0x7fd5c00a5040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc005fd0 tx=0x7fd5cc00b390 comp rx=0 tx=0).stop 2024-09-05T12:57:35.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.052+0000 7fd5dd576640 1 -- 172.21.15.73:0/142956586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d8103660 msgr2=0x7fd5d8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:35.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.052+0000 7fd5dd576640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d8103660 0x7fd5d8100ee0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c970 tx=0x7fd5c800ce30 comp rx=0 tx=0).stop 2024-09-05T12:57:35.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.053+0000 7fd5dd576640 1 -- 172.21.15.73:0/142956586 shutdown_connections 2024-09-05T12:57:35.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.053+0000 7fd5dd576640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd5c00a2b80 0x7fd5c00a5040 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:35.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.053+0000 7fd5dd576640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d810c170 0x7fd5d8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:35.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.053+0000 7fd5dd576640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d8103660 0x7fd5d8100ee0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:35.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.053+0000 7fd5dd576640 1 --2- 172.21.15.73:0/142956586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d8102d40 0x7fd5d81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:35.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.053+0000 7fd5dd576640 1 -- 172.21.15.73:0/142956586 >> 172.21.15.73:0/142956586 conn(0x7fd5d80fc7a0 msgr2=0x7fd5d80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:35.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.053+0000 7fd5dd576640 1 -- 172.21.15.73:0/142956586 shutdown_connections 2024-09-05T12:57:35.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:35.053+0000 7fd5dd576640 1 -- 172.21.15.73:0/142956586 wait complete. 2024-09-05T12:57:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:35 smithi162 ceph-mon[34220]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:57:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:35 smithi162 ceph-mon[34220]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:57:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:35 smithi162 ceph-mon[34220]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-05T12:57:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:35 smithi162 ceph-mon[34220]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:57:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:35 smithi162 ceph-mon[34220]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-05T12:57:35.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:35 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/142956586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:35.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:35 smithi169 ceph-mon[34823]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:57:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:35 smithi169 ceph-mon[34823]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:57:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:35 smithi169 ceph-mon[34823]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-05T12:57:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:35 smithi169 ceph-mon[34823]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:57:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:35 smithi169 ceph-mon[34823]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-05T12:57:35.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:35 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/142956586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:35.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:35 smithi073 ceph-mon[30883]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:57:35.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:35 smithi073 ceph-mon[30883]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:57:35.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:35 smithi073 ceph-mon[30883]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-05T12:57:35.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:35 smithi073 ceph-mon[30883]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T12:57:35.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:35 smithi073 ceph-mon[30883]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-05T12:57:35.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:35 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/142956586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:57:35.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T12:57:36.059 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:36.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.488+0000 7f29cfd95640 1 -- 172.21.15.73:0/1865899626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29c8106a60 msgr2=0x7f29c8106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:36.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.488+0000 7f29cfd95640 1 --2- 172.21.15.73:0/1865899626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29c8106a60 0x7f29c8106e40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009930 tx=0x7f29c402a420 comp rx=0 tx=0).stop 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.489+0000 7f29cfd95640 1 -- 172.21.15.73:0/1865899626 shutdown_connections 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.489+0000 7f29cfd95640 1 --2- 172.21.15.73:0/1865899626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c8101400 0x7f29c810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.489+0000 7f29cfd95640 1 --2- 172.21.15.73:0/1865899626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c8100a60 0x7f29c8100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.489+0000 7f29cfd95640 1 --2- 172.21.15.73:0/1865899626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29c8106a60 0x7f29c8106e40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.489+0000 7f29cfd95640 1 -- 172.21.15.73:0/1865899626 >> 172.21.15.73:0/1865899626 conn(0x7f29c80fc780 msgr2=0x7f29c80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.489+0000 7f29cfd95640 1 -- 172.21.15.73:0/1865899626 shutdown_connections 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.489+0000 7f29cfd95640 1 -- 172.21.15.73:0/1865899626 wait complete. 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.489+0000 7f29cfd95640 1 Processor -- start 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.489+0000 7f29cfd95640 1 -- start start 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cfd95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29c8100a60 0x7f29c8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cfd95640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c8101400 0x7f29c81997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cfd95640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c8106a60 0x7f29c81a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cfd95640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f29c8110e20 con 0x7f29c8100a60 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cfd95640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f29c8110ca0 con 0x7f29c8106a60 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cfd95640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29c8110fa0 con 0x7f29c8101400 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cdb31640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29c8100a60 0x7f29c8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cdb31640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29c8100a60 0x7f29c8199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35962/0 (socket says 172.21.15.73:35962) 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cdb31640 1 -- 172.21.15.73:0/1794901919 learned_addr learned my addr 172.21.15.73:0/1794901919 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29ce332640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c8106a60 0x7f29c81a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cd330640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c8101400 0x7f29c81997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cdb31640 1 -- 172.21.15.73:0/1794901919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c8101400 msgr2=0x7f29c81997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cdb31640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c8101400 0x7f29c81997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cdb31640 1 -- 172.21.15.73:0/1794901919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c8106a60 msgr2=0x7f29c81a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cdb31640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c8106a60 0x7f29c81a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cdb31640 1 -- 172.21.15.73:0/1794901919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c81a4850 con 0x7f29c8100a60 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cdb31640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29c8100a60 0x7f29c8199290 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009a50 tx=0x7f29c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29beffd640 1 -- 172.21.15.73:0/1794901919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c403f030 con 0x7f29c8100a60 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29beffd640 1 -- 172.21.15.73:0/1794901919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29c4003ce0 con 0x7f29c8100a60 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cfd95640 1 -- 172.21.15.73:0/1794901919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c81a4a20 con 0x7f29c8100a60 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29beffd640 1 -- 172.21.15.73:0/1794901919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4035070 con 0x7f29c8100a60 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.490+0000 7f29cfd95640 1 -- 172.21.15.73:0/1794901919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c81a4e70 con 0x7f29c8100a60 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.492+0000 7f29cfd95640 1 -- 172.21.15.73:0/1794901919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c8100ec0 con 0x7f29c8100a60 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.492+0000 7f29beffd640 1 -- 172.21.15.73:0/1794901919 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f29c4042030 con 0x7f29c8100a60 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.493+0000 7f29beffd640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f29b40a2b80 0x7f29b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.493+0000 7f29beffd640 1 -- 172.21.15.73:0/1794901919 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f29c40ef640 con 0x7f29c8100a60 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.493+0000 7f29cd330640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f29b40a2b80 0x7f29b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.494+0000 7f29cd330640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f29b40a2b80 0x7f29b40a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f29c806b300 tx=0x7f29b8005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:36.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.497+0000 7f29beffd640 1 -- 172.21.15.73:0/1794901919 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29c40bc5d0 con 0x7f29c8100a60 2024-09-05T12:57:36.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.665+0000 7f29cfd95640 1 -- 172.21.15.73:0/1794901919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29c8108fd0 con 0x7f29c8100a60 2024-09-05T12:57:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.667+0000 7f29beffd640 1 -- 172.21.15.73:0/1794901919 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22645 (secure 0 0 0) 0x7f29c40bbed0 con 0x7f29c8100a60 2024-09-05T12:57:36.668 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:57:36.668 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":80,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T12:56:05.055165+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T12:57:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 -- 172.21.15.73:0/1794901919 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f29b40a2b80 msgr2=0x7f29b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f29b40a2b80 0x7f29b40a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f29c806b300 tx=0x7f29b8005cc0 comp rx=0 tx=0).stop 2024-09-05T12:57:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 -- 172.21.15.73:0/1794901919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29c8100a60 msgr2=0x7f29c8199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29c8100a60 0x7f29c8199290 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009a50 tx=0x7f29c4004270 comp rx=0 tx=0).stop 2024-09-05T12:57:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 -- 172.21.15.73:0/1794901919 shutdown_connections 2024-09-05T12:57:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f29b40a2b80 0x7f29b40a5040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c8106a60 0x7f29c81a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:36.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c8101400 0x7f29c81997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:36.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 --2- 172.21.15.73:0/1794901919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29c8100a60 0x7f29c8199290 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:36.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 -- 172.21.15.73:0/1794901919 >> 172.21.15.73:0/1794901919 conn(0x7f29c80fc780 msgr2=0x7f29c80fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:36.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 -- 172.21.15.73:0/1794901919 shutdown_connections 2024-09-05T12:57:36.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:36.669+0000 7f29cfd95640 1 -- 172.21.15.73:0/1794901919 wait complete. 2024-09-05T12:57:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:37 smithi162 ceph-mon[34220]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-05T12:57:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:37 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1794901919' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:57:37.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:37 smithi169 ceph-mon[34823]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-05T12:57:37.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:37 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1794901919' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:57:37.374 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:37 smithi073 ceph-mon[30883]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-05T12:57:37.374 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:37 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1794901919' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T12:57:37.404 DEBUG:tasks.fwd_scrub:Yielding 2024-09-05T12:57:37.405 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-05T12:57:37.415 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2024-09-05T12:57:37.415 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-05T12:57:37.415 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-05T12:57:37.415 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T12:57:37.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T12:57:37.418 INFO:teuthology.run_tasks:Running task workunit... 2024-09-05T12:57:37.524 INFO:tasks.workunit:Pulling workunits from ref e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:57:37.525 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-05T12:57:37.525 INFO:tasks.workunit:timeout=3h 2024-09-05T12:57:37.525 INFO:tasks.workunit:cleanup=True 2024-09-05T12:57:37.525 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-05T12:57:37.542 INFO:teuthology.orchestra.run.smithi073.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-05T12:57:37.542 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-05T12:57:37.543 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 79h/121d Inode: 1099511628283 Links: 2 2024-09-05T12:57:37.543 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T12:57:37.543 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-05T12:57:37.543 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-05 12:56:04.400926058 +0000 2024-09-05T12:57:37.543 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-05 12:56:04.400926058 +0000 2024-09-05T12:57:37.543 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-05 12:57:29.267616153 +0000 2024-09-05T12:57:37.543 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-05 12:56:04.400926058 +0000 2024-09-05T12:57:37.543 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-05T12:57:37.543 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-05T12:57:37.617 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e856d6b2462509a377ef39149a05475ed006ebac 2024-09-05T12:57:37.666 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:37.673 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-05T12:57:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.178+0000 7f3da69b7640 1 -- 172.21.15.73:0/3712135056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3da01036e0 msgr2=0x7f3da0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.178+0000 7f3da69b7640 1 --2- 172.21.15.73:0/3712135056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3da01036e0 0x7f3da0107b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009930 tx=0x7f3d8802a420 comp rx=0 tx=0).stop 2024-09-05T12:57:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.178+0000 7f3da69b7640 1 -- 172.21.15.73:0/3712135056 shutdown_connections 2024-09-05T12:57:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.178+0000 7f3da69b7640 1 --2- 172.21.15.73:0/3712135056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01082a0 0x7f3da010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.178+0000 7f3da69b7640 1 --2- 172.21.15.73:0/3712135056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3da01036e0 0x7f3da0107b90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.178+0000 7f3da69b7640 1 --2- 172.21.15.73:0/3712135056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3da0102d30 0x7f3da0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.178+0000 7f3da69b7640 1 -- 172.21.15.73:0/3712135056 >> 172.21.15.73:0/3712135056 conn(0x7f3da00fc7d0 msgr2=0x7f3da00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.178+0000 7f3da69b7640 1 -- 172.21.15.73:0/3712135056 shutdown_connections 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.178+0000 7f3da69b7640 1 -- 172.21.15.73:0/3712135056 wait complete. 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da69b7640 1 Processor -- start 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da69b7640 1 -- start start 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da69b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3da0102d30 0x7f3da01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da69b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 0x7f3da0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da69b7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3da01082a0 0x7f3da019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da69b7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01120a0 con 0x7f3da01082a0 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da69b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3da0111f20 con 0x7f3da0102d30 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da69b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3da0112220 con 0x7f3da01036e0 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da4f54640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3da01082a0 0x7f3da019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da4f54640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3da01082a0 0x7f3da019ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35990/0 (socket says 172.21.15.73:35990) 2024-09-05T12:57:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da4f54640 1 -- 172.21.15.73:0/2335788704 learned_addr learned my addr 172.21.15.73:0/2335788704 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3da0102d30 0x7f3da01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3d97fff640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 0x7f3da0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da4f54640 1 -- 172.21.15.73:0/2335788704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 msgr2=0x7f3da0198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da4f54640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 0x7f3da0198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da4f54640 1 -- 172.21.15.73:0/2335788704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3da0102d30 msgr2=0x7f3da01985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da4f54640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3da0102d30 0x7f3da01985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da4f54640 1 -- 172.21.15.73:0/2335788704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da019d570 con 0x7f3da01082a0 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3da0102d30 0x7f3da01985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3d97fff640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 0x7f3da0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.179+0000 7f3da4f54640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3da01082a0 0x7f3da019ce90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800eaa0 tx=0x7f3d9800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.180+0000 7f3d9dffb640 1 -- 172.21.15.73:0/2335788704 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800cdb0 con 0x7f3da01082a0 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.180+0000 7f3da69b7640 1 -- 172.21.15.73:0/2335788704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da019d860 con 0x7f3da01082a0 2024-09-05T12:57:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.180+0000 7f3d9dffb640 1 -- 172.21.15.73:0/2335788704 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d98005020 con 0x7f3da01082a0 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.180+0000 7f3d9dffb640 1 -- 172.21.15.73:0/2335788704 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d980116b0 con 0x7f3da01082a0 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.180+0000 7f3da69b7640 1 -- 172.21.15.73:0/2335788704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da01a5140 con 0x7f3da01082a0 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.182+0000 7f3d9dffb640 1 -- 172.21.15.73:0/2335788704 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3d98005560 con 0x7f3da01082a0 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.182+0000 7f3da8d8d740 1 Processor -- start 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.182+0000 7f3da8d8d740 1 -- start start 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.182+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea0543f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea0551130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fea04a9280 con 0x55fea0544480 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fea0450b10 con 0x55fea0543b60 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fea04a5240 con 0x55fea054ed40 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9dffb640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3d8c0a2b80 0x7f3d8c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36004/0 (socket says 172.21.15.73:36004) 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9ffff640 1 -- 172.21.15.73:0/3341974351 learned_addr learned my addr 172.21.15.73:0/3341974351 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d97fff640 1 --2- 172.21.15.73:0/3341974351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea0551130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3da4f54640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3d8c0a2b80 0x7f3d8c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d97fff640 1 --2- 172.21.15.73:0/3341974351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea0543f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9dffb640 1 -- 172.21.15.73:0/2335788704 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3d980cf2a0 con 0x7f3da01082a0 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9ffff640 1 -- 172.21.15.73:0/3341974351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 msgr2=0x55fea0551130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/3341974351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea0551130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9ffff640 1 -- 172.21.15.73:0/3341974351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 msgr2=0x55fea0543f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/3341974351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea0543f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9ffff640 1 -- 172.21.15.73:0/3341974351 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea045d1f0 con 0x55fea0544480 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d97fff640 1 --2- 172.21.15.73:0/3341974351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea0551130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/3341974351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054e800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009c50 tx=0x7f3d9000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04f52864e2c148b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3da4f54640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3d8c0a2b80 0x7f3d8c0a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d9809b830 tx=0x7f3d98066700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d967fc640 1 -- 172.21.15.73:0/3341974351 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90016070 con 0x55fea0544480 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d967fc640 1 -- 172.21.15.73:0/3341974351 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d90005500 con 0x55fea0544480 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.183+0000 7f3d967fc640 1 -- 172.21.15.73:0/3341974351 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90011670 con 0x55fea0544480 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.184+0000 7f3da8d8d740 1 -- 172.21.15.73:0/3341974351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 msgr2=0x55fea054e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.184+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/3341974351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054e800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009c50 tx=0x7f3d9000e6c0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.184+0000 7f3da8d8d740 1 -- 172.21.15.73:0/3341974351 shutdown_connections 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.184+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/3341974351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea0551130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.184+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/3341974351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054e800 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.184+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/3341974351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea0543f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.184+0000 7f3da8d8d740 1 -- 172.21.15.73:0/3341974351 >> 172.21.15.73:0/3341974351 conn(0x55fea05400f0 msgr2=0x55fea05404d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.184+0000 7f3da8d8d740 1 -- 172.21.15.73:0/3341974351 shutdown_connections 2024-09-05T12:57:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.184+0000 7f3da8d8d740 1 -- 172.21.15.73:0/3341974351 wait complete. 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.184+0000 7f3da8d8d740 1 -- start start 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3da8d8d740 1 Processor -- start 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea054bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea054c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fea0551910 con 0x55fea0544480 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fea0463f10 con 0x55fea0543b60 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fea0551a90 con 0x55fea054ed40 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3da8d8d740 10 client.0 _ll_register_callbacks cb 0x55fea042ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3d9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3d9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36008/0 (socket says 172.21.15.73:36008) 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3d9ffff640 1 -- 172.21.15.73:0/354779138 learned_addr learned my addr 172.21.15.73:0/354779138 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3d97fff640 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea054bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3d9ffff640 1 -- 172.21.15.73:0/354779138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 msgr2=0x55fea054c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea054c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3d9ffff640 1 -- 172.21.15.73:0/354779138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 msgr2=0x55fea054bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea054bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.185+0000 7f3d9ffff640 1 -- 172.21.15.73:0/354779138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea021a6a0 con 0x55fea0544480 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054c120 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3d900099c0 tx=0x7f3d9000efc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2924c9ce37e76d0c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3d7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/354779138 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90028060 con 0x55fea0544480 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/354779138 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3d90004e50 con 0x55fea0544480 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3da8d8d740 1 -- 172.21.15.73:0/354779138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d90005500 con 0x55fea0544480 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/354779138 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d90016040 con 0x55fea0544480 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3da8d8d740 10 client.15207 fetch_fsmap learned FSMap version 25 2024-09-05T12:57:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3da8d8d740 1 -- 172.21.15.73:0/354779138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fea055d4e0 con 0x55fea0544480 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/354779138 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d90005500 con 0x55fea0544480 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/354779138 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d9000f040 con 0x55fea0544480 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3da8d8d740 10 client.15207 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3da8d8d740 10 client.15207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3da8d8d740 20 client.15207 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fea055e890 0x55fea0560c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3da8d8d740 4 client.15207 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.186+0000 7f3da8d8d740 1 -- 172.21.15.73:0/354779138 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fea04b67f0 con 0x55fea055e890 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.187+0000 7f3d97fff640 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fea055e890 0x55fea0560c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.187+0000 7f3d97fff640 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fea055e890 0x55fea0560c80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f99d63f431a8d45b server_cookie=afa17c0a6729fbe1 in_seq=0 out_seq=0 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.187+0000 7f3d7f7fe640 10 client.15207 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/354779138 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fea04b67f0 con 0x55fea055e890 2024-09-05T12:57:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3d7f7fe640 10 client.15207 handle_command_reply: tid=0 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 client.15207 shutdown 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 -- 172.21.15.73:0/354779138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 msgr2=0x55fea054c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054c120 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3d900099c0 tx=0x7f3d9000efc0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 -- 172.21.15.73:0/354779138 shutdown_connections 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fea055e890 0x55fea0560c80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea054c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea054c120 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3d7f7fe640 0 client.15207 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/354779138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea054bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 -- 172.21.15.73:0/354779138 >> 172.21.15.73:0/354779138 conn(0x55fea05400f0 msgr2=0x55fea053f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 -- 172.21.15.73:0/354779138 shutdown_connections 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 1 -- 172.21.15.73:0/354779138 wait complete. 2024-09-05T12:57:38.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.188+0000 7f3da8d8d740 20 client.15207 trim_cache size 0 max 16384 2024-09-05T12:57:38.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3da8d8d740 1 Processor -- start 2024-09-05T12:57:38.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3da8d8d740 1 -- start start 2024-09-05T12:57:38.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea05662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea0566820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea05455b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01affa0 con 0x55fea0544480 2024-09-05T12:57:38.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01ad870 con 0x55fea0543b60 2024-09-05T12:57:38.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01ab6c0 con 0x55fea054ed40 2024-09-05T12:57:38.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea0566820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea0566820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36016/0 (socket says 172.21.15.73:36016) 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d9ffff640 1 -- 172.21.15.73:0/2407245072 learned_addr learned my addr 172.21.15.73:0/2407245072 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d97fff640 1 --2- 172.21.15.73:0/2407245072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea05455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d9ffff640 1 -- 172.21.15.73:0/2407245072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 msgr2=0x55fea05455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/2407245072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea05455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d97fff640 1 --2- 172.21.15.73:0/2407245072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea05662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d9ffff640 1 -- 172.21.15.73:0/2407245072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 msgr2=0x55fea05662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/2407245072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea05662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d9ffff640 1 -- 172.21.15.73:0/2407245072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea05450e0 con 0x55fea0544480 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d97fff640 1 --2- 172.21.15.73:0/2407245072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea05662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.206+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/2407245072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea0566820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009990 tx=0x7f3d90005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b1d8fa4f7405a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3d95ffb640 1 -- 172.21.15.73:0/2407245072 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90028070 con 0x55fea0544480 2024-09-05T12:57:38.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3d95ffb640 1 -- 172.21.15.73:0/2407245072 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d90034020 con 0x55fea0544480 2024-09-05T12:57:38.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3d95ffb640 1 -- 172.21.15.73:0/2407245072 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9002f480 con 0x55fea0544480 2024-09-05T12:57:38.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2407245072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 msgr2=0x55fea0566820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:38.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/2407245072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea0566820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009990 tx=0x7f3d90005e50 comp rx=0 tx=0).stop 2024-09-05T12:57:38.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2407245072 shutdown_connections 2024-09-05T12:57:38.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/2407245072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea054ed40 0x55fea05455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/2407245072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea0544480 0x55fea0566820 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/2407245072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea05662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2407245072 >> 172.21.15.73:0/2407245072 conn(0x55fea05400f0 msgr2=0x55fea054acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2407245072 shutdown_connections 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.207+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2407245072 wait complete. 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.208+0000 7f3da8d8d740 1 -- start start 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.208+0000 7f3da8d8d740 1 Processor -- start 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.208+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea05573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.208+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea0544480 0x55fea0552720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.208+0000 7f3da8d8d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea054ed40 0x55fea0552c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.208+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01abd30 con 0x55fea054ed40 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.208+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01ad1a0 con 0x55fea0543b60 2024-09-05T12:57:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.208+0000 7f3da8d8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01ac400 con 0x55fea0544480 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.208+0000 7f3da8d8d740 10 client.0 _ll_register_callbacks cb 0x7f3d90009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.208+0000 7f3d97fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea054ed40 0x55fea0552c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d9ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea0544480 0x55fea0552720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d97fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea054ed40 0x55fea0552c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36030/0 (socket says 172.21.15.73:36030) 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d97fff640 1 -- 172.21.15.73:0/2499031218 learned_addr learned my addr 172.21.15.73:0/2499031218 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d97fff640 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea05573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d9ffff640 1 -- 172.21.15.73:0/2499031218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 msgr2=0x55fea05573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea05573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d9ffff640 1 -- 172.21.15.73:0/2499031218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea054ed40 msgr2=0x55fea0552c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea054ed40 0x55fea0552c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d9ffff640 1 -- 172.21.15.73:0/2499031218 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea0553470 con 0x55fea0544480 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d97fff640 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea054ed40 0x55fea0552c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:57:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d9ffff640 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea0544480 0x55fea0552720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55fea054ccd0 tx=0x7f3d90009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e1da9b8026df062 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/2499031218 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90028040 con 0x55fea0544480 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2499031218 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d90034020 con 0x55fea0544480 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/2499031218 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3d90035070 con 0x55fea0544480 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.209+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/2499031218 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d90004230 con 0x55fea0544480 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3da8d8d740 10 client.24844 fetch_fsmap learned FSMap version 25 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2499031218 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fea05c91d0 con 0x55fea0544480 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/2499031218 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d90034020 con 0x55fea0544480 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/2499031218 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d900037f0 con 0x55fea0544480 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3da8d8d740 10 client.24844 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3da8d8d740 10 client.24844 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3da8d8d740 20 client.24844 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fea05c98b0 0x55fea05cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3da8d8d740 4 client.24844 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T12:57:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2499031218 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fea04b0d00 con 0x55fea05c98b0 2024-09-05T12:57:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.210+0000 7f3d97fff640 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fea05c98b0 0x55fea05cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.211+0000 7f3d7f7fe640 10 client.24844 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.211+0000 7f3d97fff640 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fea05c98b0 0x55fea05cbcd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8581802ddc44abe server_cookie=824e895c5b0019cc in_seq=0 out_seq=0 2024-09-05T12:57:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3d7f7fe640 1 -- 172.21.15.73:0/2499031218 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fea04b0d00 con 0x55fea05c98b0 2024-09-05T12:57:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3d7f7fe640 10 client.24844 handle_command_reply: tid=0 2024-09-05T12:57:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 client.24844 shutdown 2024-09-05T12:57:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2499031218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea0544480 msgr2=0x55fea0552720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea0544480 0x55fea0552720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55fea054ccd0 tx=0x7f3d90009560 comp rx=0 tx=0).stop 2024-09-05T12:57:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2499031218 shutdown_connections 2024-09-05T12:57:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55fea05c98b0 0x55fea05cbcd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3d7f7fe640 0 client.24844 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:38.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fea054ed40 0x55fea0552c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea0544480 0x55fea0552720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 --2- 172.21.15.73:0/2499031218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fea0543b60 0x55fea05573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2499031218 >> 172.21.15.73:0/2499031218 conn(0x55fea05400f0 msgr2=0x55fea0545580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:38.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2499031218 shutdown_connections 2024-09-05T12:57:38.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 1 -- 172.21.15.73:0/2499031218 wait complete. 2024-09-05T12:57:38.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.212+0000 7f3da8d8d740 20 client.24844 trim_cache size 0 max 16384 2024-09-05T12:57:38.218 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:57:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2024-09-05T12:57:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "b348b5e7-6cdc-484e-8300-b7823a10a67e", 2024-09-05T12:57:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2024-09-05T12:57:38.219 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:57:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 -- 172.21.15.73:0/2335788704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3d8c0a2b80 msgr2=0x7f3d8c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3d8c0a2b80 0x7f3d8c0a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d9809b830 tx=0x7f3d98066700 comp rx=0 tx=0).stop 2024-09-05T12:57:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 -- 172.21.15.73:0/2335788704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3da01082a0 msgr2=0x7f3da019ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3da01082a0 0x7f3da019ce90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800eaa0 tx=0x7f3d9800ef60 comp rx=0 tx=0).stop 2024-09-05T12:57:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 -- 172.21.15.73:0/2335788704 shutdown_connections 2024-09-05T12:57:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3d8c0a2b80 0x7f3d8c0a5040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3da01082a0 0x7f3da019ce90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 0x7f3da0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 --2- 172.21.15.73:0/2335788704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3da0102d30 0x7f3da01985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 -- 172.21.15.73:0/2335788704 >> 172.21.15.73:0/2335788704 conn(0x7f3da00fc7d0 msgr2=0x7f3da0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 -- 172.21.15.73:0/2335788704 shutdown_connections 2024-09-05T12:57:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:38.213+0000 7f3da69b7640 1 -- 172.21.15.73:0/2335788704 wait complete. 2024-09-05T12:57:38.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T12:57:39.242 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:57:39.360 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:39 smithi073 ceph-mon[30883]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-05T12:57:39.361 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:39 smithi073 ceph-mon[30883]: scrub queued for path: / 2024-09-05T12:57:39.361 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:39 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T12:57:39.361 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:39 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T12:57:39.361 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:39 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T12:57:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:39 smithi162 ceph-mon[34220]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-05T12:57:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:39 smithi162 ceph-mon[34220]: scrub queued for path: / 2024-09-05T12:57:39.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:39 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T12:57:39.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:39 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T12:57:39.362 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:39 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T12:57:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:39 smithi169 ceph-mon[34823]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-05T12:57:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:39 smithi169 ceph-mon[34823]: scrub queued for path: / 2024-09-05T12:57:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:39 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T12:57:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:39 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T12:57:39.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:39 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T12:57:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 -- 172.21.15.73:0/3682284061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca2010c2f0 msgr2=0x7fca2010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 --2- 172.21.15.73:0/3682284061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca2010c2f0 0x7fca2010e790 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fca10009ca0 tx=0x7fca1002a8c0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 -- 172.21.15.73:0/3682284061 shutdown_connections 2024-09-05T12:57:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 --2- 172.21.15.73:0/3682284061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca2010c2f0 0x7fca2010e790 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 --2- 172.21.15.73:0/3682284061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca201037a0 0x7fca2010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 --2- 172.21.15.73:0/3682284061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca20102df0 0x7fca201031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 -- 172.21.15.73:0/3682284061 >> 172.21.15.73:0/3682284061 conn(0x7fca200fc7d0 msgr2=0x7fca200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 -- 172.21.15.73:0/3682284061 shutdown_connections 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 -- 172.21.15.73:0/3682284061 wait complete. 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 Processor -- start 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 -- start start 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca20102df0 0x7fca201985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca201037a0 0x7fca20198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca2010c2f0 0x7fca2019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fca20112110 con 0x7fca201037a0 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca20111f90 con 0x7fca2010c2f0 2024-09-05T12:57:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.703+0000 7fca26f62640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca20112290 con 0x7fca20102df0 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca201037a0 0x7fca20198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca201037a0 0x7fca20198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36040/0 (socket says 172.21.15.73:36040) 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1ffff640 1 -- 172.21.15.73:0/29811029 learned_addr learned my addr 172.21.15.73:0/29811029 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca24cfe640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca20102df0 0x7fca201985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca254ff640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca2010c2f0 0x7fca2019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1ffff640 1 -- 172.21.15.73:0/29811029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca20102df0 msgr2=0x7fca201985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1ffff640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca20102df0 0x7fca201985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1ffff640 1 -- 172.21.15.73:0/29811029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca2010c2f0 msgr2=0x7fca2019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1ffff640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca2010c2f0 0x7fca2019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1ffff640 1 -- 172.21.15.73:0/29811029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2019d580 con 0x7fca201037a0 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1ffff640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca201037a0 0x7fca20198b10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fca0800d750 tx=0x7fca0800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1dffb640 1 -- 172.21.15.73:0/29811029 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08017070 con 0x7fca201037a0 2024-09-05T12:57:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca26f62640 1 -- 172.21.15.73:0/29811029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2019d870 con 0x7fca201037a0 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1dffb640 1 -- 172.21.15.73:0/29811029 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca08005500 con 0x7fca201037a0 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca1dffb640 1 -- 172.21.15.73:0/29811029 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08004e00 con 0x7fca201037a0 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.704+0000 7fca26f62640 1 -- 172.21.15.73:0/29811029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201a5150 con 0x7fca201037a0 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca1dffb640 1 -- 172.21.15.73:0/29811029 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fca08004fa0 con 0x7fca201037a0 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca29338740 1 Processor -- start 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca29338740 1 -- start start 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca1dffb640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fca0c0a2b80 0x7fca0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca29338740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaaef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca29338740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 0x55dcfaafe550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca29338740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 0x55dcfab00e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca29338740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55dcfaa552e0 con 0x55dcfaaef380 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca29338740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa9fcce0 con 0x55dcfaafea90 2024-09-05T12:57:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca29338740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dcfaa512a0 con 0x55dcfaaefca0 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca24cfe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaaef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.707+0000 7fca254ff640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fca0c0a2b80 0x7fca0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca1dffb640 1 -- 172.21.15.73:0/29811029 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fca080ce8a0 con 0x7fca201037a0 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca24cfe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaaef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36054/0 (socket says 172.21.15.73:36054) 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca24cfe640 1 -- 172.21.15.73:0/776359459 learned_addr learned my addr 172.21.15.73:0/776359459 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca1ffff640 1 --2- 172.21.15.73:0/776359459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 0x55dcfaafe550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca254ff640 1 --2- 172.21.15.73:0/776359459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 0x55dcfab00e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca24cfe640 1 -- 172.21.15.73:0/776359459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 msgr2=0x55dcfaafe550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca24cfe640 1 --2- 172.21.15.73:0/776359459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 0x55dcfaafe550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca24cfe640 1 -- 172.21.15.73:0/776359459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 msgr2=0x55dcfab00e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca24cfe640 1 --2- 172.21.15.73:0/776359459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 0x55dcfab00e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca24cfe640 1 -- 172.21.15.73:0/776359459 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfa9e1440 con 0x55dcfaaef380 2024-09-05T12:57:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca1ffff640 1 --2- 172.21.15.73:0/776359459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 0x55dcfaafe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca254ff640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fca0c0a2b80 0x7fca0c0a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fca10004af0 tx=0x7fca10031c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca24cfe640 1 --2- 172.21.15.73:0/776359459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaaef760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fca1800bd10 tx=0x7fca180107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a570cf950cd7f6f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca16ffd640 1 -- 172.21.15.73:0/776359459 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18004030 con 0x55dcfaaef380 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca16ffd640 1 -- 172.21.15.73:0/776359459 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca180041d0 con 0x55dcfaaef380 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.708+0000 7fca16ffd640 1 -- 172.21.15.73:0/776359459 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18011800 con 0x55dcfaaef380 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 -- 172.21.15.73:0/776359459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 msgr2=0x55dcfaaef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 --2- 172.21.15.73:0/776359459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaaef760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fca1800bd10 tx=0x7fca180107a0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 -- 172.21.15.73:0/776359459 shutdown_connections 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 --2- 172.21.15.73:0/776359459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 0x55dcfab00e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 --2- 172.21.15.73:0/776359459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 0x55dcfaafe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 --2- 172.21.15.73:0/776359459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaaef760 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 -- 172.21.15.73:0/776359459 >> 172.21.15.73:0/776359459 conn(0x55dcfaaeba30 msgr2=0x55dcfaaebe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 -- 172.21.15.73:0/776359459 shutdown_connections 2024-09-05T12:57:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 -- 172.21.15.73:0/776359459 wait complete. 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 -- start start 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.709+0000 7fca29338740 1 Processor -- start 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca29338740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaafe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca29338740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 0x55dcfaafb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca29338740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 0x55dcfaafbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca29338740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55dcfab01660 con 0x55dcfaaef380 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca29338740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dcfaa10050 con 0x55dcfaafea90 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca29338740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dcfab017e0 con 0x55dcfaaefca0 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca29338740 10 client.0 _ll_register_callbacks cb 0x55dcfaa50160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca24cfe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaafe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca24cfe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaafe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36056/0 (socket says 172.21.15.73:36056) 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca24cfe640 1 -- 172.21.15.73:0/3761306740 learned_addr learned my addr 172.21.15.73:0/3761306740 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca254ff640 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 0x55dcfaafbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca24cfe640 1 -- 172.21.15.73:0/3761306740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 msgr2=0x55dcfaafb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca1ffff640 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 0x55dcfaafb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca24cfe640 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 0x55dcfaafb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca24cfe640 1 -- 172.21.15.73:0/3761306740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 msgr2=0x55dcfaafbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca24cfe640 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 0x55dcfaafbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca24cfe640 1 -- 172.21.15.73:0/3761306740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcfa7c63c0 con 0x55dcfaaef380 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca254ff640 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 0x55dcfaafbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca1ffff640 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 0x55dcfaafb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fca24cfe640 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaafe380 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fca18011010 tx=0x7fca180058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67672f0430e45577 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.710+0000 7fc9fffff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fc9fffff640 1 -- 172.21.15.73:0/3761306740 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18029060 con 0x55dcfaaef380 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fc9fffff640 1 -- 172.21.15.73:0/3761306740 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fca180035f0 con 0x55dcfaaef380 2024-09-05T12:57:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fca29338740 1 -- 172.21.15.73:0/3761306740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca180041d0 con 0x55dcfaaef380 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fc9fffff640 1 -- 172.21.15.73:0/3761306740 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fca1800be80 con 0x55dcfaaef380 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fca29338740 10 client.15225 fetch_fsmap learned FSMap version 25 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fca29338740 1 -- 172.21.15.73:0/3761306740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dcfab0d010 con 0x55dcfaaef380 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fc9fffff640 1 -- 172.21.15.73:0/3761306740 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca180041d0 con 0x55dcfaaef380 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fc9fffff640 1 -- 172.21.15.73:0/3761306740 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fca18004810 con 0x55dcfaaef380 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fca29338740 10 client.15225 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fca29338740 10 client.15225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fca29338740 20 client.15225 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fca29338740 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55dcfab0e4d0 0x55dcfab108c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fca29338740 4 client.15225 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fca29338740 1 -- 172.21.15.73:0/3761306740 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcfaa62850 con 0x55dcfab0e4d0 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.711+0000 7fca1ffff640 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55dcfab0e4d0 0x55dcfab108c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.712+0000 7fc9fffff640 10 client.15225 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.712+0000 7fca1ffff640 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55dcfab0e4d0 0x55dcfab108c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41449d54fa590178 server_cookie=5e98ff37a2d4d5d2 in_seq=0 out_seq=0 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fc9fffff640 1 -- 172.21.15.73:0/3761306740 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dcfaa62850 con 0x55dcfab0e4d0 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fc9fffff640 10 client.15225 handle_command_reply: tid=0 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 client.15225 shutdown 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 -- 172.21.15.73:0/3761306740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 msgr2=0x55dcfaafe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaafe380 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fca18011010 tx=0x7fca180058e0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 -- 172.21.15.73:0/3761306740 shutdown_connections 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55dcfab0e4d0 0x55dcfab108c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaafea90 0x55dcfaafbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaefca0 0x55dcfaafb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fc9fffff640 0 client.15225 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 --2- 172.21.15.73:0/3761306740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaef380 0x55dcfaafe380 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 -- 172.21.15.73:0/3761306740 >> 172.21.15.73:0/3761306740 conn(0x55dcfaaeba30 msgr2=0x55dcfaaf1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 -- 172.21.15.73:0/3761306740 shutdown_connections 2024-09-05T12:57:39.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 1 -- 172.21.15.73:0/3761306740 wait complete. 2024-09-05T12:57:39.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.713+0000 7fca29338740 20 client.15225 trim_cache size 0 max 16384 2024-09-05T12:57:39.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca29338740 1 Processor -- start 2024-09-05T12:57:39.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca29338740 1 -- start start 2024-09-05T12:57:39.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca29338740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaaef380 0x55dcfab0a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca29338740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaefca0 0x55dcfab15ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca29338740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaafea90 0x55dcfab16400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca29338740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fca201adb60 con 0x55dcfaaefca0 2024-09-05T12:57:39.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca29338740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca201ab430 con 0x55dcfaaef380 2024-09-05T12:57:39.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca29338740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca201a92a0 con 0x55dcfaafea90 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaefca0 0x55dcfab15ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaefca0 0x55dcfab15ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36066/0 (socket says 172.21.15.73:36066) 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca1ffff640 1 -- 172.21.15.73:0/3904061374 learned_addr learned my addr 172.21.15.73:0/3904061374 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca254ff640 1 --2- 172.21.15.73:0/3904061374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaafea90 0x55dcfab16400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca1ffff640 1 -- 172.21.15.73:0/3904061374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaafea90 msgr2=0x55dcfab16400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca1ffff640 1 --2- 172.21.15.73:0/3904061374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaafea90 0x55dcfab16400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca1ffff640 1 -- 172.21.15.73:0/3904061374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaaef380 msgr2=0x55dcfab0a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca1ffff640 1 --2- 172.21.15.73:0/3904061374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaaef380 0x55dcfab0a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.730+0000 7fca1ffff640 1 -- 172.21.15.73:0/3904061374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfaafe6f0 con 0x55dcfaaefca0 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca1ffff640 1 --2- 172.21.15.73:0/3904061374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaefca0 0x55dcfab15ec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fca08097bb0 tx=0x7fca080cc2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320419650e2ebccc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca167fc640 1 -- 172.21.15.73:0/3904061374 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08020040 con 0x55dcfaaefca0 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca167fc640 1 -- 172.21.15.73:0/3904061374 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca080a3da0 con 0x55dcfaaefca0 2024-09-05T12:57:39.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca167fc640 1 -- 172.21.15.73:0/3904061374 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080994e0 con 0x55dcfaaefca0 2024-09-05T12:57:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca29338740 1 -- 172.21.15.73:0/3904061374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaefca0 msgr2=0x55dcfab15ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca29338740 1 --2- 172.21.15.73:0/3904061374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaefca0 0x55dcfab15ec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fca08097bb0 tx=0x7fca080cc2a0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca29338740 1 -- 172.21.15.73:0/3904061374 shutdown_connections 2024-09-05T12:57:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca29338740 1 --2- 172.21.15.73:0/3904061374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaafea90 0x55dcfab16400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca29338740 1 --2- 172.21.15.73:0/3904061374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaaefca0 0x55dcfab15ec0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca29338740 1 --2- 172.21.15.73:0/3904061374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaaef380 0x55dcfab0a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.731+0000 7fca29338740 1 -- 172.21.15.73:0/3904061374 >> 172.21.15.73:0/3904061374 conn(0x55dcfaaeba30 msgr2=0x55dcfaafa630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 1 -- 172.21.15.73:0/3904061374 shutdown_connections 2024-09-05T12:57:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 1 -- 172.21.15.73:0/3904061374 wait complete. 2024-09-05T12:57:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 1 -- start start 2024-09-05T12:57:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 1 Processor -- start 2024-09-05T12:57:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaef380 0x55dcfab071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaaefca0 0x55dcfaaf8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaafea90 0x55dcfaaf8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fca201a98f0 con 0x55dcfaafea90 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca201aad60 con 0x55dcfaaefca0 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca201a9fc0 con 0x55dcfaaef380 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca29338740 10 client.0 _ll_register_callbacks cb 0x7fca1800bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca254ff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaafea90 0x55dcfaaf8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca254ff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaafea90 0x55dcfaaf8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36068/0 (socket says 172.21.15.73:36068) 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca254ff640 1 -- 172.21.15.73:0/2225596838 learned_addr learned my addr 172.21.15.73:0/2225596838 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.732+0000 7fca24cfe640 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaef380 0x55dcfab071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fca1ffff640 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaaefca0 0x55dcfaaf8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fca254ff640 1 -- 172.21.15.73:0/2225596838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaef380 msgr2=0x55dcfab071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fca254ff640 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaef380 0x55dcfab071b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fca254ff640 1 -- 172.21.15.73:0/2225596838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaaefca0 msgr2=0x55dcfaaf8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fca254ff640 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaaefca0 0x55dcfaaf8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fca254ff640 1 -- 172.21.15.73:0/2225596838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcfaaf90b0 con 0x55dcfaafea90 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fca254ff640 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaafea90 0x55dcfaaf8880 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca10005fe0 tx=0x7fca10046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab12a3507cf82370 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fc9fffff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fc9fffff640 1 -- 172.21.15.73:0/2225596838 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10004790 con 0x55dcfaafea90 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fc9fffff640 1 -- 172.21.15.73:0/2225596838 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fca1002f610 con 0x55dcfaafea90 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fca29338740 1 -- 172.21.15.73:0/2225596838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca080a3da0 con 0x55dcfaafea90 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fc9fffff640 1 -- 172.21.15.73:0/2225596838 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fca1002f810 con 0x55dcfaafea90 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fca29338740 10 client.15231 fetch_fsmap learned FSMap version 25 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fca29338740 1 -- 172.21.15.73:0/2225596838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dcfab78e10 con 0x55dcfaafea90 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.733+0000 7fc9fffff640 1 -- 172.21.15.73:0/2225596838 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca080a3da0 con 0x55dcfaafea90 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fc9fffff640 1 -- 172.21.15.73:0/2225596838 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fca10030b50 con 0x55dcfaafea90 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fca29338740 10 client.15231 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:57:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fca29338740 10 client.15231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fca29338740 20 client.15231 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fca29338740 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55dcfab0e4d0 0x55dcfab7b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fca29338740 4 client.15231 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fca29338740 1 -- 172.21.15.73:0/2225596838 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dcfaa5cd60 con 0x55dcfab0e4d0 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fca24cfe640 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55dcfab0e4d0 0x55dcfab7b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fca24cfe640 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55dcfab0e4d0 0x55dcfab7b5f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd15ac553f76605c server_cookie=4b3ecc6f62c57a83 in_seq=0 out_seq=0 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fc9fffff640 10 client.15231 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fc9fffff640 1 -- 172.21.15.73:0/2225596838 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55dcfaa5cd60 con 0x55dcfab0e4d0 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fc9fffff640 10 client.15231 handle_command_reply: tid=0 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.734+0000 7fca29338740 1 client.15231 shutdown 2024-09-05T12:57:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 1 -- 172.21.15.73:0/2225596838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaafea90 msgr2=0x55dcfaaf8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaafea90 0x55dcfaaf8880 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca10005fe0 tx=0x7fca10046000 comp rx=0 tx=0).stop 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 1 -- 172.21.15.73:0/2225596838 shutdown_connections 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55dcfab0e4d0 0x55dcfab7b5f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dcfaafea90 0x55dcfaaf8880 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcfaaefca0 0x55dcfaaf8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 1 --2- 172.21.15.73:0/2225596838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dcfaaef380 0x55dcfab071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fc9fffff640 0 client.15231 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 1 -- 172.21.15.73:0/2225596838 >> 172.21.15.73:0/2225596838 conn(0x55dcfaaeba30 msgr2=0x55dcfaaea270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 1 -- 172.21.15.73:0/2225596838 shutdown_connections 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 1 -- 172.21.15.73:0/2225596838 wait complete. 2024-09-05T12:57:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca29338740 20 client.15231 trim_cache size 0 max 16384 2024-09-05T12:57:39.743 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:57:39.743 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-05T12:57:39.743 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2024-09-05T12:57:39.743 INFO:teuthology.orchestra.run.smithi073.stdout: "b348b5e7-6cdc-484e-8300-b7823a10a67e": { 2024-09-05T12:57:39.743 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-05T12:57:39.743 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "b348b5e7-6cdc-484e-8300-b7823a10a67e", 2024-09-05T12:57:39.743 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2024-09-05T12:57:39.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T12:57:39.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T12:57:39.743 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:57:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca26f62640 1 -- 172.21.15.73:0/29811029 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fca0c0a2b80 msgr2=0x7fca0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca26f62640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fca0c0a2b80 0x7fca0c0a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fca10004af0 tx=0x7fca10031c90 comp rx=0 tx=0).stop 2024-09-05T12:57:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca26f62640 1 -- 172.21.15.73:0/29811029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca201037a0 msgr2=0x7fca20198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca26f62640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca201037a0 0x7fca20198b10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fca0800d750 tx=0x7fca0800dc10 comp rx=0 tx=0).stop 2024-09-05T12:57:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca26f62640 1 -- 172.21.15.73:0/29811029 shutdown_connections 2024-09-05T12:57:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca26f62640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fca0c0a2b80 0x7fca0c0a5040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca26f62640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca2010c2f0 0x7fca2019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca26f62640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca201037a0 0x7fca20198b10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca26f62640 1 --2- 172.21.15.73:0/29811029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca20102df0 0x7fca201985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.735+0000 7fca26f62640 1 -- 172.21.15.73:0/29811029 >> 172.21.15.73:0/29811029 conn(0x7fca200fc7d0 msgr2=0x7fca200fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:39.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.736+0000 7fca26f62640 1 -- 172.21.15.73:0/29811029 shutdown_connections 2024-09-05T12:57:39.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:57:39.736+0000 7fca26f62640 1 -- 172.21.15.73:0/29811029 wait complete. 2024-09-05T12:57:40.554 INFO:tasks.cephfs.filesystem:scrub status for tag:b348b5e7-6cdc-484e-8300-b7823a10a67e - {'path': '/', 'tag': 'b348b5e7-6cdc-484e-8300-b7823a10a67e', 'options': 'recursive,force'} 2024-09-05T12:57:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:41 smithi162 ceph-mon[34220]: pgmap v328: 97 pgs: 97 active+clean; 649 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-05T12:57:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:41 smithi169 ceph-mon[34823]: pgmap v328: 97 pgs: 97 active+clean; 649 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-05T12:57:41.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:41 smithi073 ceph-mon[30883]: pgmap v328: 97 pgs: 97 active+clean; 649 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-05T12:57:43.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:43 smithi162 ceph-mon[34220]: pgmap v329: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:57:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:43 smithi169 ceph-mon[34823]: pgmap v329: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:57:43.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:43 smithi073 ceph-mon[30883]: pgmap v329: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:57:45.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:45 smithi162 ceph-mon[34220]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:57:45.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:45 smithi169 ceph-mon[34823]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:57:45.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:45 smithi073 ceph-mon[30883]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:57:47.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:47 smithi162 ceph-mon[34220]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-05T12:57:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:47 smithi169 ceph-mon[34823]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-05T12:57:47.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:47 smithi073 ceph-mon[30883]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-05T12:57:49.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:49 smithi162 ceph-mon[34220]: pgmap v332: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-05T12:57:49.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:49 smithi169 ceph-mon[34823]: pgmap v332: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-05T12:57:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:49 smithi073 ceph-mon[30883]: pgmap v332: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-05T12:57:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.553+0000 7fe3fe296640 1 -- 172.21.15.73:0/2039601590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f81025f0 msgr2=0x7fe3f8108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.553+0000 7fe3fe296640 1 --2- 172.21.15.73:0/2039601590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f81025f0 0x7fe3f8108e80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009ca0 tx=0x7fe3f002a8c0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.553+0000 7fe3fe296640 1 -- 172.21.15.73:0/2039601590 shutdown_connections 2024-09-05T12:57:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.553+0000 7fe3fe296640 1 --2- 172.21.15.73:0/2039601590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f81025f0 0x7fe3f8108e80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.553+0000 7fe3fe296640 1 --2- 172.21.15.73:0/2039601590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3f8101c30 0x7fe3f81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.553+0000 7fe3fe296640 1 --2- 172.21.15.73:0/2039601590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f8100a40 0x7fe3f8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.553+0000 7fe3fe296640 1 -- 172.21.15.73:0/2039601590 >> 172.21.15.73:0/2039601590 conn(0x7fe3f80fc1e0 msgr2=0x7fe3f80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.553+0000 7fe3fe296640 1 -- 172.21.15.73:0/2039601590 shutdown_connections 2024-09-05T12:57:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.553+0000 7fe3fe296640 1 -- 172.21.15.73:0/2039601590 wait complete. 2024-09-05T12:57:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.553+0000 7fe3fe296640 1 Processor -- start 2024-09-05T12:57:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3fe296640 1 -- start start 2024-09-05T12:57:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3fe296640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f8100a40 0x7fe3f806a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3fe296640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3f8101c30 0x7fe3f819ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3fe296640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f81025f0 0x7fe3f819f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3fe296640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f810c6a0 con 0x7fe3f8100a40 2024-09-05T12:57:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3fe296640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f810c520 con 0x7fe3f8101c30 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3fe296640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f810c820 con 0x7fe3f81025f0 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f8100a40 0x7fe3f806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f8100a40 0x7fe3f806a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45102/0 (socket says 172.21.15.73:45102) 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f7fff640 1 -- 172.21.15.73:0/2732060501 learned_addr learned my addr 172.21.15.73:0/2732060501 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3fc833640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f81025f0 0x7fe3f819f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f77fe640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3f8101c30 0x7fe3f819ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f7fff640 1 -- 172.21.15.73:0/2732060501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f81025f0 msgr2=0x7fe3f819f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f81025f0 0x7fe3f819f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f7fff640 1 -- 172.21.15.73:0/2732060501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3f8101c30 msgr2=0x7fe3f819ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3f8101c30 0x7fe3f819ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f7fff640 1 -- 172.21.15.73:0/2732060501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f819f960 con 0x7fe3f8100a40 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3fc833640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f81025f0 0x7fe3f819f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f77fe640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3f8101c30 0x7fe3f819ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.554+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f8100a40 0x7fe3f806a430 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800d950 tx=0x7fe3e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.555+0000 7fe3f57fa640 1 -- 172.21.15.73:0/2732060501 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8017020 con 0x7fe3f8100a40 2024-09-05T12:57:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.555+0000 7fe3fe296640 1 -- 172.21.15.73:0/2732060501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f819fc50 con 0x7fe3f8100a40 2024-09-05T12:57:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.555+0000 7fe3f57fa640 1 -- 172.21.15.73:0/2732060501 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e8009c30 con 0x7fe3f8100a40 2024-09-05T12:57:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.555+0000 7fe3f57fa640 1 -- 172.21.15.73:0/2732060501 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800f720 con 0x7fe3f8100a40 2024-09-05T12:57:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.555+0000 7fe3fe296640 1 -- 172.21.15.73:0/2732060501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f81a01a0 con 0x7fe3f8100a40 2024-09-05T12:57:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.557+0000 7fe3f57fa640 1 -- 172.21.15.73:0/2732060501 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe3e801a020 con 0x7fe3f8100a40 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.557+0000 7fe401023740 1 Processor -- start 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.557+0000 7fe401023740 1 -- start start 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe401023740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387239a0 0x55e838723da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe401023740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 0x55e838728da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe401023740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e838729370 0x55e83872b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe401023740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e8386872f0 con 0x55e8387239a0 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe401023740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e83862f270 con 0x55e838729370 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe401023740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e8386832b0 con 0x55e8387242e0 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3fc833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387239a0 0x55e838723da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3fc833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387239a0 0x55e838723da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45114/0 (socket says 172.21.15.73:45114) 2024-09-05T12:57:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3fc833640 1 -- 172.21.15.73:0/2434232986 learned_addr learned my addr 172.21.15.73:0/2434232986 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 0x55e838728da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3f77fe640 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e838729370 0x55e83872b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3fc833640 1 -- 172.21.15.73:0/2434232986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 msgr2=0x55e838728da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3fc833640 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 0x55e838728da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3fc833640 1 -- 172.21.15.73:0/2434232986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e838729370 msgr2=0x55e83872b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3f57fa640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe3e00a2c30 0x7fe3e00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3fc833640 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e838729370 0x55e83872b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3fc833640 1 -- 172.21.15.73:0/2434232986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83862e340 con 0x55e8387239a0 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 0x55e838728da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3f77fe640 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e838729370 0x55e83872b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3fc833640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe3e00a2c30 0x7fe3e00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3f57fa640 1 -- 172.21.15.73:0/2732060501 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe3e80ceff0 con 0x7fe3f8100a40 2024-09-05T12:57:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.558+0000 7fe3fc833640 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387239a0 0x55e838723da0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0035000 tx=0x7fe3f00093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827dd4099be278a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe3de7fc640 1 -- 172.21.15.73:0/2434232986 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f004b070 con 0x55e8387239a0 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe3de7fc640 1 -- 172.21.15.73:0/2434232986 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3f0036070 con 0x55e8387239a0 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe3de7fc640 1 -- 172.21.15.73:0/2434232986 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0030800 con 0x55e8387239a0 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe401023740 1 -- 172.21.15.73:0/2434232986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387239a0 msgr2=0x55e838723da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe3fc833640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe3e00a2c30 0x7fe3e00a50f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009a60 tx=0x7fe3f0049000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe401023740 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387239a0 0x55e838723da0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0035000 tx=0x7fe3f00093e0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe401023740 1 -- 172.21.15.73:0/2434232986 shutdown_connections 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe401023740 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e838729370 0x55e83872b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe401023740 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 0x55e838728da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe401023740 1 --2- 172.21.15.73:0/2434232986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387239a0 0x55e838723da0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe401023740 1 -- 172.21.15.73:0/2434232986 >> 172.21.15.73:0/2434232986 conn(0x55e83871f010 msgr2=0x55e83871f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe401023740 1 -- 172.21.15.73:0/2434232986 shutdown_connections 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.559+0000 7fe401023740 1 -- 172.21.15.73:0/2434232986 wait complete. 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe401023740 1 -- start start 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe401023740 1 Processor -- start 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe401023740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e83872daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe401023740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 0x55e83872dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe401023740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e838729370 0x55e838735020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe401023740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e83872c1c0 con 0x55e838729370 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe401023740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e838610290 con 0x55e8387239a0 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe401023740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e83872c340 con 0x55e8387242e0 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe401023740 10 client.0 _ll_register_callbacks cb 0x55e838641140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe3fc833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e838729370 0x55e838735020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe3fc833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e838729370 0x55e838735020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45116/0 (socket says 172.21.15.73:45116) 2024-09-05T12:57:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe3fc833640 1 -- 172.21.15.73:0/275424634 learned_addr learned my addr 172.21.15.73:0/275424634 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.560+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e83872daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3f77fe640 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 0x55e83872dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3fc833640 1 -- 172.21.15.73:0/275424634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 msgr2=0x55e83872dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3fc833640 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 0x55e83872dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3fc833640 1 -- 172.21.15.73:0/275424634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 msgr2=0x55e83872daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3fc833640 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e83872daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3fc833640 1 -- 172.21.15.73:0/275424634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e83839a210 con 0x55e838729370 2024-09-05T12:57:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e83872daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3fc833640 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e838729370 0x55e838735020 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009ca0 tx=0x7fe3f0030e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b83e3a851a12136 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3d77fe640 1 -- 172.21.15.73:0/275424634 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0056070 con 0x55e838729370 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3d77fe640 1 -- 172.21.15.73:0/275424634 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe3f00305c0 con 0x55e838729370 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe401023740 1 -- 172.21.15.73:0/275424634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3f0036070 con 0x55e838729370 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3d77fe640 1 -- 172.21.15.73:0/275424634 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe3f004b040 con 0x55e838729370 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe401023740 10 client.15243 fetch_fsmap learned FSMap version 25 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe401023740 1 -- 172.21.15.73:0/275424634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e838466620 con 0x55e838729370 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.561+0000 7fe3d77fe640 1 -- 172.21.15.73:0/275424634 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3f0036070 con 0x55e838729370 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.562+0000 7fe3d77fe640 1 -- 172.21.15.73:0/275424634 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe3f0044030 con 0x55e838729370 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.562+0000 7fe401023740 10 client.15243 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.562+0000 7fe401023740 10 client.15243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.562+0000 7fe401023740 20 client.15243 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.562+0000 7fe401023740 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e838739380 0x55e83873b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.562+0000 7fe401023740 4 client.15243 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:57:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.562+0000 7fe401023740 1 -- 172.21.15.73:0/275424634 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e838694a20 con 0x55e838739380 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.562+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e838739380 0x55e83873b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.562+0000 7fe3d77fe640 10 client.15243 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.562+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e838739380 0x55e83873b770 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94a647648e9b7492 server_cookie=679520ec40f5fab6 in_seq=0 out_seq=0 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe3d77fe640 1 -- 172.21.15.73:0/275424634 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e838694a20 con 0x55e838739380 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe3d77fe640 10 client.15243 handle_command_reply: tid=0 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 client.15243 shutdown 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 -- 172.21.15.73:0/275424634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e838729370 msgr2=0x55e838735020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e838729370 0x55e838735020 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009ca0 tx=0x7fe3f0030e80 comp rx=0 tx=0).stop 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 -- 172.21.15.73:0/275424634 shutdown_connections 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e838739380 0x55e83873b770 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e838729370 0x55e838735020 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe3d77fe640 0 client.15243 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8387242e0 0x55e83872dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 --2- 172.21.15.73:0/275424634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e83872daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 -- 172.21.15.73:0/275424634 >> 172.21.15.73:0/275424634 conn(0x55e83871f010 msgr2=0x55e838720820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 -- 172.21.15.73:0/275424634 shutdown_connections 2024-09-05T12:57:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.563+0000 7fe401023740 1 -- 172.21.15.73:0/275424634 wait complete. 2024-09-05T12:57:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.564+0000 7fe401023740 20 client.15243 trim_cache size 0 max 16384 2024-09-05T12:57:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.577+0000 7fe401023740 1 Processor -- start 2024-09-05T12:57:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe401023740 1 -- start start 2024-09-05T12:57:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe401023740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 0x55e83871e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe401023740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e838734fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe401023740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e838740030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe401023740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81ab7f0 con 0x55e8387242e0 2024-09-05T12:57:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe401023740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81a90c0 con 0x55e8387239a0 2024-09-05T12:57:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe401023740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81a6f10 con 0x55e83871f010 2024-09-05T12:57:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3fc833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e838740030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3fc833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e838740030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45128/0 (socket says 172.21.15.73:45128) 2024-09-05T12:57:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3fc833640 1 -- 172.21.15.73:0/1627719348 learned_addr learned my addr 172.21.15.73:0/1627719348 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3f77fe640 1 --2- 172.21.15.73:0/1627719348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e838734fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/1627719348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 0x55e83871e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3fc833640 1 -- 172.21.15.73:0/1627719348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 msgr2=0x55e83871e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3fc833640 1 --2- 172.21.15.73:0/1627719348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 0x55e83871e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3fc833640 1 -- 172.21.15.73:0/1627719348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 msgr2=0x55e838734fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3fc833640 1 --2- 172.21.15.73:0/1627719348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e838734fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3fc833640 1 -- 172.21.15.73:0/1627719348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83871fca0 con 0x55e8387242e0 2024-09-05T12:57:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/1627719348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 0x55e83871e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:57:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.578+0000 7fe3fc833640 1 --2- 172.21.15.73:0/1627719348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e838740030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0002230 tx=0x7fe3f002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457b3b6ca50900bb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe3ddffb640 1 -- 172.21.15.73:0/1627719348 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0056040 con 0x55e8387242e0 2024-09-05T12:57:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe3ddffb640 1 -- 172.21.15.73:0/1627719348 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3f0036030 con 0x55e8387242e0 2024-09-05T12:57:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe3ddffb640 1 -- 172.21.15.73:0/1627719348 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0003e80 con 0x55e8387242e0 2024-09-05T12:57:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe401023740 1 -- 172.21.15.73:0/1627719348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 msgr2=0x55e838740030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe401023740 1 --2- 172.21.15.73:0/1627719348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e838740030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0002230 tx=0x7fe3f002a8c0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe401023740 1 -- 172.21.15.73:0/1627719348 shutdown_connections 2024-09-05T12:57:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe401023740 1 --2- 172.21.15.73:0/1627719348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e838740030 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe401023740 1 --2- 172.21.15.73:0/1627719348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e838734fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe401023740 1 --2- 172.21.15.73:0/1627719348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 0x55e83871e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe401023740 1 -- 172.21.15.73:0/1627719348 >> 172.21.15.73:0/1627719348 conn(0x55e838728e90 msgr2=0x55e83871d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe401023740 1 -- 172.21.15.73:0/1627719348 shutdown_connections 2024-09-05T12:57:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.579+0000 7fe401023740 1 -- 172.21.15.73:0/1627719348 wait complete. 2024-09-05T12:57:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe401023740 1 -- start start 2024-09-05T12:57:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe401023740 1 Processor -- start 2024-09-05T12:57:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe401023740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 0x55e838732e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe401023740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e8387333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe401023740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e8387343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe401023740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81a7580 con 0x55e8387242e0 2024-09-05T12:57:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe401023740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81a89f0 con 0x55e8387239a0 2024-09-05T12:57:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe401023740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81a7c50 con 0x55e83871f010 2024-09-05T12:57:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe401023740 10 client.0 _ll_register_callbacks cb 0x7fe3f0049070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:57:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe3fc833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e8387343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe3fc833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e8387343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45140/0 (socket says 172.21.15.73:45140) 2024-09-05T12:57:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe3fc833640 1 -- 172.21.15.73:0/3362444480 learned_addr learned my addr 172.21.15.73:0/3362444480 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:57:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe3f77fe640 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e8387333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.580+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 0x55e838732e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3fc833640 1 -- 172.21.15.73:0/3362444480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 msgr2=0x55e838732e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3fc833640 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 0x55e838732e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3fc833640 1 -- 172.21.15.73:0/3362444480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 msgr2=0x55e8387333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:57:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3fc833640 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e8387333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3fc833640 1 -- 172.21.15.73:0/3362444480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8387349c0 con 0x55e8387242e0 2024-09-05T12:57:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3fc833640 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e8387343b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0006010 tx=0x7fe3f0030be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a33b70149dde3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:57:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:57:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3d77fe640 1 -- 172.21.15.73:0/3362444480 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0004b40 con 0x55e8387242e0 2024-09-05T12:57:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3d77fe640 1 -- 172.21.15.73:0/3362444480 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe3f0031450 con 0x55e8387242e0 2024-09-05T12:57:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe401023740 1 -- 172.21.15.73:0/3362444480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3f0036030 con 0x55e8387242e0 2024-09-05T12:57:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3d77fe640 1 -- 172.21.15.73:0/3362444480 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe3f0030e60 con 0x55e8387242e0 2024-09-05T12:57:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe401023740 10 client.15249 fetch_fsmap learned FSMap version 25 2024-09-05T12:57:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe401023740 1 -- 172.21.15.73:0/3362444480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e8387a47c0 con 0x55e8387242e0 2024-09-05T12:57:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3d77fe640 1 -- 172.21.15.73:0/3362444480 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3f0036030 con 0x55e8387242e0 2024-09-05T12:57:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe3d77fe640 1 -- 172.21.15.73:0/3362444480 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe3f0044040 con 0x55e8387242e0 2024-09-05T12:57:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe401023740 10 client.15249 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:57:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe401023740 10 client.15249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:57:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe401023740 20 client.15249 populate_metadata read hostname 'smithi073' 2024-09-05T12:57:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe401023740 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e838729370 0x55e8387a6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:57:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe401023740 4 client.15249 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T12:57:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.581+0000 7fe401023740 1 -- 172.21.15.73:0/3362444480 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e83868ed70 con 0x55e838729370 2024-09-05T12:57:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.582+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e838729370 0x55e8387a6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:57:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.582+0000 7fe3f7fff640 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e838729370 0x55e8387a6f80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f36406ce8fc80 server_cookie=84b23f2d91dc5c1 in_seq=0 out_seq=0 2024-09-05T12:57:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.582+0000 7fe3d77fe640 10 client.15249 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe3d77fe640 1 -- 172.21.15.73:0/3362444480 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e83868ed70 con 0x55e838729370 2024-09-05T12:57:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe3d77fe640 10 client.15249 handle_command_reply: tid=0 2024-09-05T12:57:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 client.15249 shutdown 2024-09-05T12:57:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 -- 172.21.15.73:0/3362444480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 msgr2=0x55e8387343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e8387343b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0006010 tx=0x7fe3f0030be0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 -- 172.21.15.73:0/3362444480 shutdown_connections 2024-09-05T12:57:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e838729370 0x55e8387a6f80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e8387242e0 0x55e8387343b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8387239a0 0x55e8387333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe3d77fe640 0 client.15249 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:57:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 --2- 172.21.15.73:0/3362444480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e83871f010 0x55e838732e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 -- 172.21.15.73:0/3362444480 >> 172.21.15.73:0/3362444480 conn(0x55e838728e90 msgr2=0x55e83871e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 -- 172.21.15.73:0/3362444480 shutdown_connections 2024-09-05T12:57:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 1 -- 172.21.15.73:0/3362444480 wait complete. 2024-09-05T12:57:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.594+0000 7fe401023740 20 client.15249 trim_cache size 0 max 16384 2024-09-05T12:57:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T12:57:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T12:57:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T12:57:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T12:57:50.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 -- 172.21.15.73:0/2732060501 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe3e00a2c30 msgr2=0x7fe3e00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe3e00a2c30 0x7fe3e00a50f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009a60 tx=0x7fe3f0049000 comp rx=0 tx=0).stop 2024-09-05T12:57:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 -- 172.21.15.73:0/2732060501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f8100a40 msgr2=0x7fe3f806a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:57:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f8100a40 0x7fe3f806a430 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800d950 tx=0x7fe3e800de10 comp rx=0 tx=0).stop 2024-09-05T12:57:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 -- 172.21.15.73:0/2732060501 shutdown_connections 2024-09-05T12:57:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe3e00a2c30 0x7fe3e00a50f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f81025f0 0x7fe3f819f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3f8101c30 0x7fe3f819ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 --2- 172.21.15.73:0/2732060501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f8100a40 0x7fe3f806a430 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 -- 172.21.15.73:0/2732060501 >> 172.21.15.73:0/2732060501 conn(0x7fe3f80fc1e0 msgr2=0x7fe3f8104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 -- 172.21.15.73:0/2732060501 shutdown_connections 2024-09-05T12:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:57:50.595+0000 7fe3fe296640 1 -- 172.21.15.73:0/2732060501 wait complete. 2024-09-05T12:57:51.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:51 smithi162 ceph-mon[34220]: pgmap v333: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-05T12:57:51.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:51 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T12:57:51.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:51 smithi169 ceph-mon[34823]: pgmap v333: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-05T12:57:51.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:51 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T12:57:51.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:51 smithi073 ceph-mon[30883]: pgmap v333: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-05T12:57:51.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:51 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T12:57:52.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:52 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:57:52.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:52 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:57:52.448 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:52 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:57:53.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:53 smithi162 ceph-mon[34220]: pgmap v334: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-05T12:57:53.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:53 smithi169 ceph-mon[34823]: pgmap v334: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-05T12:57:53.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:53 smithi073 ceph-mon[30883]: pgmap v334: 97 pgs: 97 active+clean; 650 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-05T12:57:54.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:57:54.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:57:54.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:54 smithi073 ceph-mon[30883]: pgmap v335: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-05T12:57:54.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:57:54.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:57:54.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:54 smithi162 ceph-mon[34220]: pgmap v335: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-05T12:57:54.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:57:54.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:57:54.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:57:54.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:54 smithi169 ceph-mon[34823]: pgmap v335: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-05T12:57:57.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:57 smithi162 ceph-mon[34220]: pgmap v336: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-05T12:57:57.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:57 smithi169 ceph-mon[34823]: pgmap v336: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-05T12:57:57.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:57 smithi073 ceph-mon[30883]: pgmap v336: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-05T12:57:59.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:57:59 smithi162 ceph-mon[34220]: pgmap v337: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T12:57:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:57:59 smithi169 ceph-mon[34823]: pgmap v337: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T12:57:59.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:57:59 smithi073 ceph-mon[30883]: pgmap v337: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T12:58:01.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:01 smithi162 ceph-mon[34220]: pgmap v338: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T12:58:01.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:01 smithi169 ceph-mon[34823]: pgmap v338: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T12:58:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:01 smithi073 ceph-mon[30883]: pgmap v338: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T12:58:03.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:02 smithi073 ceph-mon[30883]: pgmap v339: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T12:58:03.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:02 smithi162 ceph-mon[34220]: pgmap v339: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T12:58:03.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:02 smithi169 ceph-mon[34823]: pgmap v339: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T12:58:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.697+0000 7ff8d23dd640 1 -- 172.21.15.73:0/436103526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8cc101c30 msgr2=0x7ff8cc1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.697+0000 7ff8d23dd640 1 --2- 172.21.15.73:0/436103526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8cc101c30 0x7ff8cc1020b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009900 tx=0x7ff8c002a410 comp rx=0 tx=0).stop 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.697+0000 7ff8d23dd640 1 -- 172.21.15.73:0/436103526 shutdown_connections 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.697+0000 7ff8d23dd640 1 --2- 172.21.15.73:0/436103526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc1025f0 0x7ff8cc108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.697+0000 7ff8d23dd640 1 --2- 172.21.15.73:0/436103526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8cc101c30 0x7ff8cc1020b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.697+0000 7ff8d23dd640 1 --2- 172.21.15.73:0/436103526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc100a40 0x7ff8cc100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.698+0000 7ff8d23dd640 1 -- 172.21.15.73:0/436103526 >> 172.21.15.73:0/436103526 conn(0x7ff8cc0fc1e0 msgr2=0x7ff8cc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.698+0000 7ff8d23dd640 1 -- 172.21.15.73:0/436103526 shutdown_connections 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.698+0000 7ff8d23dd640 1 -- 172.21.15.73:0/436103526 wait complete. 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.698+0000 7ff8d23dd640 1 Processor -- start 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.698+0000 7ff8d23dd640 1 -- start start 2024-09-05T12:58:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.698+0000 7ff8d23dd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc100a40 0x7ff8cc199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.698+0000 7ff8d23dd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8cc101c30 0x7ff8cc19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.698+0000 7ff8d23dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc1025f0 0x7ff8cc1a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8d23dd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc10b600 con 0x7ff8cc101c30 2024-09-05T12:58:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8d23dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc10b480 con 0x7ff8cc1025f0 2024-09-05T12:58:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8d23dd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc10b780 con 0x7ff8cc100a40 2024-09-05T12:58:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8cb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8cc101c30 0x7ff8cc19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8cb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8cc101c30 0x7ff8cc19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54864/0 (socket says 172.21.15.73:54864) 2024-09-05T12:58:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8cb7fe640 1 -- 172.21.15.73:0/1637261738 learned_addr learned my addr 172.21.15.73:0/1637261738 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc100a40 0x7ff8cc199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8d097a640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc1025f0 0x7ff8cc1a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8cb7fe640 1 -- 172.21.15.73:0/1637261738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc100a40 msgr2=0x7ff8cc199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8cb7fe640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc100a40 0x7ff8cc199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8cb7fe640 1 -- 172.21.15.73:0/1637261738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc1025f0 msgr2=0x7ff8cc1a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8cb7fe640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc1025f0 0x7ff8cc1a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8cb7fe640 1 -- 172.21.15.73:0/1637261738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc1a1bd0 con 0x7ff8cc101c30 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.699+0000 7ff8cb7fe640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8cc101c30 0x7ff8cc19a4f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009230 tx=0x7ff8c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.700+0000 7ff8c97fa640 1 -- 172.21.15.73:0/1637261738 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c003f030 con 0x7ff8cc101c30 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.700+0000 7ff8c97fa640 1 -- 172.21.15.73:0/1637261738 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8c0003ce0 con 0x7ff8cc101c30 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.700+0000 7ff8d23dd640 1 -- 172.21.15.73:0/1637261738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc1a1e60 con 0x7ff8cc101c30 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.700+0000 7ff8c97fa640 1 -- 172.21.15.73:0/1637261738 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0035070 con 0x7ff8cc101c30 2024-09-05T12:58:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.700+0000 7ff8d23dd640 1 -- 172.21.15.73:0/1637261738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc1a2210 con 0x7ff8cc101c30 2024-09-05T12:58:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.702+0000 7ff8d5250740 1 Processor -- start 2024-09-05T12:58:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d5250740 1 -- start start 2024-09-05T12:58:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d5250740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb691da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d5250740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6922e0 0x558ebb696da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d5250740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb697370 0x558ebb699830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d5250740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558ebb5f52f0 con 0x558ebb6919a0 2024-09-05T12:58:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d5250740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558ebb59d270 con 0x558ebb6922e0 2024-09-05T12:58:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d5250740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558ebb5f12b0 con 0x558ebb697370 2024-09-05T12:58:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d097a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb691da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d097a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb691da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54878/0 (socket says 172.21.15.73:54878) 2024-09-05T12:58:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d097a640 1 -- 172.21.15.73:0/486698763 learned_addr learned my addr 172.21.15.73:0/486698763 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8c97fa640 1 -- 172.21.15.73:0/1637261738 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff8c0042030 con 0x7ff8cc101c30 2024-09-05T12:58:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/486698763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6922e0 0x558ebb696da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d097a640 1 -- 172.21.15.73:0/486698763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb697370 msgr2=0x558ebb699830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d097a640 1 --2- 172.21.15.73:0/486698763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb697370 0x558ebb699830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d097a640 1 -- 172.21.15.73:0/486698763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6922e0 msgr2=0x558ebb696da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d097a640 1 --2- 172.21.15.73:0/486698763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6922e0 0x558ebb696da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.703+0000 7ff8d097a640 1 -- 172.21.15.73:0/486698763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ebb59c340 con 0x558ebb6919a0 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.704+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/486698763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6922e0 0x558ebb696da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.704+0000 7ff8d097a640 1 --2- 172.21.15.73:0/486698763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb691da0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009fd0 tx=0x7ff8c40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb9bc67ed1c1c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.704+0000 7ff8c97fa640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8b40a2cb0 0x7ff8b40a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.704+0000 7ff8b27fc640 1 -- 172.21.15.73:0/486698763 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4004d20 con 0x558ebb6919a0 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.704+0000 7ff8b27fc640 1 -- 172.21.15.73:0/486698763 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8c4004050 con 0x558ebb6919a0 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.704+0000 7ff8b27fc640 1 -- 172.21.15.73:0/486698763 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4005240 con 0x558ebb6919a0 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.704+0000 7ff8c97fa640 1 -- 172.21.15.73:0/1637261738 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ff8c00ef420 con 0x7ff8cc101c30 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.704+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8b40a2cb0 0x7ff8b40a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8d5250740 1 -- 172.21.15.73:0/486698763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 msgr2=0x558ebb691da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8b40a2cb0 0x7ff8b40a5170 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x558ebb692d10 tx=0x7ff8bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8d5250740 1 --2- 172.21.15.73:0/486698763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb691da0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009fd0 tx=0x7ff8c40118d0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8d5250740 1 -- 172.21.15.73:0/486698763 shutdown_connections 2024-09-05T12:58:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8d5250740 1 --2- 172.21.15.73:0/486698763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb697370 0x558ebb699830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8d5250740 1 --2- 172.21.15.73:0/486698763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6922e0 0x558ebb696da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8d5250740 1 --2- 172.21.15.73:0/486698763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb691da0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8d5250740 1 -- 172.21.15.73:0/486698763 >> 172.21.15.73:0/486698763 conn(0x558ebb68d010 msgr2=0x558ebb68d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8d5250740 1 -- 172.21.15.73:0/486698763 shutdown_connections 2024-09-05T12:58:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8d5250740 1 -- 172.21.15.73:0/486698763 wait complete. 2024-09-05T12:58:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.705+0000 7ff8d5250740 1 -- start start 2024-09-05T12:58:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d5250740 1 Processor -- start 2024-09-05T12:58:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d5250740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6919a0 0x558ebb69bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d5250740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb69c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d5250740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb697370 0x558ebb6a3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d5250740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558ebb69a340 con 0x558ebb697370 2024-09-05T12:58:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d5250740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558ebb57e290 con 0x558ebb6919a0 2024-09-05T12:58:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d5250740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558ebb69a4c0 con 0x558ebb6922e0 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d097a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb697370 0x558ebb6a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d5250740 10 client.0 _ll_register_callbacks cb 0x558ebb5af140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d097a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb697370 0x558ebb6a3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54888/0 (socket says 172.21.15.73:54888) 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d097a640 1 -- 172.21.15.73:0/155662278 learned_addr learned my addr 172.21.15.73:0/155662278 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6919a0 0x558ebb69bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8cb7fe640 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb69c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d097a640 1 -- 172.21.15.73:0/155662278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 msgr2=0x558ebb69c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d097a640 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb69c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d097a640 1 -- 172.21.15.73:0/155662278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6919a0 msgr2=0x558ebb69bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d097a640 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6919a0 0x558ebb69bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8d097a640 1 -- 172.21.15.73:0/155662278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ebb308210 con 0x558ebb697370 2024-09-05T12:58:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.706+0000 7ff8cb7fe640 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb69c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.707+0000 7ff8d097a640 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb697370 0x558ebb6a3200 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4000f80 tx=0x7ff8c40044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad4e0317043e90c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.707+0000 7ff8ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.707+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/155662278 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4028020 con 0x558ebb697370 2024-09-05T12:58:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.707+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/155662278 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ff8c4004c50 con 0x558ebb697370 2024-09-05T12:58:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.707+0000 7ff8d5250740 1 -- 172.21.15.73:0/155662278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8c4004050 con 0x558ebb697370 2024-09-05T12:58:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.707+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/155662278 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff8c4005040 con 0x558ebb697370 2024-09-05T12:58:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.707+0000 7ff8d5250740 10 client.15261 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.707+0000 7ff8d5250740 1 -- 172.21.15.73:0/155662278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ebb3d4620 con 0x558ebb697370 2024-09-05T12:58:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.707+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/155662278 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8c40056c0 con 0x558ebb697370 2024-09-05T12:58:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.707+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/155662278 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff8c400f8d0 con 0x558ebb697370 2024-09-05T12:58:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.708+0000 7ff8d5250740 10 client.15261 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.708+0000 7ff8d5250740 10 client.15261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.708+0000 7ff8d5250740 20 client.15261 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.708+0000 7ff8d5250740 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558ebb6a76e0 0x558ebb6a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.708+0000 7ff8d5250740 4 client.15261 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.708+0000 7ff8d5250740 1 -- 172.21.15.73:0/155662278 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff8c4004050 con 0x558ebb6a76e0 2024-09-05T12:58:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.708+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558ebb6a76e0 0x558ebb6a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.709+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558ebb6a76e0 0x558ebb6a9b00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc7ac9a110af5fd5 server_cookie=5cd1fe8ec9f82825 in_seq=0 out_seq=0 2024-09-05T12:58:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.709+0000 7ff8ab7fe640 10 client.15261 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.709+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/155662278 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff8c4004050 con 0x558ebb6a76e0 2024-09-05T12:58:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.709+0000 7ff8ab7fe640 10 client.15261 handle_command_reply: tid=0 2024-09-05T12:58:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.709+0000 7ff8d5250740 1 client.15261 shutdown 2024-09-05T12:58:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 1 -- 172.21.15.73:0/155662278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb697370 msgr2=0x558ebb6a3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb697370 0x558ebb6a3200 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4000f80 tx=0x7ff8c40044b0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 1 -- 172.21.15.73:0/155662278 shutdown_connections 2024-09-05T12:58:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558ebb6a76e0 0x558ebb6a9b00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb697370 0x558ebb6a3200 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb69c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 1 --2- 172.21.15.73:0/155662278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb6919a0 0x558ebb69bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 1 -- 172.21.15.73:0/155662278 >> 172.21.15.73:0/155662278 conn(0x558ebb68d010 msgr2=0x558ebb68e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8ab7fe640 0 client.15261 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 1 -- 172.21.15.73:0/155662278 shutdown_connections 2024-09-05T12:58:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 1 -- 172.21.15.73:0/155662278 wait complete. 2024-09-05T12:58:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.710+0000 7ff8d5250740 20 client.15261 trim_cache size 0 max 16384 2024-09-05T12:58:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.724+0000 7ff8d5250740 1 Processor -- start 2024-09-05T12:58:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.724+0000 7ff8d5250740 1 -- start start 2024-09-05T12:58:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.724+0000 7ff8d5250740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb68dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.724+0000 7ff8d5250740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb6a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.724+0000 7ff8d5250740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 0x558ebb68e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.724+0000 7ff8d5250740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc1ad9c0 con 0x558ebb6919a0 2024-09-05T12:58:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.724+0000 7ff8d5250740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc1ab290 con 0x558ebb697370 2024-09-05T12:58:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.724+0000 7ff8d5250740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc1a90e0 con 0x558ebb6922e0 2024-09-05T12:58:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb68dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb6a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb68dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54894/0 (socket says 172.21.15.73:54894) 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cbfff640 1 -- 172.21.15.73:0/2481436479 learned_addr learned my addr 172.21.15.73:0/2481436479 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb6a31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:34464/0 (socket says 172.21.15.73:34464) 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8d097a640 1 --2- 172.21.15.73:0/2481436479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 0x558ebb68e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cbfff640 1 -- 172.21.15.73:0/2481436479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 msgr2=0x558ebb6a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/2481436479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb6a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cbfff640 1 -- 172.21.15.73:0/2481436479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 msgr2=0x558ebb68e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/2481436479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 0x558ebb68e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cbfff640 1 -- 172.21.15.73:0/2481436479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ebb69a220 con 0x558ebb6919a0 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cb7fe640 1 --2- 172.21.15.73:0/2481436479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb6a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/2481436479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb68dec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x558ebb68de90 tx=0x7ff8bc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3988721173d0abdf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8b1ffb640 1 -- 172.21.15.73:0/2481436479 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc034860 con 0x558ebb6919a0 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8b1ffb640 1 -- 172.21.15.73:0/2481436479 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8bc039070 con 0x558ebb6919a0 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.725+0000 7ff8b1ffb640 1 -- 172.21.15.73:0/2481436479 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc01e420 con 0x558ebb6919a0 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.726+0000 7ff8d5250740 1 -- 172.21.15.73:0/2481436479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 msgr2=0x558ebb68dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.726+0000 7ff8d5250740 1 --2- 172.21.15.73:0/2481436479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb68dec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x558ebb68de90 tx=0x7ff8bc01b000 comp rx=0 tx=0).stop 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.726+0000 7ff8d5250740 1 -- 172.21.15.73:0/2481436479 shutdown_connections 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.726+0000 7ff8d5250740 1 --2- 172.21.15.73:0/2481436479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 0x558ebb68e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.726+0000 7ff8d5250740 1 --2- 172.21.15.73:0/2481436479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb6a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.726+0000 7ff8d5250740 1 --2- 172.21.15.73:0/2481436479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb68dec0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.726+0000 7ff8d5250740 1 -- 172.21.15.73:0/2481436479 >> 172.21.15.73:0/2481436479 conn(0x558ebb68d010 msgr2=0x558ebb69bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.726+0000 7ff8d5250740 1 -- 172.21.15.73:0/2481436479 shutdown_connections 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.726+0000 7ff8d5250740 1 -- 172.21.15.73:0/2481436479 wait complete. 2024-09-05T12:58:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8d5250740 1 -- start start 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8d5250740 1 Processor -- start 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8d5250740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb6a0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb6a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb6a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54906/0 (socket says 172.21.15.73:54906) 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8cbfff640 1 -- 172.21.15.73:0/4052782625 learned_addr learned my addr 172.21.15.73:0/4052782625 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8d5250740 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb6a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8d5250740 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 0x558ebb6a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc1a9750 con 0x558ebb6919a0 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc1aabc0 con 0x558ebb697370 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc1a9e20 con 0x558ebb6922e0 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8d5250740 10 client.0 _ll_register_callbacks cb 0x7ff8bc0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8d097a640 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 0x558ebb6a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.727+0000 7ff8cb7fe640 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb6a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8cbfff640 1 -- 172.21.15.73:0/4052782625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 msgr2=0x558ebb6a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb6a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8cbfff640 1 -- 172.21.15.73:0/4052782625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 msgr2=0x558ebb6a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 0x558ebb6a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8cbfff640 1 -- 172.21.15.73:0/4052782625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ebb6a2230 con 0x558ebb6919a0 2024-09-05T12:58:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8d097a640 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 0x558ebb6a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8cbfff640 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb6a0720 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc013010 tx=0x7ff8bc01fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c4cd1ec1dc9a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/4052782625 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc02bc90 con 0x558ebb6919a0 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/4052782625 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ff8bc005040 con 0x558ebb6919a0 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8bc039070 con 0x558ebb6919a0 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/4052782625 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff8bc005240 con 0x558ebb6919a0 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8d5250740 10 client.15267 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.728+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ebb6a3520 con 0x558ebb6919a0 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/4052782625 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8bc042070 con 0x558ebb6919a0 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/4052782625 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff8bc004880 con 0x558ebb6919a0 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8d5250740 10 client.15267 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8d5250740 10 client.15267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8d5250740 20 client.15267 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8d5250740 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558ebb712b60 0x558ebb714f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8d5250740 4 client.15267 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T12:58:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7ff8bc039070 con 0x558ebb712b60 2024-09-05T12:58:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8cb7fe640 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558ebb712b60 0x558ebb714f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8ab7fe640 10 client.15267 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.729+0000 7ff8cb7fe640 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558ebb712b60 0x558ebb714f80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2aaa9899a19b66a server_cookie=a4d3e56293a46c3c in_seq=0 out_seq=0 2024-09-05T12:58:03.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.735+0000 7ff8ab7fe640 1 -- 172.21.15.73:0/4052782625 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7ff8bc039070 con 0x558ebb712b60 2024-09-05T12:58:03.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.735+0000 7ff8ab7fe640 10 client.15267 handle_command_reply: tid=0 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.735+0000 7ff8d5250740 1 client.15267 shutdown 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 msgr2=0x558ebb6a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb6a0720 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc013010 tx=0x7ff8bc01fed0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 shutdown_connections 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x558ebb712b60 0x558ebb714f80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8ab7fe640 0 client.15267 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ebb697370 0x558ebb6a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ebb6922e0 0x558ebb6a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 1 --2- 172.21.15.73:0/4052782625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ebb6919a0 0x558ebb6a0720 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 >> 172.21.15.73:0/4052782625 conn(0x558ebb68d010 msgr2=0x558ebb68b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 shutdown_connections 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 1 -- 172.21.15.73:0/4052782625 wait complete. 2024-09-05T12:58:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d5250740 20 client.15267 trim_cache size 0 max 16384 2024-09-05T12:58:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T12:58:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T12:58:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T12:58:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T12:58:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d23dd640 1 -- 172.21.15.73:0/1637261738 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8b40a2cb0 msgr2=0x7ff8b40a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d23dd640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8b40a2cb0 0x7ff8b40a5170 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x558ebb692d10 tx=0x7ff8bc005f90 comp rx=0 tx=0).stop 2024-09-05T12:58:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d23dd640 1 -- 172.21.15.73:0/1637261738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8cc101c30 msgr2=0x7ff8cc19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.736+0000 7ff8d23dd640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8cc101c30 0x7ff8cc19a4f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009230 tx=0x7ff8c00042f0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.737+0000 7ff8d23dd640 1 -- 172.21.15.73:0/1637261738 shutdown_connections 2024-09-05T12:58:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.737+0000 7ff8d23dd640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ff8b40a2cb0 0x7ff8b40a5170 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.737+0000 7ff8d23dd640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc1025f0 0x7ff8cc1a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.737+0000 7ff8d23dd640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8cc101c30 0x7ff8cc19a4f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.737+0000 7ff8d23dd640 1 --2- 172.21.15.73:0/1637261738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc100a40 0x7ff8cc199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.737+0000 7ff8d23dd640 1 -- 172.21.15.73:0/1637261738 >> 172.21.15.73:0/1637261738 conn(0x7ff8cc0fc1e0 msgr2=0x7ff8cc104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.737+0000 7ff8d23dd640 1 -- 172.21.15.73:0/1637261738 shutdown_connections 2024-09-05T12:58:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:03.737+0000 7ff8d23dd640 1 -- 172.21.15.73:0/1637261738 wait complete. 2024-09-05T12:58:05.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:05 smithi162 ceph-mon[34220]: pgmap v340: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-05T12:58:05.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:05 smithi169 ceph-mon[34823]: pgmap v340: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-05T12:58:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:05 smithi073 ceph-mon[30883]: pgmap v340: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-05T12:58:07.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:07 smithi162 ceph-mon[34220]: pgmap v341: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-05T12:58:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:07 smithi169 ceph-mon[34823]: pgmap v341: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-05T12:58:07.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:07 smithi073 ceph-mon[30883]: pgmap v341: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-05T12:58:09.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:09 smithi162 ceph-mon[34220]: pgmap v342: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-05T12:58:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:09 smithi169 ceph-mon[34823]: pgmap v342: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-05T12:58:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:09 smithi073 ceph-mon[30883]: pgmap v342: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-05T12:58:10.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T12:58:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:11.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:11 smithi073 ceph-mon[30883]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-05T12:58:11.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:11 smithi162 ceph-mon[34220]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-05T12:58:11.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:11 smithi169 ceph-mon[34823]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-05T12:58:11.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.383+0000 7f97d8612640 1 -- 172.21.15.73:0/3412523348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d0106f10 msgr2=0x7f97d010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:11.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.383+0000 7f97d8612640 1 --2- 172.21.15.73:0/3412523348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d0106f10 0x7f97d010ea90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009ca0 tx=0x7f97c802a8c0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.383+0000 7f97d8612640 1 -- 172.21.15.73:0/3412523348 shutdown_connections 2024-09-05T12:58:11.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.383+0000 7f97d8612640 1 --2- 172.21.15.73:0/3412523348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d0106f10 0x7f97d010ea90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.383+0000 7f97d8612640 1 --2- 172.21.15.73:0/3412523348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d0102790 0x7f97d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.383+0000 7f97d8612640 1 --2- 172.21.15.73:0/3412523348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d0101de0 0x7f97d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.383+0000 7f97d8612640 1 -- 172.21.15.73:0/3412523348 >> 172.21.15.73:0/3412523348 conn(0x7f97d00fd8e0 msgr2=0x7f97d00ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:11.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.383+0000 7f97d8612640 1 -- 172.21.15.73:0/3412523348 shutdown_connections 2024-09-05T12:58:11.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.383+0000 7f97d8612640 1 -- 172.21.15.73:0/3412523348 wait complete. 2024-09-05T12:58:11.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.384+0000 7f97d8612640 1 Processor -- start 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.384+0000 7f97d8612640 1 -- start start 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.384+0000 7f97d8612640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d0101de0 0x7f97d01983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.384+0000 7f97d8612640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d0102790 0x7f97d01988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.384+0000 7f97d8612640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d0106f10 0x7f97d019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d8612640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f97d0111f70 con 0x7f97d0106f10 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d8612640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97d0111df0 con 0x7f97d0102790 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d8612640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97d01120f0 con 0x7f97d0101de0 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d63ae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d0101de0 0x7f97d01983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d5bad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d0102790 0x7f97d01988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d63ae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d0101de0 0x7f97d01983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:34504/0 (socket says 172.21.15.73:34504) 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d63ae640 1 -- 172.21.15.73:0/1758297167 learned_addr learned my addr 172.21.15.73:0/1758297167 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d6baf640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d0106f10 0x7f97d019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d5bad640 1 -- 172.21.15.73:0/1758297167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d0101de0 msgr2=0x7f97d01983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d5bad640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d0101de0 0x7f97d01983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d5bad640 1 -- 172.21.15.73:0/1758297167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d0106f10 msgr2=0x7f97d019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d5bad640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d0106f10 0x7f97d019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d5bad640 1 -- 172.21.15.73:0/1758297167 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d019d360 con 0x7f97d0102790 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.385+0000 7f97d5bad640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d0102790 0x7f97d01988f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f97c000d6d0 tx=0x7f97c000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.386+0000 7f97c77fe640 1 -- 172.21.15.73:0/1758297167 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0017070 con 0x7f97d0102790 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.386+0000 7f97d8612640 1 -- 172.21.15.73:0/1758297167 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d019d650 con 0x7f97d0102790 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.386+0000 7f97c77fe640 1 -- 172.21.15.73:0/1758297167 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97c0009820 con 0x7f97d0102790 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.386+0000 7f97c77fe640 1 -- 172.21.15.73:0/1758297167 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0004cd0 con 0x7f97d0102790 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.386+0000 7f97d8612640 1 -- 172.21.15.73:0/1758297167 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d01a4f30 con 0x7f97d0102790 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.389+0000 7f97c77fe640 1 -- 172.21.15.73:0/1758297167 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f97c00099d0 con 0x7f97d0102790 2024-09-05T12:58:11.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.389+0000 7f97da9e8740 1 Processor -- start 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.389+0000 7f97da9e8740 1 -- start start 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.389+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd0273c0 0x55c9bd0277a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.389+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd027ce0 0x55c9bd036550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd038e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97da9e8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c9bcf8d2e0 con 0x55c9bd036a90 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97da9e8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c9bcf34ce0 con 0x55c9bd0273c0 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97da9e8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c9bcf892a0 con 0x55c9bd027ce0 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d6baf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd0273c0 0x55c9bd0277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d63ae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd027ce0 0x55c9bd036550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d6baf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd0273c0 0x55c9bd0277a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:59570/0 (socket says 172.21.15.73:59570) 2024-09-05T12:58:11.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d6baf640 1 -- 172.21.15.73:0/2936997492 learned_addr learned my addr 172.21.15.73:0/2936997492 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:11.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97c77fe640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97bc0a2c00 0x7f97bc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d5bad640 1 --2- 172.21.15.73:0/2936997492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d6baf640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97bc0a2c00 0x7f97bc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97c77fe640 1 -- 172.21.15.73:0/1758297167 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f97c00ceb10 con 0x7f97d0102790 2024-09-05T12:58:11.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d6baf640 1 -- 172.21.15.73:0/2936997492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd027ce0 msgr2=0x55c9bd036550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:11.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d6baf640 1 --2- 172.21.15.73:0/2936997492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd027ce0 0x55c9bd036550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d6baf640 1 -- 172.21.15.73:0/2936997492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 msgr2=0x55c9bd038e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:11.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d6baf640 1 --2- 172.21.15.73:0/2936997492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd038e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d6baf640 1 -- 172.21.15.73:0/2936997492 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9bcf19440 con 0x55c9bd0273c0 2024-09-05T12:58:11.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d63ae640 1 --2- 172.21.15.73:0/2936997492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd027ce0 0x55c9bd036550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:11.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.390+0000 7f97d5bad640 1 --2- 172.21.15.73:0/2936997492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd038e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.391+0000 7f97d6baf640 1 --2- 172.21.15.73:0/2936997492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd0273c0 0x55c9bd0277a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009430 tx=0x7f97c80039f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9693b59b1cda584 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.391+0000 7f97d6baf640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97bc0a2c00 0x7f97bc0a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f97c8048000 tx=0x7f97c804a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.391+0000 7f97c4ff9640 1 -- 172.21.15.73:0/2936997492 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c804f070 con 0x55c9bd0273c0 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.391+0000 7f97c4ff9640 1 -- 172.21.15.73:0/2936997492 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97c8036040 con 0x55c9bd0273c0 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.391+0000 7f97c4ff9640 1 -- 172.21.15.73:0/2936997492 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c802fc20 con 0x55c9bd0273c0 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.392+0000 7f97da9e8740 1 -- 172.21.15.73:0/2936997492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd0273c0 msgr2=0x55c9bd0277a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.392+0000 7f97da9e8740 1 --2- 172.21.15.73:0/2936997492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd0273c0 0x55c9bd0277a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009430 tx=0x7f97c80039f0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.392+0000 7f97da9e8740 1 -- 172.21.15.73:0/2936997492 shutdown_connections 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.392+0000 7f97da9e8740 1 --2- 172.21.15.73:0/2936997492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd038e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.392+0000 7f97da9e8740 1 --2- 172.21.15.73:0/2936997492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd027ce0 0x55c9bd036550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.392+0000 7f97da9e8740 1 --2- 172.21.15.73:0/2936997492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd0273c0 0x55c9bd0277a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.392+0000 7f97da9e8740 1 -- 172.21.15.73:0/2936997492 >> 172.21.15.73:0/2936997492 conn(0x55c9bd023a30 msgr2=0x55c9bd023e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:11.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.392+0000 7f97da9e8740 1 -- 172.21.15.73:0/2936997492 shutdown_connections 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.392+0000 7f97da9e8740 1 -- 172.21.15.73:0/2936997492 wait complete. 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.393+0000 7f97da9e8740 1 -- start start 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.393+0000 7f97da9e8740 1 Processor -- start 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.394+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd0273c0 0x55c9bd036410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.394+0000 7f97d63ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd0273c0 0x55c9bd036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.394+0000 7f97d63ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd0273c0 0x55c9bd036410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54944/0 (socket says 172.21.15.73:54944) 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.394+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd027ce0 0x55c9bd0336c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.394+0000 7f97d63ae640 1 -- 172.21.15.73:0/346605277 learned_addr learned my addr 172.21.15.73:0/346605277 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.394+0000 7f97da9e8740 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd036a90 0x55c9bd033c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.394+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c9bd0394e0 con 0x55c9bd0273c0 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.394+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c9bcf48050 con 0x55c9bd027ce0 2024-09-05T12:58:11.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.394+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c9bd039660 con 0x55c9bd036a90 2024-09-05T12:58:11.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97d6baf640 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd036a90 0x55c9bd033c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97da9e8740 10 client.0 _ll_register_callbacks cb 0x55c9bcf88160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:11.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97d63ae640 1 -- 172.21.15.73:0/346605277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd036a90 msgr2=0x55c9bd033c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:11.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97d63ae640 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd036a90 0x55c9bd033c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97d63ae640 1 -- 172.21.15.73:0/346605277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd027ce0 msgr2=0x55c9bd0336c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:11.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97d63ae640 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd027ce0 0x55c9bd0336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97d63ae640 1 -- 172.21.15.73:0/346605277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9bccfe3c0 con 0x55c9bd0273c0 2024-09-05T12:58:11.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97d63ae640 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd0273c0 0x55c9bd036410 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00ba40 tx=0x7f97cc00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14024ff2f794cb6b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:11.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:11.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97b9ffb640 1 -- 172.21.15.73:0/346605277 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc005020 con 0x55c9bd0273c0 2024-09-05T12:58:11.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97c8036040 con 0x55c9bd0273c0 2024-09-05T12:58:11.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.395+0000 7f97b9ffb640 1 -- 172.21.15.73:0/346605277 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f97cc0051c0 con 0x55c9bd0273c0 2024-09-05T12:58:11.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97b9ffb640 1 -- 172.21.15.73:0/346605277 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97cc0053c0 con 0x55c9bd0273c0 2024-09-05T12:58:11.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97da9e8740 10 client.15276 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:11.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9bd044ef0 con 0x55c9bd0273c0 2024-09-05T12:58:11.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97b9ffb640 1 -- 172.21.15.73:0/346605277 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97cc005560 con 0x55c9bd0273c0 2024-09-05T12:58:11.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97b9ffb640 1 -- 172.21.15.73:0/346605277 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f97cc011830 con 0x55c9bd0273c0 2024-09-05T12:58:11.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97da9e8740 10 client.15276 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:11.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97da9e8740 10 client.15276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97da9e8740 20 client.15276 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97da9e8740 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c9bd046300 0x55c9bd0487c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97da9e8740 4 client.15276 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.396+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f97c8036040 con 0x55c9bd046300 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.397+0000 7f97d5bad640 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c9bd046300 0x55c9bd0487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.397+0000 7f97d5bad640 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c9bd046300 0x55c9bd0487c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=259ff0b73869e3ca server_cookie=fe8f436ee4ef2256 in_seq=0 out_seq=0 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.397+0000 7f97b9ffb640 10 client.15276 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97b9ffb640 1 -- 172.21.15.73:0/346605277 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f97c8036040 con 0x55c9bd046300 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97b9ffb640 10 client.15276 handle_command_reply: tid=0 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 client.15276 shutdown 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd0273c0 msgr2=0x55c9bd036410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:11.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd0273c0 0x55c9bd036410 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00ba40 tx=0x7f97cc00bf00 comp rx=0 tx=0).stop 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 shutdown_connections 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c9bd046300 0x55c9bd0487c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd036a90 0x55c9bd033c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd027ce0 0x55c9bd0336c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 --2- 172.21.15.73:0/346605277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd0273c0 0x55c9bd036410 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 >> 172.21.15.73:0/346605277 conn(0x55c9bd023a30 msgr2=0x55c9bd022b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97b9ffb640 0 client.15276 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 shutdown_connections 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.398+0000 7f97da9e8740 1 -- 172.21.15.73:0/346605277 wait complete. 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.399+0000 7f97da9e8740 20 client.15276 trim_cache size 0 max 16384 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.415+0000 7f97da9e8740 1 Processor -- start 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.415+0000 7f97da9e8740 1 -- start start 2024-09-05T12:58:11.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd027ce0 0x55c9bd042780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd036a90 0x55c9bd04e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd04e620 0x55c9bd03e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97da9e8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f97d01adbc0 con 0x55c9bd027ce0 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97da9e8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97d01ab490 con 0x55c9bd036a90 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97da9e8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97d01a92e0 con 0x55c9bd04e620 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d63ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd027ce0 0x55c9bd042780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d63ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd027ce0 0x55c9bd042780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54952/0 (socket says 172.21.15.73:54952) 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d63ae640 1 -- 172.21.15.73:0/1005992600 learned_addr learned my addr 172.21.15.73:0/1005992600 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d6baf640 1 --2- 172.21.15.73:0/1005992600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd04e620 0x55c9bd03e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d5bad640 1 --2- 172.21.15.73:0/1005992600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd036a90 0x55c9bd04e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d63ae640 1 -- 172.21.15.73:0/1005992600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd04e620 msgr2=0x55c9bd03e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d63ae640 1 --2- 172.21.15.73:0/1005992600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd04e620 0x55c9bd03e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d63ae640 1 -- 172.21.15.73:0/1005992600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd036a90 msgr2=0x55c9bd04e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d63ae640 1 --2- 172.21.15.73:0/1005992600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd036a90 0x55c9bd04e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d63ae640 1 -- 172.21.15.73:0/1005992600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9bd033fb0 con 0x55c9bd027ce0 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97d63ae640 1 --2- 172.21.15.73:0/1005992600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd027ce0 0x55c9bd042780 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00b580 tx=0x7f97cc003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffa650560146d23 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.416+0000 7f97bbfff640 1 -- 172.21.15.73:0/1005992600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc010430 con 0x55c9bd027ce0 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97bbfff640 1 -- 172.21.15.73:0/1005992600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97cc011920 con 0x55c9bd027ce0 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97bbfff640 1 -- 172.21.15.73:0/1005992600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc010950 con 0x55c9bd027ce0 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97da9e8740 1 -- 172.21.15.73:0/1005992600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd027ce0 msgr2=0x55c9bd042780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97da9e8740 1 --2- 172.21.15.73:0/1005992600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd027ce0 0x55c9bd042780 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00b580 tx=0x7f97cc003b00 comp rx=0 tx=0).stop 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97da9e8740 1 -- 172.21.15.73:0/1005992600 shutdown_connections 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97da9e8740 1 --2- 172.21.15.73:0/1005992600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd04e620 0x55c9bd03e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97da9e8740 1 --2- 172.21.15.73:0/1005992600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd036a90 0x55c9bd04e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97da9e8740 1 --2- 172.21.15.73:0/1005992600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd027ce0 0x55c9bd042780 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97da9e8740 1 -- 172.21.15.73:0/1005992600 >> 172.21.15.73:0/1005992600 conn(0x55c9bd023a30 msgr2=0x55c9bd022b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:11.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97da9e8740 1 -- 172.21.15.73:0/1005992600 shutdown_connections 2024-09-05T12:58:11.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.417+0000 7f97da9e8740 1 -- 172.21.15.73:0/1005992600 wait complete. 2024-09-05T12:58:11.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97da9e8740 1 -- start start 2024-09-05T12:58:11.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97da9e8740 1 Processor -- start 2024-09-05T12:58:11.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd02eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd04e620 0x55c9bd03f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97da9e8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd03d370 0x55c9bd03d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97da9e8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f97d01a9950 con 0x55c9bd036a90 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97da9e8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97d01aadc0 con 0x55c9bd04e620 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97da9e8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97d01aa020 con 0x55c9bd03d370 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97da9e8740 10 client.0 _ll_register_callbacks cb 0x7f97cc004110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97d63ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd02eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97d63ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd02eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54962/0 (socket says 172.21.15.73:54962) 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.418+0000 7f97d63ae640 1 -- 172.21.15.73:0/2394846394 learned_addr learned my addr 172.21.15.73:0/2394846394 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97d6baf640 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd03d370 0x55c9bd03d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97d63ae640 1 -- 172.21.15.73:0/2394846394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd03d370 msgr2=0x55c9bd03d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97d63ae640 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd03d370 0x55c9bd03d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97d63ae640 1 -- 172.21.15.73:0/2394846394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd04e620 msgr2=0x55c9bd03f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97d63ae640 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd04e620 0x55c9bd03f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97d63ae640 1 -- 172.21.15.73:0/2394846394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9bd03deb0 con 0x55c9bd036a90 2024-09-05T12:58:11.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97d6baf640 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd03d370 0x55c9bd03d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:11.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97d63ae640 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd02eee0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f97cc013010 tx=0x7f97cc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad83abd2890b2f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:11.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:11.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97b9ffb640 1 -- 172.21.15.73:0/2394846394 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00b5b0 con 0x55c9bd036a90 2024-09-05T12:58:11.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97da9e8740 1 -- 172.21.15.73:0/2394846394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97cc011920 con 0x55c9bd036a90 2024-09-05T12:58:11.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97b9ffb640 1 -- 172.21.15.73:0/2394846394 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f97cc010660 con 0x55c9bd036a90 2024-09-05T12:58:11.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97b9ffb640 1 -- 172.21.15.73:0/2394846394 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97cc04b030 con 0x55c9bd036a90 2024-09-05T12:58:11.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97da9e8740 10 client.15282 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:11.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.419+0000 7f97da9e8740 1 -- 172.21.15.73:0/2394846394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9bd0a9070 con 0x55c9bd036a90 2024-09-05T12:58:11.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.420+0000 7f97b9ffb640 1 -- 172.21.15.73:0/2394846394 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97cc010dd0 con 0x55c9bd036a90 2024-09-05T12:58:11.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.420+0000 7f97b9ffb640 1 -- 172.21.15.73:0/2394846394 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f97cc04e070 con 0x55c9bd036a90 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.420+0000 7f97da9e8740 10 client.15282 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.420+0000 7f97da9e8740 10 client.15282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.420+0000 7f97da9e8740 20 client.15282 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.420+0000 7f97da9e8740 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c9bd0a96c0 0x55c9bd0abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.420+0000 7f97da9e8740 4 client.15282 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.420+0000 7f97da9e8740 1 -- 172.21.15.73:0/2394846394 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f97cc011920 con 0x55c9bd0a96c0 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.420+0000 7f97d5bad640 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c9bd0a96c0 0x55c9bd0abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.421+0000 7f97d5bad640 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c9bd0a96c0 0x55c9bd0abae0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca449df494ad2624 server_cookie=f162aee44609454a in_seq=0 out_seq=0 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.421+0000 7f97b9ffb640 10 client.15282 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.421+0000 7f97b9ffb640 1 -- 172.21.15.73:0/2394846394 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f97cc011920 con 0x55c9bd0a96c0 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.421+0000 7f97b9ffb640 10 client.15282 handle_command_reply: tid=0 2024-09-05T12:58:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.421+0000 7f97da9e8740 1 client.15282 shutdown 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.421+0000 7f97da9e8740 1 -- 172.21.15.73:0/2394846394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 msgr2=0x55c9bd02eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.421+0000 7f97da9e8740 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd02eee0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f97cc013010 tx=0x7f97cc011ad0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.421+0000 7f97da9e8740 1 -- 172.21.15.73:0/2394846394 shutdown_connections 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.421+0000 7f97da9e8740 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c9bd0a96c0 0x55c9bd0abae0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.422+0000 7f97da9e8740 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9bd03d370 0x55c9bd03d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.422+0000 7f97da9e8740 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9bd04e620 0x55c9bd03f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.422+0000 7f97da9e8740 1 --2- 172.21.15.73:0/2394846394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9bd036a90 0x55c9bd02eee0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.422+0000 7f97da9e8740 1 -- 172.21.15.73:0/2394846394 >> 172.21.15.73:0/2394846394 conn(0x55c9bd023a30 msgr2=0x55c9bd034f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.422+0000 7f97b9ffb640 0 client.15282 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.422+0000 7f97da9e8740 1 -- 172.21.15.73:0/2394846394 shutdown_connections 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.422+0000 7f97da9e8740 1 -- 172.21.15.73:0/2394846394 wait complete. 2024-09-05T12:58:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.422+0000 7f97da9e8740 20 client.15282 trim_cache size 0 max 16384 2024-09-05T12:58:11.442 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:58:11.442 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2024-09-05T12:58:11.442 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2024-09-05T12:58:11.442 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:58:11.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 -- 172.21.15.73:0/1758297167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97bc0a2c00 msgr2=0x7f97bc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97bc0a2c00 0x7f97bc0a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f97c8048000 tx=0x7f97c804a000 comp rx=0 tx=0).stop 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 -- 172.21.15.73:0/1758297167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d0102790 msgr2=0x7f97d01988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d0102790 0x7f97d01988f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f97c000d6d0 tx=0x7f97c000db90 comp rx=0 tx=0).stop 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 -- 172.21.15.73:0/1758297167 shutdown_connections 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f97bc0a2c00 0x7f97bc0a50c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d0106f10 0x7f97d019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d0102790 0x7f97d01988f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 --2- 172.21.15.73:0/1758297167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d0101de0 0x7f97d01983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 -- 172.21.15.73:0/1758297167 >> 172.21.15.73:0/1758297167 conn(0x7f97d00fd8e0 msgr2=0x7f97d00febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 -- 172.21.15.73:0/1758297167 shutdown_connections 2024-09-05T12:58:11.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:11.423+0000 7f97d8612640 1 -- 172.21.15.73:0/1758297167 wait complete. 2024-09-05T12:58:12.239 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T12:58:12.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:58:12.515 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:13.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.034+0000 7f7842bb0640 1 -- 172.21.15.73:0/3699647036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783c102db0 msgr2=0x7f783c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:13.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.034+0000 7f7842bb0640 1 --2- 172.21.15.73:0/3699647036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783c102db0 0x7f783c103190 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7830009930 tx=0x7f783002a420 comp rx=0 tx=0).stop 2024-09-05T12:58:13.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.034+0000 7f7842bb0640 1 -- 172.21.15.73:0/3699647036 shutdown_connections 2024-09-05T12:58:13.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.034+0000 7f7842bb0640 1 --2- 172.21.15.73:0/3699647036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f783c1082e0 0x7f783c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:13.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.034+0000 7f7842bb0640 1 --2- 172.21.15.73:0/3699647036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f783c103760 0x7f783c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:13.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.034+0000 7f7842bb0640 1 --2- 172.21.15.73:0/3699647036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783c102db0 0x7f783c103190 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:13.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.034+0000 7f7842bb0640 1 -- 172.21.15.73:0/3699647036 >> 172.21.15.73:0/3699647036 conn(0x7f783c0fc7d0 msgr2=0x7f783c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:13.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.035+0000 7f7842bb0640 1 -- 172.21.15.73:0/3699647036 shutdown_connections 2024-09-05T12:58:13.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.035+0000 7f7842bb0640 1 -- 172.21.15.73:0/3699647036 wait complete. 2024-09-05T12:58:13.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.036+0000 7f7842bb0640 1 Processor -- start 2024-09-05T12:58:13.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.036+0000 7f7842bb0640 1 -- start start 2024-09-05T12:58:13.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.036+0000 7f7842bb0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f783c103760 0x7f783c19e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:13.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.036+0000 7f7842bb0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783c1082e0 0x7f783c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:13.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.037+0000 7f7842bb0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f783c198600 0x7f783c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:13.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.037+0000 7f7842bb0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f783c112090 con 0x7f783c1082e0 2024-09-05T12:58:13.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.037+0000 7f783bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783c1082e0 0x7f783c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:13.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.037+0000 7f783bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783c1082e0 0x7f783c19e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54984/0 (socket says 172.21.15.73:54984) 2024-09-05T12:58:13.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.037+0000 7f783bfff640 1 -- 172.21.15.73:0/763306831 learned_addr learned my addr 172.21.15.73:0/763306831 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:13.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.037+0000 7f784114d640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f783c198600 0x7f783c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:13.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.037+0000 7f7842bb0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f783c111f10 con 0x7f783c198600 2024-09-05T12:58:13.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.037+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f783c112210 con 0x7f783c103760 2024-09-05T12:58:13.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.037+0000 7f784094c640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f783c103760 0x7f783c19e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:13.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.038+0000 7f783bfff640 1 -- 172.21.15.73:0/763306831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f783c103760 msgr2=0x7f783c19e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:13.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.038+0000 7f783bfff640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f783c103760 0x7f783c19e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:13.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.038+0000 7f783bfff640 1 -- 172.21.15.73:0/763306831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f783c198600 msgr2=0x7f783c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:13.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.038+0000 7f783bfff640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f783c198600 0x7f783c198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:13.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.038+0000 7f783bfff640 1 -- 172.21.15.73:0/763306831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c199120 con 0x7f783c1082e0 2024-09-05T12:58:13.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.038+0000 7f783bfff640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783c1082e0 0x7f783c19e980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f782800e9f0 tx=0x7f782800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:13.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.038+0000 7f7839ffb640 1 -- 172.21.15.73:0/763306831 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782800ccc0 con 0x7f783c1082e0 2024-09-05T12:58:13.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.038+0000 7f7839ffb640 1 -- 172.21.15.73:0/763306831 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7828010910 con 0x7f783c1082e0 2024-09-05T12:58:13.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.038+0000 7f7839ffb640 1 -- 172.21.15.73:0/763306831 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828018920 con 0x7f783c1082e0 2024-09-05T12:58:13.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.039+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c199410 con 0x7f783c1082e0 2024-09-05T12:58:13.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.039+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c1a5540 con 0x7f783c1082e0 2024-09-05T12:58:13.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.040+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f783c103190 con 0x7f783c1082e0 2024-09-05T12:58:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.041+0000 7f7839ffb640 1 -- 172.21.15.73:0/763306831 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7828010ac0 con 0x7f783c1082e0 2024-09-05T12:58:13.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.042+0000 7f7839ffb640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f782c0a2c30 0x7f782c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:13.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.043+0000 7f7839ffb640 1 -- 172.21.15.73:0/763306831 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f78280cf2d0 con 0x7f783c1082e0 2024-09-05T12:58:13.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.043+0000 7f784094c640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f782c0a2c30 0x7f782c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:13.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.043+0000 7f784094c640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f782c0a2c30 0x7f782c0a50f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7830009230 tx=0x7f7830009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:13.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.046+0000 7f7839ffb640 1 -- 172.21.15.73:0/763306831 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f782809c260 con 0x7f783c1082e0 2024-09-05T12:58:13.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:13 smithi073 ceph-mon[30883]: pgmap v344: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-05T12:58:13.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.275+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f783c10a2f0 con 0x7f783c1082e0 2024-09-05T12:58:13.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.276+0000 7f7839ffb640 1 -- 172.21.15.73:0/763306831 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11926 (secure 0 0 0) 0x7f782809bb60 con 0x7f783c1082e0 2024-09-05T12:58:13.277 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:58:13.277 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"btime":"2024-09-05T12:57:30:110632+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:57:30.060424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T12:58:13.277 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 25 2024-09-05T12:58:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f782c0a2c30 msgr2=0x7f782c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f782c0a2c30 0x7f782c0a50f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7830009230 tx=0x7f7830009560 comp rx=0 tx=0).stop 2024-09-05T12:58:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783c1082e0 msgr2=0x7f783c19e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783c1082e0 0x7f783c19e980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f782800e9f0 tx=0x7f782800eeb0 comp rx=0 tx=0).stop 2024-09-05T12:58:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 shutdown_connections 2024-09-05T12:58:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f782c0a2c30 0x7f782c0a50f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f783c198600 0x7f783c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:13.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783c1082e0 0x7f783c19e980 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:13.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 --2- 172.21.15.73:0/763306831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f783c103760 0x7f783c19e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:13.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 >> 172.21.15.73:0/763306831 conn(0x7f783c0fc7d0 msgr2=0x7f783c105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:13.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 shutdown_connections 2024-09-05T12:58:13.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:13.279+0000 7f7842bb0640 1 -- 172.21.15.73:0/763306831 wait complete. 2024-09-05T12:58:13.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:13 smithi162 ceph-mon[34220]: pgmap v344: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-05T12:58:13.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:13 smithi169 ceph-mon[34823]: pgmap v344: 97 pgs: 97 active+clean; 653 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-05T12:58:13.952 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T12:58:14.236 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:14.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:14 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/763306831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:58:14.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:14 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/763306831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:58:14.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:14 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/763306831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:58:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.785+0000 7f39f7bed640 1 -- 172.21.15.73:0/3483940491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f0100e20 msgr2=0x7f39f0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.785+0000 7f39f7bed640 1 --2- 172.21.15.73:0/3483940491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f0100e20 0x7f39f0101200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009900 tx=0x7f39ec02a480 comp rx=0 tx=0).stop 2024-09-05T12:58:14.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.785+0000 7f39f7bed640 1 -- 172.21.15.73:0/3483940491 shutdown_connections 2024-09-05T12:58:14.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.785+0000 7f39f7bed640 1 --2- 172.21.15.73:0/3483940491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f0102ef0 0x7f39f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.785+0000 7f39f7bed640 1 --2- 172.21.15.73:0/3483940491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39f0102570 0x7f39f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.785+0000 7f39f7bed640 1 --2- 172.21.15.73:0/3483940491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f0100e20 0x7f39f0101200 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.785+0000 7f39f7bed640 1 -- 172.21.15.73:0/3483940491 >> 172.21.15.73:0/3483940491 conn(0x7f39f00fc7d0 msgr2=0x7f39f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:14.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.785+0000 7f39f7bed640 1 -- 172.21.15.73:0/3483940491 shutdown_connections 2024-09-05T12:58:14.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.785+0000 7f39f7bed640 1 -- 172.21.15.73:0/3483940491 wait complete. 2024-09-05T12:58:14.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.786+0000 7f39f7bed640 1 Processor -- start 2024-09-05T12:58:14.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.786+0000 7f39f7bed640 1 -- start start 2024-09-05T12:58:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.787+0000 7f39f7bed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39f0100e20 0x7f39f01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.787+0000 7f39f7bed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f0102570 0x7f39f0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.787+0000 7f39f7bed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f0102ef0 0x7f39f019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.787+0000 7f39f7bed640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01120d0 con 0x7f39f0102ef0 2024-09-05T12:58:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.787+0000 7f39f5989640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39f0100e20 0x7f39f01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.787+0000 7f39f5989640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39f0100e20 0x7f39f01985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:41488/0 (socket says 172.21.15.73:41488) 2024-09-05T12:58:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.787+0000 7f39f5989640 1 -- 172.21.15.73:0/2502966684 learned_addr learned my addr 172.21.15.73:0/2502966684 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.787+0000 7f39f7bed640 1 -- 172.21.15.73:0/2502966684 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0111f50 con 0x7f39f0102570 2024-09-05T12:58:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.787+0000 7f39f7bed640 1 -- 172.21.15.73:0/2502966684 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0112250 con 0x7f39f0100e20 2024-09-05T12:58:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.787+0000 7f39f5188640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f0102570 0x7f39f0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.788+0000 7f39f618a640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f0102ef0 0x7f39f019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.788+0000 7f39f5188640 1 -- 172.21.15.73:0/2502966684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39f0100e20 msgr2=0x7f39f01985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:14.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.788+0000 7f39f5188640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39f0100e20 0x7f39f01985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.788+0000 7f39f5188640 1 -- 172.21.15.73:0/2502966684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f0102ef0 msgr2=0x7f39f019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:14.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.788+0000 7f39f5188640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f0102ef0 0x7f39f019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.788+0000 7f39f5188640 1 -- 172.21.15.73:0/2502966684 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f019d550 con 0x7f39f0102570 2024-09-05T12:58:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.788+0000 7f39f5989640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39f0100e20 0x7f39f01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.788+0000 7f39f5188640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f0102570 0x7f39f0198ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39e0005fd0 tx=0x7f39e000dd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.788+0000 7f39e6ffd640 1 -- 172.21.15.73:0/2502966684 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0009c30 con 0x7f39f0102570 2024-09-05T12:58:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.789+0000 7f39e6ffd640 1 -- 172.21.15.73:0/2502966684 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39e000be30 con 0x7f39f0102570 2024-09-05T12:58:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.789+0000 7f39f7bed640 1 -- 172.21.15.73:0/2502966684 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f019d840 con 0x7f39f0102570 2024-09-05T12:58:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.789+0000 7f39f7bed640 1 -- 172.21.15.73:0/2502966684 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f01a5120 con 0x7f39f0102570 2024-09-05T12:58:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.789+0000 7f39e6ffd640 1 -- 172.21.15.73:0/2502966684 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0010460 con 0x7f39f0102570 2024-09-05T12:58:14.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.792+0000 7f39e6ffd640 1 -- 172.21.15.73:0/2502966684 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f39e0003e70 con 0x7f39f0102570 2024-09-05T12:58:14.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.792+0000 7f39f9fc3740 1 Processor -- start 2024-09-05T12:58:14.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f9fc3740 1 -- start start 2024-09-05T12:58:14.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 0x5638d9168090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d91685d0 0x5638d9168a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 0x5638d9179b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f9fc3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5638d90ce2f0 con 0x5638d9177780 2024-09-05T12:58:14.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f9fc3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5638d9075cf0 con 0x5638d9169b80 2024-09-05T12:58:14.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f9fc3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5638d90ca2b0 con 0x5638d91685d0 2024-09-05T12:58:14.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f5989640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d91685d0 0x5638d9168a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f5989640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d91685d0 0x5638d9168a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:41502/0 (socket says 172.21.15.73:41502) 2024-09-05T12:58:14.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f5989640 1 -- 172.21.15.73:0/127924266 learned_addr learned my addr 172.21.15.73:0/127924266 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:14.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.793+0000 7f39f618a640 1 --2- 172.21.15.73:0/127924266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 0x5638d9168090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39f5989640 1 -- 172.21.15.73:0/127924266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 msgr2=0x5638d9168090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:14.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39f5989640 1 --2- 172.21.15.73:0/127924266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 0x5638d9168090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39f5989640 1 -- 172.21.15.73:0/127924266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 msgr2=0x5638d9179b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39f5188640 1 --2- 172.21.15.73:0/127924266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 0x5638d9179b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39f5989640 1 --2- 172.21.15.73:0/127924266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 0x5638d9179b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39f5989640 1 -- 172.21.15.73:0/127924266 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d905a3a0 con 0x5638d91685d0 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39f5188640 1 --2- 172.21.15.73:0/127924266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 0x5638d9179b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39f5989640 1 --2- 172.21.15.73:0/127924266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d91685d0 0x5638d9168a30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39ec004070 tx=0x7f39ec0040a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7febdf3a2d6b41df server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39dbfff640 1 -- 172.21.15.73:0/127924266 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec035030 con 0x5638d91685d0 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39dbfff640 1 -- 172.21.15.73:0/127924266 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39ec0044c0 con 0x5638d91685d0 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.794+0000 7f39dbfff640 1 -- 172.21.15.73:0/127924266 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0035f0 con 0x5638d91685d0 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.795+0000 7f39e6ffd640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39dc0a2c40 0x7f39dc0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.795+0000 7f39f618a640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39dc0a2c40 0x7f39dc0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.795+0000 7f39e6ffd640 1 -- 172.21.15.73:0/2502966684 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f39e00cea80 con 0x7f39f0102570 2024-09-05T12:58:14.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.795+0000 7f39f9fc3740 1 -- 172.21.15.73:0/127924266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d91685d0 msgr2=0x5638d9168a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.795+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/127924266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d91685d0 0x5638d9168a30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39ec004070 tx=0x7f39ec0040a0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.796+0000 7f39f9fc3740 1 -- 172.21.15.73:0/127924266 shutdown_connections 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.796+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/127924266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 0x5638d9179b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.796+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/127924266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d91685d0 0x5638d9168a30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.796+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/127924266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 0x5638d9168090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.796+0000 7f39f9fc3740 1 -- 172.21.15.73:0/127924266 >> 172.21.15.73:0/127924266 conn(0x5638d9131310 msgr2=0x5638d9164c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.796+0000 7f39f9fc3740 1 -- 172.21.15.73:0/127924266 shutdown_connections 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.796+0000 7f39f9fc3740 1 -- 172.21.15.73:0/127924266 wait complete. 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.796+0000 7f39f618a640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39dc0a2c40 0x7f39dc0a5100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39e8005fd0 tx=0x7f39e8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.796+0000 7f39f9fc3740 1 -- start start 2024-09-05T12:58:14.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.796+0000 7f39f9fc3740 1 Processor -- start 2024-09-05T12:58:14.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.797+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9177170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.797+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9169b80 0x5638d9174420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.797+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 0x5638d9174a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.797+0000 7f39f9fc3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5638d917a480 con 0x5638d9177780 2024-09-05T12:58:14.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.797+0000 7f39f9fc3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5638d9089060 con 0x5638d91685d0 2024-09-05T12:58:14.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.797+0000 7f39f9fc3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5638d917a600 con 0x5638d9169b80 2024-09-05T12:58:14.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f9fc3740 10 client.0 _ll_register_callbacks cb 0x5638d8ddc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:14.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f5989640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9177170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f5989640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9177170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:60832/0 (socket says 172.21.15.73:60832) 2024-09-05T12:58:14.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f5989640 1 -- 172.21.15.73:0/3685688585 learned_addr learned my addr 172.21.15.73:0/3685688585 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f618a640 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 0x5638d9174a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f5989640 1 -- 172.21.15.73:0/3685688585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9169b80 msgr2=0x5638d9174420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f5989640 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9169b80 0x5638d9174420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f5989640 1 -- 172.21.15.73:0/3685688585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 msgr2=0x5638d9174a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f5989640 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 0x5638d9174a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f5989640 1 -- 172.21.15.73:0/3685688585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d8e3f3c0 con 0x5638d91685d0 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f618a640 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 0x5638d9174a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39f5989640 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9177170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f39ec006010 tx=0x7f39ec009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd0cc30ead86b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.798+0000 7f39d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.799+0000 7f39d97fa640 1 -- 172.21.15.73:0/3685688585 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec052060 con 0x5638d91685d0 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.799+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3685688585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638d90db860 con 0x5638d91685d0 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.799+0000 7f39d97fa640 1 -- 172.21.15.73:0/3685688585 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f39ec0042c0 con 0x5638d91685d0 2024-09-05T12:58:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.799+0000 7f39d97fa640 1 -- 172.21.15.73:0/3685688585 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f39ec035050 con 0x5638d91685d0 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.799+0000 7f39f9fc3740 10 client.24875 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.799+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3685688585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5638d9185e90 con 0x5638d91685d0 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.799+0000 7f39d97fa640 1 -- 172.21.15.73:0/3685688585 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5638d90db860 con 0x5638d91685d0 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.801+0000 7f39d97fa640 1 -- 172.21.15.73:0/3685688585 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f39ec031540 con 0x5638d91685d0 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.801+0000 7f39f9fc3740 10 client.24875 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.801+0000 7f39f9fc3740 10 client.24875 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.801+0000 7f39f9fc3740 20 client.24875 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.801+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5638d91871e0 0x5638d91895d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.801+0000 7f39f9fc3740 4 client.24875 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.801+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3685688585 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638d90d5d70 con 0x5638d91871e0 2024-09-05T12:58:14.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.801+0000 7f39f5188640 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5638d91871e0 0x5638d91895d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.802+0000 7f39f5188640 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5638d91871e0 0x5638d91895d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b291f0204c1ac26 server_cookie=f6aa981499264294 in_seq=0 out_seq=0 2024-09-05T12:58:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.802+0000 7f39d97fa640 10 client.24875 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T12:58:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.802+0000 7f39d97fa640 1 -- 172.21.15.73:0/3685688585 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638d90d5d70 con 0x5638d91871e0 2024-09-05T12:58:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.802+0000 7f39d97fa640 10 client.24875 handle_command_reply: tid=0 2024-09-05T12:58:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.802+0000 7f39f9fc3740 1 client.24875 shutdown 2024-09-05T12:58:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.804+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3685688585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 msgr2=0x5638d9177170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.804+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9177170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f39ec006010 tx=0x7f39ec009260 comp rx=0 tx=0).stop 2024-09-05T12:58:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.804+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3685688585 shutdown_connections 2024-09-05T12:58:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.804+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9177780 0x5638d9174a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.804+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5638d91871e0 0x5638d91895d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.804+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9169b80 0x5638d9174420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.804+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3685688585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9177170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.804+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3685688585 >> 172.21.15.73:0/3685688585 conn(0x5638d9131310 msgr2=0x5638d916a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:14.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.805+0000 7f39d97fa640 0 client.24875 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T12:58:14.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.805+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3685688585 shutdown_connections 2024-09-05T12:58:14.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.805+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3685688585 wait complete. 2024-09-05T12:58:14.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.805+0000 7f39f9fc3740 20 client.24875 trim_cache size 0 max 16384 2024-09-05T12:58:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.829+0000 7f39f9fc3740 1 Processor -- start 2024-09-05T12:58:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.829+0000 7f39f9fc3740 1 -- start start 2024-09-05T12:58:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.829+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9178b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9169b80 0x5638d91790b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f5989640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9178b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f5188640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9169b80 0x5638d91790b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f5188640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9169b80 0x5638d91790b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35822/0 (socket says 172.21.15.73:35822) 2024-09-05T12:58:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f5989640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9178b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:60846/0 (socket says 172.21.15.73:60846) 2024-09-05T12:58:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f5188640 1 -- 172.21.15.73:0/3773257235 learned_addr learned my addr 172.21.15.73:0/3773257235 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3773257235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9177780 0x5638d91634e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3773257235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01adb50 con 0x5638d9169b80 2024-09-05T12:58:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3773257235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01ab420 con 0x5638d91685d0 2024-09-05T12:58:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3773257235 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01a9270 con 0x5638d9177780 2024-09-05T12:58:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f5188640 1 -- 172.21.15.73:0/3773257235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9177780 msgr2=0x5638d91634e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.830+0000 7f39f5188640 1 --2- 172.21.15.73:0/3773257235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9177780 0x5638d91634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.831+0000 7f39f5188640 1 -- 172.21.15.73:0/3773257235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 msgr2=0x5638d9178b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.831+0000 7f39f5188640 1 --2- 172.21.15.73:0/3773257235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9178b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.831+0000 7f39f5188640 1 -- 172.21.15.73:0/3773257235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d90e1e70 con 0x5638d9169b80 2024-09-05T12:58:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.831+0000 7f39f5188640 1 --2- 172.21.15.73:0/3773257235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9169b80 0x5638d91790b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f39e00cc590 tx=0x7f39e00cc460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940e16cf01c0e83f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.831+0000 7f39db7fe640 1 -- 172.21.15.73:0/3773257235 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0020040 con 0x5638d9169b80 2024-09-05T12:58:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.831+0000 7f39db7fe640 1 -- 172.21.15.73:0/3773257235 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39e00a3f60 con 0x5638d9169b80 2024-09-05T12:58:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.831+0000 7f39db7fe640 1 -- 172.21.15.73:0/3773257235 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0095e60 con 0x5638d9169b80 2024-09-05T12:58:14.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.832+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3773257235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9169b80 msgr2=0x5638d91790b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:14.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.832+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3773257235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9169b80 0x5638d91790b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f39e00cc590 tx=0x7f39e00cc460 comp rx=0 tx=0).stop 2024-09-05T12:58:14.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.832+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3773257235 shutdown_connections 2024-09-05T12:58:14.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.832+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3773257235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9177780 0x5638d91634e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.832+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3773257235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d9169b80 0x5638d91790b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.832+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3773257235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d91685d0 0x5638d9178b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.832+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3773257235 >> 172.21.15.73:0/3773257235 conn(0x5638d9131310 msgr2=0x5638d916f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:14.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.833+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3773257235 shutdown_connections 2024-09-05T12:58:14.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.833+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3773257235 wait complete. 2024-09-05T12:58:14.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.833+0000 7f39f9fc3740 1 -- start start 2024-09-05T12:58:14.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.833+0000 7f39f9fc3740 1 Processor -- start 2024-09-05T12:58:14.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.834+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d91685d0 0x5638d918cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.834+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 0x5638d91871e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.834+0000 7f39f9fc3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9177780 0x5638d9187970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.834+0000 7f39f5989640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d91685d0 0x5638d918cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.834+0000 7f39f9fc3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01a98e0 con 0x5638d91685d0 2024-09-05T12:58:14.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.834+0000 7f39f5989640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d91685d0 0x5638d918cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35824/0 (socket says 172.21.15.73:35824) 2024-09-05T12:58:14.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.834+0000 7f39f5989640 1 -- 172.21.15.73:0/3767747011 learned_addr learned my addr 172.21.15.73:0/3767747011 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:14.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.834+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3767747011 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01aad50 con 0x5638d9169b80 2024-09-05T12:58:14.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.834+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3767747011 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01a9fb0 con 0x5638d9177780 2024-09-05T12:58:14.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.834+0000 7f39f5188640 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 0x5638d91871e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39f9fc3740 10 client.0 _ll_register_callbacks cb 0x7f39ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:14.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39f618a640 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9177780 0x5638d9187970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39f5188640 1 -- 172.21.15.73:0/3767747011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9177780 msgr2=0x5638d9187970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:14.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39f5188640 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9177780 0x5638d9187970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39f5188640 1 -- 172.21.15.73:0/3767747011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d91685d0 msgr2=0x5638d918cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:14.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39f5188640 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d91685d0 0x5638d918cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39f5188640 1 -- 172.21.15.73:0/3767747011 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d91efb00 con 0x5638d9169b80 2024-09-05T12:58:14.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39f5989640 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d91685d0 0x5638d918cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:14.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39f5188640 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 0x5638d91871e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5638d9173c80 tx=0x7f39e000df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59cb1827e212d644 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:14.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T12:58:14.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39d97fa640 1 -- 172.21.15.73:0/3767747011 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0095e60 con 0x5638d9169b80 2024-09-05T12:58:14.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39d97fa640 1 -- 172.21.15.73:0/3767747011 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f39e00b4260 con 0x5638d9169b80 2024-09-05T12:58:14.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.835+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3767747011 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39e00a3f60 con 0x5638d9169b80 2024-09-05T12:58:14.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39d97fa640 1 -- 172.21.15.73:0/3767747011 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f39e0097960 con 0x5638d9169b80 2024-09-05T12:58:14.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39f9fc3740 10 client.24881 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:14.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3767747011 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5638d91f0c90 con 0x5638d9169b80 2024-09-05T12:58:14.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39d97fa640 1 -- 172.21.15.73:0/3767747011 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39e009f170 con 0x5638d9169b80 2024-09-05T12:58:14.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39d97fa640 1 -- 172.21.15.73:0/3767747011 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f39e0097040 con 0x5638d9169b80 2024-09-05T12:58:14.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39f9fc3740 10 client.24881 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:14.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39f9fc3740 10 client.24881 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T12:58:14.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39f9fc3740 20 client.24881 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:14.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5638d91f1290 0x5638d91f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:14.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39f9fc3740 4 client.24881 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T12:58:14.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.836+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3767747011 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f39e00a3f60 con 0x5638d91f1290 2024-09-05T12:58:14.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.837+0000 7f39f5989640 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5638d91f1290 0x5638d91f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:14.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.837+0000 7f39d97fa640 10 client.24881 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T12:58:14.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.837+0000 7f39f5989640 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5638d91f1290 0x5638d91f36b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e360696c0fd47896 server_cookie=29c44d1a8633874d in_seq=0 out_seq=0 2024-09-05T12:58:14.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39d97fa640 1 -- 172.21.15.73:0/3767747011 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f39e00a3f60 con 0x5638d91f1290 2024-09-05T12:58:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39d97fa640 10 client.24881 handle_command_reply: tid=0 2024-09-05T12:58:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39f9fc3740 1 client.24881 shutdown 2024-09-05T12:58:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3767747011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 msgr2=0x5638d91871e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 0x5638d91871e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5638d9173c80 tx=0x7f39e000df70 comp rx=0 tx=0).stop 2024-09-05T12:58:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3767747011 shutdown_connections 2024-09-05T12:58:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x5638d91f1290 0x5638d91f36b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39d97fa640 0 client.24881 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T12:58:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d9177780 0x5638d9187970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638d9169b80 0x5638d91871e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39f9fc3740 1 --2- 172.21.15.73:0/3767747011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5638d91685d0 0x5638d918cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.838+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3767747011 >> 172.21.15.73:0/3767747011 conn(0x5638d9131310 msgr2=0x5638d9172bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.839+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3767747011 shutdown_connections 2024-09-05T12:58:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.839+0000 7f39f9fc3740 1 -- 172.21.15.73:0/3767747011 wait complete. 2024-09-05T12:58:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.839+0000 7f39f9fc3740 20 client.24881 trim_cache size 0 max 16384 2024-09-05T12:58:14.852 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T12:58:14.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 -- 172.21.15.73:0/2502966684 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39dc0a2c40 msgr2=0x7f39dc0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:14.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39dc0a2c40 0x7f39dc0a5100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39e8005fd0 tx=0x7f39e8009500 comp rx=0 tx=0).stop 2024-09-05T12:58:14.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 -- 172.21.15.73:0/2502966684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f0102570 msgr2=0x7f39f0198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:14.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f0102570 0x7f39f0198ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39e0005fd0 tx=0x7f39e000dd20 comp rx=0 tx=0).stop 2024-09-05T12:58:14.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 -- 172.21.15.73:0/2502966684 shutdown_connections 2024-09-05T12:58:14.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39dc0a2c40 0x7f39dc0a5100 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f0102ef0 0x7f39f019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f0102570 0x7f39f0198ae0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 --2- 172.21.15.73:0/2502966684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39f0100e20 0x7f39f01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:14.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 -- 172.21.15.73:0/2502966684 >> 172.21.15.73:0/2502966684 conn(0x7f39f00fc7d0 msgr2=0x7f39f00fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:14.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 -- 172.21.15.73:0/2502966684 shutdown_connections 2024-09-05T12:58:14.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:14.840+0000 7f39f7bed640 1 -- 172.21.15.73:0/2502966684 wait complete. 2024-09-05T12:58:15.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:15 smithi162 ceph-mon[34220]: pgmap v345: 97 pgs: 97 active+clean; 663 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-05T12:58:15.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:15 smithi169 ceph-mon[34823]: pgmap v345: 97 pgs: 97 active+clean; 663 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-05T12:58:15.391 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:15 smithi073 ceph-mon[30883]: pgmap v345: 97 pgs: 97 active+clean; 663 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-05T12:58:15.554 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T12:58:15.826 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:16.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.385+0000 7f05b1406640 1 -- 172.21.15.73:0/3357559815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05ac074ee0 msgr2=0x7f05ac10def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.385+0000 7f05b1406640 1 --2- 172.21.15.73:0/3357559815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05ac074ee0 0x7f05ac10def0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009900 tx=0x7f05a002a480 comp rx=0 tx=0).stop 2024-09-05T12:58:16.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.385+0000 7f05b1406640 1 -- 172.21.15.73:0/3357559815 shutdown_connections 2024-09-05T12:58:16.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.385+0000 7f05b1406640 1 --2- 172.21.15.73:0/3357559815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05ac10e430 0x7f05ac110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.385+0000 7f05b1406640 1 --2- 172.21.15.73:0/3357559815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05ac074ee0 0x7f05ac10def0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.385+0000 7f05b1406640 1 --2- 172.21.15.73:0/3357559815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ac0745c0 0x7f05ac0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.385+0000 7f05b1406640 1 -- 172.21.15.73:0/3357559815 >> 172.21.15.73:0/3357559815 conn(0x7f05ac0fd8f0 msgr2=0x7f05ac0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.385+0000 7f05b1406640 1 -- 172.21.15.73:0/3357559815 shutdown_connections 2024-09-05T12:58:16.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.385+0000 7f05b1406640 1 -- 172.21.15.73:0/3357559815 wait complete. 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05b1406640 1 Processor -- start 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05b1406640 1 -- start start 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05b1406640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ac0745c0 0x7f05ac101b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05b1406640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05ac074ee0 0x7f05ac102090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05b1406640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05ac10e430 0x7f05ac1025d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05aa7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05ac074ee0 0x7f05ac102090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05aa7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05ac074ee0 0x7f05ac102090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35836/0 (socket says 172.21.15.73:35836) 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05aa7fc640 1 -- 172.21.15.73:0/3152702115 learned_addr learned my addr 172.21.15.73:0/3152702115 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac114190 con 0x7f05ac074ee0 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac114010 con 0x7f05ac10e430 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.386+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac114310 con 0x7f05ac0745c0 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f05aaffd640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ac0745c0 0x7f05ac101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f05ab7fe640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05ac10e430 0x7f05ac1025d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f05aa7fc640 1 -- 172.21.15.73:0/3152702115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ac0745c0 msgr2=0x7f05ac101b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ac0745c0 0x7f05ac101b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f05aa7fc640 1 -- 172.21.15.73:0/3152702115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05ac10e430 msgr2=0x7f05ac1025d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05ac10e430 0x7f05ac1025d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f05aa7fc640 1 -- 172.21.15.73:0/3152702115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac1aabf0 con 0x7f05ac074ee0 2024-09-05T12:58:16.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05ac074ee0 0x7f05ac102090 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f05a0030680 tx=0x7f05a00306b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f0593fff640 1 -- 172.21.15.73:0/3152702115 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a003f070 con 0x7f05ac074ee0 2024-09-05T12:58:16.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f0593fff640 1 -- 172.21.15.73:0/3152702115 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05a0004460 con 0x7f05ac074ee0 2024-09-05T12:58:16.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.387+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ac1aae80 con 0x7f05ac074ee0 2024-09-05T12:58:16.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.388+0000 7f0593fff640 1 -- 172.21.15.73:0/3152702115 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0035030 con 0x7f05ac074ee0 2024-09-05T12:58:16.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.389+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ac1ab2e0 con 0x7f05ac074ee0 2024-09-05T12:58:16.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.390+0000 7f0593fff640 1 -- 172.21.15.73:0/3152702115 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f05a0042070 con 0x7f05ac074ee0 2024-09-05T12:58:16.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.391+0000 7f0593fff640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05940a2c80 0x7f05940a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.391+0000 7f0593fff640 1 -- 172.21.15.73:0/3152702115 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f05a00ef3b0 con 0x7f05ac074ee0 2024-09-05T12:58:16.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.391+0000 7f05aaffd640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05940a2c80 0x7f05940a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.392+0000 7f05aaffd640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05940a2c80 0x7f05940a5140 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f059c005fd0 tx=0x7f059c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05b37dc740 1 Processor -- start 2024-09-05T12:58:16.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05b37dc740 1 -- start start 2024-09-05T12:58:16.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a10090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a105d0 0x565485a10a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a1d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05b37dc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5654859762f0 con 0x565485a1b370 2024-09-05T12:58:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05b37dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56548591dcf0 con 0x565485a105d0 2024-09-05T12:58:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05b37dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5654859722b0 con 0x565485a11b80 2024-09-05T12:58:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05ab7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a1d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05ab7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a1d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35840/0 (socket says 172.21.15.73:35840) 2024-09-05T12:58:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05ab7fe640 1 -- 172.21.15.73:0/1231263053 learned_addr learned my addr 172.21.15.73:0/1231263053 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05aaffd640 1 --2- 172.21.15.73:0/1231263053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a10090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.393+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/1231263053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a105d0 0x565485a10a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.394+0000 7f05ab7fe640 1 -- 172.21.15.73:0/1231263053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 msgr2=0x565485a10090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.394+0000 7f05ab7fe640 1 --2- 172.21.15.73:0/1231263053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a10090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.394+0000 7f05ab7fe640 1 -- 172.21.15.73:0/1231263053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a105d0 msgr2=0x565485a10a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.394+0000 7f05ab7fe640 1 --2- 172.21.15.73:0/1231263053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a105d0 0x565485a10a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.394+0000 7f05ab7fe640 1 -- 172.21.15.73:0/1231263053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654859023a0 con 0x565485a1b370 2024-09-05T12:58:16.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.394+0000 7f05ab7fe640 1 --2- 172.21.15.73:0/1231263053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a1d760 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009e30 tx=0x7f05a4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc558696f49b9f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.394+0000 7f05917fa640 1 -- 172.21.15.73:0/1231263053 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4016070 con 0x565485a1b370 2024-09-05T12:58:16.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.394+0000 7f05917fa640 1 -- 172.21.15.73:0/1231263053 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05a4004d20 con 0x565485a1b370 2024-09-05T12:58:16.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.394+0000 7f05917fa640 1 -- 172.21.15.73:0/1231263053 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a40127f0 con 0x565485a1b370 2024-09-05T12:58:16.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 -- 172.21.15.73:0/1231263053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 msgr2=0x565485a1d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 --2- 172.21.15.73:0/1231263053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a1d760 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009e30 tx=0x7f05a4010740 comp rx=0 tx=0).stop 2024-09-05T12:58:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 -- 172.21.15.73:0/1231263053 shutdown_connections 2024-09-05T12:58:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 --2- 172.21.15.73:0/1231263053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a1d760 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 --2- 172.21.15.73:0/1231263053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a105d0 0x565485a10a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 --2- 172.21.15.73:0/1231263053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a10090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 -- 172.21.15.73:0/1231263053 >> 172.21.15.73:0/1231263053 conn(0x5654859d9310 msgr2=0x565485a0cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 -- 172.21.15.73:0/1231263053 shutdown_connections 2024-09-05T12:58:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 -- 172.21.15.73:0/1231263053 wait complete. 2024-09-05T12:58:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 -- start start 2024-09-05T12:58:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.395+0000 7f05b37dc740 1 Processor -- start 2024-09-05T12:58:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a105d0 0x565485a1ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a11b80 0x565485a17fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a1b370 0x565485a18530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05b37dc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x565485a1e0d0 con 0x565485a105d0 2024-09-05T12:58:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05b37dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x565485931060 con 0x565485a11b80 2024-09-05T12:58:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05b37dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x565485a1e250 con 0x565485a1b370 2024-09-05T12:58:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05b37dc740 10 client.0 _ll_register_callbacks cb 0x5654856848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05aaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a105d0 0x565485a1ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05aaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a105d0 0x565485a1ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35850/0 (socket says 172.21.15.73:35850) 2024-09-05T12:58:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05aaffd640 1 -- 172.21.15.73:0/2915627015 learned_addr learned my addr 172.21.15.73:0/2915627015 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05ab7fe640 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a1b370 0x565485a18530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05aaffd640 1 -- 172.21.15.73:0/2915627015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a1b370 msgr2=0x565485a18530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05aaffd640 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a1b370 0x565485a18530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05aaffd640 1 -- 172.21.15.73:0/2915627015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a11b80 msgr2=0x565485a17fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T12:58:16.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a11b80 0x565485a17fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05aaffd640 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a11b80 0x565485a17fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.396+0000 7f05aaffd640 1 -- 172.21.15.73:0/2915627015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654856e73c0 con 0x565485a105d0 2024-09-05T12:58:16.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.397+0000 7f05aaffd640 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a105d0 0x565485a1ad00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f059c003fd0 tx=0x7f059c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f10ca1212444f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.397+0000 7f058eff5640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:16.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.397+0000 7f058eff5640 1 -- 172.21.15.73:0/2915627015 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c01e830 con 0x565485a105d0 2024-09-05T12:58:16.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.397+0000 7f05b37dc740 1 -- 172.21.15.73:0/2915627015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05a4004d20 con 0x565485a105d0 2024-09-05T12:58:16.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.397+0000 7f058eff5640 1 -- 172.21.15.73:0/2915627015 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f059c01e9d0 con 0x565485a105d0 2024-09-05T12:58:16.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.397+0000 7f058eff5640 1 -- 172.21.15.73:0/2915627015 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f059c01ebd0 con 0x565485a105d0 2024-09-05T12:58:16.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.397+0000 7f05b37dc740 10 client.15315 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:16.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.397+0000 7f05b37dc740 1 -- 172.21.15.73:0/2915627015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565485a29bb0 con 0x565485a105d0 2024-09-05T12:58:16.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.398+0000 7f058eff5640 1 -- 172.21.15.73:0/2915627015 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05a4004d20 con 0x565485a105d0 2024-09-05T12:58:16.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.398+0000 7f058eff5640 1 -- 172.21.15.73:0/2915627015 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f059c026020 con 0x565485a105d0 2024-09-05T12:58:16.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.398+0000 7f05b37dc740 10 client.15315 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:16.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.398+0000 7f05b37dc740 10 client.15315 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T12:58:16.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.398+0000 7f05b37dc740 20 client.15315 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:16.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.398+0000 7f05b37dc740 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x565485a2b3a0 0x565485a2d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.398+0000 7f05b37dc740 4 client.15315 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:16.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.398+0000 7f05b37dc740 1 -- 172.21.15.73:0/2915627015 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565485983860 con 0x565485a2b3a0 2024-09-05T12:58:16.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.398+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x565485a2b3a0 0x565485a2d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.399+0000 7f058eff5640 10 client.15315 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T12:58:16.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.399+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x565485a2b3a0 0x565485a2d820 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aca7410a7ea3ead3 server_cookie=e5f6c74dc15602ec in_seq=0 out_seq=0 2024-09-05T12:58:16.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f058eff5640 1 -- 172.21.15.73:0/2915627015 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565485983860 con 0x565485a2b3a0 2024-09-05T12:58:16.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f058eff5640 10 client.15315 handle_command_reply: tid=0 2024-09-05T12:58:16.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 client.15315 shutdown 2024-09-05T12:58:16.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 -- 172.21.15.73:0/2915627015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a105d0 msgr2=0x565485a1ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a105d0 0x565485a1ad00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f059c003fd0 tx=0x7f059c004730 comp rx=0 tx=0).stop 2024-09-05T12:58:16.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 -- 172.21.15.73:0/2915627015 shutdown_connections 2024-09-05T12:58:16.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x565485a2b3a0 0x565485a2d820 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a1b370 0x565485a18530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f058eff5640 0 client.15315 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T12:58:16.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a11b80 0x565485a17fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 --2- 172.21.15.73:0/2915627015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a105d0 0x565485a1ad00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 -- 172.21.15.73:0/2915627015 >> 172.21.15.73:0/2915627015 conn(0x5654859d9310 msgr2=0x565485a129a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 -- 172.21.15.73:0/2915627015 shutdown_connections 2024-09-05T12:58:16.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 1 -- 172.21.15.73:0/2915627015 wait complete. 2024-09-05T12:58:16.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.400+0000 7f05b37dc740 20 client.15315 trim_cache size 0 max 16384 2024-09-05T12:58:16.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.424+0000 7f05b37dc740 1 Processor -- start 2024-09-05T12:58:16.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.424+0000 7f05b37dc740 1 -- start start 2024-09-05T12:58:16.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.424+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a0bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.424+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a1b370 0x565485a13160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.424+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a2b3a0 0x565485a136a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.424+0000 7f05b37dc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac1b64a0 con 0x565485a2b3a0 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05b37dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac1b3d70 con 0x565485a1b370 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05b37dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac1b1bc0 con 0x565485a11b80 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05aaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a0bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05ab7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a2b3a0 0x565485a136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05aaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a0bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:41572/0 (socket says 172.21.15.73:41572) 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05aaffd640 1 -- 172.21.15.73:0/3871487842 learned_addr learned my addr 172.21.15.73:0/3871487842 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/3871487842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a1b370 0x565485a13160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05aaffd640 1 -- 172.21.15.73:0/3871487842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a1b370 msgr2=0x565485a13160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05aaffd640 1 --2- 172.21.15.73:0/3871487842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a1b370 0x565485a13160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05aaffd640 1 -- 172.21.15.73:0/3871487842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a2b3a0 msgr2=0x565485a136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05aaffd640 1 --2- 172.21.15.73:0/3871487842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a2b3a0 0x565485a136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05aaffd640 1 -- 172.21.15.73:0/3871487842 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565485a188a0 con 0x565485a11b80 2024-09-05T12:58:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05ab7fe640 1 --2- 172.21.15.73:0/3871487842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a2b3a0 0x565485a136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:16.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f05aaffd640 1 --2- 172.21.15.73:0/3871487842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a0bc10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f059c011fd0 tx=0x7f059c005cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=988cce0aa6259834 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f0590ff9640 1 -- 172.21.15.73:0/3871487842 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c01e630 con 0x565485a11b80 2024-09-05T12:58:16.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f0590ff9640 1 -- 172.21.15.73:0/3871487842 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f059c01e7d0 con 0x565485a11b80 2024-09-05T12:58:16.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.425+0000 7f0590ff9640 1 -- 172.21.15.73:0/3871487842 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c01a7b0 con 0x565485a11b80 2024-09-05T12:58:16.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.426+0000 7f05b37dc740 1 -- 172.21.15.73:0/3871487842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 msgr2=0x565485a0bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.426+0000 7f05b37dc740 1 --2- 172.21.15.73:0/3871487842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a0bc10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f059c011fd0 tx=0x7f059c005cd0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.426+0000 7f05b37dc740 1 -- 172.21.15.73:0/3871487842 shutdown_connections 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.426+0000 7f05b37dc740 1 --2- 172.21.15.73:0/3871487842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a2b3a0 0x565485a136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.426+0000 7f05b37dc740 1 --2- 172.21.15.73:0/3871487842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a1b370 0x565485a13160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.426+0000 7f05b37dc740 1 --2- 172.21.15.73:0/3871487842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a0bc10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.426+0000 7f05b37dc740 1 -- 172.21.15.73:0/3871487842 >> 172.21.15.73:0/3871487842 conn(0x5654859d9310 msgr2=0x565485a0b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 1 -- 172.21.15.73:0/3871487842 shutdown_connections 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 1 -- 172.21.15.73:0/3871487842 wait complete. 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 1 -- start start 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 1 Processor -- start 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a30b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a2b3a0 0x565485a310b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac1b2230 con 0x565485a1b370 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac1b36a0 con 0x565485a2b3a0 2024-09-05T12:58:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05aa7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a30b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac1b2900 con 0x565485a11b80 2024-09-05T12:58:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05aa7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a30b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35872/0 (socket says 172.21.15.73:35872) 2024-09-05T12:58:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05aa7fc640 1 -- 172.21.15.73:0/394538520 learned_addr learned my addr 172.21.15.73:0/394538520 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05aaffd640 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05b37dc740 10 client.0 _ll_register_callbacks cb 0x7f059c003cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.427+0000 7f05ab7fe640 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a2b3a0 0x565485a310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f05aa7fc640 1 -- 172.21.15.73:0/394538520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 msgr2=0x565485a337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a337b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f05aa7fc640 1 -- 172.21.15.73:0/394538520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a2b3a0 msgr2=0x565485a310b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a2b3a0 0x565485a310b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f05aa7fc640 1 -- 172.21.15.73:0/394538520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565485a318e0 con 0x565485a1b370 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f05aaffd640 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f05aa7fc640 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a30b50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f05a00b85b0 tx=0x7f05a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e4be137964a935 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f058eff5640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f058eff5640 1 -- 172.21.15.73:0/394538520 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a00d8020 con 0x565485a1b370 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f058eff5640 1 -- 172.21.15.73:0/394538520 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f05a00035f0 con 0x565485a1b370 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f05b37dc740 1 -- 172.21.15.73:0/394538520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f059c01e7d0 con 0x565485a1b370 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.428+0000 7f058eff5640 1 -- 172.21.15.73:0/394538520 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f05a00a6040 con 0x565485a1b370 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f05b37dc740 10 client.15321 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f05b37dc740 1 -- 172.21.15.73:0/394538520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565485a96170 con 0x565485a1b370 2024-09-05T12:58:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f058eff5640 1 -- 172.21.15.73:0/394538520 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f059c01e7d0 con 0x565485a1b370 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f058eff5640 1 -- 172.21.15.73:0/394538520 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f05a0031bd0 con 0x565485a1b370 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f05b37dc740 10 client.15321 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f05b37dc740 10 client.15321 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f05b37dc740 20 client.15321 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f05b37dc740 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x565485a968f0 0x565485a98d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f05b37dc740 4 client.15321 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f05b37dc740 1 -- 172.21.15.73:0/394538520 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56548597dd70 con 0x565485a968f0 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.429+0000 7f05aaffd640 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x565485a968f0 0x565485a98d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f05aaffd640 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x565485a968f0 0x565485a98d10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2f295723c9b3d49 server_cookie=4632cc32c92e2cb3 in_seq=0 out_seq=0 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f058eff5640 10 client.15321 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f058eff5640 1 -- 172.21.15.73:0/394538520 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56548597dd70 con 0x565485a968f0 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f058eff5640 10 client.15321 handle_command_reply: tid=0 2024-09-05T12:58:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f05b37dc740 1 client.15321 shutdown 2024-09-05T12:58:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f05b37dc740 1 -- 172.21.15.73:0/394538520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 msgr2=0x565485a30b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f05b37dc740 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a30b50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f05a00b85b0 tx=0x7f05a000b040 comp rx=0 tx=0).stop 2024-09-05T12:58:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f05b37dc740 1 -- 172.21.15.73:0/394538520 shutdown_connections 2024-09-05T12:58:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f05b37dc740 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x565485a968f0 0x565485a98d10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f05b37dc740 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565485a2b3a0 0x565485a310b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f05b37dc740 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565485a1b370 0x565485a30b50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f05b37dc740 1 --2- 172.21.15.73:0/394538520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565485a11b80 0x565485a337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.430+0000 7f05b37dc740 1 -- 172.21.15.73:0/394538520 >> 172.21.15.73:0/394538520 conn(0x5654859d9310 msgr2=0x565485a0bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.431+0000 7f058eff5640 0 client.15321 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T12:58:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.431+0000 7f05b37dc740 1 -- 172.21.15.73:0/394538520 shutdown_connections 2024-09-05T12:58:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.431+0000 7f05b37dc740 1 -- 172.21.15.73:0/394538520 wait complete. 2024-09-05T12:58:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.431+0000 7f05b37dc740 20 client.15321 trim_cache size 0 max 16384 2024-09-05T12:58:16.436 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T12:58:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.431+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05940a2c80 msgr2=0x7f05940a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.431+0000 7f05b1406640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05940a2c80 0x7f05940a5140 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f059c005fd0 tx=0x7f059c00b390 comp rx=0 tx=0).stop 2024-09-05T12:58:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.431+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05ac074ee0 msgr2=0x7f05ac102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.431+0000 7f05b1406640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05ac074ee0 0x7f05ac102090 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f05a0030680 tx=0x7f05a00306b0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.432+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 shutdown_connections 2024-09-05T12:58:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.432+0000 7f05b1406640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05940a2c80 0x7f05940a5140 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.432+0000 7f05b1406640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05ac10e430 0x7f05ac1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.432+0000 7f05b1406640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05ac074ee0 0x7f05ac102090 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.432+0000 7f05b1406640 1 --2- 172.21.15.73:0/3152702115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ac0745c0 0x7f05ac101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.432+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 >> 172.21.15.73:0/3152702115 conn(0x7f05ac0fd8f0 msgr2=0x7f05ac0fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.432+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 shutdown_connections 2024-09-05T12:58:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:16.432+0000 7f05b1406640 1 -- 172.21.15.73:0/3152702115 wait complete. 2024-09-05T12:58:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 -- 172.21.15.73:0/2107106010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a0c102600 msgr2=0x7f6a0c108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 --2- 172.21.15.73:0/2107106010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a0c102600 0x7f6a0c108e90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009ca0 tx=0x7f6a0402a8c0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 -- 172.21.15.73:0/2107106010 shutdown_connections 2024-09-05T12:58:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 --2- 172.21.15.73:0/2107106010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a0c102600 0x7f6a0c108e90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 --2- 172.21.15.73:0/2107106010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a0c101c40 0x7f6a0c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 --2- 172.21.15.73:0/2107106010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a0c100a50 0x7f6a0c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 -- 172.21.15.73:0/2107106010 >> 172.21.15.73:0/2107106010 conn(0x7f6a0c0fc1b0 msgr2=0x7f6a0c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 -- 172.21.15.73:0/2107106010 shutdown_connections 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 -- 172.21.15.73:0/2107106010 wait complete. 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 Processor -- start 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.860+0000 7f6a136ed640 1 -- start start 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a136ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a0c100a50 0x7f6a0c197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a136ed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a0c101c40 0x7f6a0c1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a136ed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a0c102600 0x7f6a0c19f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a136ed640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c10c6b0 con 0x7f6a0c100a50 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a136ed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c10c530 con 0x7f6a0c101c40 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a136ed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c10c830 con 0x7f6a0c102600 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11489640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a0c100a50 0x7f6a0c197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11489640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a0c100a50 0x7f6a0c197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35878/0 (socket says 172.21.15.73:35878) 2024-09-05T12:58:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11489640 1 -- 172.21.15.73:0/158764040 learned_addr learned my addr 172.21.15.73:0/158764040 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a10c88640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a0c101c40 0x7f6a0c1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11c8a640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a0c102600 0x7f6a0c19f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11489640 1 -- 172.21.15.73:0/158764040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a0c102600 msgr2=0x7f6a0c19f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11489640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a0c102600 0x7f6a0c19f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11489640 1 -- 172.21.15.73:0/158764040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a0c101c40 msgr2=0x7f6a0c1981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11489640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a0c101c40 0x7f6a0c1981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11489640 1 -- 172.21.15.73:0/158764040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c19f8e0 con 0x7f6a0c100a50 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11c8a640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a0c102600 0x7f6a0c19f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.861+0000 7f6a11489640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a0c100a50 0x7f6a0c197ca0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800d950 tx=0x7f6a0800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.862+0000 7f6a027fc640 1 -- 172.21.15.73:0/158764040 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08017020 con 0x7f6a0c100a50 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.862+0000 7f6a027fc640 1 -- 172.21.15.73:0/158764040 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a08009c30 con 0x7f6a0c100a50 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.862+0000 7f6a027fc640 1 -- 172.21.15.73:0/158764040 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0800f6b0 con 0x7f6a0c100a50 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.862+0000 7f6a136ed640 1 -- 172.21.15.73:0/158764040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c19fbd0 con 0x7f6a0c100a50 2024-09-05T12:58:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.862+0000 7f6a136ed640 1 -- 172.21.15.73:0/158764040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c1a0110 con 0x7f6a0c100a50 2024-09-05T12:58:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.865+0000 7f6a027fc640 1 -- 172.21.15.73:0/158764040 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6a0801a020 con 0x7f6a0c100a50 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.865+0000 7f6a16482740 1 Processor -- start 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.865+0000 7f6a16482740 1 -- start start 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.865+0000 7f6a16482740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc48db0 0x5592abc491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.865+0000 7f6a16482740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc496f0 0x5592abc4e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.865+0000 7f6a16482740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc50c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.865+0000 7f6a16482740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5592abba82f0 con 0x5592abc4e780 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.865+0000 7f6a16482740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592abb50270 con 0x5592abc48db0 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.865+0000 7f6a16482740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5592abba42b0 con 0x5592abc496f0 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a10c88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc50c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a10c88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc50c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35886/0 (socket says 172.21.15.73:35886) 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a10c88640 1 -- 172.21.15.73:0/124570012 learned_addr learned my addr 172.21.15.73:0/124570012 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a11489640 1 --2- 172.21.15.73:0/124570012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc496f0 0x5592abc4e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a027fc640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f69f80a2cb0 0x7f69f80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a11c8a640 1 --2- 172.21.15.73:0/124570012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc48db0 0x5592abc491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a11c8a640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f69f80a2cb0 0x7f69f80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a10c88640 1 -- 172.21.15.73:0/124570012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc496f0 msgr2=0x5592abc4e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a10c88640 1 --2- 172.21.15.73:0/124570012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc496f0 0x5592abc4e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a10c88640 1 -- 172.21.15.73:0/124570012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc48db0 msgr2=0x5592abc491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a10c88640 1 --2- 172.21.15.73:0/124570012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc48db0 0x5592abc491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a10c88640 1 -- 172.21.15.73:0/124570012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592abb4f340 con 0x5592abc4e780 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a027fc640 1 -- 172.21.15.73:0/158764040 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f6a080ce990 con 0x7f6a0c100a50 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a10c88640 1 --2- 172.21.15.73:0/124570012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc50c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00ac20 tx=0x7f69fc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3317d820787dd29a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f6a11c8a640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f69f80a2cb0 0x7f69f80a5170 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6a04031c10 tx=0x7f6a040095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f69f77fe640 1 -- 172.21.15.73:0/124570012 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc01d070 con 0x5592abc4e780 2024-09-05T12:58:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.866+0000 7f69f77fe640 1 -- 172.21.15.73:0/124570012 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69fc018b20 con 0x5592abc4e780 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.867+0000 7f69f77fe640 1 -- 172.21.15.73:0/124570012 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc010ab0 con 0x5592abc4e780 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.867+0000 7f6a16482740 1 -- 172.21.15.73:0/124570012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 msgr2=0x5592abc50c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.867+0000 7f6a16482740 1 --2- 172.21.15.73:0/124570012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc50c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00ac20 tx=0x7f69fc00f790 comp rx=0 tx=0).stop 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.867+0000 7f6a16482740 1 -- 172.21.15.73:0/124570012 shutdown_connections 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.867+0000 7f6a16482740 1 --2- 172.21.15.73:0/124570012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc50c40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.867+0000 7f6a16482740 1 --2- 172.21.15.73:0/124570012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc496f0 0x5592abc4e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.867+0000 7f6a16482740 1 --2- 172.21.15.73:0/124570012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc48db0 0x5592abc491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.867+0000 7f6a16482740 1 -- 172.21.15.73:0/124570012 >> 172.21.15.73:0/124570012 conn(0x5592abc44420 msgr2=0x5592abc44820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.867+0000 7f6a16482740 1 -- 172.21.15.73:0/124570012 shutdown_connections 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.867+0000 7f6a16482740 1 -- 172.21.15.73:0/124570012 wait complete. 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a16482740 1 -- start start 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a16482740 1 Processor -- start 2024-09-05T12:58:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a16482740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc48db0 0x5592abc53000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a16482740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc496f0 0x5592abc53540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a16482740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 0x5592abc5a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a16482740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5592abc51750 con 0x5592abc496f0 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a16482740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592abb31290 con 0x5592abc48db0 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a16482740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5592abc518d0 con 0x5592abc4e780 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a16482740 10 client.0 _ll_register_callbacks cb 0x5592abb62140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a10c88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc496f0 0x5592abc53540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a10c88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc496f0 0x5592abc53540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35888/0 (socket says 172.21.15.73:35888) 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.868+0000 7f6a10c88640 1 -- 172.21.15.73:0/542564443 learned_addr learned my addr 172.21.15.73:0/542564443 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a11c8a640 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 0x5592abc5a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a11489640 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc48db0 0x5592abc53000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a10c88640 1 -- 172.21.15.73:0/542564443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 msgr2=0x5592abc5a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a10c88640 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 0x5592abc5a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a10c88640 1 -- 172.21.15.73:0/542564443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc48db0 msgr2=0x5592abc53000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a10c88640 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc48db0 0x5592abc53000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a10c88640 1 -- 172.21.15.73:0/542564443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592ab8bb210 con 0x5592abc496f0 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a11c8a640 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 0x5592abc5a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a10c88640 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc496f0 0x5592abc53540 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f69fc005910 tx=0x7f69fc0186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea654e039863b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f69f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f69f4ff9640 1 -- 172.21.15.73:0/542564443 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc01d050 con 0x5592abc496f0 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a16482740 1 -- 172.21.15.73:0/542564443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69fc018b20 con 0x5592abc496f0 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f69f4ff9640 1 -- 172.21.15.73:0/542564443 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f69fc005240 con 0x5592abc496f0 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f69f4ff9640 1 -- 172.21.15.73:0/542564443 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f69fc00ae60 con 0x5592abc496f0 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a16482740 10 client.15333 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.869+0000 7f6a16482740 1 -- 172.21.15.73:0/542564443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5592ab987620 con 0x5592abc496f0 2024-09-05T12:58:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.870+0000 7f69f4ff9640 1 -- 172.21.15.73:0/542564443 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69fc018b20 con 0x5592abc496f0 2024-09-05T12:58:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.870+0000 7f69f4ff9640 1 -- 172.21.15.73:0/542564443 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f69fc004880 con 0x5592abc496f0 2024-09-05T12:58:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.870+0000 7f6a16482740 10 client.15333 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.870+0000 7f6a16482740 10 client.15333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.870+0000 7f6a16482740 20 client.15333 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.870+0000 7f6a16482740 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5592abc5e920 0x5592abc60d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.870+0000 7f6a16482740 4 client.15333 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.870+0000 7f6a16482740 1 -- 172.21.15.73:0/542564443 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592abbb5a20 con 0x5592abc5e920 2024-09-05T12:58:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.870+0000 7f6a11489640 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5592abc5e920 0x5592abc60d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.871+0000 7f69f4ff9640 10 client.15333 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.871+0000 7f6a11489640 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5592abc5e920 0x5592abc60d10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2de38eaeb5cb3c4f server_cookie=69d5e09389c019f1 in_seq=0 out_seq=0 2024-09-05T12:58:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.871+0000 7f69f4ff9640 1 -- 172.21.15.73:0/542564443 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5592abbb5a20 con 0x5592abc5e920 2024-09-05T12:58:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f69f4ff9640 10 client.15333 handle_command_reply: tid=0 2024-09-05T12:58:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 client.15333 shutdown 2024-09-05T12:58:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 -- 172.21.15.73:0/542564443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc496f0 msgr2=0x5592abc53540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc496f0 0x5592abc53540 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f69fc005910 tx=0x7f69fc0186f0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 -- 172.21.15.73:0/542564443 shutdown_connections 2024-09-05T12:58:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5592abc5e920 0x5592abc60d10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 0x5592abc5a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc496f0 0x5592abc53540 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 --2- 172.21.15.73:0/542564443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc48db0 0x5592abc53000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 -- 172.21.15.73:0/542564443 >> 172.21.15.73:0/542564443 conn(0x5592abc44420 msgr2=0x5592abc3f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f69f4ff9640 0 client.15333 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 -- 172.21.15.73:0/542564443 shutdown_connections 2024-09-05T12:58:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 1 -- 172.21.15.73:0/542564443 wait complete. 2024-09-05T12:58:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.872+0000 7f6a16482740 20 client.15333 trim_cache size 0 max 16384 2024-09-05T12:58:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.895+0000 7f6a16482740 1 Processor -- start 2024-09-05T12:58:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.895+0000 7f6a16482740 1 -- start start 2024-09-05T12:58:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.895+0000 7f6a16482740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 0x5592abc44800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.895+0000 7f6a16482740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc48db0 0x5592abc5a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.895+0000 7f6a16482740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc44d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.895+0000 7f6a16482740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1a9510 con 0x5592abc4e780 2024-09-05T12:58:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.895+0000 7f6a16482740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1a6de0 con 0x5592abc44420 2024-09-05T12:58:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.895+0000 7f6a16482740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1a4c30 con 0x5592abc48db0 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11c8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc44d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11c8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc44d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35896/0 (socket says 172.21.15.73:35896) 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11c8a640 1 -- 172.21.15.73:0/3216431809 learned_addr learned my addr 172.21.15.73:0/3216431809 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11489640 1 --2- 172.21.15.73:0/3216431809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 0x5592abc44800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a10c88640 1 --2- 172.21.15.73:0/3216431809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc48db0 0x5592abc5a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11489640 1 -- 172.21.15.73:0/3216431809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc48db0 msgr2=0x5592abc5a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11489640 1 --2- 172.21.15.73:0/3216431809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc48db0 0x5592abc5a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11489640 1 -- 172.21.15.73:0/3216431809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 msgr2=0x5592abc44d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11489640 1 --2- 172.21.15.73:0/3216431809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc44d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11489640 1 -- 172.21.15.73:0/3216431809 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592abc44240 con 0x5592abc44420 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11c8a640 1 --2- 172.21.15.73:0/3216431809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc44d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f6a11489640 1 --2- 172.21.15.73:0/3216431809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 0x5592abc44800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6a080cc490 tx=0x7f6a0809f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef03e2ba1454dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.896+0000 7f69f6ffd640 1 -- 172.21.15.73:0/3216431809 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a080b9e60 con 0x5592abc44420 2024-09-05T12:58:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f69f6ffd640 1 -- 172.21.15.73:0/3216431809 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a0809b220 con 0x5592abc44420 2024-09-05T12:58:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f69f6ffd640 1 -- 172.21.15.73:0/3216431809 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a080a3a00 con 0x5592abc44420 2024-09-05T12:58:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f6a16482740 1 -- 172.21.15.73:0/3216431809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 msgr2=0x5592abc44800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f6a16482740 1 --2- 172.21.15.73:0/3216431809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 0x5592abc44800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6a080cc490 tx=0x7f6a0809f040 comp rx=0 tx=0).stop 2024-09-05T12:58:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f6a16482740 1 -- 172.21.15.73:0/3216431809 shutdown_connections 2024-09-05T12:58:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f6a16482740 1 --2- 172.21.15.73:0/3216431809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc4e780 0x5592abc44d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f6a16482740 1 --2- 172.21.15.73:0/3216431809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc48db0 0x5592abc5a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f6a16482740 1 --2- 172.21.15.73:0/3216431809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 0x5592abc44800 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f6a16482740 1 -- 172.21.15.73:0/3216431809 >> 172.21.15.73:0/3216431809 conn(0x5592abc4a1b0 msgr2=0x5592abc4a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f6a16482740 1 -- 172.21.15.73:0/3216431809 shutdown_connections 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.897+0000 7f6a16482740 1 -- 172.21.15.73:0/3216431809 wait complete. 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a16482740 1 -- start start 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a16482740 1 Processor -- start 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a16482740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 0x5592abc577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a16482740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc48db0 0x5592abc57d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a16482740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 0x5592abc58d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a16482740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1a52a0 con 0x5592abc48db0 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a16482740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1a6710 con 0x5592abc44420 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a16482740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1a5970 con 0x5592abc4e780 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a16482740 10 client.0 _ll_register_callbacks cb 0x7f69fc01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a10c88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc48db0 0x5592abc57d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a10c88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc48db0 0x5592abc57d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35900/0 (socket says 172.21.15.73:35900) 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a10c88640 1 -- 172.21.15.73:0/4173458444 learned_addr learned my addr 172.21.15.73:0/4173458444 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.898+0000 7f6a11c8a640 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 0x5592abc58d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f6a11489640 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 0x5592abc577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f6a10c88640 1 -- 172.21.15.73:0/4173458444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 msgr2=0x5592abc58d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f6a10c88640 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 0x5592abc58d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f6a10c88640 1 -- 172.21.15.73:0/4173458444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 msgr2=0x5592abc577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f6a10c88640 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 0x5592abc577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f6a10c88640 1 -- 172.21.15.73:0/4173458444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592abc59330 con 0x5592abc48db0 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f6a10c88640 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc48db0 0x5592abc57d10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f69fc004e40 tx=0x7f69fc030670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db359ef1cde5052 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f69f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f69f4ff9640 1 -- 172.21.15.73:0/4173458444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc01d040 con 0x5592abc48db0 2024-09-05T12:58:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f69f4ff9640 1 -- 172.21.15.73:0/4173458444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f69fc030760 con 0x5592abc48db0 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f6a16482740 1 -- 172.21.15.73:0/4173458444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a0809b220 con 0x5592abc48db0 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f69f4ff9640 1 -- 172.21.15.73:0/4173458444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f69fc00a860 con 0x5592abc48db0 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f6a16482740 10 client.15339 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.899+0000 7f6a16482740 1 -- 172.21.15.73:0/4173458444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5592abc5a640 con 0x5592abc48db0 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f69f4ff9640 1 -- 172.21.15.73:0/4173458444 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a0809b220 con 0x5592abc48db0 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f69f4ff9640 1 -- 172.21.15.73:0/4173458444 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f69fc041030 con 0x5592abc48db0 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f6a16482740 10 client.15339 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f6a16482740 10 client.15339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f6a16482740 20 client.15339 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f6a16482740 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5592abcc9b80 0x5592abccbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f6a16482740 4 client.15339 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f6a16482740 1 -- 172.21.15.73:0/4173458444 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5592abbafd70 con 0x5592abcc9b80 2024-09-05T12:58:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f6a11489640 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5592abcc9b80 0x5592abccbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f69f4ff9640 10 client.15339 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.900+0000 7f6a11489640 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5592abcc9b80 0x5592abccbfa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80322a3eba23947 server_cookie=4626e48a2e3409b in_seq=0 out_seq=0 2024-09-05T12:58:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f69f4ff9640 1 -- 172.21.15.73:0/4173458444 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5592abbafd70 con 0x5592abcc9b80 2024-09-05T12:58:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f69f4ff9640 10 client.15339 handle_command_reply: tid=0 2024-09-05T12:58:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 client.15339 shutdown 2024-09-05T12:58:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 -- 172.21.15.73:0/4173458444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc48db0 msgr2=0x5592abc57d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc48db0 0x5592abc57d10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f69fc004e40 tx=0x7f69fc030670 comp rx=0 tx=0).stop 2024-09-05T12:58:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 -- 172.21.15.73:0/4173458444 shutdown_connections 2024-09-05T12:58:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5592abcc9b80 0x5592abccbfa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5592abc4e780 0x5592abc58d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f69f4ff9640 0 client.15339 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592abc48db0 0x5592abc57d10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 --2- 172.21.15.73:0/4173458444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592abc44420 0x5592abc577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 -- 172.21.15.73:0/4173458444 >> 172.21.15.73:0/4173458444 conn(0x5592abc4a1b0 msgr2=0x5592abc3e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 -- 172.21.15.73:0/4173458444 shutdown_connections 2024-09-05T12:58:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.907+0000 7f6a16482740 1 -- 172.21.15.73:0/4173458444 wait complete. 2024-09-05T12:58:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.908+0000 7f6a16482740 20 client.15339 trim_cache size 0 max 16384 2024-09-05T12:58:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T12:58:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T12:58:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T12:58:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T12:58:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.908+0000 7f6a136ed640 1 -- 172.21.15.73:0/158764040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f69f80a2cb0 msgr2=0x7f69f80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.908+0000 7f6a136ed640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f69f80a2cb0 0x7f69f80a5170 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6a04031c10 tx=0x7f6a040095c0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.908+0000 7f6a136ed640 1 -- 172.21.15.73:0/158764040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a0c100a50 msgr2=0x7f6a0c197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.908+0000 7f6a136ed640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a0c100a50 0x7f6a0c197ca0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800d950 tx=0x7f6a0800dd50 comp rx=0 tx=0).stop 2024-09-05T12:58:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.908+0000 7f6a136ed640 1 -- 172.21.15.73:0/158764040 shutdown_connections 2024-09-05T12:58:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.908+0000 7f6a136ed640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f69f80a2cb0 0x7f69f80a5170 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.909+0000 7f6a136ed640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a0c102600 0x7f6a0c19f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.909+0000 7f6a136ed640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a0c101c40 0x7f6a0c1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.909+0000 7f6a136ed640 1 --2- 172.21.15.73:0/158764040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a0c100a50 0x7f6a0c197ca0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.909+0000 7f6a136ed640 1 -- 172.21.15.73:0/158764040 >> 172.21.15.73:0/158764040 conn(0x7f6a0c0fc1b0 msgr2=0x7f6a0c0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.909+0000 7f6a136ed640 1 -- 172.21.15.73:0/158764040 shutdown_connections 2024-09-05T12:58:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:16.909+0000 7f6a136ed640 1 -- 172.21.15.73:0/158764040 wait complete. 2024-09-05T12:58:17.180 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T12:58:17.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:17 smithi162 ceph-mon[34220]: pgmap v346: 97 pgs: 97 active+clean; 663 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-05T12:58:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:17 smithi169 ceph-mon[34823]: pgmap v346: 97 pgs: 97 active+clean; 663 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-05T12:58:17.498 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:17 smithi073 ceph-mon[30883]: pgmap v346: 97 pgs: 97 active+clean; 663 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-05T12:58:17.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.989+0000 7f34c1a4d640 1 -- 172.21.15.73:0/542706821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc106f20 msgr2=0x7f34bc10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:17.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.989+0000 7f34c1a4d640 1 --2- 172.21.15.73:0/542706821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc106f20 0x7f34bc10eaa0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009ca0 tx=0x7f34b402a8c0 comp rx=0 tx=0).stop 2024-09-05T12:58:17.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.989+0000 7f34c1a4d640 1 -- 172.21.15.73:0/542706821 shutdown_connections 2024-09-05T12:58:17.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.989+0000 7f34c1a4d640 1 --2- 172.21.15.73:0/542706821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc106f20 0x7f34bc10eaa0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:17.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.989+0000 7f34c1a4d640 1 --2- 172.21.15.73:0/542706821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34bc1027a0 0x7f34bc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:17.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.989+0000 7f34c1a4d640 1 --2- 172.21.15.73:0/542706821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc101df0 0x7f34bc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:17.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.989+0000 7f34c1a4d640 1 -- 172.21.15.73:0/542706821 >> 172.21.15.73:0/542706821 conn(0x7f34bc0fd8f0 msgr2=0x7f34bc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:17.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.990+0000 7f34c1a4d640 1 -- 172.21.15.73:0/542706821 shutdown_connections 2024-09-05T12:58:17.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.990+0000 7f34c1a4d640 1 -- 172.21.15.73:0/542706821 wait complete. 2024-09-05T12:58:17.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.990+0000 7f34c1a4d640 1 Processor -- start 2024-09-05T12:58:17.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34c1a4d640 1 -- start start 2024-09-05T12:58:17.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34c1a4d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc101df0 0x7f34bc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:17.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34c1a4d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34bc1027a0 0x7f34bc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:17.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34c1a4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc106f20 0x7f34bc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:17.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34baffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc101df0 0x7f34bc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:17.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34baffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc101df0 0x7f34bc1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35924/0 (socket says 172.21.15.73:35924) 2024-09-05T12:58:17.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34baffd640 1 -- 172.21.15.73:0/3781015873 learned_addr learned my addr 172.21.15.73:0/3781015873 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:17.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc111f80 con 0x7f34bc101df0 2024-09-05T12:58:17.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc111e00 con 0x7f34bc106f20 2024-09-05T12:58:17.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc112100 con 0x7f34bc1027a0 2024-09-05T12:58:17.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34bc1027a0 0x7f34bc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.991+0000 7f34bb7fe640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc106f20 0x7f34bc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.992+0000 7f34ba7fc640 1 -- 172.21.15.73:0/3781015873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc106f20 msgr2=0x7f34bc19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.992+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc106f20 0x7f34bc19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.992+0000 7f34ba7fc640 1 -- 172.21.15.73:0/3781015873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc101df0 msgr2=0x7f34bc1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.992+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc101df0 0x7f34bc1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.992+0000 7f34ba7fc640 1 -- 172.21.15.73:0/3781015873 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34bc19d370 con 0x7f34bc1027a0 2024-09-05T12:58:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.992+0000 7f34baffd640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc101df0 0x7f34bc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.992+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34bc1027a0 0x7f34bc198900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f34b000e9f0 tx=0x7f34b000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.992+0000 7f34c0a4b640 1 -- 172.21.15.73:0/3781015873 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b000ccc0 con 0x7f34bc1027a0 2024-09-05T12:58:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.992+0000 7f34c0a4b640 1 -- 172.21.15.73:0/3781015873 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b0005020 con 0x7f34bc1027a0 2024-09-05T12:58:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.993+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34bc19d660 con 0x7f34bc1027a0 2024-09-05T12:58:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.993+0000 7f34c0a4b640 1 -- 172.21.15.73:0/3781015873 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b00049e0 con 0x7f34bc1027a0 2024-09-05T12:58:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.993+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34bc1a4f40 con 0x7f34bc1027a0 2024-09-05T12:58:17.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34c3e23740 1 Processor -- start 2024-09-05T12:58:17.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34c3e23740 1 -- start start 2024-09-05T12:58:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34c0a4b640 1 -- 172.21.15.73:0/3781015873 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f34b0005560 con 0x7f34bc1027a0 2024-09-05T12:58:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c724ffc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c724fe4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 0x560c72513f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34c3e23740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x560c724642f0 con 0x560c724ff870 2024-09-05T12:58:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34c3e23740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560c7240bcf0 con 0x560c724feb10 2024-09-05T12:58:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34c3e23740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560c724602b0 con 0x560c724fe090 2024-09-05T12:58:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c724ffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c724ffc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35936/0 (socket says 172.21.15.73:35936) 2024-09-05T12:58:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34bb7fe640 1 -- 172.21.15.73:0/2113347291 learned_addr learned my addr 172.21.15.73:0/2113347291 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34ba7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 0x560c72513f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.996+0000 7f34baffd640 1 --2- 172.21.15.73:0/2113347291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c724fe4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.997+0000 7f34bb7fe640 1 -- 172.21.15.73:0/2113347291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 msgr2=0x560c724fe4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.997+0000 7f34bb7fe640 1 --2- 172.21.15.73:0/2113347291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c724fe4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.997+0000 7f34bb7fe640 1 -- 172.21.15.73:0/2113347291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 msgr2=0x560c72513f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.997+0000 7f34bb7fe640 1 --2- 172.21.15.73:0/2113347291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 0x560c72513f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.997+0000 7f34bb7fe640 1 -- 172.21.15.73:0/2113347291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c723f03a0 con 0x560c724ff870 2024-09-05T12:58:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.997+0000 7f34baffd640 1 --2- 172.21.15.73:0/2113347291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c724fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.997+0000 7f34bb7fe640 1 --2- 172.21.15.73:0/2113347291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c724ffc50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f34b4005cc0 tx=0x7f34b4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c582caf105ab57c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.997+0000 7f34c0a4b640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34a40a2c00 0x7f34a40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.998+0000 7f34baffd640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34a40a2c00 0x7f34a40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.998+0000 7f34c0a4b640 1 -- 172.21.15.73:0/3781015873 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f34b00cefa0 con 0x7f34bc1027a0 2024-09-05T12:58:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.998+0000 7f34a1ffb640 1 -- 172.21.15.73:0/2113347291 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4031db0 con 0x560c724ff870 2024-09-05T12:58:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.998+0000 7f34a1ffb640 1 -- 172.21.15.73:0/2113347291 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b4036050 con 0x560c724ff870 2024-09-05T12:58:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.998+0000 7f34a1ffb640 1 -- 172.21.15.73:0/2113347291 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40042a0 con 0x560c724ff870 2024-09-05T12:58:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34c3e23740 1 -- 172.21.15.73:0/2113347291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 msgr2=0x560c724ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34baffd640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34a40a2c00 0x7f34a40a50c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x560c724ff210 tx=0x7f34ac00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34c3e23740 1 --2- 172.21.15.73:0/2113347291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c724ffc50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f34b4005cc0 tx=0x7f34b4005ef0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34c3e23740 1 -- 172.21.15.73:0/2113347291 shutdown_connections 2024-09-05T12:58:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34c3e23740 1 --2- 172.21.15.73:0/2113347291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 0x560c72513f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34c3e23740 1 --2- 172.21.15.73:0/2113347291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c724fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34c3e23740 1 --2- 172.21.15.73:0/2113347291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c724ffc50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34c3e23740 1 -- 172.21.15.73:0/2113347291 >> 172.21.15.73:0/2113347291 conn(0x560c724c7310 msgr2=0x560c724fac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34c3e23740 1 -- 172.21.15.73:0/2113347291 shutdown_connections 2024-09-05T12:58:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34c3e23740 1 -- 172.21.15.73:0/2113347291 wait complete. 2024-09-05T12:58:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:17.999+0000 7f34c3e23740 1 -- start start 2024-09-05T12:58:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34c3e23740 1 Processor -- start 2024-09-05T12:58:18.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c72513e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 0x560c72511150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c72511760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34c3e23740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x560c725146f0 con 0x560c724ff870 2024-09-05T12:58:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34c3e23740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560c7241f060 con 0x560c724feb10 2024-09-05T12:58:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34c3e23740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560c72514870 con 0x560c724fe090 2024-09-05T12:58:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34c3e23740 10 client.0 _ll_register_callbacks cb 0x560c721728c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c72511760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34baffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c72513e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c72511760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35944/0 (socket says 172.21.15.73:35944) 2024-09-05T12:58:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34ba7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 0x560c72511150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34bb7fe640 1 -- 172.21.15.73:0/986209701 learned_addr learned my addr 172.21.15.73:0/986209701 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.000+0000 7f34baffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c72513e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:41686/0 (socket says 172.21.15.73:41686) 2024-09-05T12:58:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.001+0000 7f34ba7fc640 1 -- 172.21.15.73:0/986209701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 msgr2=0x560c72513e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.001+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c72513e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.001+0000 7f34ba7fc640 1 -- 172.21.15.73:0/986209701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 msgr2=0x560c72511760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.001+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c72511760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.001+0000 7f34ba7fc640 1 -- 172.21.15.73:0/986209701 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c721d53c0 con 0x560c724feb10 2024-09-05T12:58:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.001+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 0x560c72511150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34b009b4d0 tx=0x7f34b0097470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e84e3e42307d8580 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.001+0000 7f349affd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T12:58:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.001+0000 7f349affd640 1 -- 172.21.15.73:0/986209701 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b001c070 con 0x560c724feb10 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.001+0000 7f34c3e23740 1 -- 172.21.15.73:0/986209701 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34b4036050 con 0x560c724feb10 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.001+0000 7f349affd640 1 -- 172.21.15.73:0/986209701 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f34b0004ca0 con 0x560c724feb10 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.002+0000 7f349affd640 1 -- 172.21.15.73:0/986209701 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f34b009b130 con 0x560c724feb10 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.002+0000 7f34c3e23740 10 client.24923 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.002+0000 7f34c3e23740 1 -- 172.21.15.73:0/986209701 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c725201e0 con 0x560c724feb10 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.002+0000 7f349affd640 1 -- 172.21.15.73:0/986209701 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b4036050 con 0x560c724feb10 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.003+0000 7f349affd640 1 -- 172.21.15.73:0/986209701 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f34b00a3fb0 con 0x560c724feb10 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.003+0000 7f34c3e23740 10 client.24923 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.003+0000 7f34c3e23740 10 client.24923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.003+0000 7f34c3e23740 20 client.24923 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.003+0000 7f34c3e23740 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c725215f0 0x560c725239e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.003+0000 7f34c3e23740 4 client.24923 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.003+0000 7f34c3e23740 1 -- 172.21.15.73:0/986209701 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c72471860 con 0x560c725215f0 2024-09-05T12:58:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.003+0000 7f34baffd640 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c725215f0 0x560c725239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.003+0000 7f34baffd640 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c725215f0 0x560c725239e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1b274c80f5accdd server_cookie=d307a53669c40e35 in_seq=0 out_seq=0 2024-09-05T12:58:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.003+0000 7f349affd640 10 client.24923 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:18.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.004+0000 7f349affd640 1 -- 172.21.15.73:0/986209701 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c72471860 con 0x560c725215f0 2024-09-05T12:58:18.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.004+0000 7f349affd640 10 client.24923 handle_command_reply: tid=0 2024-09-05T12:58:18.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.004+0000 7f34c3e23740 1 client.24923 shutdown 2024-09-05T12:58:18.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.004+0000 7f34c3e23740 1 -- 172.21.15.73:0/986209701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 msgr2=0x560c72511150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:18.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.004+0000 7f34c3e23740 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 0x560c72511150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34b009b4d0 tx=0x7f34b0097470 comp rx=0 tx=0).stop 2024-09-05T12:58:18.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.005+0000 7f34c3e23740 1 -- 172.21.15.73:0/986209701 shutdown_connections 2024-09-05T12:58:18.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.005+0000 7f34c3e23740 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c725215f0 0x560c725239e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.005+0000 7f34c3e23740 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724ff870 0x560c72511760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.005+0000 7f349affd640 0 client.24923 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.005+0000 7f34c3e23740 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724feb10 0x560c72511150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.005+0000 7f34c3e23740 1 --2- 172.21.15.73:0/986209701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c72513e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.005+0000 7f34c3e23740 1 -- 172.21.15.73:0/986209701 >> 172.21.15.73:0/986209701 conn(0x560c724c7310 msgr2=0x560c724f9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.005+0000 7f34c3e23740 1 -- 172.21.15.73:0/986209701 shutdown_connections 2024-09-05T12:58:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.005+0000 7f34c3e23740 1 -- 172.21.15.73:0/986209701 wait complete. 2024-09-05T12:58:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.005+0000 7f34c3e23740 20 client.24923 trim_cache size 0 max 16384 2024-09-05T12:58:18.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34c3e23740 1 Processor -- start 2024-09-05T12:58:18.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34c3e23740 1 -- start start 2024-09-05T12:58:18.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c7251d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72529230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724ff870 0x560c72529770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34c3e23740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc1adad0 con 0x560c724feb10 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34c3e23740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc1ab3a0 con 0x560c724ff870 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34c3e23740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc1a91f0 con 0x560c724fe090 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34ba7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72529230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34ba7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72529230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35946/0 (socket says 172.21.15.73:35946) 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.030+0000 7f34ba7fc640 1 -- 172.21.15.73:0/1308153457 learned_addr learned my addr 172.21.15.73:0/1308153457 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34baffd640 1 --2- 172.21.15.73:0/1308153457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c7251d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34bb7fe640 1 --2- 172.21.15.73:0/1308153457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724ff870 0x560c72529770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34ba7fc640 1 -- 172.21.15.73:0/1308153457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 msgr2=0x560c7251d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/1308153457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c7251d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34ba7fc640 1 -- 172.21.15.73:0/1308153457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724ff870 msgr2=0x560c72529770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:18.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/1308153457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724ff870 0x560c72529770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34ba7fc640 1 -- 172.21.15.73:0/1308153457 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c7250f6a0 con 0x560c724feb10 2024-09-05T12:58:18.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/1308153457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72529230 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f34b000e9c0 tx=0x7f34b00d2b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b419364cf6883f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:18.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34a17fa640 1 -- 172.21.15.73:0/1308153457 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b001c040 con 0x560c724feb10 2024-09-05T12:58:18.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34a17fa640 1 -- 172.21.15.73:0/1308153457 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b009b7d0 con 0x560c724feb10 2024-09-05T12:58:18.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.031+0000 7f34a17fa640 1 -- 172.21.15.73:0/1308153457 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b00d20e0 con 0x560c724feb10 2024-09-05T12:58:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.032+0000 7f34c3e23740 1 -- 172.21.15.73:0/1308153457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 msgr2=0x560c72529230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.032+0000 7f34c3e23740 1 --2- 172.21.15.73:0/1308153457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72529230 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f34b000e9c0 tx=0x7f34b00d2b50 comp rx=0 tx=0).stop 2024-09-05T12:58:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.032+0000 7f34c3e23740 1 -- 172.21.15.73:0/1308153457 shutdown_connections 2024-09-05T12:58:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.032+0000 7f34c3e23740 1 --2- 172.21.15.73:0/1308153457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724ff870 0x560c72529770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.032+0000 7f34c3e23740 1 --2- 172.21.15.73:0/1308153457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72529230 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.032+0000 7f34c3e23740 1 --2- 172.21.15.73:0/1308153457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724fe090 0x560c7251d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.032+0000 7f34c3e23740 1 -- 172.21.15.73:0/1308153457 >> 172.21.15.73:0/1308153457 conn(0x560c724c7310 msgr2=0x560c724f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.033+0000 7f34c3e23740 1 -- 172.21.15.73:0/1308153457 shutdown_connections 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.033+0000 7f34c3e23740 1 -- 172.21.15.73:0/1308153457 wait complete. 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.033+0000 7f34c3e23740 1 -- start start 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.033+0000 7f34c3e23740 1 Processor -- start 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724fe090 0x560c7251a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72528c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34c3e23740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724ff870 0x560c72529410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34c3e23740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc1a9860 con 0x560c724feb10 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34c3e23740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc1aacd0 con 0x560c724fe090 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34c3e23740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc1a9f30 con 0x560c724ff870 2024-09-05T12:58:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34c3e23740 10 client.0 _ll_register_callbacks cb 0x7f34b00d26d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34ba7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72528c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34ba7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72528c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35956/0 (socket says 172.21.15.73:35956) 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34ba7fc640 1 -- 172.21.15.73:0/930704618 learned_addr learned my addr 172.21.15.73:0/930704618 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34baffd640 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724fe090 0x560c7251a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34bb7fe640 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724ff870 0x560c72529410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34ba7fc640 1 -- 172.21.15.73:0/930704618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724ff870 msgr2=0x560c72529410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724ff870 0x560c72529410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34ba7fc640 1 -- 172.21.15.73:0/930704618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724fe090 msgr2=0x560c7251a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724fe090 0x560c7251a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34ba7fc640 1 -- 172.21.15.73:0/930704618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c7258b200 con 0x560c724feb10 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34bb7fe640 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724ff870 0x560c72529410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:18.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f34ba7fc640 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72528c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f34b000c6a0 tx=0x7f34b0004eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf4125e2df93ca server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.034+0000 7f349affd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f349affd640 1 -- 172.21.15.73:0/930704618 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b001c070 con 0x560c724feb10 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f349affd640 1 -- 172.21.15.73:0/930704618 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f34b00d2270 con 0x560c724feb10 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f34c3e23740 1 -- 172.21.15.73:0/930704618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c7246bd70 con 0x560c724feb10 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f349affd640 1 -- 172.21.15.73:0/930704618 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f34b009fb80 con 0x560c724feb10 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f34c3e23740 10 client.15357 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f34c3e23740 1 -- 172.21.15.73:0/930704618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c7258c350 con 0x560c724feb10 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f349affd640 1 -- 172.21.15.73:0/930704618 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560c7246bd70 con 0x560c724feb10 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f349affd640 1 -- 172.21.15.73:0/930704618 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f34b0097520 con 0x560c724feb10 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f34c3e23740 10 client.15357 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f34c3e23740 10 client.15357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.035+0000 7f34c3e23740 20 client.15357 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:18.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.036+0000 7f34c3e23740 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c7258c820 0x560c7258ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:18.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.036+0000 7f34c3e23740 4 client.15357 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T12:58:18.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.036+0000 7f34c3e23740 1 -- 172.21.15.73:0/930704618 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c723e8170 con 0x560c7258c820 2024-09-05T12:58:18.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.036+0000 7f34baffd640 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c7258c820 0x560c7258ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:18.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.036+0000 7f349affd640 10 client.15357 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:18.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.036+0000 7f34baffd640 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c7258c820 0x560c7258ec10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8a12056b22256aa server_cookie=517c17410dc655f8 in_seq=0 out_seq=0 2024-09-05T12:58:18.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f349affd640 1 -- 172.21.15.73:0/930704618 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c723e8170 con 0x560c7258c820 2024-09-05T12:58:18.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f349affd640 10 client.15357 handle_command_reply: tid=0 2024-09-05T12:58:18.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 client.15357 shutdown 2024-09-05T12:58:18.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 -- 172.21.15.73:0/930704618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 msgr2=0x560c72528c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:18.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72528c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f34b000c6a0 tx=0x7f34b0004eb0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 -- 172.21.15.73:0/930704618 shutdown_connections 2024-09-05T12:58:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c7258c820 0x560c7258ec10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c724ff870 0x560c72529410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f349affd640 0 client.15357 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c724feb10 0x560c72528c80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 --2- 172.21.15.73:0/930704618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c724fe090 0x560c7251a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 -- 172.21.15.73:0/930704618 >> 172.21.15.73:0/930704618 conn(0x560c724c7310 msgr2=0x560c7250fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 -- 172.21.15.73:0/930704618 shutdown_connections 2024-09-05T12:58:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 1 -- 172.21.15.73:0/930704618 wait complete. 2024-09-05T12:58:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.037+0000 7f34c3e23740 20 client.15357 trim_cache size 0 max 16384 2024-09-05T12:58:18.043 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T12:58:18.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34a40a2c00 msgr2=0x7f34a40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34a40a2c00 0x7f34a40a50c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x560c724ff210 tx=0x7f34ac00b4a0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34bc1027a0 msgr2=0x7f34bc198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34bc1027a0 0x7f34bc198900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f34b000e9f0 tx=0x7f34b000eeb0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 shutdown_connections 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f34a40a2c00 0x7f34a40a50c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc106f20 0x7f34bc19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34bc1027a0 0x7f34bc198900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 --2- 172.21.15.73:0/3781015873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc101df0 0x7f34bc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 >> 172.21.15.73:0/3781015873 conn(0x7f34bc0fd8f0 msgr2=0x7f34bc0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 shutdown_connections 2024-09-05T12:58:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:18.038+0000 7f34c1a4d640 1 -- 172.21.15.73:0/3781015873 wait complete. 2024-09-05T12:58:19.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:19 smithi162 ceph-mon[34220]: pgmap v347: 97 pgs: 97 active+clean; 663 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-05T12:58:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:19 smithi169 ceph-mon[34823]: pgmap v347: 97 pgs: 97 active+clean; 663 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-05T12:58:19.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:19 smithi073 ceph-mon[30883]: pgmap v347: 97 pgs: 97 active+clean; 663 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-05T12:58:19.798 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T12:58:19.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T12:58:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:20.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.712+0000 7fe7260c7640 1 -- 172.21.15.73:0/924439602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe720106a90 msgr2=0x7fe720106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:20.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.712+0000 7fe7260c7640 1 --2- 172.21.15.73:0/924439602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe720106a90 0x7fe720106e70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe710009930 tx=0x7fe71002a420 comp rx=0 tx=0).stop 2024-09-05T12:58:20.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.712+0000 7fe7260c7640 1 -- 172.21.15.73:0/924439602 shutdown_connections 2024-09-05T12:58:20.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.712+0000 7fe7260c7640 1 --2- 172.21.15.73:0/924439602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe720101430 0x7fe72010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.712+0000 7fe7260c7640 1 --2- 172.21.15.73:0/924439602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe720100a90 0x7fe720100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.712+0000 7fe7260c7640 1 --2- 172.21.15.73:0/924439602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe720106a90 0x7fe720106e70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.712+0000 7fe7260c7640 1 -- 172.21.15.73:0/924439602 >> 172.21.15.73:0/924439602 conn(0x7fe7200fc7d0 msgr2=0x7fe7200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.713+0000 7fe7260c7640 1 -- 172.21.15.73:0/924439602 shutdown_connections 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.713+0000 7fe7260c7640 1 -- 172.21.15.73:0/924439602 wait complete. 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.713+0000 7fe7260c7640 1 Processor -- start 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe7260c7640 1 -- start start 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe7260c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe720100a90 0x7fe72019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe7260c7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe720101430 0x7fe72019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe7260c7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe720106a90 0x7fe720198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe720100a90 0x7fe72019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe720100a90 0x7fe72019d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35982/0 (socket says 172.21.15.73:35982) 2024-09-05T12:58:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe7260c7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe720110f20 con 0x7fe720100a90 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe71effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe720101430 0x7fe72019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe71f7fe640 1 -- 172.21.15.73:0/3882323251 learned_addr learned my addr 172.21.15.73:0/3882323251 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe7260c7640 1 -- 172.21.15.73:0/3882323251 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe720110da0 con 0x7fe720106a90 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.714+0000 7fe7260c7640 1 -- 172.21.15.73:0/3882323251 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7201110a0 con 0x7fe720101430 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.715+0000 7fe71ffff640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe720106a90 0x7fe720198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.715+0000 7fe71effd640 1 -- 172.21.15.73:0/3882323251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe720106a90 msgr2=0x7fe720198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.715+0000 7fe71effd640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe720106a90 0x7fe720198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.715+0000 7fe71effd640 1 -- 172.21.15.73:0/3882323251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe720100a90 msgr2=0x7fe72019d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.715+0000 7fe71effd640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe720100a90 0x7fe72019d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.715+0000 7fe71effd640 1 -- 172.21.15.73:0/3882323251 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe720198d30 con 0x7fe720101430 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.715+0000 7fe71f7fe640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe720100a90 0x7fe72019d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.715+0000 7fe71effd640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe720101430 0x7fe72019d620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe71400d720 tx=0x7fe71400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.715+0000 7fe71cff9640 1 -- 172.21.15.73:0/3882323251 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714017070 con 0x7fe720101430 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.715+0000 7fe71cff9640 1 -- 172.21.15.73:0/3882323251 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe71400de30 con 0x7fe720101430 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.716+0000 7fe7260c7640 1 -- 172.21.15.73:0/3882323251 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe720199020 con 0x7fe720101430 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.716+0000 7fe71cff9640 1 -- 172.21.15.73:0/3882323251 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7140047a0 con 0x7fe720101430 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.717+0000 7fe7260c7640 1 -- 172.21.15.73:0/3882323251 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7201116e0 con 0x7fe720101430 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.719+0000 7fe71cff9640 1 -- 172.21.15.73:0/3882323251 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe7140099d0 con 0x7fe720101430 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.720+0000 7fe72849d740 1 Processor -- start 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.720+0000 7fe71cff9640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7080a2c00 0x7fe7080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.720+0000 7fe72849d740 1 -- start start 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.720+0000 7fe72849d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b8b60 0x55cbe36b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.720+0000 7fe72849d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b9480 0x55cbe36c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.720+0000 7fe72849d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36c3d40 0x55cbe36c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.720+0000 7fe72849d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cbe361e280 con 0x55cbe36c3d40 2024-09-05T12:58:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.720+0000 7fe72849d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cbe35c5b10 con 0x55cbe36b9480 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.720+0000 7fe72849d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cbe361a240 con 0x55cbe36b8b60 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b8b60 0x55cbe36b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b9480 0x55cbe36c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b9480 0x55cbe36c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:32808/0 (socket says 172.21.15.73:32808) 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71effd640 1 -- 172.21.15.73:0/2986588485 learned_addr learned my addr 172.21.15.73:0/2986588485 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71ffff640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7080a2c00 0x7fe7080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71f7fe640 1 -- 172.21.15.73:0/2986588485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b9480 msgr2=0x55cbe36c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71f7fe640 1 --2- 172.21.15.73:0/2986588485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b9480 0x55cbe36c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71f7fe640 1 -- 172.21.15.73:0/2986588485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36c3d40 msgr2=0x55cbe36c6130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71f7fe640 1 --2- 172.21.15.73:0/2986588485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36c3d40 0x55cbe36c6130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71f7fe640 1 -- 172.21.15.73:0/2986588485 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbe35d21f0 con 0x55cbe36b8b60 2024-09-05T12:58:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.721+0000 7fe71cff9640 1 -- 172.21.15.73:0/3882323251 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe7140ce830 con 0x7fe720101430 2024-09-05T12:58:20.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.722+0000 7fe71f7fe640 1 --2- 172.21.15.73:0/2986588485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b8b60 0x55cbe36b8f40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe710006010 tx=0x7fe710004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10204ebfb1a3140c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:20.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.722+0000 7fe705ffb640 1 -- 172.21.15.73:0/2986588485 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710035040 con 0x55cbe36b8b60 2024-09-05T12:58:20.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.722+0000 7fe705ffb640 1 -- 172.21.15.73:0/2986588485 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe710004c40 con 0x55cbe36b8b60 2024-09-05T12:58:20.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.722+0000 7fe705ffb640 1 -- 172.21.15.73:0/2986588485 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710003be0 con 0x55cbe36b8b60 2024-09-05T12:58:20.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe72849d740 1 -- 172.21.15.73:0/2986588485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b8b60 msgr2=0x55cbe36b8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:20.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe71ffff640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7080a2c00 0x7fe7080a50c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe718012500 tx=0x7fe71800f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:20.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe72849d740 1 --2- 172.21.15.73:0/2986588485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b8b60 0x55cbe36b8f40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe710006010 tx=0x7fe710004530 comp rx=0 tx=0).stop 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe72849d740 1 -- 172.21.15.73:0/2986588485 shutdown_connections 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe72849d740 1 --2- 172.21.15.73:0/2986588485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36c3d40 0x55cbe36c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe72849d740 1 --2- 172.21.15.73:0/2986588485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b9480 0x55cbe36c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe72849d740 1 --2- 172.21.15.73:0/2986588485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b8b60 0x55cbe36b8f40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe72849d740 1 -- 172.21.15.73:0/2986588485 >> 172.21.15.73:0/2986588485 conn(0x55cbe36b50f0 msgr2=0x55cbe36b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe72849d740 1 -- 172.21.15.73:0/2986588485 shutdown_connections 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe72849d740 1 -- 172.21.15.73:0/2986588485 wait complete. 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.723+0000 7fe72849d740 1 -- start start 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe72849d740 1 Processor -- start 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe72849d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 0x55cbe36c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe72849d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe72849d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36c3d40 0x55cbe36c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe72849d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cbe36c68b0 con 0x55cbe36b8b60 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe72849d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cbe35d8f10 con 0x55cbe36c3d40 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe72849d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cbe36c6a30 con 0x55cbe36b9480 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 0x55cbe36c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 0x55cbe36c0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35986/0 (socket says 172.21.15.73:35986) 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe71f7fe640 1 -- 172.21.15.73:0/2588974499 learned_addr learned my addr 172.21.15.73:0/2588974499 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe72849d740 10 client.0 _ll_register_callbacks cb 0x55cbe35a1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe71effd640 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.724+0000 7fe71ffff640 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36c3d40 0x55cbe36c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe71ffff640 1 -- 172.21.15.73:0/2588974499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 msgr2=0x55cbe36c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe71ffff640 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36c12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe71ffff640 1 -- 172.21.15.73:0/2588974499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 msgr2=0x55cbe36c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:20.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe71ffff640 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 0x55cbe36c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe71ffff640 1 -- 172.21.15.73:0/2588974499 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbe338f6a0 con 0x55cbe36c3d40 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe71f7fe640 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 0x55cbe36c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe71ffff640 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36c3d40 0x55cbe36c1800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55cbe36b6470 tx=0x7fe718004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1e9acd2e0ff6636 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe6feffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe6feffd640 1 -- 172.21.15.73:0/2588974499 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718026060 con 0x55cbe36c3d40 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe72849d740 1 -- 172.21.15.73:0/2588974499 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe710004c40 con 0x55cbe36c3d40 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.725+0000 7fe6feffd640 1 -- 172.21.15.73:0/2588974499 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe7180213f0 con 0x55cbe36c3d40 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.726+0000 7fe6feffd640 1 -- 172.21.15.73:0/2588974499 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe718017e60 con 0x55cbe36c3d40 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.726+0000 7fe72849d740 10 client.24938 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.726+0000 7fe72849d740 1 -- 172.21.15.73:0/2588974499 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cbe36dae70 con 0x55cbe36c3d40 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.726+0000 7fe6feffd640 1 -- 172.21.15.73:0/2588974499 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe718021ad0 con 0x55cbe36c3d40 2024-09-05T12:58:20.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.727+0000 7fe6feffd640 1 -- 172.21.15.73:0/2588974499 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe718020070 con 0x55cbe36c3d40 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.727+0000 7fe72849d740 10 client.24938 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.727+0000 7fe72849d740 10 client.24938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.727+0000 7fe72849d740 20 client.24938 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.727+0000 7fe72849d740 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cbe36dc330 0x55cbe36de720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.727+0000 7fe72849d740 4 client.24938 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.727+0000 7fe72849d740 1 -- 172.21.15.73:0/2588974499 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe710004c40 con 0x55cbe36dc330 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.728+0000 7fe71f7fe640 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cbe36dc330 0x55cbe36de720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.728+0000 7fe6feffd640 10 client.24938 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.728+0000 7fe71f7fe640 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cbe36dc330 0x55cbe36de720 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b854f448419280ba server_cookie=1fbf25667d64a558 in_seq=0 out_seq=0 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe6feffd640 1 -- 172.21.15.73:0/2588974499 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe710004c40 con 0x55cbe36dc330 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe6feffd640 10 client.24938 handle_command_reply: tid=0 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe72849d740 1 client.24938 shutdown 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe72849d740 1 -- 172.21.15.73:0/2588974499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36c3d40 msgr2=0x55cbe36c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:20.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe72849d740 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36c3d40 0x55cbe36c1800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55cbe36b6470 tx=0x7fe718004b50 comp rx=0 tx=0).stop 2024-09-05T12:58:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe72849d740 1 -- 172.21.15.73:0/2588974499 shutdown_connections 2024-09-05T12:58:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe72849d740 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cbe36dc330 0x55cbe36de720 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe72849d740 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36c3d40 0x55cbe36c1800 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe6feffd640 0 client.24938 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe72849d740 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe72849d740 1 --2- 172.21.15.73:0/2588974499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 0x55cbe36c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe72849d740 1 -- 172.21.15.73:0/2588974499 >> 172.21.15.73:0/2588974499 conn(0x55cbe36b50f0 msgr2=0x55cbe36badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.729+0000 7fe72849d740 1 -- 172.21.15.73:0/2588974499 shutdown_connections 2024-09-05T12:58:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.730+0000 7fe72849d740 1 -- 172.21.15.73:0/2588974499 wait complete. 2024-09-05T12:58:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.730+0000 7fe72849d740 20 client.24938 trim_cache size 0 max 16384 2024-09-05T12:58:20.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.763+0000 7fe72849d740 1 Processor -- start 2024-09-05T12:58:20.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.763+0000 7fe72849d740 1 -- start start 2024-09-05T12:58:20.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe72849d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 0x55cbe36c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe72849d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe72849d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36c3d40 0x55cbe36e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe72849d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe7201ad9e0 con 0x55cbe36b8b60 2024-09-05T12:58:20.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe72849d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7201ab2b0 con 0x55cbe36c3d40 2024-09-05T12:58:20.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe72849d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7201a91b0 con 0x55cbe36b9480 2024-09-05T12:58:20.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe71effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 0x55cbe36c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe71effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36e3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:41752/0 (socket says 172.21.15.73:41752) 2024-09-05T12:58:20.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe71effd640 1 -- 172.21.15.73:0/4113647757 learned_addr learned my addr 172.21.15.73:0/4113647757 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:20.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe71effd640 1 -- 172.21.15.73:0/4113647757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36c3d40 msgr2=0x55cbe36e44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:20.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe71effd640 1 --2- 172.21.15.73:0/4113647757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36c3d40 0x55cbe36e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe71effd640 1 -- 172.21.15.73:0/4113647757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 msgr2=0x55cbe36c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:20.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe71effd640 1 --2- 172.21.15.73:0/4113647757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 0x55cbe36c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.764+0000 7fe71effd640 1 -- 172.21.15.73:0/4113647757 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbe36bf2d0 con 0x55cbe36b9480 2024-09-05T12:58:20.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.765+0000 7fe71effd640 1 --2- 172.21.15.73:0/4113647757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36e3f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe7140cc3b0 tx=0x7fe7140bb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae35c0ab5d2433f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.765+0000 7fe7057fa640 1 -- 172.21.15.73:0/4113647757 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714004220 con 0x55cbe36b9480 2024-09-05T12:58:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.765+0000 7fe7057fa640 1 -- 172.21.15.73:0/4113647757 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe71409b0c0 con 0x55cbe36b9480 2024-09-05T12:58:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.765+0000 7fe7057fa640 1 -- 172.21.15.73:0/4113647757 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71409f120 con 0x55cbe36b9480 2024-09-05T12:58:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.766+0000 7fe72849d740 1 -- 172.21.15.73:0/4113647757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 msgr2=0x55cbe36e3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.766+0000 7fe72849d740 1 --2- 172.21.15.73:0/4113647757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36e3f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe7140cc3b0 tx=0x7fe7140bb040 comp rx=0 tx=0).stop 2024-09-05T12:58:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.766+0000 7fe72849d740 1 -- 172.21.15.73:0/4113647757 shutdown_connections 2024-09-05T12:58:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.766+0000 7fe72849d740 1 --2- 172.21.15.73:0/4113647757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36c3d40 0x55cbe36e44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.766+0000 7fe72849d740 1 --2- 172.21.15.73:0/4113647757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36e3f80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.766+0000 7fe72849d740 1 --2- 172.21.15.73:0/4113647757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36b8b60 0x55cbe36c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.766+0000 7fe72849d740 1 -- 172.21.15.73:0/4113647757 >> 172.21.15.73:0/4113647757 conn(0x55cbe36b50f0 msgr2=0x55cbe36badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:20.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.767+0000 7fe72849d740 1 -- 172.21.15.73:0/4113647757 shutdown_connections 2024-09-05T12:58:20.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.767+0000 7fe72849d740 1 -- 172.21.15.73:0/4113647757 wait complete. 2024-09-05T12:58:20.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.767+0000 7fe72849d740 1 -- start start 2024-09-05T12:58:20.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.767+0000 7fe72849d740 1 Processor -- start 2024-09-05T12:58:20.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.768+0000 7fe72849d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b8b60 0x55cbe36d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.768+0000 7fe72849d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.768+0000 7fe72849d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36c3d40 0x55cbe36d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.768+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b8b60 0x55cbe36d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.768+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b8b60 0x55cbe36d0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:32834/0 (socket says 172.21.15.73:32834) 2024-09-05T12:58:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.768+0000 7fe71f7fe640 1 -- 172.21.15.73:0/975571205 learned_addr learned my addr 172.21.15.73:0/975571205 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.768+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe7201a9770 con 0x55cbe36c3d40 2024-09-05T12:58:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.768+0000 7fe71effd640 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.768+0000 7fe71ffff640 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36c3d40 0x55cbe36d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7201aabe0 con 0x55cbe36b8b60 2024-09-05T12:58:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7201a9e40 con 0x55cbe36b9480 2024-09-05T12:58:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe72849d740 10 client.0 _ll_register_callbacks cb 0x7fe7180121e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe71f7fe640 1 -- 172.21.15.73:0/975571205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 msgr2=0x55cbe36d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe71f7fe640 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe71f7fe640 1 -- 172.21.15.73:0/975571205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36c3d40 msgr2=0x55cbe36d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe71f7fe640 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36c3d40 0x55cbe36d0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe71f7fe640 1 -- 172.21.15.73:0/975571205 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbe3746220 con 0x55cbe36b8b60 2024-09-05T12:58:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe71409b0c0 con 0x55cbe36b8b60 2024-09-05T12:58:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe71f7fe640 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b8b60 0x55cbe36d0540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55cbe36deef0 tx=0x7fe71002a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6beac4fdd4aca25d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe6feffd640 10 client.24941 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T12:58:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.769+0000 7fe6feffd640 1 -- 172.21.15.73:0/975571205 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71005f050 con 0x55cbe36b8b60 2024-09-05T12:58:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe6feffd640 1 -- 172.21.15.73:0/975571205 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe7100050c0 con 0x55cbe36b8b60 2024-09-05T12:58:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe6feffd640 1 -- 172.21.15.73:0/975571205 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe710054030 con 0x55cbe36b8b60 2024-09-05T12:58:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe72849d740 10 client.24941 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55cbe3747460 con 0x55cbe36b8b60 2024-09-05T12:58:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe6feffd640 1 -- 172.21.15.73:0/975571205 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe710005300 con 0x55cbe36b8b60 2024-09-05T12:58:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe72849d740 10 client.24941 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe72849d740 10 client.24941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe72849d740 20 client.24941 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe72849d740 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cbe36dc330 0x55cbe37496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe72849d740 4 client.24941 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T12:58:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.770+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cbe362b7f0 con 0x55cbe36dc330 2024-09-05T12:58:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.771+0000 7fe71effd640 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cbe36dc330 0x55cbe37496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.771+0000 7fe6feffd640 10 client.24941 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.771+0000 7fe71effd640 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cbe36dc330 0x55cbe37496a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c561289fc5ebb14 server_cookie=cac5d27bd7e7ac54 in_seq=0 out_seq=0 2024-09-05T12:58:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.772+0000 7fe6feffd640 1 -- 172.21.15.73:0/975571205 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cbe362b7f0 con 0x55cbe36dc330 2024-09-05T12:58:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.772+0000 7fe6feffd640 10 client.24941 handle_command_reply: tid=0 2024-09-05T12:58:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.772+0000 7fe72849d740 1 client.24941 shutdown 2024-09-05T12:58:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.772+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b8b60 msgr2=0x55cbe36d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.772+0000 7fe72849d740 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b8b60 0x55cbe36d0540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55cbe36deef0 tx=0x7fe71002a420 comp rx=0 tx=0).stop 2024-09-05T12:58:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.773+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 shutdown_connections 2024-09-05T12:58:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.773+0000 7fe72849d740 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cbe36dc330 0x55cbe37496a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.773+0000 7fe72849d740 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbe36c3d40 0x55cbe36d0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.773+0000 7fe72849d740 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbe36b9480 0x55cbe36d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.773+0000 7fe72849d740 1 --2- 172.21.15.73:0/975571205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbe36b8b60 0x55cbe36d0540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.773+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 >> 172.21.15.73:0/975571205 conn(0x55cbe36b50f0 msgr2=0x55cbe36ba5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.773+0000 7fe6feffd640 0 client.24941 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.773+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 shutdown_connections 2024-09-05T12:58:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.773+0000 7fe72849d740 1 -- 172.21.15.73:0/975571205 wait complete. 2024-09-05T12:58:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.773+0000 7fe72849d740 20 client.24941 trim_cache size 0 max 16384 2024-09-05T12:58:20.796 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:58:20.797 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2024-09-05T12:58:20.797 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "ac3f59bd-bd41-4b41-9953-e95f42ff14d4", 2024-09-05T12:58:20.797 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2024-09-05T12:58:20.797 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:58:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 -- 172.21.15.73:0/3882323251 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7080a2c00 msgr2=0x7fe7080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7080a2c00 0x7fe7080a50c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe718012500 tx=0x7fe71800f040 comp rx=0 tx=0).stop 2024-09-05T12:58:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 -- 172.21.15.73:0/3882323251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe720101430 msgr2=0x7fe72019d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe720101430 0x7fe72019d620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe71400d720 tx=0x7fe71400dbe0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 -- 172.21.15.73:0/3882323251 shutdown_connections 2024-09-05T12:58:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7080a2c00 0x7fe7080a50c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe720106a90 0x7fe720198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe720101430 0x7fe72019d620 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 --2- 172.21.15.73:0/3882323251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe720100a90 0x7fe72019d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 -- 172.21.15.73:0/3882323251 >> 172.21.15.73:0/3882323251 conn(0x7fe7200fc7d0 msgr2=0x7fe7200fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 -- 172.21.15.73:0/3882323251 shutdown_connections 2024-09-05T12:58:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:20.774+0000 7fe7260c7640 1 -- 172.21.15.73:0/3882323251 wait complete. 2024-09-05T12:58:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:21 smithi162 ceph-mon[34220]: pgmap v348: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-05T12:58:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:21 smithi162 ceph-mon[34220]: scrub queued for path: / 2024-09-05T12:58:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:21 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:21 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T12:58:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:21 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:21 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T12:58:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:21 smithi169 ceph-mon[34823]: pgmap v348: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-05T12:58:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:21 smithi169 ceph-mon[34823]: scrub queued for path: / 2024-09-05T12:58:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:21 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:21.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:21 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T12:58:21.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:21 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:21.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:21 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T12:58:21.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:21 smithi073 ceph-mon[30883]: pgmap v348: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-05T12:58:21.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:21 smithi073 ceph-mon[30883]: scrub queued for path: / 2024-09-05T12:58:21.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:21 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:21.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:21 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T12:58:21.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:21 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:21.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:21 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T12:58:21.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T12:58:21.890 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.382+0000 7fba0c848640 1 -- 172.21.15.73:0/3632082853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba08100e20 msgr2=0x7fba08101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.382+0000 7fba0c848640 1 --2- 172.21.15.73:0/3632082853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba08100e20 0x7fba08101200 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009900 tx=0x7fb9f802a480 comp rx=0 tx=0).stop 2024-09-05T12:58:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.382+0000 7fba0c848640 1 -- 172.21.15.73:0/3632082853 shutdown_connections 2024-09-05T12:58:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.382+0000 7fba0c848640 1 --2- 172.21.15.73:0/3632082853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba08102ef0 0x7fba0810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.382+0000 7fba0c848640 1 --2- 172.21.15.73:0/3632082853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba08102570 0x7fba081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.382+0000 7fba0c848640 1 --2- 172.21.15.73:0/3632082853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba08100e20 0x7fba08101200 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.382+0000 7fba0c848640 1 -- 172.21.15.73:0/3632082853 >> 172.21.15.73:0/3632082853 conn(0x7fba080fc7d0 msgr2=0x7fba080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.382+0000 7fba0c848640 1 -- 172.21.15.73:0/3632082853 shutdown_connections 2024-09-05T12:58:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.382+0000 7fba0c848640 1 -- 172.21.15.73:0/3632082853 wait complete. 2024-09-05T12:58:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.383+0000 7fba0c848640 1 Processor -- start 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.383+0000 7fba0c848640 1 -- start start 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0c848640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba08100e20 0x7fba08197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0c848640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba08102570 0x7fba08197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0c848640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba08102ef0 0x7fba0819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba08100e20 0x7fba08197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0c848640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fba08110f80 con 0x7fba08100e20 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0c848640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba08110e00 con 0x7fba08102570 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba08100e20 0x7fba08197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36042/0 (socket says 172.21.15.73:36042) 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0c848640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba08111100 con 0x7fba08102ef0 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0659c640 1 -- 172.21.15.73:0/2867487523 learned_addr learned my addr 172.21.15.73:0/2867487523 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba05d9b640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba08102570 0x7fba08197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba06d9d640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba08102ef0 0x7fba0819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0659c640 1 -- 172.21.15.73:0/2867487523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba08102ef0 msgr2=0x7fba0819bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0659c640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba08102ef0 0x7fba0819bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0659c640 1 -- 172.21.15.73:0/2867487523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba08102570 msgr2=0x7fba08197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0659c640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba08102570 0x7fba08197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba0659c640 1 -- 172.21.15.73:0/2867487523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0819c3c0 con 0x7fba08100e20 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.384+0000 7fba05d9b640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba08102570 0x7fba08197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.385+0000 7fba0659c640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba08100e20 0x7fba08197410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8006010 tx=0x7fb9f8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.385+0000 7fb9f77fe640 1 -- 172.21.15.73:0/2867487523 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f803f070 con 0x7fba08100e20 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.385+0000 7fb9f77fe640 1 -- 172.21.15.73:0/2867487523 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9f8031c30 con 0x7fba08100e20 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.385+0000 7fba0c848640 1 -- 172.21.15.73:0/2867487523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0819c650 con 0x7fba08100e20 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.385+0000 7fba0c848640 1 -- 172.21.15.73:0/2867487523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba08069f70 con 0x7fba08100e20 2024-09-05T12:58:22.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.386+0000 7fb9f77fe640 1 -- 172.21.15.73:0/2867487523 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8035030 con 0x7fba08100e20 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.388+0000 7fba0ec1e740 1 Processor -- start 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.388+0000 7fba0ec1e740 1 -- start start 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.388+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 0x559ccb7de880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.388+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7dedc0 0x559ccb7e9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.388+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7e9680 0x559ccb7eba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.388+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559ccb7442e0 con 0x559ccb7dedc0 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.388+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559ccb6ebce0 con 0x559ccb7de4a0 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.388+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559ccb7402a0 con 0x559ccb7e9680 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.388+0000 7fb9f77fe640 1 -- 172.21.15.73:0/2867487523 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb9f8042070 con 0x7fba08100e20 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.389+0000 7fba06d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 0x559ccb7de880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.389+0000 7fba05d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7e9680 0x559ccb7eba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.389+0000 7fba06d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 0x559ccb7de880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:32862/0 (socket says 172.21.15.73:32862) 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.389+0000 7fba06d9d640 1 -- 172.21.15.73:0/1401677151 learned_addr learned my addr 172.21.15.73:0/1401677151 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fba0659c640 1 --2- 172.21.15.73:0/1401677151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7dedc0 0x559ccb7e9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fba06d9d640 1 -- 172.21.15.73:0/1401677151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7e9680 msgr2=0x559ccb7eba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fba06d9d640 1 --2- 172.21.15.73:0/1401677151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7e9680 0x559ccb7eba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fba06d9d640 1 -- 172.21.15.73:0/1401677151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7dedc0 msgr2=0x559ccb7e9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fba06d9d640 1 --2- 172.21.15.73:0/1401677151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7dedc0 0x559ccb7e9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fba06d9d640 1 -- 172.21.15.73:0/1401677151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ccb6d0440 con 0x559ccb7de4a0 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fb9f77fe640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9f00a2ad0 0x7fb9f00a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fba05d9b640 1 --2- 172.21.15.73:0/1401677151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7e9680 0x559ccb7eba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fba05d9b640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9f00a2ad0 0x7fb9f00a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fb9f77fe640 1 -- 172.21.15.73:0/2867487523 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb9f80ef400 con 0x7fba08100e20 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fba06d9d640 1 --2- 172.21.15.73:0/1401677151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 0x559ccb7de880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fba00010370 tx=0x7fba00010770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d961907bc42cbd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.390+0000 7fb9f4ff9640 1 -- 172.21.15.73:0/1401677151 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00016070 con 0x559ccb7de4a0 2024-09-05T12:58:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.391+0000 7fb9f4ff9640 1 -- 172.21.15.73:0/1401677151 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba00004d20 con 0x559ccb7de4a0 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.391+0000 7fb9f4ff9640 1 -- 172.21.15.73:0/1401677151 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00012810 con 0x559ccb7de4a0 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.391+0000 7fba0ec1e740 1 -- 172.21.15.73:0/1401677151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 msgr2=0x559ccb7de880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.391+0000 7fba05d9b640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9f00a2ad0 0x7fb9f00a4f90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x559ccb7dbdb0 tx=0x7fb9fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.391+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/1401677151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 0x559ccb7de880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fba00010370 tx=0x7fba00010770 comp rx=0 tx=0).stop 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.392+0000 7fba0ec1e740 1 -- 172.21.15.73:0/1401677151 shutdown_connections 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.392+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/1401677151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7e9680 0x559ccb7eba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.392+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/1401677151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7dedc0 0x559ccb7e9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.392+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/1401677151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 0x559ccb7de880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.392+0000 7fba0ec1e740 1 -- 172.21.15.73:0/1401677151 >> 172.21.15.73:0/1401677151 conn(0x559ccb7daa30 msgr2=0x559ccb7dae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.392+0000 7fba0ec1e740 1 -- 172.21.15.73:0/1401677151 shutdown_connections 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.392+0000 7fba0ec1e740 1 -- 172.21.15.73:0/1401677151 wait complete. 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.392+0000 7fba0ec1e740 1 -- start start 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.392+0000 7fba0ec1e740 1 Processor -- start 2024-09-05T12:58:22.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 0x559ccb7e9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7dedc0 0x559ccb7e6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559ccb7ec250 con 0x559ccb7e9680 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559ccb6ff050 con 0x559ccb7dedc0 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559ccb7ec3d0 con 0x559ccb7de4a0 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba06d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba06d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7e68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36060/0 (socket says 172.21.15.73:36060) 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba06d9d640 1 -- 172.21.15.73:0/2207517146 learned_addr learned my addr 172.21.15.73:0/2207517146 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba05d9b640 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7dedc0 0x559ccb7e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba0659c640 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 0x559ccb7e9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba06d9d640 1 -- 172.21.15.73:0/2207517146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 msgr2=0x559ccb7e9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba06d9d640 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 0x559ccb7e9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba06d9d640 1 -- 172.21.15.73:0/2207517146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7dedc0 msgr2=0x559ccb7e6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba06d9d640 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7dedc0 0x559ccb7e6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba06d9d640 1 -- 172.21.15.73:0/2207517146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ccb4b53c0 con 0x559ccb7e9680 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba0659c640 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 0x559ccb7e9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba0ec1e740 10 client.0 _ll_register_callbacks cb 0x559ccb73f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba0ec1e740 1 -- 172.21.15.73:0/2207517146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba00004d20 con 0x559ccb7e9680 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fba06d9d640 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7e68e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fba00005a10 tx=0x7fba00004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68994696aba4f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.393+0000 7fb9edffb640 10 client.15384 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fb9edffb640 1 -- 172.21.15.73:0/2207517146 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00016070 con 0x559ccb7e9680 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fb9edffb640 1 -- 172.21.15.73:0/2207517146 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fba00012920 con 0x559ccb7e9680 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fb9edffb640 1 -- 172.21.15.73:0/2207517146 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba00012b60 con 0x559ccb7e9680 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fba0ec1e740 10 client.15384 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fba0ec1e740 1 -- 172.21.15.73:0/2207517146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({fsmap=25}) -- 0x559ccb7f6350 con 0x559ccb7e9680 2024-09-05T12:58:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fb9edffb640 1 -- 172.21.15.73:0/2207517146 <== mon.0 v2:172.21.15.73:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba0000f040 con 0x559ccb7e9680 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fba0ec1e740 10 client.15384 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fba0ec1e740 10 client.15384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fba0ec1e740 20 client.15384 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559ccb7f76a0 0x559ccb7f9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.394+0000 7fba0ec1e740 4 client.15384 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.395+0000 7fba0ec1e740 1 -- 172.21.15.73:0/2207517146 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ccb751850 con 0x559ccb7f76a0 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.395+0000 7fba0659c640 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559ccb7f76a0 0x559ccb7f9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.395+0000 7fb9edffb640 10 client.15384 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.395+0000 7fba0659c640 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559ccb7f76a0 0x559ccb7f9b30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca2285981873e75 server_cookie=7e8c71dbf2de47a5 in_seq=0 out_seq=0 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fb9edffb640 1 -- 172.21.15.73:0/2207517146 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ccb751850 con 0x559ccb7f76a0 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fb9edffb640 10 client.15384 handle_command_reply: tid=0 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 client.15384 shutdown 2024-09-05T12:58:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 -- 172.21.15.73:0/2207517146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 msgr2=0x559ccb7e68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7e68e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fba00005a10 tx=0x7fba00004c70 comp rx=0 tx=0).stop 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 -- 172.21.15.73:0/2207517146 shutdown_connections 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559ccb7f76a0 0x559ccb7f9b30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fb9edffb640 0 client.15384 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7e68e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7dedc0 0x559ccb7e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/2207517146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 0x559ccb7e9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 -- 172.21.15.73:0/2207517146 >> 172.21.15.73:0/2207517146 conn(0x559ccb7daa30 msgr2=0x559ccb7e0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 -- 172.21.15.73:0/2207517146 shutdown_connections 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 1 -- 172.21.15.73:0/2207517146 wait complete. 2024-09-05T12:58:22.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.396+0000 7fba0ec1e740 20 client.15384 trim_cache size 0 max 16384 2024-09-05T12:58:22.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.423+0000 7fba0ec1e740 1 Processor -- start 2024-09-05T12:58:22.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.423+0000 7fba0ec1e740 1 -- start start 2024-09-05T12:58:22.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.423+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 0x559ccb7f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.423+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7dedc0 0x559ccb8053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.423+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb805900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.423+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fba081ad890 con 0x559ccb7e9680 2024-09-05T12:58:22.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.423+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba081ab160 con 0x559ccb7de4a0 2024-09-05T12:58:22.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.423+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba081a8fd0 con 0x559ccb7dedc0 2024-09-05T12:58:22.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba06d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb805900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba06d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb805900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36062/0 (socket says 172.21.15.73:36062) 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba06d9d640 1 -- 172.21.15.73:0/3910048616 learned_addr learned my addr 172.21.15.73:0/3910048616 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba05d9b640 1 --2- 172.21.15.73:0/3910048616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7dedc0 0x559ccb8053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba0659c640 1 --2- 172.21.15.73:0/3910048616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 0x559ccb7f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba06d9d640 1 -- 172.21.15.73:0/3910048616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7dedc0 msgr2=0x559ccb8053c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba06d9d640 1 --2- 172.21.15.73:0/3910048616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7dedc0 0x559ccb8053c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba06d9d640 1 -- 172.21.15.73:0/3910048616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 msgr2=0x559ccb7f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba06d9d640 1 --2- 172.21.15.73:0/3910048616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 0x559ccb7f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba06d9d640 1 -- 172.21.15.73:0/3910048616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ccb7e4860 con 0x559ccb7e9680 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fba06d9d640 1 --2- 172.21.15.73:0/3910048616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb805900 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fba00009ef0 tx=0x7fba00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa35fabc52eb6a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fb9effff640 1 -- 172.21.15.73:0/3910048616 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00009bb0 con 0x559ccb7e9680 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fb9effff640 1 -- 172.21.15.73:0/3910048616 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba00004d20 con 0x559ccb7e9680 2024-09-05T12:58:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.424+0000 7fb9effff640 1 -- 172.21.15.73:0/3910048616 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba000053c0 con 0x559ccb7e9680 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.425+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3910048616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 msgr2=0x559ccb805900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.425+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/3910048616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb805900 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fba00009ef0 tx=0x7fba00016000 comp rx=0 tx=0).stop 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.425+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3910048616 shutdown_connections 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.425+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/3910048616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb805900 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.425+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/3910048616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7dedc0 0x559ccb8053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.425+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/3910048616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7de4a0 0x559ccb7f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.425+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3910048616 >> 172.21.15.73:0/3910048616 conn(0x559ccb7daa30 msgr2=0x559ccb7e8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.425+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3910048616 shutdown_connections 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.425+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3910048616 wait complete. 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.425+0000 7fba0ec1e740 1 -- start start 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0ec1e740 1 Processor -- start 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 0x559ccb7f1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7dedc0 0x559ccb7f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0ec1e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fba081a9620 con 0x559ccb7e9680 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba081aaa90 con 0x559ccb7dedc0 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0ec1e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba081a9cf0 con 0x559ccb7de4a0 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0ec1e740 10 client.0 _ll_register_callbacks cb 0x7fb9f80f2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba06d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 0x559ccb7f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba05d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7dedc0 0x559ccb7f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 0x559ccb7f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:41802/0 (socket says 172.21.15.73:41802) 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba0659c640 1 -- 172.21.15.73:0/3821904803 learned_addr learned my addr 172.21.15.73:0/3821904803 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba06d9d640 1 -- 172.21.15.73:0/3821904803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 msgr2=0x559ccb7f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba06d9d640 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 0x559ccb7f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba06d9d640 1 -- 172.21.15.73:0/3821904803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7dedc0 msgr2=0x559ccb7f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba06d9d640 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7dedc0 0x559ccb7f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.426+0000 7fba06d9d640 1 -- 172.21.15.73:0/3821904803 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ccb7ed5a0 con 0x559ccb7e9680 2024-09-05T12:58:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.427+0000 7fba06d9d640 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7ecd70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fba0001acb0 tx=0x7fba0001a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b778524a9ae6b26b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.427+0000 7fb9edffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.427+0000 7fb9edffb640 1 -- 172.21.15.73:0/3821904803 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0004f060 con 0x559ccb7e9680 2024-09-05T12:58:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.427+0000 7fb9edffb640 1 -- 172.21.15.73:0/3821904803 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fba00047070 con 0x559ccb7e9680 2024-09-05T12:58:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.427+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3821904803 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba00004d20 con 0x559ccb7e9680 2024-09-05T12:58:22.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.427+0000 7fb9edffb640 1 -- 172.21.15.73:0/3821904803 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba000124a0 con 0x559ccb7e9680 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.427+0000 7fba0ec1e740 10 client.15390 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.427+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3821904803 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559ccb863f80 con 0x559ccb7e9680 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.428+0000 7fb9edffb640 1 -- 172.21.15.73:0/3821904803 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba00009bb0 con 0x559ccb7e9680 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.428+0000 7fb9edffb640 1 -- 172.21.15.73:0/3821904803 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba0001ace0 con 0x559ccb7e9680 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.428+0000 7fba0ec1e740 10 client.15390 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.428+0000 7fba0ec1e740 10 client.15390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.428+0000 7fba0ec1e740 20 client.15390 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.428+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559ccb7f76a0 0x559ccb866540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.428+0000 7fba0ec1e740 4 client.15390 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.428+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3821904803 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fba00004d20 con 0x559ccb7f76a0 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.428+0000 7fba0659c640 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559ccb7f76a0 0x559ccb866540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fb9edffb640 10 client.15390 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0659c640 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559ccb7f76a0 0x559ccb866540 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=928005505bbc1c96 server_cookie=973a70ab9e8ebabd in_seq=0 out_seq=0 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fb9edffb640 1 -- 172.21.15.73:0/3821904803 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fba00004d20 con 0x559ccb7f76a0 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fb9edffb640 10 client.15390 handle_command_reply: tid=0 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0ec1e740 1 client.15390 shutdown 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3821904803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 msgr2=0x559ccb7ecd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7ecd70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fba0001acb0 tx=0x7fba0001a620 comp rx=0 tx=0).stop 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3821904803 shutdown_connections 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559ccb7f76a0 0x559ccb866540 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fb9edffb640 0 client.15390 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ccb7e9680 0x559ccb7ecd70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccb7dedc0 0x559ccb7f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0ec1e740 1 --2- 172.21.15.73:0/3821904803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ccb7de4a0 0x559ccb7f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3821904803 >> 172.21.15.73:0/3821904803 conn(0x559ccb7daa30 msgr2=0x559ccb7d9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.429+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3821904803 shutdown_connections 2024-09-05T12:58:22.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0ec1e740 1 -- 172.21.15.73:0/3821904803 wait complete. 2024-09-05T12:58:22.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0ec1e740 20 client.15390 trim_cache size 0 max 16384 2024-09-05T12:58:22.436 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:58:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2024-09-05T12:58:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2024-09-05T12:58:22.436 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:58:22.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0c848640 1 -- 172.21.15.73:0/2867487523 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9f00a2ad0 msgr2=0x7fb9f00a4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:22.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0c848640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9f00a2ad0 0x7fb9f00a4f90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x559ccb7dbdb0 tx=0x7fb9fc00b390 comp rx=0 tx=0).stop 2024-09-05T12:58:22.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0c848640 1 -- 172.21.15.73:0/2867487523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba08100e20 msgr2=0x7fba08197410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:22.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0c848640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba08100e20 0x7fba08197410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8006010 tx=0x7fb9f8003c10 comp rx=0 tx=0).stop 2024-09-05T12:58:22.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0c848640 1 -- 172.21.15.73:0/2867487523 shutdown_connections 2024-09-05T12:58:22.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0c848640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb9f00a2ad0 0x7fb9f00a4f90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0c848640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba08102ef0 0x7fba0819bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0c848640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba08102570 0x7fba08197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0c848640 1 --2- 172.21.15.73:0/2867487523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba08100e20 0x7fba08197410 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:22.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.430+0000 7fba0c848640 1 -- 172.21.15.73:0/2867487523 >> 172.21.15.73:0/2867487523 conn(0x7fba080fc7d0 msgr2=0x7fba080fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:22.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.431+0000 7fba0c848640 1 -- 172.21.15.73:0/2867487523 shutdown_connections 2024-09-05T12:58:22.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:22.431+0000 7fba0c848640 1 -- 172.21.15.73:0/2867487523 wait complete. 2024-09-05T12:58:23.201 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T12:58:23.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:58:23.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:23 smithi162 ceph-mon[34220]: pgmap v349: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:58:23.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:23 smithi169 ceph-mon[34823]: pgmap v349: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:58:23.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:23 smithi073 ceph-mon[30883]: pgmap v349: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:58:23.566 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:24.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.092+0000 7fc349a7d640 1 -- 172.21.15.73:0/3186110437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3441082a0 msgr2=0x7fc34410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:24.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.092+0000 7fc349a7d640 1 --2- 172.21.15.73:0/3186110437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3441082a0 0x7fc34410ec40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009c10 tx=0x7fc33c02a6e0 comp rx=0 tx=0).stop 2024-09-05T12:58:24.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.092+0000 7fc349a7d640 1 -- 172.21.15.73:0/3186110437 shutdown_connections 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.092+0000 7fc349a7d640 1 --2- 172.21.15.73:0/3186110437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3441082a0 0x7fc34410ec40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.093+0000 7fc349a7d640 1 --2- 172.21.15.73:0/3186110437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3441036e0 0x7fc344107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.093+0000 7fc349a7d640 1 --2- 172.21.15.73:0/3186110437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc344102d30 0x7fc344103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.093+0000 7fc349a7d640 1 -- 172.21.15.73:0/3186110437 >> 172.21.15.73:0/3186110437 conn(0x7fc3440fc7d0 msgr2=0x7fc3440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.093+0000 7fc349a7d640 1 -- 172.21.15.73:0/3186110437 shutdown_connections 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.093+0000 7fc349a7d640 1 -- 172.21.15.73:0/3186110437 wait complete. 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.093+0000 7fc349a7d640 1 Processor -- start 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc349a7d640 1 -- start start 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc349a7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc344102d30 0x7fc3441a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc349a7d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3441036e0 0x7fc3441a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc349a7d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3441082a0 0x7fc34410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc3437fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc344102d30 0x7fc3441a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc3437fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc344102d30 0x7fc3441a4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56690/0 (socket says 172.21.15.73:56690) 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc3437fe640 1 -- 172.21.15.73:0/2167038342 learned_addr learned my addr 172.21.15.73:0/2167038342 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc344112050 con 0x7fc344102d30 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc344111ed0 con 0x7fc3441036e0 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3441121d0 con 0x7fc3441082a0 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc342ffd640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3441036e0 0x7fc3441a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.094+0000 7fc343fff640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3441082a0 0x7fc34410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.095+0000 7fc342ffd640 1 -- 172.21.15.73:0/2167038342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3441082a0 msgr2=0x7fc34410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.095+0000 7fc342ffd640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3441082a0 0x7fc34410de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.095+0000 7fc342ffd640 1 -- 172.21.15.73:0/2167038342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc344102d30 msgr2=0x7fc3441a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.095+0000 7fc342ffd640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc344102d30 0x7fc3441a4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.095+0000 7fc342ffd640 1 -- 172.21.15.73:0/2167038342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34410e5a0 con 0x7fc3441036e0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.095+0000 7fc342ffd640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3441036e0 0x7fc3441a4da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc3440697d0 tx=0x7fc33800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.097+0000 7fc340ff9640 1 -- 172.21.15.73:0/2167038342 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33800cc40 con 0x7fc3441036e0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.097+0000 7fc340ff9640 1 -- 172.21.15.73:0/2167038342 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc33800cde0 con 0x7fc3441036e0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.097+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34410e890 con 0x7fc3441036e0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.097+0000 7fc340ff9640 1 -- 172.21.15.73:0/2167038342 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3380188e0 con 0x7fc3441036e0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.097+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3441ab730 con 0x7fc3441036e0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.098+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc344103110 con 0x7fc3441036e0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.100+0000 7fc340ff9640 1 -- 172.21.15.73:0/2167038342 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc338010430 con 0x7fc3441036e0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.100+0000 7fc340ff9640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc32c0a2c00 0x7fc32c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.100+0000 7fc340ff9640 1 -- 172.21.15.73:0/2167038342 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc3380cf200 con 0x7fc3441036e0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.100+0000 7fc3437fe640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc32c0a2c00 0x7fc32c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.101+0000 7fc3437fe640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc32c0a2c00 0x7fc32c0a50c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc34410efb0 tx=0x7fc334009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:24.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.105+0000 7fc340ff9640 1 -- 172.21.15.73:0/2167038342 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc33809bb40 con 0x7fc3441036e0 2024-09-05T12:58:24.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.316+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc34419ff50 con 0x7fc3441036e0 2024-09-05T12:58:24.318 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:58:24.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.317+0000 7fc340ff9640 1 -- 172.21.15.73:0/2167038342 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11926 (secure 0 0 0) 0x7fc33809fe40 con 0x7fc3441036e0 2024-09-05T12:58:24.318 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 25 2024-09-05T12:58:24.319 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"btime":"2024-09-05T12:57:30:110632+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:57:30.060424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2325276065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2325276065},{"type":"v1","addr":"172.21.15.169:6837","nonce":2325276065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T12:58:24.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc32c0a2c00 msgr2=0x7fc32c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:24.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc32c0a2c00 0x7fc32c0a50c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc34410efb0 tx=0x7fc334009260 comp rx=0 tx=0).stop 2024-09-05T12:58:24.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3441036e0 msgr2=0x7fc3441a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:24.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3441036e0 0x7fc3441a4da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc3440697d0 tx=0x7fc33800ee50 comp rx=0 tx=0).stop 2024-09-05T12:58:24.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 shutdown_connections 2024-09-05T12:58:24.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc32c0a2c00 0x7fc32c0a50c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:24.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3441082a0 0x7fc34410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:24.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3441036e0 0x7fc3441a4da0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:24.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 --2- 172.21.15.73:0/2167038342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc344102d30 0x7fc3441a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:24.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 >> 172.21.15.73:0/2167038342 conn(0x7fc3440fc7d0 msgr2=0x7fc344103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:24.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 shutdown_connections 2024-09-05T12:58:24.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:24.319+0000 7fc349a7d640 1 -- 172.21.15.73:0/2167038342 wait complete. 2024-09-05T12:58:24.952 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T12:58:25.224 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:25 smithi073 ceph-mon[30883]: pgmap v350: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:58:25.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:25 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2167038342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:58:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:25 smithi162 ceph-mon[34220]: pgmap v350: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:58:25.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:25 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2167038342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:58:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:25 smithi169 ceph-mon[34823]: pgmap v350: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-05T12:58:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:25 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2167038342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:58:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.721+0000 7fd8b0451640 1 -- 172.21.15.73:0/859568722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8a8102570 msgr2=0x7fd8a81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.722+0000 7fd8b0451640 1 --2- 172.21.15.73:0/859568722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8a8102570 0x7fd8a81029b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd898009900 tx=0x7fd89802a480 comp rx=0 tx=0).stop 2024-09-05T12:58:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.722+0000 7fd8b0451640 1 -- 172.21.15.73:0/859568722 shutdown_connections 2024-09-05T12:58:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.722+0000 7fd8b0451640 1 --2- 172.21.15.73:0/859568722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a8102ef0 0x7fd8a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.722+0000 7fd8b0451640 1 --2- 172.21.15.73:0/859568722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8a8102570 0x7fd8a81029b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.722+0000 7fd8b0451640 1 --2- 172.21.15.73:0/859568722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a8100e20 0x7fd8a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.722+0000 7fd8b0451640 1 -- 172.21.15.73:0/859568722 >> 172.21.15.73:0/859568722 conn(0x7fd8a80fc7d0 msgr2=0x7fd8a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:25.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.722+0000 7fd8b0451640 1 -- 172.21.15.73:0/859568722 shutdown_connections 2024-09-05T12:58:25.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.722+0000 7fd8b0451640 1 -- 172.21.15.73:0/859568722 wait complete. 2024-09-05T12:58:25.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.722+0000 7fd8b0451640 1 Processor -- start 2024-09-05T12:58:25.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8b0451640 1 -- start start 2024-09-05T12:58:25.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8b0451640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8a8100e20 0x7fd8a8197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8b0451640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a8102570 0x7fd8a8197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8b0451640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a8102ef0 0x7fd8a819bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8b0451640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a8110f80 con 0x7fd8a8100e20 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8b0451640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a8110e00 con 0x7fd8a8102570 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8b0451640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a8111100 con 0x7fd8a8102ef0 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8ae1ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8a8100e20 0x7fd8a8197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8ae1ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8a8100e20 0x7fd8a8197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56710/0 (socket says 172.21.15.73:56710) 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8ae1ed640 1 -- 172.21.15.73:0/1340829322 learned_addr learned my addr 172.21.15.73:0/1340829322 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8ad9ec640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a8102570 0x7fd8a8197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8ae1ed640 1 -- 172.21.15.73:0/1340829322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a8102ef0 msgr2=0x7fd8a819bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a8102ef0 0x7fd8a819bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8ae1ed640 1 -- 172.21.15.73:0/1340829322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a8102570 msgr2=0x7fd8a8197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a8102570 0x7fd8a8197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8ae1ed640 1 -- 172.21.15.73:0/1340829322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a819c3b0 con 0x7fd8a8100e20 2024-09-05T12:58:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.723+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8a8100e20 0x7fd8a8197400 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400d770 tx=0x7fd8a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.724+0000 7fd89f7fe640 1 -- 172.21.15.73:0/1340829322 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4017070 con 0x7fd8a8100e20 2024-09-05T12:58:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.724+0000 7fd89f7fe640 1 -- 172.21.15.73:0/1340829322 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8a4005500 con 0x7fd8a8100e20 2024-09-05T12:58:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.724+0000 7fd8b0451640 1 -- 172.21.15.73:0/1340829322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a819c6a0 con 0x7fd8a8100e20 2024-09-05T12:58:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.724+0000 7fd89f7fe640 1 -- 172.21.15.73:0/1340829322 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4004e00 con 0x7fd8a8100e20 2024-09-05T12:58:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.724+0000 7fd8b0451640 1 -- 172.21.15.73:0/1340829322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a81a3f80 con 0x7fd8a8100e20 2024-09-05T12:58:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.726+0000 7fd89f7fe640 1 -- 172.21.15.73:0/1340829322 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd8a4004fa0 con 0x7fd8a8100e20 2024-09-05T12:58:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.726+0000 7fd8b2827740 1 Processor -- start 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8b2827740 1 -- start start 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc13b80 0x55ee9bc12090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc125d0 0x55ee9bc12a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc1f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8b2827740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ee9bb782f0 con 0x55ee9bc1d370 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8b2827740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ee9bb1fcf0 con 0x55ee9bc125d0 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8b2827740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ee9bb742b0 con 0x55ee9bc13b80 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8ae9ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc13b80 0x55ee9bc12090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8ad9ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc1f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8ae9ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc13b80 0x55ee9bc12090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:44544/0 (socket says 172.21.15.73:44544) 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/1948375674 learned_addr learned my addr 172.21.15.73:0/1948375674 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.727+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/1948375674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc125d0 0x55ee9bc12a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd89f7fe640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd8940a2c00 0x7fd8940a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/1948375674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc125d0 msgr2=0x55ee9bc12a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:25.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/1948375674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc125d0 0x55ee9bc12a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/1948375674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 msgr2=0x55ee9bc1f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:25.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/1948375674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc1f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/1948375674 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee9bb043a0 con 0x55ee9bc13b80 2024-09-05T12:58:25.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd8940a2c00 0x7fd8940a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd89f7fe640 1 -- 172.21.15.73:0/1340829322 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd8a40ce690 con 0x7fd8a8100e20 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/1948375674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc13b80 0x55ee9bc12090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009c90 tx=0x7fd8a000e850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3584e85e7b7b7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd8ad9ec640 1 --2- 172.21.15.73:0/1948375674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc1f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd89cdec640 1 -- 172.21.15.73:0/1948375674 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000c460 con 0x55ee9bc13b80 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd89cdec640 1 -- 172.21.15.73:0/1948375674 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8a000cb60 con 0x55ee9bc13b80 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.728+0000 7fd89cdec640 1 -- 172.21.15.73:0/1948375674 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0018c10 con 0x55ee9bc13b80 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.729+0000 7fd8b2827740 1 -- 172.21.15.73:0/1948375674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc13b80 msgr2=0x55ee9bc12090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.729+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd8940a2c00 0x7fd8940a50c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd8a001c000 tx=0x7fd8a0017760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.729+0000 7fd8b2827740 1 --2- 172.21.15.73:0/1948375674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc13b80 0x55ee9bc12090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009c90 tx=0x7fd8a000e850 comp rx=0 tx=0).stop 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.729+0000 7fd8b2827740 1 -- 172.21.15.73:0/1948375674 shutdown_connections 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.729+0000 7fd8b2827740 1 --2- 172.21.15.73:0/1948375674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc1f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.729+0000 7fd8b2827740 1 --2- 172.21.15.73:0/1948375674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc125d0 0x55ee9bc12a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.729+0000 7fd8b2827740 1 --2- 172.21.15.73:0/1948375674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc13b80 0x55ee9bc12090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.729+0000 7fd8b2827740 1 -- 172.21.15.73:0/1948375674 >> 172.21.15.73:0/1948375674 conn(0x55ee9bbdb310 msgr2=0x55ee9bc0ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.729+0000 7fd8b2827740 1 -- 172.21.15.73:0/1948375674 shutdown_connections 2024-09-05T12:58:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.729+0000 7fd8b2827740 1 -- 172.21.15.73:0/1948375674 wait complete. 2024-09-05T12:58:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8b2827740 1 -- start start 2024-09-05T12:58:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8b2827740 1 Processor -- start 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc125d0 0x55ee9bc1cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc19fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc1d370 0x55ee9bc1a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8b2827740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ee9bc20070 con 0x55ee9bc125d0 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8b2827740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ee9bb33060 con 0x55ee9bc13b80 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8b2827740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ee9bc201f0 con 0x55ee9bc1d370 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8ae1ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc125d0 0x55ee9bc1cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8b2827740 10 client.0 _ll_register_callbacks cb 0x55ee9b8868c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8ae1ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc125d0 0x55ee9bc1cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56718/0 (socket says 172.21.15.73:56718) 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.730+0000 7fd8ae1ed640 1 -- 172.21.15.73:0/1459755264 learned_addr learned my addr 172.21.15.73:0/1459755264 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc1d370 0x55ee9bc1a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd8ad9ec640 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc19fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/1459755264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 msgr2=0x55ee9bc19fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc19fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/1459755264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc125d0 msgr2=0x55ee9bc1cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc125d0 0x55ee9bc1cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/1459755264 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee9b8e93c0 con 0x55ee9bc1d370 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc125d0 0x55ee9bc1cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc1d370 0x55ee9bc1a530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009240 tx=0x7fd8a0024000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d43df6c90f470b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd891ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd891ffb640 1 -- 172.21.15.73:0/1459755264 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0032020 con 0x55ee9bc1d370 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd8b2827740 1 -- 172.21.15.73:0/1459755264 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8a000cb60 con 0x55ee9bc1d370 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd891ffb640 1 -- 172.21.15.73:0/1459755264 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd8a0017e30 con 0x55ee9bc1d370 2024-09-05T12:58:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.731+0000 7fd891ffb640 1 -- 172.21.15.73:0/1459755264 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd8a0009920 con 0x55ee9bc1d370 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd8b2827740 10 client.25027 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd8b2827740 1 -- 172.21.15.73:0/1459755264 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ee9bc2baa0 con 0x55ee9bc1d370 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd891ffb640 1 -- 172.21.15.73:0/1459755264 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8a000cb60 con 0x55ee9bc1d370 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd891ffb640 1 -- 172.21.15.73:0/1459755264 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd8a000c4f0 con 0x55ee9bc1d370 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd8b2827740 10 client.25027 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd8b2827740 10 client.25027 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd8b2827740 20 client.25027 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd8b2827740 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55ee9bc2cf60 0x55ee9bc2f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd8b2827740 4 client.25027 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd8b2827740 1 -- 172.21.15.73:0/1459755264 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee9bb85860 con 0x55ee9bc2cf60 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.732+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55ee9bc2cf60 0x55ee9bc2f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.733+0000 7fd891ffb640 10 client.25027 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.733+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55ee9bc2cf60 0x55ee9bc2f350 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5da849d930710c0a server_cookie=af51d26f0c58621c in_seq=0 out_seq=0 2024-09-05T12:58:25.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd891ffb640 1 -- 172.21.15.73:0/1459755264 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee9bb85860 con 0x55ee9bc2cf60 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd891ffb640 10 client.25027 handle_command_reply: tid=0 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 client.25027 shutdown 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 -- 172.21.15.73:0/1459755264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc1d370 msgr2=0x55ee9bc1a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc1d370 0x55ee9bc1a530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009240 tx=0x7fd8a0024000 comp rx=0 tx=0).stop 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 -- 172.21.15.73:0/1459755264 shutdown_connections 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55ee9bc2cf60 0x55ee9bc2f350 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc1d370 0x55ee9bc1a530 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd891ffb640 0 client.25027 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc19fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 --2- 172.21.15.73:0/1459755264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc125d0 0x55ee9bc1cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 -- 172.21.15.73:0/1459755264 >> 172.21.15.73:0/1459755264 conn(0x55ee9bbdb310 msgr2=0x55ee9bc149a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 -- 172.21.15.73:0/1459755264 shutdown_connections 2024-09-05T12:58:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 1 -- 172.21.15.73:0/1459755264 wait complete. 2024-09-05T12:58:25.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.734+0000 7fd8b2827740 20 client.25027 trim_cache size 0 max 16384 2024-09-05T12:58:25.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8b2827740 1 Processor -- start 2024-09-05T12:58:25.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8b2827740 1 -- start start 2024-09-05T12:58:25.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc125d0 0x55ee9bc29310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc15160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc156a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8b2827740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81adc00 con 0x55ee9bc1d370 2024-09-05T12:58:25.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8b2827740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81ab4d0 con 0x55ee9bc13b80 2024-09-05T12:58:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8b2827740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81a9340 con 0x55ee9bc125d0 2024-09-05T12:58:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8ae9ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8ae9ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc156a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56732/0 (socket says 172.21.15.73:56732) 2024-09-05T12:58:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.747+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/660658743 learned_addr learned my addr 172.21.15.73:0/660658743 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd8ad9ec640 1 --2- 172.21.15.73:0/660658743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc15160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/660658743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc125d0 0x55ee9bc29310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/660658743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc125d0 msgr2=0x55ee9bc29310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/660658743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc125d0 0x55ee9bc29310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/660658743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 msgr2=0x55ee9bc15160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/660658743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc15160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/660658743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee9bc133d0 con 0x55ee9bc1d370 2024-09-05T12:58:25.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/660658743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc156a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000ca10 tx=0x7fd8a00094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccca3726acb2561 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:25.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd893fff640 1 -- 172.21.15.73:0/660658743 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0018600 con 0x55ee9bc1d370 2024-09-05T12:58:25.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd893fff640 1 -- 172.21.15.73:0/660658743 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8a003d070 con 0x55ee9bc1d370 2024-09-05T12:58:25.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.748+0000 7fd893fff640 1 -- 172.21.15.73:0/660658743 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000ca90 con 0x55ee9bc1d370 2024-09-05T12:58:25.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.749+0000 7fd8b2827740 1 -- 172.21.15.73:0/660658743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 msgr2=0x55ee9bc156a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:25.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.749+0000 7fd8b2827740 1 --2- 172.21.15.73:0/660658743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc156a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000ca10 tx=0x7fd8a00094e0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.749+0000 7fd8b2827740 1 -- 172.21.15.73:0/660658743 shutdown_connections 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.749+0000 7fd8b2827740 1 --2- 172.21.15.73:0/660658743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc156a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.749+0000 7fd8b2827740 1 --2- 172.21.15.73:0/660658743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc15160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.749+0000 7fd8b2827740 1 --2- 172.21.15.73:0/660658743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc125d0 0x55ee9bc29310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.749+0000 7fd8b2827740 1 -- 172.21.15.73:0/660658743 >> 172.21.15.73:0/660658743 conn(0x55ee9bbdb310 msgr2=0x55ee9bc190a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.749+0000 7fd8b2827740 1 -- 172.21.15.73:0/660658743 shutdown_connections 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.749+0000 7fd8b2827740 1 -- 172.21.15.73:0/660658743 wait complete. 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8b2827740 1 -- start start 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8b2827740 1 Processor -- start 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc125d0 0x55ee9bc25810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc25d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8b2827740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc20d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8b2827740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81a9990 con 0x55ee9bc1d370 2024-09-05T12:58:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8b2827740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81aae00 con 0x55ee9bc13b80 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8b2827740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81aa060 con 0x55ee9bc125d0 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8b2827740 10 client.0 _ll_register_callbacks cb 0x7fd8a0027070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8ae9ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc20d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8ae9ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc20d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56734/0 (socket says 172.21.15.73:56734) 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/3885715821 learned_addr learned my addr 172.21.15.73:0/3885715821 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc125d0 0x55ee9bc25810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8ad9ec640 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc25d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/3885715821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc125d0 msgr2=0x55ee9bc25810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc125d0 0x55ee9bc25810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/3885715821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 msgr2=0x55ee9bc25d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc25d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.750+0000 7fd8ae9ee640 1 -- 172.21.15.73:0/3885715821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee9bc0f960 con 0x55ee9bc1d370 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.751+0000 7fd8ae9ee640 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc20d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00092f0 tx=0x7fd8a0018da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5589c016374f634 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.751+0000 7fd891ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.751+0000 7fd891ffb640 1 -- 172.21.15.73:0/3885715821 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0046030 con 0x55ee9bc1d370 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.751+0000 7fd891ffb640 1 -- 172.21.15.73:0/3885715821 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd8a0014040 con 0x55ee9bc1d370 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.751+0000 7fd8b2827740 1 -- 172.21.15.73:0/3885715821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8a003d070 con 0x55ee9bc1d370 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.751+0000 7fd891ffb640 1 -- 172.21.15.73:0/3885715821 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd8a0009920 con 0x55ee9bc1d370 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.751+0000 7fd8b2827740 10 client.15414 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.751+0000 7fd8b2827740 1 -- 172.21.15.73:0/3885715821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ee9bc973d0 con 0x55ee9bc1d370 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.751+0000 7fd891ffb640 1 -- 172.21.15.73:0/3885715821 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8a003d070 con 0x55ee9bc1d370 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.751+0000 7fd891ffb640 1 -- 172.21.15.73:0/3885715821 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd8a0003970 con 0x55ee9bc1d370 2024-09-05T12:58:25.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd8b2827740 10 client.15414 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd8b2827740 10 client.15414 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd8b2827740 20 client.15414 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd8b2827740 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55ee9bc979f0 0x55ee9bc99de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd8b2827740 4 client.15414 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd8b2827740 1 -- 172.21.15.73:0/3885715821 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee9bb7fd70 con 0x55ee9bc979f0 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55ee9bc979f0 0x55ee9bc99de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd891ffb640 10 client.15414 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd8ae1ed640 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55ee9bc979f0 0x55ee9bc99de0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52caca09b4029ec4 server_cookie=2a6e990adc498d01 in_seq=0 out_seq=0 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd891ffb640 1 -- 172.21.15.73:0/3885715821 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee9bb7fd70 con 0x55ee9bc979f0 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd891ffb640 10 client.15414 handle_command_reply: tid=0 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.752+0000 7fd8b2827740 1 client.15414 shutdown 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 1 -- 172.21.15.73:0/3885715821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 msgr2=0x55ee9bc20d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:25.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc20d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00092f0 tx=0x7fd8a0018da0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 1 -- 172.21.15.73:0/3885715821 shutdown_connections 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee9bc1d370 0x55ee9bc20d90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee9bc13b80 0x55ee9bc25d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55ee9bc979f0 0x55ee9bc99de0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 1 --2- 172.21.15.73:0/3885715821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee9bc125d0 0x55ee9bc25810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 1 -- 172.21.15.73:0/3885715821 >> 172.21.15.73:0/3885715821 conn(0x55ee9bbdb310 msgr2=0x55ee9bc1b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd891ffb640 0 client.15414 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 1 -- 172.21.15.73:0/3885715821 shutdown_connections 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 1 -- 172.21.15.73:0/3885715821 wait complete. 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b2827740 20 client.15414 trim_cache size 0 max 16384 2024-09-05T12:58:25.759 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T12:58:25.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b0451640 1 -- 172.21.15.73:0/1340829322 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd8940a2c00 msgr2=0x7fd8940a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:25.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b0451640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd8940a2c00 0x7fd8940a50c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd8a001c000 tx=0x7fd8a0017760 comp rx=0 tx=0).stop 2024-09-05T12:58:25.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b0451640 1 -- 172.21.15.73:0/1340829322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8a8100e20 msgr2=0x7fd8a8197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:25.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b0451640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8a8100e20 0x7fd8a8197400 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400d770 tx=0x7fd8a400dc30 comp rx=0 tx=0).stop 2024-09-05T12:58:25.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b0451640 1 -- 172.21.15.73:0/1340829322 shutdown_connections 2024-09-05T12:58:25.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b0451640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd8940a2c00 0x7fd8940a50c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b0451640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a8102ef0 0x7fd8a819bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b0451640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a8102570 0x7fd8a8197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b0451640 1 --2- 172.21.15.73:0/1340829322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8a8100e20 0x7fd8a8197400 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:25.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.753+0000 7fd8b0451640 1 -- 172.21.15.73:0/1340829322 >> 172.21.15.73:0/1340829322 conn(0x7fd8a80fc7d0 msgr2=0x7fd8a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:25.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.754+0000 7fd8b0451640 1 -- 172.21.15.73:0/1340829322 shutdown_connections 2024-09-05T12:58:25.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:25.754+0000 7fd8b0451640 1 -- 172.21.15.73:0/1340829322 wait complete. 2024-09-05T12:58:26.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T12:58:26.733 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:27.108 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:27 smithi073 ceph-mon[30883]: pgmap v351: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-05T12:58:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 -- 172.21.15.73:0/2346174601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c54102ef0 msgr2=0x7f3c5410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 --2- 172.21.15.73:0/2346174601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c54102ef0 0x7f3c5410da40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009ca0 tx=0x7f3c4c02a950 comp rx=0 tx=0).stop 2024-09-05T12:58:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 -- 172.21.15.73:0/2346174601 shutdown_connections 2024-09-05T12:58:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 --2- 172.21.15.73:0/2346174601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c54102ef0 0x7f3c5410da40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 --2- 172.21.15.73:0/2346174601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c54102570 0x7f3c541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 --2- 172.21.15.73:0/2346174601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c54100e20 0x7f3c54101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 -- 172.21.15.73:0/2346174601 >> 172.21.15.73:0/2346174601 conn(0x7f3c540fc7d0 msgr2=0x7f3c540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 -- 172.21.15.73:0/2346174601 shutdown_connections 2024-09-05T12:58:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 -- 172.21.15.73:0/2346174601 wait complete. 2024-09-05T12:58:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 Processor -- start 2024-09-05T12:58:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.323+0000 7f3c5b752640 1 -- start start 2024-09-05T12:58:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c5b752640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c54100e20 0x7f3c541983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c5b752640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c54102570 0x7f3c54198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c5b752640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c54102ef0 0x7f3c5419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c5b752640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3c54110f80 con 0x7f3c54100e20 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c5b752640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c54110e00 con 0x7f3c54102ef0 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c5b752640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c54111100 con 0x7f3c54102570 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c594ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c54100e20 0x7f3c541983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c594ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c54100e20 0x7f3c541983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56754/0 (socket says 172.21.15.73:56754) 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c594ee640 1 -- 172.21.15.73:0/3867465125 learned_addr learned my addr 172.21.15.73:0/3867465125 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c58ced640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c54102570 0x7f3c54198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c59cef640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c54102ef0 0x7f3c5419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c594ee640 1 -- 172.21.15.73:0/3867465125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c54102570 msgr2=0x7f3c54198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c594ee640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c54102570 0x7f3c54198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c594ee640 1 -- 172.21.15.73:0/3867465125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c54102ef0 msgr2=0x7f3c5419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c594ee640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c54102ef0 0x7f3c5419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c594ee640 1 -- 172.21.15.73:0/3867465125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5419d3a0 con 0x7f3c54100e20 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c58ced640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c54102570 0x7f3c54198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c594ee640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c54100e20 0x7f3c541983f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400c920 tx=0x7f3c4400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.324+0000 7f3c4a7fc640 1 -- 172.21.15.73:0/3867465125 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44007c70 con 0x7f3c54100e20 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.325+0000 7f3c5b752640 1 -- 172.21.15.73:0/3867465125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5419d690 con 0x7f3c54100e20 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.325+0000 7f3c4a7fc640 1 -- 172.21.15.73:0/3867465125 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c44007e10 con 0x7f3c54100e20 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.325+0000 7f3c4a7fc640 1 -- 172.21.15.73:0/3867465125 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44018890 con 0x7f3c54100e20 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.325+0000 7f3c5b752640 1 -- 172.21.15.73:0/3867465125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c541a4f70 con 0x7f3c54100e20 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.327+0000 7f3c4a7fc640 1 -- 172.21.15.73:0/3867465125 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3c44018a70 con 0x7f3c54100e20 2024-09-05T12:58:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c5db28740 1 Processor -- start 2024-09-05T12:58:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c5db28740 1 -- start start 2024-09-05T12:58:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 0x563142c1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1a5d0 0x563142c1aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c29780 0x563142c2bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c5db28740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563142b802f0 con 0x563142c1a5d0 2024-09-05T12:58:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c5db28740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563142b27cf0 con 0x563142c29780 2024-09-05T12:58:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c5db28740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563142b7c2b0 con 0x563142c1bb80 2024-09-05T12:58:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c594ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1a5d0 0x563142c1aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c594ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1a5d0 0x563142c1aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56756/0 (socket says 172.21.15.73:56756) 2024-09-05T12:58:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c594ee640 1 -- 172.21.15.73:0/3463983325 learned_addr learned my addr 172.21.15.73:0/3463983325 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c59cef640 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 0x563142c1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c4a7fc640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3c400a2b80 0x7f3c400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c58ced640 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c29780 0x563142c2bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c59cef640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3c400a2b80 0x7f3c400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.328+0000 7f3c4a7fc640 1 -- 172.21.15.73:0/3867465125 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3c440cf0a0 con 0x7f3c54100e20 2024-09-05T12:58:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c59cef640 1 -- 172.21.15.73:0/3463983325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c29780 msgr2=0x563142c2bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c59cef640 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c29780 0x563142c2bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c59cef640 1 -- 172.21.15.73:0/3463983325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1a5d0 msgr2=0x563142c1aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c59cef640 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1a5d0 0x563142c1aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c59cef640 1 -- 172.21.15.73:0/3463983325 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563142b0c3a0 con 0x563142c1bb80 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c58ced640 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c29780 0x563142c2bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c594ee640 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1a5d0 0x563142c1aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c59cef640 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 0x563142c1a090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c005cc0 tx=0x7f3c4c02f3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6710706db44a3a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c59cef640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3c400a2b80 0x7f3c400a5040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c048000 tx=0x7f3c4c04a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c3f7fe640 1 -- 172.21.15.73:0/3463983325 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c043050 con 0x563142c1bb80 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c3f7fe640 1 -- 172.21.15.73:0/3463983325 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c4c04d030 con 0x563142c1bb80 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.329+0000 7f3c3f7fe640 1 -- 172.21.15.73:0/3463983325 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c034040 con 0x563142c1bb80 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.330+0000 7f3c5db28740 1 -- 172.21.15.73:0/3463983325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 msgr2=0x563142c1a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.330+0000 7f3c5db28740 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 0x563142c1a090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c005cc0 tx=0x7f3c4c02f3a0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.330+0000 7f3c5db28740 1 -- 172.21.15.73:0/3463983325 shutdown_connections 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.330+0000 7f3c5db28740 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c29780 0x563142c2bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.330+0000 7f3c5db28740 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1a5d0 0x563142c1aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.330+0000 7f3c5db28740 1 --2- 172.21.15.73:0/3463983325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 0x563142c1a090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.330+0000 7f3c5db28740 1 -- 172.21.15.73:0/3463983325 >> 172.21.15.73:0/3463983325 conn(0x563142be3310 msgr2=0x563142c16c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.330+0000 7f3c5db28740 1 -- 172.21.15.73:0/3463983325 shutdown_connections 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.330+0000 7f3c5db28740 1 -- 172.21.15.73:0/3463983325 wait complete. 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.330+0000 7f3c5db28740 1 -- start start 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c5db28740 1 Processor -- start 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 0x563142c29140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 0x563142c26440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c26aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c5db28740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563142c2c480 con 0x563142c29780 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c5db28740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563142b3b060 con 0x563142c1a5d0 2024-09-05T12:58:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c5db28740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563142c2c600 con 0x563142c1bb80 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c5db28740 10 client.0 _ll_register_callbacks cb 0x56314288e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c59cef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c26aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c59cef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c26aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56770/0 (socket says 172.21.15.73:56770) 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c59cef640 1 -- 172.21.15.73:0/2261706056 learned_addr learned my addr 172.21.15.73:0/2261706056 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c594ee640 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 0x563142c29140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.331+0000 7f3c58ced640 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 0x563142c26440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c59cef640 1 -- 172.21.15.73:0/2261706056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 msgr2=0x563142c26440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c59cef640 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 0x563142c26440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c59cef640 1 -- 172.21.15.73:0/2261706056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 msgr2=0x563142c29140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c59cef640 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 0x563142c29140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c59cef640 1 -- 172.21.15.73:0/2261706056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631428f13c0 con 0x563142c29780 2024-09-05T12:58:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c594ee640 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 0x563142c29140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c59cef640 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c26aa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c02ae70 tx=0x7f3c4c004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc855035f6b26c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2261706056 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c05f060 con 0x563142c29780 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2261706056 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3c4c003d40 con 0x563142c29780 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c5db28740 1 -- 172.21.15.73:0/2261706056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c4c04d030 con 0x563142c29780 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2261706056 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3c4c004590 con 0x563142c29780 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c5db28740 10 client.15426 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c5db28740 1 -- 172.21.15.73:0/2261706056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563142c37f20 con 0x563142c29780 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.332+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2261706056 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c4c04d030 con 0x563142c29780 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.333+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2261706056 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3c4c051460 con 0x563142c29780 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.333+0000 7f3c5db28740 10 client.15426 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.333+0000 7f3c5db28740 10 client.15426 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T12:58:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.333+0000 7f3c5db28740 20 client.15426 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.333+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x563142c39270 0x563142c3b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.333+0000 7f3c5db28740 4 client.15426 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.333+0000 7f3c5db28740 1 -- 172.21.15.73:0/2261706056 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563142b8d860 con 0x563142c39270 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.333+0000 7f3c594ee640 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x563142c39270 0x563142c3b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.333+0000 7f3c3cff9640 10 client.15426 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.333+0000 7f3c594ee640 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x563142c39270 0x563142c3b660 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=52718cd5efe59306 server_cookie=80d4b30f151ebf07 in_seq=0 out_seq=0 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2261706056 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563142b8d860 con 0x563142c39270 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c3cff9640 10 client.15426 handle_command_reply: tid=0 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 client.15426 shutdown 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 -- 172.21.15.73:0/2261706056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 msgr2=0x563142c26aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c26aa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c02ae70 tx=0x7f3c4c004420 comp rx=0 tx=0).stop 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 -- 172.21.15.73:0/2261706056 shutdown_connections 2024-09-05T12:58:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x563142c39270 0x563142c3b660 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c26aa0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1bb80 0x563142c26440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2261706056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 0x563142c29140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 -- 172.21.15.73:0/2261706056 >> 172.21.15.73:0/2261706056 conn(0x563142be3310 msgr2=0x563142c1c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c3cff9640 0 client.15426 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T12:58:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 -- 172.21.15.73:0/2261706056 shutdown_connections 2024-09-05T12:58:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 1 -- 172.21.15.73:0/2261706056 wait complete. 2024-09-05T12:58:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.334+0000 7f3c5db28740 20 client.15426 trim_cache size 0 max 16384 2024-09-05T12:58:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c5db28740 1 Processor -- start 2024-09-05T12:58:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c5db28740 1 -- start start 2024-09-05T12:58:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 0x563142c35720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1bb80 0x563142c165f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c29780 0x563142c16b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c5db28740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541ad9d0 con 0x563142c1bb80 2024-09-05T12:58:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c5db28740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541ab2a0 con 0x563142c1a5d0 2024-09-05T12:58:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c5db28740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541a90f0 con 0x563142c29780 2024-09-05T12:58:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c58ced640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1bb80 0x563142c165f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c58ced640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1bb80 0x563142c165f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56776/0 (socket says 172.21.15.73:56776) 2024-09-05T12:58:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c58ced640 1 -- 172.21.15.73:0/1905938770 learned_addr learned my addr 172.21.15.73:0/1905938770 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c594ee640 1 --2- 172.21.15.73:0/1905938770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 0x563142c35720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c59cef640 1 --2- 172.21.15.73:0/1905938770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c29780 0x563142c16b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.348+0000 7f3c58ced640 1 -- 172.21.15.73:0/1905938770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c29780 msgr2=0x563142c16b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.349+0000 7f3c58ced640 1 --2- 172.21.15.73:0/1905938770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c29780 0x563142c16b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.349+0000 7f3c58ced640 1 -- 172.21.15.73:0/1905938770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 msgr2=0x563142c35720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.349+0000 7f3c58ced640 1 --2- 172.21.15.73:0/1905938770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 0x563142c35720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.349+0000 7f3c58ced640 1 -- 172.21.15.73:0/1905938770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563142c28d40 con 0x563142c1bb80 2024-09-05T12:58:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.349+0000 7f3c594ee640 1 --2- 172.21.15.73:0/1905938770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 0x563142c35720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.349+0000 7f3c58ced640 1 --2- 172.21.15.73:0/1905938770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1bb80 0x563142c165f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3c50010430 tx=0x7f3c500108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7dde259912cba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.349+0000 7f3c3effd640 1 -- 172.21.15.73:0/1905938770 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c50005220 con 0x563142c1bb80 2024-09-05T12:58:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.349+0000 7f3c3effd640 1 -- 172.21.15.73:0/1905938770 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c500047a0 con 0x563142c1bb80 2024-09-05T12:58:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.349+0000 7f3c3effd640 1 -- 172.21.15.73:0/1905938770 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000f9d0 con 0x563142c1bb80 2024-09-05T12:58:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 -- 172.21.15.73:0/1905938770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1bb80 msgr2=0x563142c165f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 --2- 172.21.15.73:0/1905938770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1bb80 0x563142c165f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3c50010430 tx=0x7f3c500108f0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 -- 172.21.15.73:0/1905938770 shutdown_connections 2024-09-05T12:58:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 --2- 172.21.15.73:0/1905938770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c29780 0x563142c16b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 --2- 172.21.15.73:0/1905938770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c1bb80 0x563142c165f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 --2- 172.21.15.73:0/1905938770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1a5d0 0x563142c35720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 -- 172.21.15.73:0/1905938770 >> 172.21.15.73:0/1905938770 conn(0x563142be3310 msgr2=0x563142c21720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 -- 172.21.15.73:0/1905938770 shutdown_connections 2024-09-05T12:58:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 -- 172.21.15.73:0/1905938770 wait complete. 2024-09-05T12:58:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 -- start start 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.350+0000 7f3c5db28740 1 Processor -- start 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1a5d0 0x563142c31c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1bb80 0x563142c32140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c5db28740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c22fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c5db28740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541a9760 con 0x563142c29780 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c5db28740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541aabd0 con 0x563142c1bb80 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c5db28740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541a9e30 con 0x563142c1a5d0 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c5db28740 10 client.0 _ll_register_callbacks cb 0x7f3c44097c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c59cef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c22fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c59cef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c22fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56782/0 (socket says 172.21.15.73:56782) 2024-09-05T12:58:27.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c59cef640 1 -- 172.21.15.73:0/2315409970 learned_addr learned my addr 172.21.15.73:0/2315409970 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c58ced640 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1bb80 0x563142c32140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c594ee640 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1a5d0 0x563142c31c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c59cef640 1 -- 172.21.15.73:0/2315409970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1a5d0 msgr2=0x563142c31c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c59cef640 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1a5d0 0x563142c31c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c59cef640 1 -- 172.21.15.73:0/2315409970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1bb80 msgr2=0x563142c32140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c59cef640 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1bb80 0x563142c32140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c59cef640 1 -- 172.21.15.73:0/2315409970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563142c237e0 con 0x563142c29780 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c59cef640 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c22fb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009ca0 tx=0x7f3c4c02fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62ef0784ea24676 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.351+0000 7f3c3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2315409970 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c06a030 con 0x563142c29780 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2315409970 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3c4c057050 con 0x563142c29780 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c5db28740 1 -- 172.21.15.73:0/2315409970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c500047a0 con 0x563142c29780 2024-09-05T12:58:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2315409970 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3c4c043070 con 0x563142c29780 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c5db28740 10 client.15432 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c5db28740 1 -- 172.21.15.73:0/2315409970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563142ca3890 con 0x563142c29780 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2315409970 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c500047a0 con 0x563142c29780 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2315409970 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3c4c05b9e0 con 0x563142c29780 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c5db28740 10 client.15432 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c5db28740 10 client.15432 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c5db28740 20 client.15432 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x563142ca3f50 0x563142ca6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c5db28740 4 client.15432 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.352+0000 7f3c5db28740 1 -- 172.21.15.73:0/2315409970 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563142b87d70 con 0x563142ca3f50 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c594ee640 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x563142ca3f50 0x563142ca6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c3cff9640 10 client.15432 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T12:58:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c594ee640 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x563142ca3f50 0x563142ca6370 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19c339cb59023367 server_cookie=b02e1d0806323e38 in_seq=0 out_seq=0 2024-09-05T12:58:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c3cff9640 1 -- 172.21.15.73:0/2315409970 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563142b87d70 con 0x563142ca3f50 2024-09-05T12:58:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c3cff9640 10 client.15432 handle_command_reply: tid=0 2024-09-05T12:58:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c5db28740 1 client.15432 shutdown 2024-09-05T12:58:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c5db28740 1 -- 172.21.15.73:0/2315409970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 msgr2=0x563142c22fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c22fb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009ca0 tx=0x7f3c4c02fd00 comp rx=0 tx=0).stop 2024-09-05T12:58:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c5db28740 1 -- 172.21.15.73:0/2315409970 shutdown_connections 2024-09-05T12:58:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x563142ca3f50 0x563142ca6370 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563142c29780 0x563142c22fb0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563142c1bb80 0x563142c32140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c3cff9640 0 client.15432 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T12:58:27.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c5db28740 1 --2- 172.21.15.73:0/2315409970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563142c1a5d0 0x563142c31c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.353+0000 7f3c5db28740 1 -- 172.21.15.73:0/2315409970 >> 172.21.15.73:0/2315409970 conn(0x563142be3310 msgr2=0x563142c27ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:27.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5db28740 1 -- 172.21.15.73:0/2315409970 shutdown_connections 2024-09-05T12:58:27.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5db28740 1 -- 172.21.15.73:0/2315409970 wait complete. 2024-09-05T12:58:27.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5db28740 20 client.15432 trim_cache size 0 max 16384 2024-09-05T12:58:27.361 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T12:58:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5b752640 1 -- 172.21.15.73:0/3867465125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3c400a2b80 msgr2=0x7f3c400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5b752640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3c400a2b80 0x7f3c400a5040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c048000 tx=0x7f3c4c04a000 comp rx=0 tx=0).stop 2024-09-05T12:58:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5b752640 1 -- 172.21.15.73:0/3867465125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c54100e20 msgr2=0x7f3c541983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5b752640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c54100e20 0x7f3c541983f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400c920 tx=0x7f3c4400cde0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5b752640 1 -- 172.21.15.73:0/3867465125 shutdown_connections 2024-09-05T12:58:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5b752640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3c400a2b80 0x7f3c400a5040 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5b752640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c54102ef0 0x7f3c5419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5b752640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c54102570 0x7f3c54198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5b752640 1 --2- 172.21.15.73:0/3867465125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c54100e20 0x7f3c541983f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:27.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.354+0000 7f3c5b752640 1 -- 172.21.15.73:0/3867465125 >> 172.21.15.73:0/3867465125 conn(0x7f3c540fc7d0 msgr2=0x7f3c5406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:27.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.355+0000 7f3c5b752640 1 -- 172.21.15.73:0/3867465125 shutdown_connections 2024-09-05T12:58:27.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:27.355+0000 7f3c5b752640 1 -- 172.21.15.73:0/3867465125 wait complete. 2024-09-05T12:58:27.365 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:27 smithi162 ceph-mon[34220]: pgmap v351: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-05T12:58:27.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:27 smithi169 ceph-mon[34823]: pgmap v351: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-05T12:58:28.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T12:58:28.571 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:28.706 INFO:tasks.workunit.client.0.smithi073.stderr:Updating files: 97% (11780/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-05T12:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.096+0000 7f5eacc9a640 1 -- 172.21.15.73:0/927910193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea81036e0 msgr2=0x7f5ea8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.096+0000 7f5eacc9a640 1 --2- 172.21.15.73:0/927910193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea81036e0 0x7f5ea8107b90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009930 tx=0x7f5e9c02a420 comp rx=0 tx=0).stop 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.096+0000 7f5eacc9a640 1 -- 172.21.15.73:0/927910193 shutdown_connections 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.096+0000 7f5eacc9a640 1 --2- 172.21.15.73:0/927910193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ea81082a0 0x7f5ea810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.096+0000 7f5eacc9a640 1 --2- 172.21.15.73:0/927910193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea81036e0 0x7f5ea8107b90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.096+0000 7f5eacc9a640 1 --2- 172.21.15.73:0/927910193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ea8102d30 0x7f5ea8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.096+0000 7f5eacc9a640 1 -- 172.21.15.73:0/927910193 >> 172.21.15.73:0/927910193 conn(0x7f5ea80fc7d0 msgr2=0x7f5ea80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.096+0000 7f5eacc9a640 1 -- 172.21.15.73:0/927910193 shutdown_connections 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.096+0000 7f5eacc9a640 1 -- 172.21.15.73:0/927910193 wait complete. 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.097+0000 7f5eacc9a640 1 Processor -- start 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.097+0000 7f5eacc9a640 1 -- start start 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.097+0000 7f5eacc9a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea8102d30 0x7f5ea81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.097+0000 7f5eacc9a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ea81036e0 0x7f5ea8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.097+0000 7f5eacc9a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ea81082a0 0x7f5ea819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.097+0000 7f5eacc9a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81120a0 con 0x7f5ea8102d30 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.097+0000 7f5eacc9a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8111f20 con 0x7f5ea81036e0 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.097+0000 7f5eacc9a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8112220 con 0x7f5ea81082a0 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.097+0000 7f5ea659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea8102d30 0x7f5ea81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.097+0000 7f5ea659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea8102d30 0x7f5ea81985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56792/0 (socket says 172.21.15.73:56792) 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5ea659c640 1 -- 172.21.15.73:0/3279102908 learned_addr learned my addr 172.21.15.73:0/3279102908 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ea81036e0 0x7f5ea8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ea81082a0 0x7f5ea819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5ea659c640 1 -- 172.21.15.73:0/3279102908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ea81082a0 msgr2=0x7f5ea819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5ea659c640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ea81082a0 0x7f5ea819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5ea659c640 1 -- 172.21.15.73:0/3279102908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ea81036e0 msgr2=0x7f5ea8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5ea659c640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ea81036e0 0x7f5ea8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5ea659c640 1 -- 172.21.15.73:0/3279102908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea819d550 con 0x7f5ea8102d30 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ea81036e0 0x7f5ea8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5ea659c640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea8102d30 0x7f5ea81985a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800d950 tx=0x7f5e9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5e977fe640 1 -- 172.21.15.73:0/3279102908 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e98017070 con 0x7f5ea8102d30 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5eacc9a640 1 -- 172.21.15.73:0/3279102908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea819d840 con 0x7f5ea8102d30 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5e977fe640 1 -- 172.21.15.73:0/3279102908 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e98009c30 con 0x7f5ea8102d30 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5e977fe640 1 -- 172.21.15.73:0/3279102908 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800f6b0 con 0x7f5ea8102d30 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.098+0000 7f5eacc9a640 1 -- 172.21.15.73:0/3279102908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea81a5120 con 0x7f5ea8102d30 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.101+0000 7f5eaf070740 1 Processor -- start 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.101+0000 7f5eaf070740 1 -- start start 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.101+0000 7f5e977fe640 1 -- 172.21.15.73:0/3279102908 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5e980109d0 con 0x7f5ea8102d30 2024-09-05T12:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.101+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 0x563b062be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.101+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062be5d0 0x563b062bea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.101+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.101+0000 7f5eaf070740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563b062242f0 con 0x563b062c9370 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.101+0000 7f5eaf070740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563b061cbcf0 con 0x563b062be5d0 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.101+0000 7f5eaf070740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563b062202b0 con 0x563b062bfb80 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.102+0000 7f5ea5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.102+0000 7f5ea5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56804/0 (socket says 172.21.15.73:56804) 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.102+0000 7f5ea5d9b640 1 -- 172.21.15.73:0/2143876328 learned_addr learned my addr 172.21.15.73:0/2143876328 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.102+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/2143876328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 0x563b062be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.102+0000 7f5ea5d9b640 1 -- 172.21.15.73:0/2143876328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 msgr2=0x563b062be090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.102+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/2143876328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 0x563b062be090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.102+0000 7f5ea5d9b640 1 -- 172.21.15.73:0/2143876328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062be5d0 msgr2=0x563b062bea30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T12:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.102+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/2143876328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062be5d0 0x563b062bea30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.102+0000 7f5ea5d9b640 1 -- 172.21.15.73:0/2143876328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b061b03a0 con 0x563b062c9370 2024-09-05T12:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.102+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/2143876328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062cb760 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c000c00 tx=0x7f5e9c032d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3e19e06733230e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.103+0000 7f5e977fe640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5e900a2b80 0x7f5e900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.103+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5e900a2b80 0x7f5e900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.103+0000 7f5e977fe640 1 -- 172.21.15.73:0/3279102908 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f5e980cefc0 con 0x7f5ea8102d30 2024-09-05T12:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.103+0000 7f5e94ff9640 1 -- 172.21.15.73:0/2143876328 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c03f070 con 0x563b062c9370 2024-09-05T12:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.103+0000 7f5e94ff9640 1 -- 172.21.15.73:0/2143876328 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e9c0317b0 con 0x563b062c9370 2024-09-05T12:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.103+0000 7f5e94ff9640 1 -- 172.21.15.73:0/2143876328 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c035070 con 0x563b062c9370 2024-09-05T12:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.104+0000 7f5eaf070740 1 -- 172.21.15.73:0/2143876328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 msgr2=0x563b062cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.104+0000 7f5eaf070740 1 --2- 172.21.15.73:0/2143876328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062cb760 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c000c00 tx=0x7f5e9c032d80 comp rx=0 tx=0).stop 2024-09-05T12:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.104+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5e900a2b80 0x7f5e900a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0008dc0 tx=0x7f5ea0008570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.104+0000 7f5eaf070740 1 -- 172.21.15.73:0/2143876328 shutdown_connections 2024-09-05T12:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.104+0000 7f5eaf070740 1 --2- 172.21.15.73:0/2143876328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062cb760 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.104+0000 7f5eaf070740 1 --2- 172.21.15.73:0/2143876328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062be5d0 0x563b062bea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.104+0000 7f5eaf070740 1 --2- 172.21.15.73:0/2143876328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 0x563b062be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.104+0000 7f5eaf070740 1 -- 172.21.15.73:0/2143876328 >> 172.21.15.73:0/2143876328 conn(0x563b06287310 msgr2=0x563b062bac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.104+0000 7f5eaf070740 1 -- 172.21.15.73:0/2143876328 shutdown_connections 2024-09-05T12:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.104+0000 7f5eaf070740 1 -- 172.21.15.73:0/2143876328 wait complete. 2024-09-05T12:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5eaf070740 1 -- start start 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5eaf070740 1 Processor -- start 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062be5d0 0x563b062c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 0x563b062c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062c9370 0x563b062c6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5eaf070740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563b062cc070 con 0x563b062be5d0 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5eaf070740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563b061df060 con 0x563b062c9370 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5eaf070740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563b062cc1f0 con 0x563b062bfb80 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5eaf070740 10 client.0 _ll_register_callbacks cb 0x563b05f328c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062be5d0 0x563b062c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062be5d0 0x563b062c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56806/0 (socket says 172.21.15.73:56806) 2024-09-05T12:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea659c640 1 -- 172.21.15.73:0/2779344641 learned_addr learned my addr 172.21.15.73:0/2779344641 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062c9370 0x563b062c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 0x563b062c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea659c640 1 -- 172.21.15.73:0/2779344641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 msgr2=0x563b062c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea659c640 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 0x563b062c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea659c640 1 -- 172.21.15.73:0/2779344641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062c9370 msgr2=0x563b062c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea659c640 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062c9370 0x563b062c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea659c640 1 -- 172.21.15.73:0/2779344641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b05f953c0 con 0x563b062be5d0 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.105+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 0x563b062c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5ea659c640 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062be5d0 0x563b062c8dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5e980a4030 tx=0x7f5e98009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c50071822c4fbdf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5e8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5e8dffb640 1 -- 172.21.15.73:0/2779344641 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e98020070 con 0x563b062be5d0 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5e8dffb640 1 -- 172.21.15.73:0/2779344641 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f5e980860b0 con 0x563b062be5d0 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5eaf070740 1 -- 172.21.15.73:0/2779344641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e9c0317b0 con 0x563b062be5d0 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5e8dffb640 1 -- 172.21.15.73:0/2779344641 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5e9809b8f0 con 0x563b062be5d0 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5eaf070740 10 client.15444 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5eaf070740 1 -- 172.21.15.73:0/2779344641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563b062d7bd0 con 0x563b062be5d0 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5e8dffb640 1 -- 172.21.15.73:0/2779344641 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e9c0317b0 con 0x563b062be5d0 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5e8dffb640 1 -- 172.21.15.73:0/2779344641 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5e9809ad40 con 0x563b062be5d0 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5eaf070740 10 client.15444 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5eaf070740 10 client.15444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5eaf070740 20 client.15444 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5eaf070740 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563b062d9090 0x563b062db480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5eaf070740 4 client.15444 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.106+0000 7f5eaf070740 1 -- 172.21.15.73:0/2779344641 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b06231860 con 0x563b062d9090 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.107+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563b062d9090 0x563b062db480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.107+0000 7f5e8dffb640 10 client.15444 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.107+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563b062d9090 0x563b062db480 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c26467979225336 server_cookie=539cee9c79786b1a in_seq=0 out_seq=0 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5e8dffb640 1 -- 172.21.15.73:0/2779344641 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b06231860 con 0x563b062d9090 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5e8dffb640 10 client.15444 handle_command_reply: tid=0 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 client.15444 shutdown 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 -- 172.21.15.73:0/2779344641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062be5d0 msgr2=0x563b062c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062be5d0 0x563b062c8dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5e980a4030 tx=0x7f5e98009de0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 -- 172.21.15.73:0/2779344641 shutdown_connections 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563b062d9090 0x563b062db480 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062c9370 0x563b062c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062bfb80 0x563b062c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 --2- 172.21.15.73:0/2779344641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062be5d0 0x563b062c8dc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 -- 172.21.15.73:0/2779344641 >> 172.21.15.73:0/2779344641 conn(0x563b06287310 msgr2=0x563b062c09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5e8dffb640 0 client.15444 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 -- 172.21.15.73:0/2779344641 shutdown_connections 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 1 -- 172.21.15.73:0/2779344641 wait complete. 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.108+0000 7f5eaf070740 20 client.15444 trim_cache size 0 max 16384 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5eaf070740 1 Processor -- start 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5eaf070740 1 -- start start 2024-09-05T12:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062be5d0 0x563b062bae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 0x563b062c5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062e0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5eaf070740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81afc80 con 0x563b062c9370 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5eaf070740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81ad550 con 0x563b062bfb80 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5eaf070740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81ab3c0 con 0x563b062be5d0 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5ea6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062e0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5ea6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062e0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56808/0 (socket says 172.21.15.73:56808) 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5ea6d9d640 1 -- 172.21.15.73:0/1330933336 learned_addr learned my addr 172.21.15.73:0/1330933336 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/1330933336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 0x563b062c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.121+0000 7f5ea659c640 1 --2- 172.21.15.73:0/1330933336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062be5d0 0x563b062bae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.122+0000 7f5ea6d9d640 1 -- 172.21.15.73:0/1330933336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062be5d0 msgr2=0x563b062bae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.122+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/1330933336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062be5d0 0x563b062bae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.122+0000 7f5ea6d9d640 1 -- 172.21.15.73:0/1330933336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 msgr2=0x563b062c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.122+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/1330933336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 0x563b062c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.122+0000 7f5ea6d9d640 1 -- 172.21.15.73:0/1330933336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b062c5020 con 0x563b062c9370 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.122+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/1330933336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 0x563b062c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.122+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/1330933336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062e0b90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5ea001d600 tx=0x7f5ea0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b9f47b1bde6219 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.122+0000 7f5e8ffff640 1 -- 172.21.15.73:0/1330933336 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea002b070 con 0x563b062c9370 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.122+0000 7f5e8ffff640 1 -- 172.21.15.73:0/1330933336 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea001caf0 con 0x563b062c9370 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.122+0000 7f5e8ffff640 1 -- 172.21.15.73:0/1330933336 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0026ce0 con 0x563b062c9370 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.123+0000 7f5eaf070740 1 -- 172.21.15.73:0/1330933336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 msgr2=0x563b062e0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.123+0000 7f5eaf070740 1 --2- 172.21.15.73:0/1330933336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062e0b90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5ea001d600 tx=0x7f5ea0014000 comp rx=0 tx=0).stop 2024-09-05T12:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.123+0000 7f5eaf070740 1 -- 172.21.15.73:0/1330933336 shutdown_connections 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.123+0000 7f5eaf070740 1 --2- 172.21.15.73:0/1330933336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062e0b90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.123+0000 7f5eaf070740 1 --2- 172.21.15.73:0/1330933336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 0x563b062c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.123+0000 7f5eaf070740 1 --2- 172.21.15.73:0/1330933336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062be5d0 0x563b062bae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.123+0000 7f5eaf070740 1 -- 172.21.15.73:0/1330933336 >> 172.21.15.73:0/1330933336 conn(0x563b06287310 msgr2=0x563b062ba700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.123+0000 7f5eaf070740 1 -- 172.21.15.73:0/1330933336 shutdown_connections 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.123+0000 7f5eaf070740 1 -- 172.21.15.73:0/1330933336 wait complete. 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5eaf070740 1 -- start start 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5eaf070740 1 Processor -- start 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062be5d0 0x563b062ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 0x563b062cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5eaf070740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5eaf070740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81aba10 con 0x563b062c9370 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5eaf070740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81ace80 con 0x563b062bfb80 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5eaf070740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81ac0e0 con 0x563b062be5d0 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5ea6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5eaf070740 10 client.0 _ll_register_callbacks cb 0x7f5e9809b430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5ea6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062d12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56812/0 (socket says 172.21.15.73:56812) 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5ea6d9d640 1 -- 172.21.15.73:0/3939151988 learned_addr learned my addr 172.21.15.73:0/3939151988 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 0x563b062cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.124+0000 7f5ea659c640 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062be5d0 0x563b062ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5ea6d9d640 1 -- 172.21.15.73:0/3939151988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062be5d0 msgr2=0x563b062ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062be5d0 0x563b062ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5ea6d9d640 1 -- 172.21.15.73:0/3939151988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 msgr2=0x563b062cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 0x563b062cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5ea6d9d640 1 -- 172.21.15.73:0/3939151988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b062d1910 con 0x563b062c9370 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5ea5d9b640 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 0x563b062cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5ea6d9d640 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062d12a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5ea001dac0 tx=0x7f5ea001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b695fbf5890fd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5e8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5e8dffb640 1 -- 172.21.15.73:0/3939151988 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0036060 con 0x563b062c9370 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5e8dffb640 1 -- 172.21.15.73:0/3939151988 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f5ea0004c50 con 0x563b062c9370 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5eaf070740 1 -- 172.21.15.73:0/3939151988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ea001caf0 con 0x563b062c9370 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5e8dffb640 1 -- 172.21.15.73:0/3939151988 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5ea002b070 con 0x563b062c9370 2024-09-05T12:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5eaf070740 10 client.15450 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:29.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5eaf070740 1 -- 172.21.15.73:0/3939151988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563b06343680 con 0x563b062c9370 2024-09-05T12:58:29.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.125+0000 7f5e8dffb640 1 -- 172.21.15.73:0/3939151988 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea00085e0 con 0x563b062c9370 2024-09-05T12:58:29.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.126+0000 7f5e8dffb640 1 -- 172.21.15.73:0/3939151988 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5ea0005600 con 0x563b062c9370 2024-09-05T12:58:29.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.126+0000 7f5eaf070740 10 client.15450 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:29.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.126+0000 7f5eaf070740 10 client.15450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.126+0000 7f5eaf070740 20 client.15450 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.126+0000 7f5eaf070740 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563b06343dd0 0x563b063461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.126+0000 7f5eaf070740 4 client.15450 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.126+0000 7f5eaf070740 1 -- 172.21.15.73:0/3939151988 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5ea001caf0 con 0x563b06343dd0 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.126+0000 7f5ea659c640 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563b06343dd0 0x563b063461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.126+0000 7f5e8dffb640 10 client.15450 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.126+0000 7f5ea659c640 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563b06343dd0 0x563b063461f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce4dcfd673dc3b9c server_cookie=d2d3f090e56125a9 in_seq=0 out_seq=0 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5e8dffb640 1 -- 172.21.15.73:0/3939151988 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5ea001caf0 con 0x563b06343dd0 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5e8dffb640 10 client.15450 handle_command_reply: tid=0 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 client.15450 shutdown 2024-09-05T12:58:29.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 -- 172.21.15.73:0/3939151988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 msgr2=0x563b062d12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062d12a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5ea001dac0 tx=0x7f5ea001c940 comp rx=0 tx=0).stop 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 -- 172.21.15.73:0/3939151988 shutdown_connections 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563b06343dd0 0x563b063461f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b062c9370 0x563b062d12a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b062bfb80 0x563b062cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 --2- 172.21.15.73:0/3939151988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b062be5d0 0x563b062ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 -- 172.21.15.73:0/3939151988 >> 172.21.15.73:0/3939151988 conn(0x563b06287310 msgr2=0x563b062d4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5e8dffb640 0 client.15450 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 -- 172.21.15.73:0/3939151988 shutdown_connections 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 1 -- 172.21.15.73:0/3939151988 wait complete. 2024-09-05T12:58:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.127+0000 7f5eaf070740 20 client.15450 trim_cache size 0 max 16384 2024-09-05T12:58:29.148 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T12:58:29.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 -- 172.21.15.73:0/3279102908 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5e900a2b80 msgr2=0x7f5e900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:29.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5e900a2b80 0x7f5e900a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0008dc0 tx=0x7f5ea0008570 comp rx=0 tx=0).stop 2024-09-05T12:58:29.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 -- 172.21.15.73:0/3279102908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea8102d30 msgr2=0x7f5ea81985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea8102d30 0x7f5ea81985a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800d950 tx=0x7f5e9800de10 comp rx=0 tx=0).stop 2024-09-05T12:58:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 -- 172.21.15.73:0/3279102908 shutdown_connections 2024-09-05T12:58:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5e900a2b80 0x7f5e900a5040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ea81082a0 0x7f5ea819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ea81036e0 0x7f5ea8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 --2- 172.21.15.73:0/3279102908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea8102d30 0x7f5ea81985a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 -- 172.21.15.73:0/3279102908 >> 172.21.15.73:0/3279102908 conn(0x7f5ea80fc7d0 msgr2=0x7f5ea8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 -- 172.21.15.73:0/3279102908 shutdown_connections 2024-09-05T12:58:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:29.128+0000 7f5eacc9a640 1 -- 172.21.15.73:0/3279102908 wait complete. 2024-09-05T12:58:29.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:29 smithi162 ceph-mon[34220]: pgmap v352: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-05T12:58:29.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:29 smithi169 ceph-mon[34823]: pgmap v352: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-05T12:58:29.498 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:29 smithi073 ceph-mon[30883]: pgmap v352: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-05T12:58:29.653 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to 'e856d6b2462509a377ef39149a05475ed006ebac'. 2024-09-05T12:58:29.653 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-05T12:58:29.653 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-05T12:58:29.653 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-05T12:58:29.653 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-09-05T12:58:29.653 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-05T12:58:29.653 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-05T12:58:29.653 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-05T12:58:29.653 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-05T12:58:29.654 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-09-05T12:58:29.654 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-05T12:58:29.654 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-09-05T12:58:29.654 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-05T12:58:29.654 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-09-05T12:58:29.654 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-05T12:58:29.654 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-05T12:58:29.654 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-05T12:58:29.654 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at e856d6b2462 Merge branch 'wip-67307-squid' of https://github.com/cbodley/ceph into wip-bharath6-testing-2024-09-05-1413-squid 2024-09-05T12:58:29.657 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-05T12:58:29.746 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-05T12:58:29.748 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T12:58:29.748 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-05T12:58:29.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.995+0000 7f05704ed640 1 -- 172.21.15.73:0/954668227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0568102610 msgr2=0x7f0568108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.995+0000 7f05704ed640 1 --2- 172.21.15.73:0/954668227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0568102610 0x7f0568108ea0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0560009ca0 tx=0x7f056002a8c0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.995+0000 7f05704ed640 1 -- 172.21.15.73:0/954668227 shutdown_connections 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.995+0000 7f05704ed640 1 --2- 172.21.15.73:0/954668227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0568102610 0x7f0568108ea0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.995+0000 7f05704ed640 1 --2- 172.21.15.73:0/954668227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0568101c50 0x7f05681020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.995+0000 7f05704ed640 1 --2- 172.21.15.73:0/954668227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0568100a60 0x7f0568100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.995+0000 7f05704ed640 1 -- 172.21.15.73:0/954668227 >> 172.21.15.73:0/954668227 conn(0x7f05680fc1e0 msgr2=0x7f05680fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.995+0000 7f05704ed640 1 -- 172.21.15.73:0/954668227 shutdown_connections 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.995+0000 7f05704ed640 1 -- 172.21.15.73:0/954668227 wait complete. 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f05704ed640 1 Processor -- start 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f05704ed640 1 -- start start 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f05704ed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0568100a60 0x7f0568197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f05704ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0568101c50 0x7f0568198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f05704ed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0568102610 0x7f056819f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f05704ed640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f056810c6c0 con 0x7f0568101c50 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f05704ed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f056810c540 con 0x7f0568102610 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f05704ed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f056810c840 con 0x7f0568100a60 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f056da88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0568101c50 0x7f0568198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f056da88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0568101c50 0x7f0568198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56830/0 (socket says 172.21.15.73:56830) 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f056da88640 1 -- 172.21.15.73:0/3593216057 learned_addr learned my addr 172.21.15.73:0/3593216057 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f056ea8a640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0568102610 0x7f056819f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f056e289640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0568100a60 0x7f0568197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f056da88640 1 -- 172.21.15.73:0/3593216057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0568100a60 msgr2=0x7f0568197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f056da88640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0568100a60 0x7f0568197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f056da88640 1 -- 172.21.15.73:0/3593216057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0568102610 msgr2=0x7f056819f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f056da88640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0568102610 0x7f056819f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.996+0000 7f056da88640 1 -- 172.21.15.73:0/3593216057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056819f930 con 0x7f0568101c50 2024-09-05T12:58:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.997+0000 7f056da88640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0568101c50 0x7f0568198260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f055800d950 tx=0x7f055800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.997+0000 7f055f7fe640 1 -- 172.21.15.73:0/3593216057 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558017030 con 0x7f0568101c50 2024-09-05T12:58:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.997+0000 7f055f7fe640 1 -- 172.21.15.73:0/3593216057 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0558004020 con 0x7f0568101c50 2024-09-05T12:58:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.997+0000 7f05704ed640 1 -- 172.21.15.73:0/3593216057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056819fc20 con 0x7f0568101c50 2024-09-05T12:58:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.997+0000 7f055f7fe640 1 -- 172.21.15.73:0/3593216057 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05580047a0 con 0x7f0568101c50 2024-09-05T12:58:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.997+0000 7f05704ed640 1 -- 172.21.15.73:0/3593216057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05681a01c0 con 0x7f0568101c50 2024-09-05T12:58:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.999+0000 7f055f7fe640 1 -- 172.21.15.73:0/3593216057 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f05580041d0 con 0x7f0568101c50 2024-09-05T12:58:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:29.999+0000 7f0573282740 1 Processor -- start 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f0573282740 1 -- start start 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f0573282740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc6ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f0573282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc6fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f0573282740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 0x55f8cbc72830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f0573282740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f8cbbce2f0 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f0573282740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f8cbb76270 con 0x55f8cbc70370 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f0573282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f8cbbca2b0 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056ea8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc6ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f055f7fe640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05540a2cb0 0x7f05540a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056e289640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc6fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056e289640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc6fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:44738/0 (socket says 172.21.15.73:44738) 2024-09-05T12:58:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056ea8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc6ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56844/0 (socket says 172.21.15.73:56844) 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056e289640 1 -- 172.21.15.73:0/1907412040 learned_addr learned my addr 172.21.15.73:0/1907412040 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056ea8a640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05540a2cb0 0x7f05540a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056da88640 1 --2- 172.21.15.73:0/1907412040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 0x55f8cbc72830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f055f7fe640 1 -- 172.21.15.73:0/3593216057 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f05580cea10 con 0x7f0568101c50 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056e289640 1 -- 172.21.15.73:0/1907412040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 msgr2=0x55f8cbc72830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056e289640 1 --2- 172.21.15.73:0/1907412040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 0x55f8cbc72830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056e289640 1 -- 172.21.15.73:0/1907412040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 msgr2=0x55f8cbc6ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056e289640 1 --2- 172.21.15.73:0/1907412040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc6ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056e289640 1 -- 172.21.15.73:0/1907412040 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8cbb75340 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.000+0000 7f056ea8a640 1 --2- 172.21.15.73:0/1907412040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc6ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.001+0000 7f056ea8a640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05540a2cb0 0x7f05540a5170 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0560005fc0 tx=0x7f056002a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.001+0000 7f056e289640 1 --2- 172.21.15.73:0/1907412040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc6fda0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f056400cc00 tx=0x7f056400e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eed45169af28817 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.001+0000 7f055cbfe640 1 -- 172.21.15.73:0/1907412040 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564005220 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.001+0000 7f055cbfe640 1 -- 172.21.15.73:0/1907412040 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0564016070 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.001+0000 7f055cbfe640 1 -- 172.21.15.73:0/1907412040 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640107b0 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 -- 172.21.15.73:0/1907412040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 msgr2=0x55f8cbc6fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 --2- 172.21.15.73:0/1907412040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc6fda0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f056400cc00 tx=0x7f056400e720 comp rx=0 tx=0).stop 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 -- 172.21.15.73:0/1907412040 shutdown_connections 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 --2- 172.21.15.73:0/1907412040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 0x55f8cbc72830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 --2- 172.21.15.73:0/1907412040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc6fda0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 --2- 172.21.15.73:0/1907412040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc6ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 -- 172.21.15.73:0/1907412040 >> 172.21.15.73:0/1907412040 conn(0x55f8cbc66010 msgr2=0x55f8cbc66410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 -- 172.21.15.73:0/1907412040 shutdown_connections 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 -- 172.21.15.73:0/1907412040 wait complete. 2024-09-05T12:58:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 -- start start 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 Processor -- start 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc74b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 0x55f8cbc7c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f8cbc73340 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f8cbb57290 con 0x55f8cbc70370 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f8cbc734c0 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f0573282740 10 client.0 _ll_register_callbacks cb 0x55f8cbb88140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f056e289640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc74b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f056e289640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc74b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56846/0 (socket says 172.21.15.73:56846) 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f056e289640 1 -- 172.21.15.73:0/3289246946 learned_addr learned my addr 172.21.15.73:0/3289246946 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.002+0000 7f056da88640 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f056e289640 1 -- 172.21.15.73:0/3289246946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 msgr2=0x55f8cbc750a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f056e289640 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc750a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f056ea8a640 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 0x55f8cbc7c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f056e289640 1 -- 172.21.15.73:0/3289246946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 msgr2=0x55f8cbc7c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f056e289640 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 0x55f8cbc7c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f056e289640 1 -- 172.21.15.73:0/3289246946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8cb8e1210 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f056ea8a640 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 0x55f8cbc7c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f056e289640 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc74b60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f056400ec20 tx=0x7f0564010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a996617ef9790f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f0551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f0551ffb640 1 -- 172.21.15.73:0/3289246946 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564029060 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f0551ffb640 1 -- 172.21.15.73:0/3289246946 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f056400c710 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f0573282740 1 -- 172.21.15.73:0/3289246946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0564016070 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f0551ffb640 1 -- 172.21.15.73:0/3289246946 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0564004030 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f0573282740 10 client.15462 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f0573282740 1 -- 172.21.15.73:0/3289246946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f8cb9ad620 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.003+0000 7f0551ffb640 1 -- 172.21.15.73:0/3289246946 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0564016070 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.004+0000 7f0551ffb640 1 -- 172.21.15.73:0/3289246946 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0564003c90 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.004+0000 7f0573282740 10 client.15462 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.004+0000 7f0573282740 10 client.15462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.004+0000 7f0573282740 20 client.15462 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.004+0000 7f0573282740 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f8cbc804f0 0x55f8cbc828e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.004+0000 7f0573282740 4 client.15462 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.004+0000 7f0573282740 1 -- 172.21.15.73:0/3289246946 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8cbbdba20 con 0x55f8cbc804f0 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.004+0000 7f056da88640 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f8cbc804f0 0x55f8cbc828e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.004+0000 7f056da88640 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f8cbc804f0 0x55f8cbc828e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7e84223c2fef85d server_cookie=75d33348a24cad8f in_seq=0 out_seq=0 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.004+0000 7f0551ffb640 10 client.15462 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0551ffb640 1 -- 172.21.15.73:0/3289246946 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8cbbdba20 con 0x55f8cbc804f0 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0551ffb640 10 client.15462 handle_command_reply: tid=0 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 client.15462 shutdown 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 -- 172.21.15.73:0/3289246946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 msgr2=0x55f8cbc74b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc74b60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f056400ec20 tx=0x7f0564010c00 comp rx=0 tx=0).stop 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 -- 172.21.15.73:0/3289246946 shutdown_connections 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f8cbc804f0 0x55f8cbc828e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc70370 0x55f8cbc7c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 --2- 172.21.15.73:0/3289246946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc74b60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 -- 172.21.15.73:0/3289246946 >> 172.21.15.73:0/3289246946 conn(0x55f8cbc66010 msgr2=0x55f8cbc67820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0551ffb640 0 client.15462 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 -- 172.21.15.73:0/3289246946 shutdown_connections 2024-09-05T12:58:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.005+0000 7f0573282740 1 -- 172.21.15.73:0/3289246946 wait complete. 2024-09-05T12:58:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.006+0000 7f0573282740 20 client.15462 trim_cache size 0 max 16384 2024-09-05T12:58:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.021+0000 7f0573282740 1 Processor -- start 2024-09-05T12:58:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.021+0000 7f0573282740 1 -- start start 2024-09-05T12:58:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f0573282740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc75020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f0573282740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc7c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f0573282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 0x55f8cbc66e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f0573282740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f05681ab760 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f0573282740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05681a9030 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f0573282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05681a6e80 con 0x55f8cbc70370 2024-09-05T12:58:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056da88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc7c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056da88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc7c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56858/0 (socket says 172.21.15.73:56858) 2024-09-05T12:58:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056da88640 1 -- 172.21.15.73:0/1788605949 learned_addr learned my addr 172.21.15.73:0/1788605949 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056e289640 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc75020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056ea8a640 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 0x55f8cbc66e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056da88640 1 -- 172.21.15.73:0/1788605949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 msgr2=0x55f8cbc66e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056da88640 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 0x55f8cbc66e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056da88640 1 -- 172.21.15.73:0/1788605949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6a9a0 msgr2=0x55f8cbc75020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056da88640 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc75020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056da88640 1 -- 172.21.15.73:0/1788605949 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8cbc612d0 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056e289640 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc75020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056ea8a640 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 0x55f8cbc66e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.022+0000 7f056da88640 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc7c0a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0558097be0 tx=0x7f0558017740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee06f865df23c5c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0553fff640 1 -- 172.21.15.73:0/1788605949 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05580993e0 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0553fff640 1 -- 172.21.15.73:0/1788605949 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f055809b9a0 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0553fff640 1 -- 172.21.15.73:0/1788605949 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558097880 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0573282740 1 -- 172.21.15.73:0/1788605949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6b2e0 msgr2=0x55f8cbc7c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0573282740 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc7c0a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0558097be0 tx=0x7f0558017740 comp rx=0 tx=0).stop 2024-09-05T12:58:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0573282740 1 -- 172.21.15.73:0/1788605949 shutdown_connections 2024-09-05T12:58:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0573282740 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 0x55f8cbc66e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0573282740 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc7c0a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0573282740 1 --2- 172.21.15.73:0/1788605949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc75020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0573282740 1 -- 172.21.15.73:0/1788605949 >> 172.21.15.73:0/1788605949 conn(0x55f8cbc66010 msgr2=0x55f8cbc74910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0573282740 1 -- 172.21.15.73:0/1788605949 shutdown_connections 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.023+0000 7f0573282740 1 -- 172.21.15.73:0/1788605949 wait complete. 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f0573282740 1 -- start start 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f0573282740 1 Processor -- start 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f0573282740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc78de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f0573282740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc79320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f0573282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 0x55f8cbce9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f0573282740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f05681a74f0 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f0573282740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05681a8960 con 0x55f8cbc6b2e0 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f0573282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05681a7bc0 con 0x55f8cbc70370 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f0573282740 10 client.0 _ll_register_callbacks cb 0x7f0564014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056e289640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc78de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056e289640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc78de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56870/0 (socket says 172.21.15.73:56870) 2024-09-05T12:58:30.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056e289640 1 -- 172.21.15.73:0/1853036854 learned_addr learned my addr 172.21.15.73:0/1853036854 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:30.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056ea8a640 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 0x55f8cbce9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056da88640 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc79320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056e289640 1 -- 172.21.15.73:0/1853036854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 msgr2=0x55f8cbce9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:30.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056e289640 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 0x55f8cbce9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056e289640 1 -- 172.21.15.73:0/1853036854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6b2e0 msgr2=0x55f8cbc79320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:30.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056e289640 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc79320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056e289640 1 -- 172.21.15.73:0/1853036854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8cbc7c410 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.024+0000 7f056ea8a640 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 0x55f8cbce9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f056e289640 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc78de0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0564001eb0 tx=0x7f056400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb92613e40163739 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0551ffb640 1 -- 172.21.15.73:0/1853036854 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564034070 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0551ffb640 1 -- 172.21.15.73:0/1853036854 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0564005040 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0573282740 1 -- 172.21.15.73:0/1853036854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f055809b9a0 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0551ffb640 1 -- 172.21.15.73:0/1853036854 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0564040050 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0573282740 10 client.15468 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0573282740 1 -- 172.21.15.73:0/1853036854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f8cbcea6c0 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0551ffb640 1 -- 172.21.15.73:0/1853036854 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f055809b9a0 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0551ffb640 1 -- 172.21.15.73:0/1853036854 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0564003710 con 0x55f8cbc6a9a0 2024-09-05T12:58:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0573282740 10 client.15468 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0573282740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0573282740 20 client.15468 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0573282740 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f8cbceb0a0 0x55f8cbced4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0573282740 4 client.15468 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T12:58:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.025+0000 7f0573282740 1 -- 172.21.15.73:0/1853036854 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f8cbbd5d70 con 0x55f8cbceb0a0 2024-09-05T12:58:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.026+0000 7f056da88640 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f8cbceb0a0 0x55f8cbced4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.026+0000 7f0551ffb640 10 client.15468 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.026+0000 7f056da88640 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f8cbceb0a0 0x55f8cbced4c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb8416ceebdde615 server_cookie=aa215815bdb9326a in_seq=0 out_seq=0 2024-09-05T12:58:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0551ffb640 1 -- 172.21.15.73:0/1853036854 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f8cbbd5d70 con 0x55f8cbceb0a0 2024-09-05T12:58:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0551ffb640 10 client.15468 handle_command_reply: tid=0 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 client.15468 shutdown 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 -- 172.21.15.73:0/1853036854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 msgr2=0x55f8cbc78de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc78de0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0564001eb0 tx=0x7f056400c940 comp rx=0 tx=0).stop 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 -- 172.21.15.73:0/1853036854 shutdown_connections 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f8cbceb0a0 0x55f8cbced4c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8cbc70370 0x55f8cbce9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f8cbc6b2e0 0x55f8cbc79320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0551ffb640 0 client.15468 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 --2- 172.21.15.73:0/1853036854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8cbc6a9a0 0x55f8cbc78de0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 -- 172.21.15.73:0/1853036854 >> 172.21.15.73:0/1853036854 conn(0x55f8cbc66010 msgr2=0x55f8cbc649a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 -- 172.21.15.73:0/1853036854 shutdown_connections 2024-09-05T12:58:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 1 -- 172.21.15.73:0/1853036854 wait complete. 2024-09-05T12:58:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.030+0000 7f0573282740 20 client.15468 trim_cache size 0 max 16384 2024-09-05T12:58:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T12:58:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T12:58:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T12:58:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T12:58:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 -- 172.21.15.73:0/3593216057 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05540a2cb0 msgr2=0x7f05540a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05540a2cb0 0x7f05540a5170 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0560005fc0 tx=0x7f056002a8c0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 -- 172.21.15.73:0/3593216057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0568101c50 msgr2=0x7f0568198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0568101c50 0x7f0568198260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f055800d950 tx=0x7f055800de10 comp rx=0 tx=0).stop 2024-09-05T12:58:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 -- 172.21.15.73:0/3593216057 shutdown_connections 2024-09-05T12:58:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f05540a2cb0 0x7f05540a5170 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0568102610 0x7f056819f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0568101c50 0x7f0568198260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 --2- 172.21.15.73:0/3593216057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0568100a60 0x7f0568197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 -- 172.21.15.73:0/3593216057 >> 172.21.15.73:0/3593216057 conn(0x7f05680fc1e0 msgr2=0x7f056806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 -- 172.21.15.73:0/3593216057 shutdown_connections 2024-09-05T12:58:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:30.031+0000 7f05704ed640 1 -- 172.21.15.73:0/3593216057 wait complete. 2024-09-05T12:58:30.624 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-05T12:58:30.697 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-05T12:58:30.737 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T12:58:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T12:58:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-05T12:58:30.776 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T12:58:30.780 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T12:58:30.780 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-05T12:58:30.795 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-05T12:58:30.797 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-05T12:58:30.797 DEBUG:teuthology.orchestra.run.smithi073:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e856d6b2462509a377ef39149a05475ed006ebac TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-05T12:58:30.858 INFO:tasks.workunit.client.0.smithi073.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-05T12:58:30.858 INFO:tasks.workunit.client.0.smithi073.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-05T12:58:30.858 INFO:tasks.workunit.client.0.smithi073.stderr:+ trap -- retry EXIT 2024-09-05T12:58:30.858 INFO:tasks.workunit.client.0.smithi073.stderr:+ rm -rf ffsb 2024-09-05T12:58:30.859 INFO:tasks.workunit.client.0.smithi073.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-05T12:58:30.862 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into 'ffsb'... 2024-09-05T12:58:31.040 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T12:58:31.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T12:58:31.292 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:31.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:31 smithi162 ceph-mon[34220]: pgmap v353: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-05T12:58:31.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:31 smithi169 ceph-mon[34823]: pgmap v353: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-05T12:58:31.414 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:31 smithi073 ceph-mon[30883]: pgmap v353: 97 pgs: 97 active+clean; 664 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-05T12:58:31.726 INFO:tasks.workunit.client.0.smithi073.stderr:+ trap - EXIT 2024-09-05T12:58:31.726 INFO:tasks.workunit.client.0.smithi073.stderr:+ cd ffsb 2024-09-05T12:58:31.726 INFO:tasks.workunit.client.0.smithi073.stderr:+ ./configure 2024-09-05T12:58:31.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.763+0000 7f0d51f97640 1 -- 172.21.15.73:0/3159843002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d4c102ef0 msgr2=0x7f0d4c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:31.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.763+0000 7f0d51f97640 1 --2- 172.21.15.73:0/3159843002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d4c102ef0 0x7f0d4c10da40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009ca0 tx=0x7f0d4402a950 comp rx=0 tx=0).stop 2024-09-05T12:58:31.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.763+0000 7f0d51f97640 1 -- 172.21.15.73:0/3159843002 shutdown_connections 2024-09-05T12:58:31.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.763+0000 7f0d51f97640 1 --2- 172.21.15.73:0/3159843002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d4c102ef0 0x7f0d4c10da40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.763+0000 7f0d51f97640 1 --2- 172.21.15.73:0/3159843002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d4c102570 0x7f0d4c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.763+0000 7f0d51f97640 1 --2- 172.21.15.73:0/3159843002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d4c100e20 0x7f0d4c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.763+0000 7f0d51f97640 1 -- 172.21.15.73:0/3159843002 >> 172.21.15.73:0/3159843002 conn(0x7f0d4c0fc7d0 msgr2=0x7f0d4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.763+0000 7f0d51f97640 1 -- 172.21.15.73:0/3159843002 shutdown_connections 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.763+0000 7f0d51f97640 1 -- 172.21.15.73:0/3159843002 wait complete. 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.764+0000 7f0d51f97640 1 Processor -- start 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.764+0000 7f0d51f97640 1 -- start start 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d51f97640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d4c100e20 0x7f0d4c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d51f97640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d4c102570 0x7f0d4c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d51f97640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d4c102ef0 0x7f0d4c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d51f97640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c110f80 con 0x7f0d4c102ef0 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d51f97640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c110e00 con 0x7f0d4c100e20 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d51f97640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c111100 con 0x7f0d4c102570 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d4c102ef0 0x7f0d4c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d4c100e20 0x7f0d4c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d4c102ef0 0x7f0d4c19cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56896/0 (socket says 172.21.15.73:56896) 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d4c100e20 0x7f0d4c1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:41544/0 (socket says 172.21.15.73:41544) 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4bfff640 1 -- 172.21.15.73:0/71847325 learned_addr learned my addr 172.21.15.73:0/71847325 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4affd640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d4c102570 0x7f0d4c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4bfff640 1 -- 172.21.15.73:0/71847325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d4c102570 msgr2=0x7f0d4c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4bfff640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d4c102570 0x7f0d4c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4bfff640 1 -- 172.21.15.73:0/71847325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d4c100e20 msgr2=0x7f0d4c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4bfff640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d4c100e20 0x7f0d4c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4bfff640 1 -- 172.21.15.73:0/71847325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4c19d460 con 0x7f0d4c102ef0 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d4bfff640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d4c102ef0 0x7f0d4c19cd80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0d4402ae70 tx=0x7f0d4402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d48ff9640 1 -- 172.21.15.73:0/71847325 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44034040 con 0x7f0d4c102ef0 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d51f97640 1 -- 172.21.15.73:0/71847325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4c19d6f0 con 0x7f0d4c102ef0 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d48ff9640 1 -- 172.21.15.73:0/71847325 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d44030920 con 0x7f0d4c102ef0 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.765+0000 7f0d48ff9640 1 -- 172.21.15.73:0/71847325 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44045480 con 0x7f0d4c102ef0 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.766+0000 7f0d51f97640 1 -- 172.21.15.73:0/71847325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d4c1a5030 con 0x7f0d4c102ef0 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.768+0000 7f0d5436d740 1 Processor -- start 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.768+0000 7f0d48ff9640 1 -- 172.21.15.73:0/71847325 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0d44037020 con 0x7f0d4c102ef0 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.768+0000 7f0d5436d740 1 -- start start 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce21769f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 0x55ce21774800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21774d40 0x55ce21777130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d5436d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ce216cf280 con 0x55ce21769b60 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d5436d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce21676b10 con 0x55ce21774d40 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d5436d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ce216cb240 con 0x55ce2176a480 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d4affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce21769f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d4affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce21769f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56898/0 (socket says 172.21.15.73:56898) 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d4affd640 1 -- 172.21.15.73:0/2551102560 learned_addr learned my addr 172.21.15.73:0/2551102560 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d4b7fe640 1 --2- 172.21.15.73:0/2551102560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 0x55ce21774800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d4affd640 1 --2- 172.21.15.73:0/2551102560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21774d40 0x55ce21777130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.769+0000 7f0d4affd640 1 -- 172.21.15.73:0/2551102560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 msgr2=0x55ce21774800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d4affd640 1 --2- 172.21.15.73:0/2551102560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 0x55ce21774800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d4affd640 1 -- 172.21.15.73:0/2551102560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21774d40 msgr2=0x55ce21777130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d4affd640 1 --2- 172.21.15.73:0/2551102560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21774d40 0x55ce21777130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d4affd640 1 -- 172.21.15.73:0/2551102560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce216831f0 con 0x55ce21769b60 2024-09-05T12:58:31.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d4b7fe640 1 --2- 172.21.15.73:0/2551102560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 0x55ce21774800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d48ff9640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d380a2b80 0x7f0d380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d4affd640 1 --2- 172.21.15.73:0/2551102560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce21769f40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0d34004650 tx=0x7f0d340041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae3bf5cd0c2451e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d4b7fe640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d380a2b80 0x7f0d380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d48ff9640 1 -- 172.21.15.73:0/71847325 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0d440efe70 con 0x7f0d4c102ef0 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d41ffb640 1 -- 172.21.15.73:0/2551102560 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34005020 con 0x55ce21769b60 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d41ffb640 1 -- 172.21.15.73:0/2551102560 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d340056a0 con 0x55ce21769b60 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.770+0000 7f0d41ffb640 1 -- 172.21.15.73:0/2551102560 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340106c0 con 0x55ce21769b60 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d4b7fe640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d380a2b80 0x7f0d380a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c005d00 tx=0x7f0d3c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 -- 172.21.15.73:0/2551102560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 msgr2=0x55ce21769f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 --2- 172.21.15.73:0/2551102560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce21769f40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0d34004650 tx=0x7f0d340041d0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 -- 172.21.15.73:0/2551102560 shutdown_connections 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 --2- 172.21.15.73:0/2551102560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21774d40 0x55ce21777130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 --2- 172.21.15.73:0/2551102560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 0x55ce21774800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 --2- 172.21.15.73:0/2551102560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce21769f40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 -- 172.21.15.73:0/2551102560 >> 172.21.15.73:0/2551102560 conn(0x55ce217660f0 msgr2=0x55ce217664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 -- 172.21.15.73:0/2551102560 shutdown_connections 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 -- 172.21.15.73:0/2551102560 wait complete. 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 -- start start 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.771+0000 7f0d5436d740 1 Processor -- start 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21769b60 0x55ce21771be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce2176a480 0x55ce21772120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce21774d40 0x55ce21772660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d5436d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ce217778b0 con 0x55ce2176a480 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d5436d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce21689f10 con 0x55ce21769b60 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d5436d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ce21777a30 con 0x55ce21774d40 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d5436d740 10 client.0 _ll_register_callbacks cb 0x55ce21652a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:31.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce2176a480 0x55ce21772120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce2176a480 0x55ce21772120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56914/0 (socket says 172.21.15.73:56914) 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4affd640 1 -- 172.21.15.73:0/1099805473 learned_addr learned my addr 172.21.15.73:0/1099805473 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4b7fe640 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21769b60 0x55ce21771be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4bfff640 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce21774d40 0x55ce21772660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4affd640 1 -- 172.21.15.73:0/1099805473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce21774d40 msgr2=0x55ce21772660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4affd640 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce21774d40 0x55ce21772660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4affd640 1 -- 172.21.15.73:0/1099805473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21769b60 msgr2=0x55ce21771be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4affd640 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21769b60 0x55ce21771be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4affd640 1 -- 172.21.15.73:0/1099805473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce214406a0 con 0x55ce2176a480 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d4affd640 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce2176a480 0x55ce21772120 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0d34004c20 tx=0x7f0d3400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b9fc0271b9d3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d2affd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.772+0000 7f0d2affd640 1 -- 172.21.15.73:0/1099805473 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34004fa0 con 0x55ce2176a480 2024-09-05T12:58:31.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d2affd640 1 -- 172.21.15.73:0/1099805473 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0d34005140 con 0x55ce2176a480 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d5436d740 1 -- 172.21.15.73:0/1099805473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d340056a0 con 0x55ce2176a480 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d2affd640 1 -- 172.21.15.73:0/1099805473 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d3402f020 con 0x55ce2176a480 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d5436d740 10 client.15480 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d5436d740 1 -- 172.21.15.73:0/1099805473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce21783480 con 0x55ce2176a480 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d2affd640 1 -- 172.21.15.73:0/1099805473 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d340056a0 con 0x55ce2176a480 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d2affd640 1 -- 172.21.15.73:0/1099805473 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0d3402b4a0 con 0x55ce2176a480 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d5436d740 10 client.15480 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d5436d740 10 client.15480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d5436d740 20 client.15480 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d5436d740 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ce217847d0 0x55ce21786bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d5436d740 4 client.15480 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d5436d740 1 -- 172.21.15.73:0/1099805473 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce216dc7f0 con 0x55ce217847d0 2024-09-05T12:58:31.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.773+0000 7f0d4b7fe640 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ce217847d0 0x55ce21786bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.774+0000 7f0d2affd640 10 client.15480 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.774+0000 7f0d4b7fe640 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ce217847d0 0x55ce21786bc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae48bfa21b1a0aca server_cookie=283c7319905ffe71 in_seq=0 out_seq=0 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.774+0000 7f0d2affd640 1 -- 172.21.15.73:0/1099805473 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce216dc7f0 con 0x55ce217847d0 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.774+0000 7f0d2affd640 10 client.15480 handle_command_reply: tid=0 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 client.15480 shutdown 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 -- 172.21.15.73:0/1099805473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce2176a480 msgr2=0x55ce21772120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce2176a480 0x55ce21772120 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0d34004c20 tx=0x7f0d3400bfd0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 -- 172.21.15.73:0/1099805473 shutdown_connections 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ce217847d0 0x55ce21786bc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce21774d40 0x55ce21772660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce2176a480 0x55ce21772120 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 --2- 172.21.15.73:0/1099805473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21769b60 0x55ce21771be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 -- 172.21.15.73:0/1099805473 >> 172.21.15.73:0/1099805473 conn(0x55ce217660f0 msgr2=0x55ce2176bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:31.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d2affd640 0 client.15480 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:31.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 -- 172.21.15.73:0/1099805473 shutdown_connections 2024-09-05T12:58:31.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 1 -- 172.21.15.73:0/1099805473 wait complete. 2024-09-05T12:58:31.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.775+0000 7f0d5436d740 20 client.15480 trim_cache size 0 max 16384 2024-09-05T12:58:31.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.792+0000 7f0d5436d740 1 Processor -- start 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d5436d740 1 -- start start 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce21769b60 0x55ce2178c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce2176a480 0x55ce2178c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21774d40 0x55ce21773330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d5436d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c1afc90 con 0x55ce21774d40 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d5436d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c1ad560 con 0x55ce2176a480 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d5436d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c1ab3b0 con 0x55ce21769b60 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce2176a480 0x55ce2178c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21774d40 0x55ce21773330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce2176a480 0x55ce2178c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:41576/0 (socket says 172.21.15.73:41576) 2024-09-05T12:58:31.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4affd640 1 -- 172.21.15.73:0/524832090 learned_addr learned my addr 172.21.15.73:0/524832090 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce21769b60 0x55ce2178c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4affd640 1 -- 172.21.15.73:0/524832090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce21769b60 msgr2=0x55ce2178c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4affd640 1 --2- 172.21.15.73:0/524832090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce21769b60 0x55ce2178c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4affd640 1 -- 172.21.15.73:0/524832090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21774d40 msgr2=0x55ce21773330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4affd640 1 --2- 172.21.15.73:0/524832090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21774d40 0x55ce21773330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4affd640 1 -- 172.21.15.73:0/524832090 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce2176a2b0 con 0x55ce2176a480 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.793+0000 7f0d4affd640 1 --2- 172.21.15.73:0/524832090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce2176a480 0x55ce2178c910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d3402b940 tx=0x7f0d34004c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcf570b9b7a59960 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d417fa640 1 -- 172.21.15.73:0/524832090 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34004080 con 0x55ce2176a480 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d417fa640 1 -- 172.21.15.73:0/524832090 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d3402b5c0 con 0x55ce2176a480 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d417fa640 1 -- 172.21.15.73:0/524832090 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34005100 con 0x55ce2176a480 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d5436d740 1 -- 172.21.15.73:0/524832090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce2176a480 msgr2=0x55ce2178c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d5436d740 1 --2- 172.21.15.73:0/524832090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce2176a480 0x55ce2178c910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d3402b940 tx=0x7f0d34004c50 comp rx=0 tx=0).stop 2024-09-05T12:58:31.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d5436d740 1 -- 172.21.15.73:0/524832090 shutdown_connections 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d5436d740 1 --2- 172.21.15.73:0/524832090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21774d40 0x55ce21773330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d5436d740 1 --2- 172.21.15.73:0/524832090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce2176a480 0x55ce2178c910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d5436d740 1 --2- 172.21.15.73:0/524832090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce21769b60 0x55ce2178c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d5436d740 1 -- 172.21.15.73:0/524832090 >> 172.21.15.73:0/524832090 conn(0x55ce217660f0 msgr2=0x55ce2176bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d5436d740 1 -- 172.21.15.73:0/524832090 shutdown_connections 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.794+0000 7f0d5436d740 1 -- 172.21.15.73:0/524832090 wait complete. 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.795+0000 7f0d5436d740 1 -- start start 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.795+0000 7f0d5436d740 1 Processor -- start 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.795+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce2177d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.795+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 0x55ce21778570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.795+0000 7f0d5436d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21774d40 0x55ce21778ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce2177d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.795+0000 7f0d5436d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c1aba20 con 0x55ce21769b60 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d5436d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c1ace90 con 0x55ce21774d40 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce2177d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56928/0 (socket says 172.21.15.73:56928) 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d5436d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c1ac0f0 con 0x55ce2176a480 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4b7fe640 1 -- 172.21.15.73:0/4220201166 learned_addr learned my addr 172.21.15.73:0/4220201166 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4affd640 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 0x55ce21778570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d5436d740 10 client.0 _ll_register_callbacks cb 0x7f0d3400ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4bfff640 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21774d40 0x55ce21778ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4b7fe640 1 -- 172.21.15.73:0/4220201166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 msgr2=0x55ce21778570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4b7fe640 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 0x55ce21778570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4b7fe640 1 -- 172.21.15.73:0/4220201166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21774d40 msgr2=0x55ce21778ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4b7fe640 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21774d40 0x55ce21778ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4b7fe640 1 -- 172.21.15.73:0/4220201166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce217790f0 con 0x55ce21769b60 2024-09-05T12:58:31.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d4b7fe640 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce2177d1f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x55ce21787370 tx=0x7f0d3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae16f82f13a68a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d2affd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d2affd640 1 -- 172.21.15.73:0/4220201166 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c004220 con 0x55ce21769b60 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d2affd640 1 -- 172.21.15.73:0/4220201166 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0d3c0043c0 con 0x55ce21769b60 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d5436d740 1 -- 172.21.15.73:0/4220201166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d3402b5c0 con 0x55ce21769b60 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d2affd640 1 -- 172.21.15.73:0/4220201166 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d3c037070 con 0x55ce21769b60 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d5436d740 10 client.15486 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.796+0000 7f0d5436d740 1 -- 172.21.15.73:0/4220201166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce217ef230 con 0x55ce21769b60 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.797+0000 7f0d2affd640 1 -- 172.21.15.73:0/4220201166 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d3402b5c0 con 0x55ce21769b60 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.797+0000 7f0d2affd640 1 -- 172.21.15.73:0/4220201166 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0d3c0037a0 con 0x55ce21769b60 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.797+0000 7f0d5436d740 10 client.15486 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.797+0000 7f0d5436d740 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.797+0000 7f0d5436d740 20 client.15486 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.797+0000 7f0d5436d740 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ce217ef960 0x55ce217f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:31.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.797+0000 7f0d5436d740 4 client.15486 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T12:58:31.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.797+0000 7f0d5436d740 1 -- 172.21.15.73:0/4220201166 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ce216d6d00 con 0x55ce217ef960 2024-09-05T12:58:31.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.797+0000 7f0d4affd640 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ce217ef960 0x55ce217f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:31.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.798+0000 7f0d4affd640 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ce217ef960 0x55ce217f1da0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa3651f61fd1af5 server_cookie=8c7ca2e9e367314a in_seq=0 out_seq=0 2024-09-05T12:58:31.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.798+0000 7f0d2affd640 10 client.15486 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:31.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.826+0000 7f0d2affd640 1 -- 172.21.15.73:0/4220201166 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ce216d6d00 con 0x55ce217ef960 2024-09-05T12:58:31.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.826+0000 7f0d2affd640 10 client.15486 handle_command_reply: tid=0 2024-09-05T12:58:31.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.826+0000 7f0d5436d740 1 client.15486 shutdown 2024-09-05T12:58:31.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 1 -- 172.21.15.73:0/4220201166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 msgr2=0x55ce2177d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce2177d1f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x55ce21787370 tx=0x7f0d3c0046c0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 1 -- 172.21.15.73:0/4220201166 shutdown_connections 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ce217ef960 0x55ce217f1da0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce21774d40 0x55ce21778ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce2176a480 0x55ce21778570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 1 --2- 172.21.15.73:0/4220201166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce21769b60 0x55ce2177d1f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 1 -- 172.21.15.73:0/4220201166 >> 172.21.15.73:0/4220201166 conn(0x55ce217660f0 msgr2=0x55ce21771b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d2affd640 0 client.15486 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 1 -- 172.21.15.73:0/4220201166 shutdown_connections 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 1 -- 172.21.15.73:0/4220201166 wait complete. 2024-09-05T12:58:31.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.827+0000 7f0d5436d740 20 client.15486 trim_cache size 0 max 16384 2024-09-05T12:58:31.830 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:58:31.830 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2024-09-05T12:58:31.830 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "83885b18-524d-4837-a1b4-47939ae8a653", 2024-09-05T12:58:31.830 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2024-09-05T12:58:31.830 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:58:31.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 -- 172.21.15.73:0/71847325 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d380a2b80 msgr2=0x7f0d380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d380a2b80 0x7f0d380a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c005d00 tx=0x7f0d3c00b410 comp rx=0 tx=0).stop 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 -- 172.21.15.73:0/71847325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d4c102ef0 msgr2=0x7f0d4c19cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d4c102ef0 0x7f0d4c19cd80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0d4402ae70 tx=0x7f0d4402f5d0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 -- 172.21.15.73:0/71847325 shutdown_connections 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0d380a2b80 0x7f0d380a5040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d4c102ef0 0x7f0d4c19cd80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d4c102570 0x7f0d4c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 --2- 172.21.15.73:0/71847325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d4c100e20 0x7f0d4c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 -- 172.21.15.73:0/71847325 >> 172.21.15.73:0/71847325 conn(0x7f0d4c0fc7d0 msgr2=0x7f0d4c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 -- 172.21.15.73:0/71847325 shutdown_connections 2024-09-05T12:58:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:31.828+0000 7f0d51f97640 1 -- 172.21.15.73:0/71847325 wait complete. 2024-09-05T12:58:31.898 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-05T12:58:32.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:32 smithi162 ceph-mon[34220]: scrub queued for path: / 2024-09-05T12:58:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:32 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:32 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T12:58:32.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:32 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:32 smithi169 ceph-mon[34823]: scrub queued for path: / 2024-09-05T12:58:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:32 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:32 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T12:58:32.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:32 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:32.437 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:32 smithi073 ceph-mon[30883]: scrub queued for path: / 2024-09-05T12:58:32.437 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:32 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:32.437 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:32 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T12:58:32.437 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:32 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T12:58:32.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T12:58:32.749 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:58:32.906 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether build environment is sane... yes 2024-09-05T12:58:32.915 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-05T12:58:32.915 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gawk... gawk 2024-09-05T12:58:32.930 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether make sets $(MAKE)... yes 2024-09-05T12:58:32.958 INFO:tasks.workunit.client.0.smithi073.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-05T12:58:32.958 INFO:tasks.workunit.client.0.smithi073.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-05T12:58:32.968 INFO:tasks.workunit.client.0.smithi073.stdout:checking for style of include used by make... GNU 2024-09-05T12:58:32.972 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... gcc 2024-09-05T12:58:33.031 INFO:tasks.workunit.client.0.smithi073.stdout:checking for C compiler default output file name... a.out 2024-09-05T12:58:33.032 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether the C compiler works... yes 2024-09-05T12:58:33.035 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are cross compiling... no 2024-09-05T12:58:33.070 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of executables... 2024-09-05T12:58:33.108 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of object files... o 2024-09-05T12:58:33.148 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... yes 2024-09-05T12:58:33.156 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:33 smithi073 ceph-mon[30883]: pgmap v354: 97 pgs: 97 active+clean; 664 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-05T12:58:33.194 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... yes 2024-09-05T12:58:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.240+0000 7fad09b53640 1 -- 172.21.15.73:0/1722500225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad0410e510 msgr2=0x7fad04110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.240+0000 7fad09b53640 1 --2- 172.21.15.73:0/1722500225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad0410e510 0x7fad04110900 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7facfc009ca0 tx=0x7facfc02a8c0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.240+0000 7fad09b53640 1 -- 172.21.15.73:0/1722500225 shutdown_connections 2024-09-05T12:58:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.240+0000 7fad09b53640 1 --2- 172.21.15.73:0/1722500225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad0410e510 0x7fad04110900 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.240+0000 7fad09b53640 1 --2- 172.21.15.73:0/1722500225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad04101310 0x7fad0410dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.240+0000 7fad09b53640 1 --2- 172.21.15.73:0/1722500225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad04100960 0x7fad04100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.240+0000 7fad09b53640 1 -- 172.21.15.73:0/1722500225 >> 172.21.15.73:0/1722500225 conn(0x7fad040fc7d0 msgr2=0x7fad040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.240+0000 7fad09b53640 1 -- 172.21.15.73:0/1722500225 shutdown_connections 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.240+0000 7fad09b53640 1 -- 172.21.15.73:0/1722500225 wait complete. 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad09b53640 1 Processor -- start 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad09b53640 1 -- start start 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad09b53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad04100960 0x7fad0419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad09b53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad04101310 0x7fad0419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad09b53640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad0410e510 0x7fad0419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad09b53640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fad04114180 con 0x7fad04101310 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad09b53640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad04114000 con 0x7fad0410e510 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad09b53640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fad04114300 con 0x7fad04100960 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad02ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad04101310 0x7fad0419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad02ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad04101310 0x7fad0419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56942/0 (socket says 172.21.15.73:56942) 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad02ffd640 1 -- 172.21.15.73:0/4157719495 learned_addr learned my addr 172.21.15.73:0/4157719495 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad03fff640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad0410e510 0x7fad0419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad037fe640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad04100960 0x7fad0419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad02ffd640 1 -- 172.21.15.73:0/4157719495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad04100960 msgr2=0x7fad0419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.241+0000 7fad02ffd640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad04100960 0x7fad0419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.242+0000 7fad02ffd640 1 -- 172.21.15.73:0/4157719495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad0410e510 msgr2=0x7fad0419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.242+0000 7fad02ffd640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad0410e510 0x7fad0419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.242+0000 7fad02ffd640 1 -- 172.21.15.73:0/4157719495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0419f610 con 0x7fad04101310 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.242+0000 7fad02ffd640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad04101310 0x7fad0419aba0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7facf800e9f0 tx=0x7facf800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.242+0000 7fad00ff9640 1 -- 172.21.15.73:0/4157719495 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf800cd80 con 0x7fad04101310 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.242+0000 7fad00ff9640 1 -- 172.21.15.73:0/4157719495 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facf8010910 con 0x7fad04101310 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.242+0000 7fad09b53640 1 -- 172.21.15.73:0/4157719495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0419f900 con 0x7fad04101310 2024-09-05T12:58:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.242+0000 7fad00ff9640 1 -- 172.21.15.73:0/4157719495 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8018990 con 0x7fad04101310 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.242+0000 7fad09b53640 1 -- 172.21.15.73:0/4157719495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad041a71e0 con 0x7fad04101310 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad0bf29740 1 Processor -- start 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad0bf29740 1 -- start start 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584df4a0 0x5571584df880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584dfdc0 0x5571584ea140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571584eca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad0bf29740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5571584452e0 con 0x5571584ea680 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad0bf29740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5571583ecce0 con 0x5571584df4a0 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad0bf29740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5571584412a0 con 0x5571584dfdc0 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad00ff9640 1 -- 172.21.15.73:0/4157719495 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7facf8010ac0 con 0x7fad04101310 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad037fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584dfdc0 0x5571584ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad03fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584df4a0 0x5571584df880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad037fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584dfdc0 0x5571584ea140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:44866/0 (socket says 172.21.15.73:44866) 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad037fe640 1 -- 172.21.15.73:0/197777993 learned_addr learned my addr 172.21.15.73:0/197777993 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.245+0000 7fad02ffd640 1 --2- 172.21.15.73:0/197777993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571584eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7fad037fe640 1 -- 172.21.15.73:0/197777993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584df4a0 msgr2=0x5571584df880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7fad037fe640 1 --2- 172.21.15.73:0/197777993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584df4a0 0x5571584df880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7fad037fe640 1 -- 172.21.15.73:0/197777993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 msgr2=0x5571584eca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7fad037fe640 1 --2- 172.21.15.73:0/197777993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571584eca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7fad037fe640 1 -- 172.21.15.73:0/197777993 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571583d1440 con 0x5571584dfdc0 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7fad037fe640 1 --2- 172.21.15.73:0/197777993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584dfdc0 0x5571584ea140 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facf400cbe0 tx=0x7facf400e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74ebea7c0530fc05 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7face9ffb640 1 -- 172.21.15.73:0/197777993 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4010630 con 0x5571584dfdc0 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7fad00ff9640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7facec0a2b80 0x7facec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7face9ffb640 1 -- 172.21.15.73:0/197777993 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facf4010cb0 con 0x5571584dfdc0 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7face9ffb640 1 -- 172.21.15.73:0/197777993 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf401ac20 con 0x5571584dfdc0 2024-09-05T12:58:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7fad03fff640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7facec0a2b80 0x7facec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.246+0000 7fad00ff9640 1 -- 172.21.15.73:0/4157719495 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7facf80cf320 con 0x7fad04101310 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad0bf29740 1 -- 172.21.15.73:0/197777993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584dfdc0 msgr2=0x5571584ea140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad03fff640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7facec0a2b80 0x7facec0a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7facfc006010 tx=0x7facfc004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad0bf29740 1 --2- 172.21.15.73:0/197777993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584dfdc0 0x5571584ea140 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facf400cbe0 tx=0x7facf400e720 comp rx=0 tx=0).stop 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad0bf29740 1 -- 172.21.15.73:0/197777993 shutdown_connections 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad0bf29740 1 --2- 172.21.15.73:0/197777993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571584eca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad0bf29740 1 --2- 172.21.15.73:0/197777993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584dfdc0 0x5571584ea140 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad0bf29740 1 --2- 172.21.15.73:0/197777993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584df4a0 0x5571584df880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad0bf29740 1 -- 172.21.15.73:0/197777993 >> 172.21.15.73:0/197777993 conn(0x5571584dba30 msgr2=0x5571584dbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad0bf29740 1 -- 172.21.15.73:0/197777993 shutdown_connections 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad0bf29740 1 -- 172.21.15.73:0/197777993 wait complete. 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.247+0000 7fad0bf29740 1 -- start start 2024-09-05T12:58:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad0bf29740 1 Processor -- start 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584df4a0 0x5571584e9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 0x5571584e7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571584e7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad0bf29740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5571584ed250 con 0x5571584ea680 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad0bf29740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557158400050 con 0x5571584dfdc0 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad0bf29740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5571584ed3d0 con 0x5571584df4a0 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad0bf29740 10 client.0 _ll_register_callbacks cb 0x557158440160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad03fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571584e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad03fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571584e7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56960/0 (socket says 172.21.15.73:56960) 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad03fff640 1 -- 172.21.15.73:0/1621199655 learned_addr learned my addr 172.21.15.73:0/1621199655 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad02ffd640 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 0x5571584e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad037fe640 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584df4a0 0x5571584e9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad03fff640 1 -- 172.21.15.73:0/1621199655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584df4a0 msgr2=0x5571584e9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad03fff640 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584df4a0 0x5571584e9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad03fff640 1 -- 172.21.15.73:0/1621199655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 msgr2=0x5571584e7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad03fff640 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 0x5571584e7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad03fff640 1 -- 172.21.15.73:0/1621199655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571581b63c0 con 0x5571584ea680 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad02ffd640 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 0x5571584e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7fad03fff640 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571584e7750 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7facfc009a60 tx=0x7facfc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba473c734c896027 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.248+0000 7face2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7face2ffd640 1 -- 172.21.15.73:0/1621199655 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc004310 con 0x5571584ea680 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7face2ffd640 1 -- 172.21.15.73:0/1621199655 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7facfc0044b0 con 0x5571584ea680 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7fad0bf29740 1 -- 172.21.15.73:0/1621199655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facf4010cb0 con 0x5571584ea680 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7face2ffd640 1 -- 172.21.15.73:0/1621199655 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7facfc0046f0 con 0x5571584ea680 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7fad0bf29740 10 client.15498 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7fad0bf29740 1 -- 172.21.15.73:0/1621199655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5571584f8bc0 con 0x5571584ea680 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7face2ffd640 1 -- 172.21.15.73:0/1621199655 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facf4010cb0 con 0x5571584ea680 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7face2ffd640 1 -- 172.21.15.73:0/1621199655 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7facfc030780 con 0x5571584ea680 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7fad0bf29740 10 client.15498 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7fad0bf29740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7fad0bf29740 20 client.15498 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7fad0bf29740 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5571584fa080 0x5571584fc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7fad0bf29740 4 client.15498 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.249+0000 7fad0bf29740 1 -- 172.21.15.73:0/1621199655 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557158452850 con 0x5571584fa080 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.250+0000 7fad037fe640 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5571584fa080 0x5571584fc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.250+0000 7fad037fe640 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5571584fa080 0x5571584fc490 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64cfa4636527259 server_cookie=850b3f66b6b41b24 in_seq=0 out_seq=0 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.250+0000 7face2ffd640 10 client.15498 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7face2ffd640 1 -- 172.21.15.73:0/1621199655 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557158452850 con 0x5571584fa080 2024-09-05T12:58:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7face2ffd640 10 client.15498 handle_command_reply: tid=0 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 client.15498 shutdown 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 -- 172.21.15.73:0/1621199655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 msgr2=0x5571584e7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571584e7750 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7facfc009a60 tx=0x7facfc02a8c0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 -- 172.21.15.73:0/1621199655 shutdown_connections 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5571584fa080 0x5571584fc490 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571584e7750 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7face2ffd640 0 client.15498 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 0x5571584e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 --2- 172.21.15.73:0/1621199655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584df4a0 0x5571584e9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 -- 172.21.15.73:0/1621199655 >> 172.21.15.73:0/1621199655 conn(0x5571584dba30 msgr2=0x5571584e1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 -- 172.21.15.73:0/1621199655 shutdown_connections 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 1 -- 172.21.15.73:0/1621199655 wait complete. 2024-09-05T12:58:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.251+0000 7fad0bf29740 20 client.15498 trim_cache size 0 max 16384 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad0bf29740 1 Processor -- start 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad0bf29740 1 -- start start 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584df4a0 0x5571584e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 0x557158501d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571585022a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad0bf29740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fad041b2040 con 0x5571584ea680 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad0bf29740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad041af910 con 0x5571584dfdc0 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad0bf29740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fad041ad760 con 0x5571584df4a0 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad03fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571585022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad03fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571585022a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56970/0 (socket says 172.21.15.73:56970) 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad03fff640 1 -- 172.21.15.73:0/316842037 learned_addr learned my addr 172.21.15.73:0/316842037 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.268+0000 7fad037fe640 1 --2- 172.21.15.73:0/316842037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584df4a0 0x5571584e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7fad02ffd640 1 --2- 172.21.15.73:0/316842037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 0x557158501d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7fad03fff640 1 -- 172.21.15.73:0/316842037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584df4a0 msgr2=0x5571584e9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7fad03fff640 1 --2- 172.21.15.73:0/316842037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584df4a0 0x5571584e9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7fad03fff640 1 -- 172.21.15.73:0/316842037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 msgr2=0x557158501d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7fad03fff640 1 --2- 172.21.15.73:0/316842037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 0x557158501d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7fad03fff640 1 -- 172.21.15.73:0/316842037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571584e5760 con 0x5571584ea680 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7fad02ffd640 1 --2- 172.21.15.73:0/316842037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 0x557158501d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7fad03fff640 1 --2- 172.21.15.73:0/316842037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571585022a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7facfc009bf0 tx=0x7facfc005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b89f9ad10a81e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7face97fa640 1 -- 172.21.15.73:0/316842037 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc004310 con 0x5571584ea680 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7face97fa640 1 -- 172.21.15.73:0/316842037 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc04e070 con 0x5571584ea680 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.269+0000 7face97fa640 1 -- 172.21.15.73:0/316842037 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc02fce0 con 0x5571584ea680 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 -- 172.21.15.73:0/316842037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 msgr2=0x5571585022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 --2- 172.21.15.73:0/316842037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571585022a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7facfc009bf0 tx=0x7facfc005d10 comp rx=0 tx=0).stop 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 -- 172.21.15.73:0/316842037 shutdown_connections 2024-09-05T12:58:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 --2- 172.21.15.73:0/316842037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584ea680 0x5571585022a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 --2- 172.21.15.73:0/316842037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584dfdc0 0x557158501d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 --2- 172.21.15.73:0/316842037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584df4a0 0x5571584e9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 -- 172.21.15.73:0/316842037 >> 172.21.15.73:0/316842037 conn(0x5571584dba30 msgr2=0x5571584e8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 -- 172.21.15.73:0/316842037 shutdown_connections 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 -- 172.21.15.73:0/316842037 wait complete. 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 -- start start 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.270+0000 7fad0bf29740 1 Processor -- start 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584df4a0 0x5571584f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584dfdc0 0x5571584efde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad0bf29740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584ea680 0x5571584f0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad0bf29740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fad041addd0 con 0x5571584dfdc0 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad0bf29740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad041af240 con 0x5571584df4a0 2024-09-05T12:58:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad0bf29740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fad041ae4a0 con 0x5571584ea680 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad0bf29740 10 client.0 _ll_register_callbacks cb 0x7facfc02f470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad02ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584dfdc0 0x5571584efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad02ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584dfdc0 0x5571584efde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56982/0 (socket says 172.21.15.73:56982) 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad02ffd640 1 -- 172.21.15.73:0/3051277763 learned_addr learned my addr 172.21.15.73:0/3051277763 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad037fe640 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584df4a0 0x5571584f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad03fff640 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584ea680 0x5571584f0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad02ffd640 1 -- 172.21.15.73:0/3051277763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584ea680 msgr2=0x5571584f0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad02ffd640 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584ea680 0x5571584f0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad02ffd640 1 -- 172.21.15.73:0/3051277763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584df4a0 msgr2=0x5571584f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad02ffd640 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584df4a0 0x5571584f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad02ffd640 1 -- 172.21.15.73:0/3051277763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571584f0860 con 0x5571584dfdc0 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad03fff640 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584ea680 0x5571584f0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:58:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7fad02ffd640 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584dfdc0 0x5571584efde0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7facf8098010 tx=0x7facf8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeee0185db97c9f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7face2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.271+0000 7face2ffd640 1 -- 172.21.15.73:0/3051277763 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf809b6f0 con 0x5571584dfdc0 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7face2ffd640 1 -- 172.21.15.73:0/3051277763 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7facf8018d30 con 0x5571584dfdc0 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7fad0bf29740 1 -- 172.21.15.73:0/3051277763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facfc04e070 con 0x5571584dfdc0 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7face2ffd640 1 -- 172.21.15.73:0/3051277763 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7facf809b510 con 0x5571584dfdc0 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7fad0bf29740 10 client.15504 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7fad0bf29740 1 -- 172.21.15.73:0/3051277763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557158564ac0 con 0x5571584dfdc0 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7face2ffd640 1 -- 172.21.15.73:0/3051277763 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc04e070 con 0x5571584dfdc0 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7face2ffd640 1 -- 172.21.15.73:0/3051277763 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7facf8097a10 con 0x5571584dfdc0 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7fad0bf29740 10 client.15504 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7fad0bf29740 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7fad0bf29740 20 client.15504 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7fad0bf29740 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5571584fa080 0x5571585672d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7fad0bf29740 4 client.15504 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.272+0000 7fad0bf29740 1 -- 172.21.15.73:0/3051277763 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55715844cd60 con 0x5571584fa080 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7fad037fe640 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5571584fa080 0x5571585672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7face2ffd640 10 client.15504 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7fad037fe640 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5571584fa080 0x5571585672d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d8aa7a63ddf6c0e server_cookie=e71522729cc04bd in_seq=0 out_seq=0 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7face2ffd640 1 -- 172.21.15.73:0/3051277763 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55715844cd60 con 0x5571584fa080 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7face2ffd640 10 client.15504 handle_command_reply: tid=0 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7fad0bf29740 1 client.15504 shutdown 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7fad0bf29740 1 -- 172.21.15.73:0/3051277763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584dfdc0 msgr2=0x5571584efde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7fad0bf29740 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584dfdc0 0x5571584efde0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7facf8098010 tx=0x7facf8000bc0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7fad0bf29740 1 -- 172.21.15.73:0/3051277763 shutdown_connections 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7fad0bf29740 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5571584fa080 0x5571585672d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7fad0bf29740 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571584ea680 0x5571584f0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7fad0bf29740 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5571584dfdc0 0x5571584efde0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7face2ffd640 0 client.15504 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.273+0000 7fad0bf29740 1 --2- 172.21.15.73:0/3051277763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571584df4a0 0x5571584f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad0bf29740 1 -- 172.21.15.73:0/3051277763 >> 172.21.15.73:0/3051277763 conn(0x5571584dba30 msgr2=0x5571584e9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad0bf29740 1 -- 172.21.15.73:0/3051277763 shutdown_connections 2024-09-05T12:58:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad0bf29740 1 -- 172.21.15.73:0/3051277763 wait complete. 2024-09-05T12:58:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad0bf29740 20 client.15504 trim_cache size 0 max 16384 2024-09-05T12:58:33.291 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:58:33.291 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-05T12:58:33.291 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2024-09-05T12:58:33.291 INFO:teuthology.orchestra.run.smithi073.stdout: "83885b18-524d-4837-a1b4-47939ae8a653": { 2024-09-05T12:58:33.291 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-05T12:58:33.292 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "83885b18-524d-4837-a1b4-47939ae8a653", 2024-09-05T12:58:33.292 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2024-09-05T12:58:33.292 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T12:58:33.292 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T12:58:33.292 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:58:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad09b53640 1 -- 172.21.15.73:0/4157719495 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7facec0a2b80 msgr2=0x7facec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad09b53640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7facec0a2b80 0x7facec0a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7facfc006010 tx=0x7facfc004a80 comp rx=0 tx=0).stop 2024-09-05T12:58:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad09b53640 1 -- 172.21.15.73:0/4157719495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad04101310 msgr2=0x7fad0419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad09b53640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad04101310 0x7fad0419aba0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7facf800e9f0 tx=0x7facf800eeb0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad09b53640 1 -- 172.21.15.73:0/4157719495 shutdown_connections 2024-09-05T12:58:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad09b53640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7facec0a2b80 0x7facec0a5040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad09b53640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad0410e510 0x7fad0419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad09b53640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad04101310 0x7fad0419aba0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad09b53640 1 --2- 172.21.15.73:0/4157719495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad04100960 0x7fad0419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.274+0000 7fad09b53640 1 -- 172.21.15.73:0/4157719495 >> 172.21.15.73:0/4157719495 conn(0x7fad040fc7d0 msgr2=0x7fad0410f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.275+0000 7fad09b53640 1 -- 172.21.15.73:0/4157719495 shutdown_connections 2024-09-05T12:58:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:58:33.275+0000 7fad09b53640 1 -- 172.21.15.73:0/4157719495 wait complete. 2024-09-05T12:58:33.300 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-05T12:58:33.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:33 smithi162 ceph-mon[34220]: pgmap v354: 97 pgs: 97 active+clean; 664 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-05T12:58:33.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:33 smithi169 ceph-mon[34823]: pgmap v354: 97 pgs: 97 active+clean; 664 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-05T12:58:33.411 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... gcc3 2024-09-05T12:58:33.520 INFO:tasks.workunit.client.0.smithi073.stdout:checking how to run the C preprocessor... gcc -E 2024-09-05T12:58:33.561 INFO:tasks.workunit.client.0.smithi073.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-05T12:58:33.562 INFO:tasks.workunit.client.0.smithi073.stdout:checking for egrep... /usr/bin/grep -E 2024-09-05T12:58:33.571 INFO:tasks.workunit.client.0.smithi073.stdout:checking for AIX... no 2024-09-05T12:58:33.599 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... (cached) gcc 2024-09-05T12:58:33.606 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-05T12:58:33.608 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-05T12:58:33.608 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-05T12:58:33.609 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-05T12:58:33.655 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lm... yes 2024-09-05T12:58:33.704 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lpthread... yes 2024-09-05T12:58:33.918 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ANSI C header files... yes 2024-09-05T12:58:34.077 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-05T12:58:34.079 INFO:tasks.cephfs.filesystem:scrub status for tag:83885b18-524d-4837-a1b4-47939ae8a653 - {'path': '/', 'tag': '83885b18-524d-4837-a1b4-47939ae8a653', 'options': 'recursive,force'} 2024-09-05T12:58:34.121 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/types.h... yes 2024-09-05T12:58:34.172 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/stat.h... yes 2024-09-05T12:58:34.220 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdlib.h... yes 2024-09-05T12:58:34.266 INFO:tasks.workunit.client.0.smithi073.stdout:checking for string.h... yes 2024-09-05T12:58:34.317 INFO:tasks.workunit.client.0.smithi073.stdout:checking for memory.h... yes 2024-09-05T12:58:34.367 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strings.h... yes 2024-09-05T12:58:34.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:34 smithi169 ceph-mon[34823]: pgmap v355: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 159 KiB/s wr, 15 op/s 2024-09-05T12:58:34.417 INFO:tasks.workunit.client.0.smithi073.stdout:checking for inttypes.h... yes 2024-09-05T12:58:34.456 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:34 smithi073 ceph-mon[30883]: pgmap v355: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 159 KiB/s wr, 15 op/s 2024-09-05T12:58:34.466 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... yes 2024-09-05T12:58:34.519 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... yes 2024-09-05T12:58:34.581 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h usability... yes 2024-09-05T12:58:34.606 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h presence... yes 2024-09-05T12:58:34.606 INFO:tasks.workunit.client.0.smithi073.stdout:checking for pthread.h... yes 2024-09-05T12:58:34.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:34 smithi162 ceph-mon[34220]: pgmap v355: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 159 KiB/s wr, 15 op/s 2024-09-05T12:58:34.662 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h usability... yes 2024-09-05T12:58:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h presence... yes 2024-09-05T12:58:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fcntl.h... yes 2024-09-05T12:58:34.743 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h usability... yes 2024-09-05T12:58:34.766 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h presence... yes 2024-09-05T12:58:34.766 INFO:tasks.workunit.client.0.smithi073.stdout:checking for limits.h... yes 2024-09-05T12:58:34.780 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... (cached) yes 2024-09-05T12:58:34.834 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h usability... yes 2024-09-05T12:58:34.858 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h presence... yes 2024-09-05T12:58:34.858 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/time.h... yes 2024-09-05T12:58:34.872 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... (cached) yes 2024-09-05T12:58:34.926 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h usability... yes 2024-09-05T12:58:34.949 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h presence... yes 2024-09-05T12:58:34.949 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/vfs.h... yes 2024-09-05T12:58:34.996 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h usability... no 2024-09-05T12:58:35.015 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h presence... no 2024-09-05T12:58:35.016 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/limits.h... no 2024-09-05T12:58:35.048 INFO:tasks.workunit.client.0.smithi073.stdout:checking for an ANSI C-conforming const... yes 2024-09-05T12:58:35.081 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-05T12:58:35.082 INFO:tasks.workunit.client.0.smithi073.stdout:checking for function prototypes... yes 2024-09-05T12:58:35.116 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether setvbuf arguments are reversed... no 2024-09-05T12:58:35.189 INFO:tasks.workunit.client.0.smithi073.stdout:checking for system... yes 2024-09-05T12:58:35.253 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gettimeofday... yes 2024-09-05T12:58:35.317 INFO:tasks.workunit.client.0.smithi073.stdout:checking for mkdir... yes 2024-09-05T12:58:35.381 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strerror... yes 2024-09-05T12:58:35.446 INFO:tasks.workunit.client.0.smithi073.stdout:checking for open64... yes 2024-09-05T12:58:35.519 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stat64... yes 2024-09-05T12:58:35.584 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fseeko64... yes 2024-09-05T12:58:35.650 INFO:tasks.workunit.client.0.smithi073.stdout:checking for lrand48_r... yes 2024-09-05T12:58:35.716 INFO:tasks.workunit.client.0.smithi073.stdout:checking for srand48_r... yes 2024-09-05T12:58:35.740 INFO:tasks.workunit.client.0.smithi073.stdout:configure: creating ./config.status 2024-09-05T12:58:35.845 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating Makefile 2024-09-05T12:58:35.861 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating config.h 2024-09-05T12:58:35.877 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing depfiles commands 2024-09-05T12:58:35.924 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing default commands 2024-09-05T12:58:36.082 INFO:tasks.workunit.client.0.smithi073.stderr:+ make 2024-09-05T12:58:36.102 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-05T12:58:36.105 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-05T12:58:36.106 INFO:tasks.workunit.client.0.smithi073.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-05T12:58:36.106 INFO:tasks.workunit.client.0.smithi073.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-05T12:58:36.106 INFO:tasks.workunit.client.0.smithi073.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-05T12:58:36.106 INFO:tasks.workunit.client.0.smithi073.stderr: any GNU archive site. 2024-09-05T12:58:36.107 INFO:tasks.workunit.client.0.smithi073.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-05T12:58:36.109 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-05T12:58:36.109 INFO:tasks.workunit.client.0.smithi073.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-05T12:58:36.110 INFO:tasks.workunit.client.0.smithi073.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-05T12:58:36.110 INFO:tasks.workunit.client.0.smithi073.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-05T12:58:36.110 INFO:tasks.workunit.client.0.smithi073.stderr: Grab them from any GNU archive site. 2024-09-05T12:58:36.163 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-05T12:58:36.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:36 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T12:58:36.428 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:36 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T12:58:36.458 INFO:tasks.workunit.client.0.smithi073.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-05T12:58:36.458 INFO:tasks.workunit.client.0.smithi073.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-05T12:58:36.459 INFO:tasks.workunit.client.0.smithi073.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-05T12:58:36.459 INFO:tasks.workunit.client.0.smithi073.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-05T12:58:36.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:36 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T12:58:36.572 INFO:tasks.workunit.client.0.smithi073.stdout:/bin/sh ./config.status --recheck 2024-09-05T12:58:36.630 INFO:tasks.workunit.client.0.smithi073.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-05T12:58:36.744 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-05T12:58:37.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:37 smithi162 ceph-mon[34220]: pgmap v356: 97 pgs: 97 active+clean; 2.4 MiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 162 KiB/s wr, 15 op/s 2024-09-05T12:58:37.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:37 smithi169 ceph-mon[34823]: pgmap v356: 97 pgs: 97 active+clean; 2.4 MiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 162 KiB/s wr, 15 op/s 2024-09-05T12:58:37.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:37 smithi073 ceph-mon[30883]: pgmap v356: 97 pgs: 97 active+clean; 2.4 MiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 162 KiB/s wr, 15 op/s 2024-09-05T12:58:37.751 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether build environment is sane... yes 2024-09-05T12:58:37.756 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-05T12:58:37.756 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gawk... gawk 2024-09-05T12:58:37.781 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether make sets $(MAKE)... yes 2024-09-05T12:58:37.812 INFO:tasks.workunit.client.0.smithi073.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-05T12:58:37.812 INFO:tasks.workunit.client.0.smithi073.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-05T12:58:37.823 INFO:tasks.workunit.client.0.smithi073.stdout:checking for style of include used by make... GNU 2024-09-05T12:58:37.828 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... gcc 2024-09-05T12:58:37.913 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether the C compiler works... yes 2024-09-05T12:58:37.913 INFO:tasks.workunit.client.0.smithi073.stdout:checking for C compiler default output file name... a.out 2024-09-05T12:58:37.952 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of executables... 2024-09-05T12:58:37.991 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are cross compiling... no 2024-09-05T12:58:38.031 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of object files... o 2024-09-05T12:58:38.054 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... yes 2024-09-05T12:58:38.077 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... yes 2024-09-05T12:58:38.122 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-05T12:58:38.221 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... gcc3 2024-09-05T12:58:38.275 INFO:tasks.workunit.client.0.smithi073.stdout:checking how to run the C preprocessor... gcc -E 2024-09-05T12:58:38.331 INFO:tasks.workunit.client.0.smithi073.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-05T12:58:38.332 INFO:tasks.workunit.client.0.smithi073.stdout:checking for egrep... /usr/bin/grep -E 2024-09-05T12:58:38.463 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ANSI C header files... yes 2024-09-05T12:58:38.500 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/types.h... yes 2024-09-05T12:58:38.542 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/stat.h... yes 2024-09-05T12:58:38.584 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdlib.h... yes 2024-09-05T12:58:38.628 INFO:tasks.workunit.client.0.smithi073.stdout:checking for string.h... yes 2024-09-05T12:58:38.667 INFO:tasks.workunit.client.0.smithi073.stdout:checking for memory.h... yes 2024-09-05T12:58:38.706 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strings.h... yes 2024-09-05T12:58:38.745 INFO:tasks.workunit.client.0.smithi073.stdout:checking for inttypes.h... yes 2024-09-05T12:58:38.785 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... yes 2024-09-05T12:58:38.827 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... yes 2024-09-05T12:58:38.871 INFO:tasks.workunit.client.0.smithi073.stdout:checking minix/config.h usability... no 2024-09-05T12:58:38.897 INFO:tasks.workunit.client.0.smithi073.stdout:checking minix/config.h presence... no 2024-09-05T12:58:38.897 INFO:tasks.workunit.client.0.smithi073.stdout:checking for minix/config.h... no 2024-09-05T12:58:38.931 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-05T12:58:38.931 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... (cached) gcc 2024-09-05T12:58:38.966 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-05T12:58:38.966 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-05T12:58:38.966 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-05T12:58:38.966 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-05T12:58:39.008 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lm... yes 2024-09-05T12:58:39.050 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lpthread... yes 2024-09-05T12:58:39.051 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ANSI C header files... (cached) yes 2024-09-05T12:58:39.083 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-05T12:58:39.145 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h usability... yes 2024-09-05T12:58:39.164 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h presence... yes 2024-09-05T12:58:39.164 INFO:tasks.workunit.client.0.smithi073.stdout:checking for pthread.h... yes 2024-09-05T12:58:39.209 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h usability... yes 2024-09-05T12:58:39.227 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h presence... yes 2024-09-05T12:58:39.227 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fcntl.h... yes 2024-09-05T12:58:39.272 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h usability... yes 2024-09-05T12:58:39.288 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h presence... yes 2024-09-05T12:58:39.288 INFO:tasks.workunit.client.0.smithi073.stdout:checking for limits.h... yes 2024-09-05T12:58:39.302 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... (cached) yes 2024-09-05T12:58:39.337 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h usability... yes 2024-09-05T12:58:39.354 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h presence... yes 2024-09-05T12:58:39.354 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/time.h... yes 2024-09-05T12:58:39.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:39 smithi162 ceph-mon[34220]: pgmap v357: 97 pgs: 97 active+clean; 2.7 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 192 KiB/s wr, 23 op/s 2024-09-05T12:58:39.367 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... (cached) yes 2024-09-05T12:58:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:39 smithi169 ceph-mon[34823]: pgmap v357: 97 pgs: 97 active+clean; 2.7 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 192 KiB/s wr, 23 op/s 2024-09-05T12:58:39.403 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h usability... yes 2024-09-05T12:58:39.418 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h presence... yes 2024-09-05T12:58:39.419 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/vfs.h... yes 2024-09-05T12:58:39.468 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h usability... no 2024-09-05T12:58:39.495 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h presence... no 2024-09-05T12:58:39.495 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/limits.h... no 2024-09-05T12:58:39.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:39 smithi073 ceph-mon[30883]: pgmap v357: 97 pgs: 97 active+clean; 2.7 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 192 KiB/s wr, 23 op/s 2024-09-05T12:58:39.521 INFO:tasks.workunit.client.0.smithi073.stdout:checking for an ANSI C-conforming const... yes 2024-09-05T12:58:39.549 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-05T12:58:39.605 INFO:tasks.workunit.client.0.smithi073.stdout:checking for system... yes 2024-09-05T12:58:39.658 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gettimeofday... yes 2024-09-05T12:58:39.712 INFO:tasks.workunit.client.0.smithi073.stdout:checking for mkdir... yes 2024-09-05T12:58:39.766 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strerror... yes 2024-09-05T12:58:39.821 INFO:tasks.workunit.client.0.smithi073.stdout:checking for open64... yes 2024-09-05T12:58:39.874 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stat64... yes 2024-09-05T12:58:39.928 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fseeko64... yes 2024-09-05T12:58:39.982 INFO:tasks.workunit.client.0.smithi073.stdout:checking for lrand48_r... yes 2024-09-05T12:58:40.036 INFO:tasks.workunit.client.0.smithi073.stdout:checking for srand48_r... yes 2024-09-05T12:58:40.058 INFO:tasks.workunit.client.0.smithi073.stdout:configure: creating ./config.status 2024-09-05T12:58:40.115 INFO:tasks.workunit.client.0.smithi073.stdout: /bin/sh ./config.status 2024-09-05T12:58:40.161 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating Makefile 2024-09-05T12:58:40.173 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating config.h 2024-09-05T12:58:40.193 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing depfiles commands 2024-09-05T12:58:40.204 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing default commands 2024-09-05T12:58:40.231 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-05T12:58:40.366 INFO:tasks.workunit.client.0.smithi073.stdout:rm -f stamp-h1 2024-09-05T12:58:40.369 INFO:tasks.workunit.client.0.smithi073.stdout:touch config.h.in 2024-09-05T12:58:40.370 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh ./config.status config.h 2024-09-05T12:58:40.409 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating config.h 2024-09-05T12:58:40.435 INFO:tasks.workunit.client.0.smithi073.stdout:make all-am 2024-09-05T12:58:40.440 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-05T12:58:40.441 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-05T12:58:40.594 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-05T12:58:40.597 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-05T12:58:40.692 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-05T12:58:40.695 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-05T12:58:40.776 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-05T12:58:40.779 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-05T12:58:40.872 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-05T12:58:40.875 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-05T12:58:40.996 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-05T12:58:40.999 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-05T12:58:41.049 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-05T12:58:41.050 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-05T12:58:41.091 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-05T12:58:41.094 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-05T12:58:41.139 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-05T12:58:41.142 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-05T12:58:41.338 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-05T12:58:41.341 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-05T12:58:41.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:41 smithi162 ceph-mon[34220]: pgmap v358: 97 pgs: 97 active+clean; 5.2 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 422 KiB/s wr, 42 op/s 2024-09-05T12:58:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:41 smithi169 ceph-mon[34823]: pgmap v358: 97 pgs: 97 active+clean; 5.2 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 422 KiB/s wr, 42 op/s 2024-09-05T12:58:41.464 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-05T12:58:41.468 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-05T12:58:41.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:41 smithi073 ceph-mon[30883]: pgmap v358: 97 pgs: 97 active+clean; 5.2 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 422 KiB/s wr, 42 op/s 2024-09-05T12:58:41.610 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-05T12:58:41.613 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-05T12:58:41.677 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-05T12:58:41.680 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-05T12:58:41.754 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-05T12:58:41.757 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-05T12:58:41.857 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-05T12:58:41.860 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-05T12:58:41.887 INFO:tasks.workunit.client.0.smithi073.stderr:In file included from parser.h:22, 2024-09-05T12:58:41.887 INFO:tasks.workunit.client.0.smithi073.stderr: from parser.c:25: 2024-09-05T12:58:41.887 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘init_filesys’: 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-05T12:58:41.888 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-05T12:58:41.889 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-05T12:58:41.890 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-05T12:58:41.891 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-05T12:58:41.892 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-05T12:58:41.893 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-05T12:58:41.893 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-05T12:58:41.893 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-05T12:58:41.893 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-05T12:58:41.893 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-05T12:58:41.893 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-05T12:58:41.893 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-05T12:58:41.893 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-05T12:58:41.893 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-05T12:58:41.894 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-05T12:58:41.895 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-05T12:58:41.896 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-05T12:58:41.897 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-05T12:58:41.931 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘get_optstr’: 2024-09-05T12:58:41.931 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-05T12:58:41.931 INFO:tasks.workunit.client.0.smithi073.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-05T12:58:41.931 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-05T12:58:41.932 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:200:14: note: source object declared here 2024-09-05T12:58:41.932 INFO:tasks.workunit.client.0.smithi073.stderr: 200 | char temp[BUFSIZE]; 2024-09-05T12:58:41.932 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~ 2024-09-05T12:58:41.937 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘size64_convert’: 2024-09-05T12:58:41.937 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-05T12:58:41.938 INFO:tasks.workunit.client.0.smithi073.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-05T12:58:41.938 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-05T12:58:42.215 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-05T12:58:42.219 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-05T12:58:42.272 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-05T12:58:42.276 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-05T12:58:42.363 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-05T12:58:42.366 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-05T12:58:42.396 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-05T12:58:42.400 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-05T12:58:42.432 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-05T12:58:42.432 INFO:tasks.workunit.client.0.smithi073.stderr:+ cd .. 2024-09-05T12:58:42.432 INFO:tasks.workunit.client.0.smithi073.stderr:+ mkdir tmp 2024-09-05T12:58:42.434 INFO:tasks.workunit.client.0.smithi073.stderr:+ cd tmp 2024-09-05T12:58:42.435 INFO:tasks.workunit.client.0.smithi073.stderr:+ for f in $mydir/*.ffsb 2024-09-05T12:58:42.435 INFO:tasks.workunit.client.0.smithi073.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-05T12:58:42.435 INFO:tasks.workunit.client.0.smithi073.stdout:FFSB version 6.0-RC2 started 2024-09-05T12:58:42.435 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T12:58:42.438 INFO:tasks.workunit.client.0.smithi073.stdout:benchmark time = 300 2024-09-05T12:58:42.438 INFO:tasks.workunit.client.0.smithi073.stdout:ThreadGroup 0 2024-09-05T12:58:42.438 INFO:tasks.workunit.client.0.smithi073.stdout:================ 2024-09-05T12:58:42.438 INFO:tasks.workunit.client.0.smithi073.stdout: num_threads = 32 2024-09-05T12:58:42.438 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T12:58:42.438 INFO:tasks.workunit.client.0.smithi073.stdout: read_random = off 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: read_size = 0 (0B) 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: read_blocksize = 0 (0B) 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: read_skip = off 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: read_skipsize = 0 (0B) 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: write_random = on 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: write_size = 5242880 (5MB) 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: fsync_file = 0 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: write_blocksize = 4096 (4KB) 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: wait time = 0 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: op weights 2024-09-05T12:58:42.439 INFO:tasks.workunit.client.0.smithi073.stdout: read = 0 (0.00%) 2024-09-05T12:58:42.440 INFO:tasks.workunit.client.0.smithi073.stdout: readall = 0 (0.00%) 2024-09-05T12:58:42.440 INFO:tasks.workunit.client.0.smithi073.stdout: write = 1 (100.00%) 2024-09-05T12:58:42.440 INFO:tasks.workunit.client.0.smithi073.stdout: create = 0 (0.00%) 2024-09-05T12:58:42.440 INFO:tasks.workunit.client.0.smithi073.stdout: append = 0 (0.00%) 2024-09-05T12:58:42.440 INFO:tasks.workunit.client.0.smithi073.stdout: delete = 0 (0.00%) 2024-09-05T12:58:42.440 INFO:tasks.workunit.client.0.smithi073.stdout: metaop = 0 (0.00%) 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: createdir = 0 (0.00%) 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: stat = 0 (0.00%) 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: writeall = 0 (0.00%) 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: writeall_fsync = 0 (0.00%) 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: open_close = 0 (0.00%) 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: write_fsync = 0 (0.00%) 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: create_fsync = 0 (0.00%) 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: append_fsync = 0 (0.00%) 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout:FileSystem . 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout:========== 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: num_dirs = 0 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: starting files = 128 2024-09-05T12:58:42.441 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T12:58:42.442 INFO:tasks.workunit.client.0.smithi073.stdout: min file size = 104857600 (100MB) 2024-09-05T12:58:42.442 INFO:tasks.workunit.client.0.smithi073.stdout: max file size = 104857600 (100MB) 2024-09-05T12:58:42.442 INFO:tasks.workunit.client.0.smithi073.stdout: directio = off 2024-09-05T12:58:42.442 INFO:tasks.workunit.client.0.smithi073.stdout: alignedio = on 2024-09-05T12:58:42.442 INFO:tasks.workunit.client.0.smithi073.stdout: bufferedio = off 2024-09-05T12:58:42.442 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T12:58:42.442 INFO:tasks.workunit.client.0.smithi073.stdout: aging is off 2024-09-05T12:58:42.442 INFO:tasks.workunit.client.0.smithi073.stdout: current utilization = 0.00% 2024-09-05T12:58:42.442 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T12:58:42.442 INFO:tasks.workunit.client.0.smithi073.stdout:checking existing fs: . 2024-09-05T12:58:42.443 INFO:tasks.workunit.client.0.smithi073.stdout:recreating new fileset 2024-09-05T12:58:42.443 INFO:tasks.workunit.client.0.smithi073.stderr:opendir: No such file or directory 2024-09-05T12:58:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.120+0000 7f48f9a9d640 1 -- 172.21.15.73:0/1996959245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48f4102600 msgr2=0x7f48f4108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.120+0000 7f48f9a9d640 1 --2- 172.21.15.73:0/1996959245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48f4102600 0x7f48f4108e90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009ca0 tx=0x7f48ec02a8c0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.120+0000 7f48f9a9d640 1 -- 172.21.15.73:0/1996959245 shutdown_connections 2024-09-05T12:58:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 --2- 172.21.15.73:0/1996959245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48f4102600 0x7f48f4108e90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 --2- 172.21.15.73:0/1996959245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4101c40 0x7f48f41020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 --2- 172.21.15.73:0/1996959245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48f4100a50 0x7f48f4100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 -- 172.21.15.73:0/1996959245 >> 172.21.15.73:0/1996959245 conn(0x7f48f40fc1b0 msgr2=0x7f48f40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 -- 172.21.15.73:0/1996959245 shutdown_connections 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 -- 172.21.15.73:0/1996959245 wait complete. 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 Processor -- start 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 -- start start 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48f4100a50 0x7f48f4197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48f4101c40 0x7f48f41982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4102600 0x7f48f419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f48f410c6d0 con 0x7f48f4100a50 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48f410c550 con 0x7f48f4102600 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.121+0000 7f48f9a9d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f48f410c850 con 0x7f48f4101c40 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48f4100a50 0x7f48f4197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48f4100a50 0x7f48f4197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51744/0 (socket says 172.21.15.73:51744) 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f37fe640 1 -- 172.21.15.73:0/2614270693 learned_addr learned my addr 172.21.15.73:0/2614270693 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48f4101c40 0x7f48f41982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f3fff640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4102600 0x7f48f419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f37fe640 1 -- 172.21.15.73:0/2614270693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48f4101c40 msgr2=0x7f48f41982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f37fe640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48f4101c40 0x7f48f41982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f37fe640 1 -- 172.21.15.73:0/2614270693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4102600 msgr2=0x7f48f419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f37fe640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4102600 0x7f48f419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f37fe640 1 -- 172.21.15.73:0/2614270693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f419f9c0 con 0x7f48f4100a50 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f37fe640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48f4100a50 0x7f48f4197db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f48e400e9c0 tx=0x7f48e400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f0ff9640 1 -- 172.21.15.73:0/2614270693 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e400cd80 con 0x7f48f4100a50 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f9a9d640 1 -- 172.21.15.73:0/2614270693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f419fcb0 con 0x7f48f4100a50 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f9a9d640 1 -- 172.21.15.73:0/2614270693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f41a01b0 con 0x7f48f4100a50 2024-09-05T12:58:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f0ff9640 1 -- 172.21.15.73:0/2614270693 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e40035f0 con 0x7f48f4100a50 2024-09-05T12:58:43.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.122+0000 7f48f0ff9640 1 -- 172.21.15.73:0/2614270693 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4010690 con 0x7f48f4100a50 2024-09-05T12:58:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.125+0000 7f48fc82f740 1 Processor -- start 2024-09-05T12:58:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.125+0000 7f48f0ff9640 1 -- 172.21.15.73:0/2614270693 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f48e40037a0 con 0x7f48f4100a50 2024-09-05T12:58:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48fc82f740 1 -- start start 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577faceb9a0 0x5577facebda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 0x5577facf0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facf1370 0x5577facf3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48fc82f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5577fac4f2f0 con 0x5577facf1370 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48fc82f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5577fabf7270 con 0x5577faceb9a0 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48fc82f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5577fac4b2b0 con 0x5577facec2e0 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facf1370 0x5577facf3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 0x5577facf0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577faceb9a0 0x5577facebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facf1370 0x5577facf3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51752/0 (socket says 172.21.15.73:51752) 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 0x5577facf0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:52102/0 (socket says 172.21.15.73:52102) 2024-09-05T12:58:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f2ffd640 1 -- 172.21.15.73:0/909891240 learned_addr learned my addr 172.21.15.73:0/909891240 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f0ff9640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48dc0a2c30 0x7f48dc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f2ffd640 1 -- 172.21.15.73:0/909891240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 msgr2=0x5577facf0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/909891240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 0x5577facf0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f2ffd640 1 -- 172.21.15.73:0/909891240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577faceb9a0 msgr2=0x5577facebda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/909891240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577faceb9a0 0x5577facebda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f2ffd640 1 -- 172.21.15.73:0/909891240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577fabf6340 con 0x5577facf1370 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.126+0000 7f48f3fff640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48dc0a2c30 0x7f48dc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.127+0000 7f48f0ff9640 1 -- 172.21.15.73:0/2614270693 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f48e40cf3f0 con 0x7f48f4100a50 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.127+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/909891240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facf1370 0x5577facf3830 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009cf0 tx=0x7f48e8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980d2e25b26f307f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.127+0000 7f48d9ffb640 1 -- 172.21.15.73:0/909891240 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8004230 con 0x5577facf1370 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.127+0000 7f48d9ffb640 1 -- 172.21.15.73:0/909891240 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e80043d0 con 0x5577facf1370 2024-09-05T12:58:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.127+0000 7f48d9ffb640 1 -- 172.21.15.73:0/909891240 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8019940 con 0x5577facf1370 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48fc82f740 1 -- 172.21.15.73:0/909891240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facf1370 msgr2=0x5577facf3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48f3fff640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48dc0a2c30 0x7f48dc0a50f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f48ec005e30 tx=0x7f48ec0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48fc82f740 1 --2- 172.21.15.73:0/909891240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facf1370 0x5577facf3830 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009cf0 tx=0x7f48e8011810 comp rx=0 tx=0).stop 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48fc82f740 1 -- 172.21.15.73:0/909891240 shutdown_connections 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48fc82f740 1 --2- 172.21.15.73:0/909891240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facf1370 0x5577facf3830 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48fc82f740 1 --2- 172.21.15.73:0/909891240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 0x5577facf0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48fc82f740 1 --2- 172.21.15.73:0/909891240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577faceb9a0 0x5577facebda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48fc82f740 1 -- 172.21.15.73:0/909891240 >> 172.21.15.73:0/909891240 conn(0x5577face7010 msgr2=0x5577face7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48fc82f740 1 -- 172.21.15.73:0/909891240 shutdown_connections 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48fc82f740 1 -- 172.21.15.73:0/909891240 wait complete. 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.128+0000 7f48fc82f740 1 -- start start 2024-09-05T12:58:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48fc82f740 1 Processor -- start 2024-09-05T12:58:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 0x5577facf60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 0x5577facfd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48fc82f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5577facf4340 con 0x5577faceb9a0 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48fc82f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5577fabd8290 con 0x5577facf1370 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48fc82f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5577facf44c0 con 0x5577facec2e0 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48fc82f740 10 client.0 _ll_register_callbacks cb 0x5577fac09140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51766/0 (socket says 172.21.15.73:51766) 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f37fe640 1 -- 172.21.15.73:0/2113475664 learned_addr learned my addr 172.21.15.73:0/2113475664 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 0x5577facf60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f3fff640 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 0x5577facfd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f2ffd640 1 -- 172.21.15.73:0/2113475664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 msgr2=0x5577facfd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 0x5577facfd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f2ffd640 1 -- 172.21.15.73:0/2113475664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 msgr2=0x5577facf5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f2ffd640 1 -- 172.21.15.73:0/2113475664 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577fa962210 con 0x5577facec2e0 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.129+0000 7f48f37fe640 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 0x5577facf60a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x5577face7e90 tx=0x7f48e80038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43df6e04f3e3a8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48d2ffd640 1 -- 172.21.15.73:0/2113475664 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8027070 con 0x5577facec2e0 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48d2ffd640 1 -- 172.21.15.73:0/2113475664 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f48e8005240 con 0x5577facec2e0 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48fc82f740 1 -- 172.21.15.73:0/2113475664 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e80043d0 con 0x5577facec2e0 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48d2ffd640 1 -- 172.21.15.73:0/2113475664 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f48e8033050 con 0x5577facec2e0 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48fc82f740 10 client.25126 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48fc82f740 1 -- 172.21.15.73:0/2113475664 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5577faa2e620 con 0x5577facec2e0 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48d2ffd640 1 -- 172.21.15.73:0/2113475664 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e80043d0 con 0x5577facec2e0 2024-09-05T12:58:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48d2ffd640 1 -- 172.21.15.73:0/2113475664 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f48e8004ba0 con 0x5577facec2e0 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48fc82f740 10 client.25126 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48fc82f740 10 client.25126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48fc82f740 20 client.25126 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48fc82f740 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5577fad01610 0x5577fad03a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48fc82f740 4 client.25126 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.130+0000 7f48fc82f740 1 -- 172.21.15.73:0/2113475664 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577fac5ca20 con 0x5577fad01610 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.131+0000 7f48f37fe640 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5577fad01610 0x5577fad03a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.131+0000 7f48f37fe640 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5577fad01610 0x5577fad03a20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22186dcb5b3f43f3 server_cookie=f6676496225fa43e in_seq=0 out_seq=0 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.131+0000 7f48d2ffd640 10 client.25126 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48d2ffd640 1 -- 172.21.15.73:0/2113475664 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577fac5ca20 con 0x5577fad01610 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48d2ffd640 10 client.25126 handle_command_reply: tid=0 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 client.25126 shutdown 2024-09-05T12:58:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 -- 172.21.15.73:0/2113475664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 msgr2=0x5577facf60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 0x5577facf60a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x5577face7e90 tx=0x7f48e80038a0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 -- 172.21.15.73:0/2113475664 shutdown_connections 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5577fad01610 0x5577fad03a20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 0x5577facfd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facec2e0 0x5577facf60a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48d2ffd640 0 client.25126 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 --2- 172.21.15.73:0/2113475664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 -- 172.21.15.73:0/2113475664 >> 172.21.15.73:0/2113475664 conn(0x5577face7010 msgr2=0x5577face8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 -- 172.21.15.73:0/2113475664 shutdown_connections 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 1 -- 172.21.15.73:0/2113475664 wait complete. 2024-09-05T12:58:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.132+0000 7f48fc82f740 20 client.25126 trim_cache size 0 max 16384 2024-09-05T12:58:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.146+0000 7f48fc82f740 1 Processor -- start 2024-09-05T12:58:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.146+0000 7f48fc82f740 1 -- start start 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facec2e0 0x5577facf60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 0x5577facfd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48fc82f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f48f41ab750 con 0x5577facec2e0 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48fc82f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48f41a9020 con 0x5577facf1370 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48fc82f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f48f41a6e70 con 0x5577faceb9a0 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facec2e0 0x5577facf60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 0x5577facfd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facec2e0 0x5577facf60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51770/0 (socket says 172.21.15.73:51770) 2024-09-05T12:58:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 0x5577facfd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:43178/0 (socket says 172.21.15.73:43178) 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f2ffd640 1 -- 172.21.15.73:0/1115526735 learned_addr learned my addr 172.21.15.73:0/1115526735 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f2ffd640 1 -- 172.21.15.73:0/1115526735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577faceb9a0 msgr2=0x5577facf5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/1115526735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f2ffd640 1 -- 172.21.15.73:0/1115526735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 msgr2=0x5577facfd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/1115526735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 0x5577facfd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f2ffd640 1 -- 172.21.15.73:0/1115526735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577facf3ba0 con 0x5577facec2e0 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f37fe640 1 --2- 172.21.15.73:0/1115526735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/1115526735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facec2e0 0x5577facf60a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009380 tx=0x7f48e8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e3fae4e74a6063 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48d97fa640 1 -- 172.21.15.73:0/1115526735 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8030070 con 0x5577facec2e0 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48d97fa640 1 -- 172.21.15.73:0/1115526735 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e8003ca0 con 0x5577facec2e0 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.147+0000 7f48d97fa640 1 -- 172.21.15.73:0/1115526735 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8027070 con 0x5577facec2e0 2024-09-05T12:58:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.148+0000 7f48fc82f740 1 -- 172.21.15.73:0/1115526735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facec2e0 msgr2=0x5577facf60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.148+0000 7f48fc82f740 1 --2- 172.21.15.73:0/1115526735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facec2e0 0x5577facf60a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009380 tx=0x7f48e8005f90 comp rx=0 tx=0).stop 2024-09-05T12:58:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.148+0000 7f48fc82f740 1 -- 172.21.15.73:0/1115526735 shutdown_connections 2024-09-05T12:58:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.148+0000 7f48fc82f740 1 --2- 172.21.15.73:0/1115526735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facf1370 0x5577facfd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.148+0000 7f48fc82f740 1 --2- 172.21.15.73:0/1115526735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577facec2e0 0x5577facf60a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.148+0000 7f48fc82f740 1 --2- 172.21.15.73:0/1115526735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577faceb9a0 0x5577facf5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.148+0000 7f48fc82f740 1 -- 172.21.15.73:0/1115526735 >> 172.21.15.73:0/1115526735 conn(0x5577face7010 msgr2=0x5577faced420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.148+0000 7f48fc82f740 1 -- 172.21.15.73:0/1115526735 shutdown_connections 2024-09-05T12:58:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.148+0000 7f48fc82f740 1 -- 172.21.15.73:0/1115526735 wait complete. 2024-09-05T12:58:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48fc82f740 1 -- start start 2024-09-05T12:58:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48fc82f740 1 Processor -- start 2024-09-05T12:58:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facec2e0 0x5577facfa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48fc82f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facf1370 0x5577fad6a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48fc82f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f48f41a74e0 con 0x5577faceb9a0 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48fc82f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48f41a8950 con 0x5577facec2e0 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48fc82f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f48f41a7bb0 con 0x5577facf1370 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48fc82f740 10 client.0 _ll_register_callbacks cb 0x7f48e4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51778/0 (socket says 172.21.15.73:51778) 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48f37fe640 1 -- 172.21.15.73:0/3137033869 learned_addr learned my addr 172.21.15.73:0/3137033869 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facec2e0 0x5577facfa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48f3fff640 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facf1370 0x5577fad6a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48f2ffd640 1 -- 172.21.15.73:0/3137033869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facf1370 msgr2=0x5577fad6a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facf1370 0x5577fad6a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48f2ffd640 1 -- 172.21.15.73:0/3137033869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 msgr2=0x5577facf9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.149+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48f2ffd640 1 -- 172.21.15.73:0/3137033869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577facfd1a0 con 0x5577facec2e0 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48f37fe640 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48f2ffd640 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facec2e0 0x5577facfa100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f48e8000c00 tx=0x7f48e80199a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7abd3b44503fd64 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48d2ffd640 1 -- 172.21.15.73:0/3137033869 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8030040 con 0x5577facec2e0 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48fc82f740 1 -- 172.21.15.73:0/3137033869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5577fac56d70 con 0x5577facec2e0 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48d2ffd640 1 -- 172.21.15.73:0/3137033869 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f48e8005200 con 0x5577facec2e0 2024-09-05T12:58:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48d2ffd640 1 -- 172.21.15.73:0/3137033869 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f48e8047070 con 0x5577facec2e0 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48fc82f740 10 client.25076 fetch_fsmap learned FSMap version 25 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48fc82f740 1 -- 172.21.15.73:0/3137033869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5577fad6b750 con 0x5577facec2e0 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48d2ffd640 1 -- 172.21.15.73:0/3137033869 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5577fac56d70 con 0x5577facec2e0 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48d2ffd640 1 -- 172.21.15.73:0/3137033869 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f48e8004bd0 con 0x5577facec2e0 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48fc82f740 10 client.25076 fetch_fsmap finished waiting for FSMap version 25 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48fc82f740 10 client.25076 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.150+0000 7f48fc82f740 20 client.25076 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.151+0000 7f48fc82f740 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5577fad6c0d0 0x5577fad6e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.151+0000 7f48fc82f740 4 client.25076 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.151+0000 7f48fc82f740 1 -- 172.21.15.73:0/3137033869 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5577fabd3900 con 0x5577fad6c0d0 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.151+0000 7f48f37fe640 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5577fad6c0d0 0x5577fad6e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.151+0000 7f48d2ffd640 10 client.25076 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.151+0000 7f48f37fe640 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5577fad6c0d0 0x5577fad6e4f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a612059d3b543 server_cookie=4a9461d17cf3ce28 in_seq=0 out_seq=0 2024-09-05T12:58:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48d2ffd640 1 -- 172.21.15.73:0/3137033869 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5577fabd3900 con 0x5577fad6c0d0 2024-09-05T12:58:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48d2ffd640 10 client.25076 handle_command_reply: tid=0 2024-09-05T12:58:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 client.25076 shutdown 2024-09-05T12:58:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 -- 172.21.15.73:0/3137033869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facec2e0 msgr2=0x5577facfa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facec2e0 0x5577facfa100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f48e8000c00 tx=0x7f48e80199a0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 -- 172.21.15.73:0/3137033869 shutdown_connections 2024-09-05T12:58:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5577fad6c0d0 0x5577fad6e4f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577facf1370 0x5577fad6a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48d2ffd640 0 client.25076 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577facec2e0 0x5577facfa100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 --2- 172.21.15.73:0/3137033869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577faceb9a0 0x5577facf9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 -- 172.21.15.73:0/3137033869 >> 172.21.15.73:0/3137033869 conn(0x5577face7010 msgr2=0x5577facf0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 -- 172.21.15.73:0/3137033869 shutdown_connections 2024-09-05T12:58:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 1 -- 172.21.15.73:0/3137033869 wait complete. 2024-09-05T12:58:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.248+0000 7f48fc82f740 20 client.25076 trim_cache size 0 max 16384 2024-09-05T12:58:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T12:58:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T12:58:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T12:58:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T12:58:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 -- 172.21.15.73:0/2614270693 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48dc0a2c30 msgr2=0x7f48dc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48dc0a2c30 0x7f48dc0a50f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f48ec005e30 tx=0x7f48ec0095c0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 -- 172.21.15.73:0/2614270693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48f4100a50 msgr2=0x7f48f4197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48f4100a50 0x7f48f4197db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f48e400e9c0 tx=0x7f48e400ee80 comp rx=0 tx=0).stop 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 -- 172.21.15.73:0/2614270693 shutdown_connections 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48dc0a2c30 0x7f48dc0a50f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4102600 0x7f48f419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48f4101c40 0x7f48f41982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 --2- 172.21.15.73:0/2614270693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48f4100a50 0x7f48f4197db0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 -- 172.21.15.73:0/2614270693 >> 172.21.15.73:0/2614270693 conn(0x7f48f40fc1b0 msgr2=0x7f48f40fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 -- 172.21.15.73:0/2614270693 shutdown_connections 2024-09-05T12:58:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:43.249+0000 7f48f9a9d640 1 -- 172.21.15.73:0/2614270693 wait complete. 2024-09-05T12:58:43.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:43 smithi162 ceph-mon[34220]: pgmap v359: 97 pgs: 97 active+clean; 6.2 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 556 KiB/s wr, 64 op/s 2024-09-05T12:58:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:43 smithi169 ceph-mon[34823]: pgmap v359: 97 pgs: 97 active+clean; 6.2 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 556 KiB/s wr, 64 op/s 2024-09-05T12:58:43.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:43 smithi073 ceph-mon[30883]: pgmap v359: 97 pgs: 97 active+clean; 6.2 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 556 KiB/s wr, 64 op/s 2024-09-05T12:58:45.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:45 smithi162 ceph-mon[34220]: pgmap v360: 97 pgs: 97 active+clean; 2.2 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 557 KiB/s wr, 70 op/s 2024-09-05T12:58:45.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:45 smithi169 ceph-mon[34823]: pgmap v360: 97 pgs: 97 active+clean; 2.2 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 557 KiB/s wr, 70 op/s 2024-09-05T12:58:45.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:45 smithi073 ceph-mon[30883]: pgmap v360: 97 pgs: 97 active+clean; 2.2 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 557 KiB/s wr, 70 op/s 2024-09-05T12:58:47.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:47 smithi162 ceph-mon[34220]: pgmap v361: 97 pgs: 97 active+clean; 395 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 33 MiB/s wr, 149 op/s 2024-09-05T12:58:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:47 smithi169 ceph-mon[34823]: pgmap v361: 97 pgs: 97 active+clean; 395 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 33 MiB/s wr, 149 op/s 2024-09-05T12:58:47.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:47 smithi073 ceph-mon[30883]: pgmap v361: 97 pgs: 97 active+clean; 395 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 33 MiB/s wr, 149 op/s 2024-09-05T12:58:49.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:49 smithi162 ceph-mon[34220]: pgmap v362: 97 pgs: 97 active+clean; 959 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 80 MiB/s wr, 275 op/s 2024-09-05T12:58:49.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:49 smithi169 ceph-mon[34823]: pgmap v362: 97 pgs: 97 active+clean; 959 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 80 MiB/s wr, 275 op/s 2024-09-05T12:58:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:49 smithi073 ceph-mon[30883]: pgmap v362: 97 pgs: 97 active+clean; 959 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 80 MiB/s wr, 275 op/s 2024-09-05T12:58:51.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:51 smithi162 ceph-mon[34220]: pgmap v363: 97 pgs: 97 active+clean; 2.3 GiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 198 MiB/s wr, 406 op/s 2024-09-05T12:58:51.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:51 smithi169 ceph-mon[34823]: pgmap v363: 97 pgs: 97 active+clean; 2.3 GiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 198 MiB/s wr, 406 op/s 2024-09-05T12:58:51.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:51 smithi073 ceph-mon[30883]: pgmap v363: 97 pgs: 97 active+clean; 2.3 GiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 198 MiB/s wr, 406 op/s 2024-09-05T12:58:53.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:53 smithi162 ceph-mon[34220]: pgmap v364: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 445 MiB/s wr, 478 op/s 2024-09-05T12:58:53.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:53 smithi169 ceph-mon[34823]: pgmap v364: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 445 MiB/s wr, 478 op/s 2024-09-05T12:58:53.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:53 smithi073 ceph-mon[30883]: pgmap v364: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 445 MiB/s wr, 478 op/s 2024-09-05T12:58:54.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:54 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:58:54.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:54 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:58:54.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:54 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:58:55.099 INFO:tasks.workunit.client.0.smithi073.stdout:fs setup took 12 secs 2024-09-05T12:58:55.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:55 smithi162 ceph-mon[34220]: pgmap v365: 97 pgs: 97 active+clean; 5.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 471 MiB/s wr, 462 op/s 2024-09-05T12:58:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:58:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:58:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:58:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:55 smithi169 ceph-mon[34823]: pgmap v365: 97 pgs: 97 active+clean; 5.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 471 MiB/s wr, 462 op/s 2024-09-05T12:58:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:58:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:58:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:58:55.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:55 smithi073 ceph-mon[30883]: pgmap v365: 97 pgs: 97 active+clean; 5.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 471 MiB/s wr, 462 op/s 2024-09-05T12:58:55.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T12:58:55.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T12:58:55.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:58:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.504+0000 7f822a87d640 1 -- 172.21.15.73:0/3094010103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8224101a60 msgr2=0x7f8224101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.504+0000 7f822a87d640 1 --2- 172.21.15.73:0/3094010103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8224101a60 0x7f8224101ee0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f821801a910 tx=0x7f821803b470 comp rx=0 tx=0).stop 2024-09-05T12:58:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.506+0000 7f822a87d640 1 -- 172.21.15.73:0/3094010103 shutdown_connections 2024-09-05T12:58:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.506+0000 7f822a87d640 1 --2- 172.21.15.73:0/3094010103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8224102420 0x7f8224108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.506+0000 7f822a87d640 1 --2- 172.21.15.73:0/3094010103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8224101a60 0x7f8224101ee0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.506+0000 7f822a87d640 1 --2- 172.21.15.73:0/3094010103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8224100870 0x7f8224100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.506+0000 7f822a87d640 1 -- 172.21.15.73:0/3094010103 >> 172.21.15.73:0/3094010103 conn(0x7f82240fbfb0 msgr2=0x7f82240fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.507+0000 7f822a87d640 1 -- 172.21.15.73:0/3094010103 shutdown_connections 2024-09-05T12:58:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.507+0000 7f822a87d640 1 -- 172.21.15.73:0/3094010103 wait complete. 2024-09-05T12:58:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.508+0000 7f822a87d640 1 Processor -- start 2024-09-05T12:58:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.508+0000 7f822a87d640 1 -- start start 2024-09-05T12:58:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.509+0000 7f822a87d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8224100870 0x7f82241080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.509+0000 7f822a87d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8224101a60 0x7f82241085e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.509+0000 7f822a87d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8224102420 0x7f822410fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.509+0000 7f822a87d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f822406d870 con 0x7f8224101a60 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.509+0000 7f822a87d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f822406d6f0 con 0x7f8224100870 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.509+0000 7f822a87d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f822406d9f0 con 0x7f8224102420 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.509+0000 7f82237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8224101a60 0x7f82241085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.509+0000 7f82237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8224101a60 0x7f82241085e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33614/0 (socket says 172.21.15.73:33614) 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.509+0000 7f82237fe640 1 -- 172.21.15.73:0/3044966691 learned_addr learned my addr 172.21.15.73:0/3044966691 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.510+0000 7f82237fe640 1 -- 172.21.15.73:0/3044966691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8224102420 msgr2=0x7f822410fd60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.510+0000 7f82237fe640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8224102420 0x7f822410fd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.510+0000 7f82237fe640 1 -- 172.21.15.73:0/3044966691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8224100870 msgr2=0x7f82241080a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.510+0000 7f82237fe640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8224100870 0x7f82241080a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.510+0000 7f82237fe640 1 -- 172.21.15.73:0/3044966691 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82241103d0 con 0x7f8224101a60 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.510+0000 7f82237fe640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8224101a60 0x7f82241085e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8218005ab0 tx=0x7f8218004c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.511+0000 7f82217fa640 1 -- 172.21.15.73:0/3044966691 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821804f070 con 0x7f8224101a60 2024-09-05T12:58:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.511+0000 7f82217fa640 1 -- 172.21.15.73:0/3044966691 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8218040c70 con 0x7f8224101a60 2024-09-05T12:58:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.511+0000 7f822a87d640 1 -- 172.21.15.73:0/3044966691 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8224110600 con 0x7f8224101a60 2024-09-05T12:58:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.511+0000 7f822a87d640 1 -- 172.21.15.73:0/3044966691 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8224110b50 con 0x7f8224101a60 2024-09-05T12:58:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.512+0000 7f82217fa640 1 -- 172.21.15.73:0/3044966691 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218059060 con 0x7f8224101a60 2024-09-05T12:58:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.516+0000 7f822d614740 1 Processor -- start 2024-09-05T12:58:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.517+0000 7f822d614740 1 -- start start 2024-09-05T12:58:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.517+0000 7f822d614740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 0x55b267483f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.518+0000 7f822d614740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267488f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.518+0000 7f822d614740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b267489540 0x55b26748ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.518+0000 7f822d614740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b2673e72f0 con 0x55b2674844b0 2024-09-05T12:58:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.518+0000 7f822d614740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b26738f270 con 0x55b267483b70 2024-09-05T12:58:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.518+0000 7f822d614740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b2673e32b0 con 0x55b267489540 2024-09-05T12:58:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.518+0000 7f82217fa640 1 -- 172.21.15.73:0/3044966691 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8218052070 con 0x7f8224101a60 2024-09-05T12:58:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.518+0000 7f8223fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267488f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.518+0000 7f8223fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267488f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33616/0 (socket says 172.21.15.73:33616) 2024-09-05T12:58:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.518+0000 7f8223fff640 1 -- 172.21.15.73:0/142876006 learned_addr learned my addr 172.21.15.73:0/142876006 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.519+0000 7f8223fff640 1 -- 172.21.15.73:0/142876006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b267489540 msgr2=0x55b26748ba00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T12:58:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.519+0000 7f8223fff640 1 --2- 172.21.15.73:0/142876006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b267489540 0x55b26748ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.522 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.519+0000 7f8223fff640 1 -- 172.21.15.73:0/142876006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 msgr2=0x55b267483f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T12:58:56.522 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.519+0000 7f8223fff640 1 --2- 172.21.15.73:0/142876006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 0x55b267483f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.522 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.519+0000 7f8223fff640 1 -- 172.21.15.73:0/142876006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b26738e340 con 0x55b2674844b0 2024-09-05T12:58:56.522 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.520+0000 7f82217fa640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f820c0c4c50 0x7f820c0c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.523 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.521+0000 7f8223fff640 1 --2- 172.21.15.73:0/142876006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267488f70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8214009740 tx=0x7f8214009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc08c043d4ed2db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:56.524 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.521+0000 7f8228e1a640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f820c0c4c50 0x7f820c0c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:56.524 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.521+0000 7f82217fa640 1 -- 172.21.15.73:0/3044966691 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f8218100780 con 0x7f8224101a60 2024-09-05T12:58:56.524 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.522+0000 7f8228e1a640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f820c0c4c50 0x7f820c0c7110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f821c00aab0 tx=0x7f821c009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:56.529 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.527+0000 7f820a7fc640 1 -- 172.21.15.73:0/142876006 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214015020 con 0x55b2674844b0 2024-09-05T12:58:56.529 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.527+0000 7f820a7fc640 1 -- 172.21.15.73:0/142876006 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8214009e50 con 0x55b2674844b0 2024-09-05T12:58:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.529+0000 7f822d614740 1 -- 172.21.15.73:0/142876006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 msgr2=0x55b267488f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.529+0000 7f822d614740 1 --2- 172.21.15.73:0/142876006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267488f70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8214009740 tx=0x7f8214009c00 comp rx=0 tx=0).stop 2024-09-05T12:58:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.530+0000 7f822d614740 1 -- 172.21.15.73:0/142876006 shutdown_connections 2024-09-05T12:58:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.530+0000 7f822d614740 1 --2- 172.21.15.73:0/142876006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b267489540 0x55b26748ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.530+0000 7f822d614740 1 --2- 172.21.15.73:0/142876006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267488f70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.530+0000 7f822d614740 1 --2- 172.21.15.73:0/142876006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 0x55b267483f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.530+0000 7f822d614740 1 -- 172.21.15.73:0/142876006 >> 172.21.15.73:0/142876006 conn(0x55b26747f1e0 msgr2=0x55b26747f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.533+0000 7f822d614740 1 -- 172.21.15.73:0/142876006 shutdown_connections 2024-09-05T12:58:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.533+0000 7f822d614740 1 -- 172.21.15.73:0/142876006 wait complete. 2024-09-05T12:58:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.534+0000 7f822d614740 1 -- start start 2024-09-05T12:58:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.534+0000 7f822d614740 1 Processor -- start 2024-09-05T12:58:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.537+0000 7f822d614740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 0x55b26748de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.537+0000 7f822d614740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b2674844b0 0x55b26748e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.537+0000 7f822d614740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267489540 0x55b2674953b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.537+0000 7f822d614740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b26748c560 con 0x55b267489540 2024-09-05T12:58:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.537+0000 7f822d614740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b267370290 con 0x55b267483b70 2024-09-05T12:58:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.537+0000 7f822d614740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b26748c6e0 con 0x55b2674844b0 2024-09-05T12:58:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.537+0000 7f822d614740 10 client.0 _ll_register_callbacks cb 0x55b2673a1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.537+0000 7f8228e1a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267489540 0x55b2674953b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.538+0000 7f8228e1a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267489540 0x55b2674953b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33626/0 (socket says 172.21.15.73:33626) 2024-09-05T12:58:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.538+0000 7f8228e1a640 1 -- 172.21.15.73:0/1700730136 learned_addr learned my addr 172.21.15.73:0/1700730136 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.538+0000 7f8228e1a640 1 -- 172.21.15.73:0/1700730136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b2674844b0 msgr2=0x55b26748e370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T12:58:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.538+0000 7f8228e1a640 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b2674844b0 0x55b26748e370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.538+0000 7f8228e1a640 1 -- 172.21.15.73:0/1700730136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 msgr2=0x55b26748de30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T12:58:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.538+0000 7f8228e1a640 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 0x55b26748de30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.538+0000 7f8228e1a640 1 -- 172.21.15.73:0/1700730136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2670fa210 con 0x55b267489540 2024-09-05T12:58:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.539+0000 7f8228e1a640 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267489540 0x55b2674953b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f821c00da80 tx=0x7f821c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19061436d81a5838 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.539+0000 7f82037fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.539+0000 7f82037fe640 1 -- 172.21.15.73:0/1700730136 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c018d90 con 0x55b267489540 2024-09-05T12:58:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.539+0000 7f822d614740 1 -- 172.21.15.73:0/1700730136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8214009e50 con 0x55b267489540 2024-09-05T12:58:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.540+0000 7f82037fe640 1 -- 172.21.15.73:0/1700730136 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f821c023480 con 0x55b267489540 2024-09-05T12:58:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.540+0000 7f82037fe640 1 -- 172.21.15.73:0/1700730136 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f821c023680 con 0x55b267489540 2024-09-05T12:58:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.540+0000 7f822d614740 10 client.15534 fetch_fsmap learned FSMap version 26 2024-09-05T12:58:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.540+0000 7f822d614740 1 -- 172.21.15.73:0/1700730136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b2671c6620 con 0x55b267489540 2024-09-05T12:58:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.542+0000 7f82037fe640 1 -- 172.21.15.73:0/1700730136 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8214009e50 con 0x55b267489540 2024-09-05T12:58:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.542+0000 7f82037fe640 1 -- 172.21.15.73:0/1700730136 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f821c01a620 con 0x55b267489540 2024-09-05T12:58:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.542+0000 7f822d614740 10 client.15534 fetch_fsmap finished waiting for FSMap version 26 2024-09-05T12:58:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.542+0000 7f822d614740 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.543+0000 7f822d614740 20 client.15534 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.543+0000 7f822d614740 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b26749a000 0x55b26749c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.543+0000 7f822d614740 4 client.15534 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:58:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.543+0000 7f822d614740 1 -- 172.21.15.73:0/1700730136 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2673f4a20 con 0x55b26749a000 2024-09-05T12:58:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.548+0000 7f8223fff640 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b26749a000 0x55b26749c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.552+0000 7f8223fff640 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b26749a000 0x55b26749c4c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4627bfaa1e92b3b3 server_cookie=a00bd47b51290de9 in_seq=0 out_seq=0 2024-09-05T12:58:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.552+0000 7f82037fe640 10 client.15534 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.555+0000 7f82037fe640 1 -- 172.21.15.73:0/1700730136 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2673f4a20 con 0x55b26749a000 2024-09-05T12:58:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.555+0000 7f82037fe640 10 client.15534 handle_command_reply: tid=0 2024-09-05T12:58:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.555+0000 7f822d614740 1 client.15534 shutdown 2024-09-05T12:58:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.556+0000 7f822d614740 1 -- 172.21.15.73:0/1700730136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267489540 msgr2=0x55b2674953b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.556+0000 7f822d614740 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267489540 0x55b2674953b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f821c00da80 tx=0x7f821c004ad0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.557+0000 7f822d614740 1 -- 172.21.15.73:0/1700730136 shutdown_connections 2024-09-05T12:58:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.557+0000 7f822d614740 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b26749a000 0x55b26749c4c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.557+0000 7f822d614740 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267489540 0x55b2674953b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.557+0000 7f822d614740 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b2674844b0 0x55b26748e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.557+0000 7f822d614740 1 --2- 172.21.15.73:0/1700730136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 0x55b26748de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.557+0000 7f822d614740 1 -- 172.21.15.73:0/1700730136 >> 172.21.15.73:0/1700730136 conn(0x55b26747f1e0 msgr2=0x55b2674809f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.559+0000 7f82037fe640 0 client.15534 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.559+0000 7f822d614740 1 -- 172.21.15.73:0/1700730136 shutdown_connections 2024-09-05T12:58:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.560+0000 7f822d614740 1 -- 172.21.15.73:0/1700730136 wait complete. 2024-09-05T12:58:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.565+0000 7f822d614740 20 client.15534 trim_cache size 0 max 16384 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.614+0000 7f822d614740 1 Processor -- start 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.614+0000 7f822d614740 1 -- start start 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f822d614740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 0x55b267479ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f822d614740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267495370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f822d614740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b267489540 0x55b26748de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f82237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267495370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f822d614740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f822411c0b0 con 0x55b2674844b0 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f82237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267495370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33638/0 (socket says 172.21.15.73:33638) 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f82237fe640 1 -- 172.21.15.73:0/1719292964 learned_addr learned my addr 172.21.15.73:0/1719292964 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f822d614740 1 -- 172.21.15.73:0/1719292964 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8224119980 con 0x55b267483b70 2024-09-05T12:58:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f822d614740 1 -- 172.21.15.73:0/1719292964 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f82241177d0 con 0x55b267489540 2024-09-05T12:58:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f82237fe640 1 -- 172.21.15.73:0/1719292964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b267489540 msgr2=0x55b26748de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f82237fe640 1 --2- 172.21.15.73:0/1719292964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b267489540 0x55b26748de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f82237fe640 1 -- 172.21.15.73:0/1719292964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 msgr2=0x55b267479ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:58:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f82237fe640 1 --2- 172.21.15.73:0/1719292964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 0x55b267479ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.615+0000 7f82237fe640 1 -- 172.21.15.73:0/1719292964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b26747f000 con 0x55b2674844b0 2024-09-05T12:58:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.616+0000 7f82237fe640 1 --2- 172.21.15.73:0/1719292964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267495370 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f82180ccf40 tx=0x7f82180cc9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d379c373703a034c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.616+0000 7f8209ffb640 1 -- 172.21.15.73:0/1719292964 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82180ccfb0 con 0x55b2674844b0 2024-09-05T12:58:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.616+0000 7f8209ffb640 1 -- 172.21.15.73:0/1719292964 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82180d1360 con 0x55b2674844b0 2024-09-05T12:58:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.616+0000 7f8209ffb640 1 -- 172.21.15.73:0/1719292964 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82180c9620 con 0x55b2674844b0 2024-09-05T12:58:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.618+0000 7f822d614740 1 -- 172.21.15.73:0/1719292964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 msgr2=0x55b267495370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.618+0000 7f822d614740 1 --2- 172.21.15.73:0/1719292964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267495370 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f82180ccf40 tx=0x7f82180cc9d0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.619+0000 7f822d614740 1 -- 172.21.15.73:0/1719292964 shutdown_connections 2024-09-05T12:58:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.619+0000 7f822d614740 1 --2- 172.21.15.73:0/1719292964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b267489540 0x55b26748de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.619+0000 7f822d614740 1 --2- 172.21.15.73:0/1719292964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2674844b0 0x55b267495370 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.619+0000 7f822d614740 1 --2- 172.21.15.73:0/1719292964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267483b70 0x55b267479ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.620+0000 7f822d614740 1 -- 172.21.15.73:0/1719292964 >> 172.21.15.73:0/1719292964 conn(0x55b26747f1e0 msgr2=0x55b267485650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:56.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.620+0000 7f822d614740 1 -- 172.21.15.73:0/1719292964 shutdown_connections 2024-09-05T12:58:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.620+0000 7f822d614740 1 -- 172.21.15.73:0/1719292964 wait complete. 2024-09-05T12:58:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.620+0000 7f822d614740 1 -- start start 2024-09-05T12:58:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.621+0000 7f822d614740 1 Processor -- start 2024-09-05T12:58:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.622+0000 7f822d614740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267483b70 0x55b267492060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.622+0000 7f822d614740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b2674844b0 0x55b2674925a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.622+0000 7f822d614740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267489540 0x55b267502d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.622+0000 7f822d614740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8224117e40 con 0x55b267483b70 2024-09-05T12:58:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.622+0000 7f822d614740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82241192b0 con 0x55b267489540 2024-09-05T12:58:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.622+0000 7f822d614740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8224118510 con 0x55b2674844b0 2024-09-05T12:58:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.622+0000 7f822d614740 10 client.0 _ll_register_callbacks cb 0x7f821c00d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:58:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.623+0000 7f8223fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267483b70 0x55b267492060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.623+0000 7f8223fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267483b70 0x55b267492060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33646/0 (socket says 172.21.15.73:33646) 2024-09-05T12:58:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.623+0000 7f8223fff640 1 -- 172.21.15.73:0/1453403698 learned_addr learned my addr 172.21.15.73:0/1453403698 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:58:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.623+0000 7f8223fff640 1 -- 172.21.15.73:0/1453403698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b2674844b0 msgr2=0x55b2674925a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T12:58:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.623+0000 7f8223fff640 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b2674844b0 0x55b2674925a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.623+0000 7f8223fff640 1 -- 172.21.15.73:0/1453403698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267489540 msgr2=0x55b267502d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T12:58:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.623+0000 7f8223fff640 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267489540 0x55b267502d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.623+0000 7f8223fff640 1 -- 172.21.15.73:0/1453403698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b267492c10 con 0x55b267483b70 2024-09-05T12:58:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.624+0000 7f8223fff640 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267483b70 0x55b267492060 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8214009660 tx=0x7f8214009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45aaaa11785d6b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:58:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.624+0000 7f82037fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:58:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.625+0000 7f82037fe640 1 -- 172.21.15.73:0/1453403698 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214015040 con 0x55b267483b70 2024-09-05T12:58:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.625+0000 7f82037fe640 1 -- 172.21.15.73:0/1453403698 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f8214011aa0 con 0x55b267483b70 2024-09-05T12:58:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.625+0000 7f822d614740 1 -- 172.21.15.73:0/1453403698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82180d1360 con 0x55b267483b70 2024-09-05T12:58:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.626+0000 7f82037fe640 1 -- 172.21.15.73:0/1453403698 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8214009350 con 0x55b267483b70 2024-09-05T12:58:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.627+0000 7f822d614740 10 client.15540 fetch_fsmap learned FSMap version 26 2024-09-05T12:58:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.627+0000 7f822d614740 1 -- 172.21.15.73:0/1453403698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b267504450 con 0x55b267483b70 2024-09-05T12:58:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.628+0000 7f82037fe640 1 -- 172.21.15.73:0/1453403698 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82180d1360 con 0x55b267483b70 2024-09-05T12:58:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.628+0000 7f82037fe640 1 -- 172.21.15.73:0/1453403698 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f8214021070 con 0x55b267483b70 2024-09-05T12:58:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.629+0000 7f822d614740 10 client.15540 fetch_fsmap finished waiting for FSMap version 26 2024-09-05T12:58:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.629+0000 7f822d614740 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:58:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.629+0000 7f822d614740 20 client.15540 populate_metadata read hostname 'smithi073' 2024-09-05T12:58:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.629+0000 7f822d614740 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b267504cf0 0x55b267507110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:58:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.629+0000 7f822d614740 4 client.15540 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T12:58:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.629+0000 7f822d614740 1 -- 172.21.15.73:0/1453403698 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b2673eed70 con 0x55b267504cf0 2024-09-05T12:58:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.632+0000 7f82237fe640 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b267504cf0 0x55b267507110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:58:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.635+0000 7f82037fe640 10 client.15540 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:56.635+0000 7f82237fe640 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b267504cf0 0x55b267507110 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4bba55043da8cf server_cookie=1c83fc0f482329e2 in_seq=0 out_seq=0 2024-09-05T12:58:57.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:57 smithi162 ceph-mon[34220]: pgmap v366: 97 pgs: 97 active+clean; 8.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 713 MiB/s wr, 610 op/s 2024-09-05T12:58:57.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:57 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:58:57.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:57 smithi169 ceph-mon[34823]: pgmap v366: 97 pgs: 97 active+clean; 8.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 713 MiB/s wr, 610 op/s 2024-09-05T12:58:57.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:57 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:58:57.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:57 smithi073 ceph-mon[30883]: pgmap v366: 97 pgs: 97 active+clean; 8.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 713 MiB/s wr, 610 op/s 2024-09-05T12:58:57.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:57 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:58:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.597+0000 7f82037fe640 1 -- 172.21.15.73:0/1453403698 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2673eed70 con 0x55b267504cf0 2024-09-05T12:58:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.597+0000 7f82037fe640 10 client.15540 handle_command_reply: tid=0 2024-09-05T12:58:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 client.15540 shutdown 2024-09-05T12:58:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 -- 172.21.15.73:0/1453403698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267483b70 msgr2=0x55b267492060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267483b70 0x55b267492060 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8214009660 tx=0x7f8214009f40 comp rx=0 tx=0).stop 2024-09-05T12:58:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 -- 172.21.15.73:0/1453403698 shutdown_connections 2024-09-05T12:58:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b267504cf0 0x55b267507110 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b267489540 0x55b267502d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f82037fe640 0 client.15540 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:58:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b2674844b0 0x55b2674925a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 --2- 172.21.15.73:0/1453403698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b267483b70 0x55b267492060 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 -- 172.21.15.73:0/1453403698 >> 172.21.15.73:0/1453403698 conn(0x55b26747f1e0 msgr2=0x55b26748ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 -- 172.21.15.73:0/1453403698 shutdown_connections 2024-09-05T12:58:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 1 -- 172.21.15.73:0/1453403698 wait complete. 2024-09-05T12:58:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.598+0000 7f822d614740 20 client.15540 trim_cache size 0 max 16384 2024-09-05T12:58:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T12:58:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T12:58:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T12:58:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T12:58:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 -- 172.21.15.73:0/3044966691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f820c0c4c50 msgr2=0x7f820c0c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f820c0c4c50 0x7f820c0c7110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f821c00aab0 tx=0x7f821c009250 comp rx=0 tx=0).stop 2024-09-05T12:58:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 -- 172.21.15.73:0/3044966691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8224101a60 msgr2=0x7f82241085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:58:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8224101a60 0x7f82241085e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8218005ab0 tx=0x7f8218004c20 comp rx=0 tx=0).stop 2024-09-05T12:58:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 -- 172.21.15.73:0/3044966691 shutdown_connections 2024-09-05T12:58:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f820c0c4c50 0x7f820c0c7110 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8224102420 0x7f822410fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8224101a60 0x7f82241085e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 --2- 172.21.15.73:0/3044966691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8224100870 0x7f82241080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:58:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 -- 172.21.15.73:0/3044966691 >> 172.21.15.73:0/3044966691 conn(0x7f82240fbfb0 msgr2=0x7f8224070490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:58:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 -- 172.21.15.73:0/3044966691 shutdown_connections 2024-09-05T12:58:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:58:58.600+0000 7f822a87d640 1 -- 172.21.15.73:0/3044966691 wait complete. 2024-09-05T12:58:59.009 INFO:tasks.workunit.client.0.smithi073.stdout:Syncing()...3 sec 2024-09-05T12:58:59.010 INFO:tasks.workunit.client.0.smithi073.stdout:Starting Actual Benchmark At: Thu Sep 5 12:58:59 2024 2024-09-05T12:58:59.010 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T12:58:59.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:58:59 smithi162 ceph-mon[34220]: pgmap v367: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 774 MiB/s wr, 546 op/s 2024-09-05T12:58:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:58:59 smithi169 ceph-mon[34823]: pgmap v367: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 774 MiB/s wr, 546 op/s 2024-09-05T12:58:59.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:58:59 smithi073 ceph-mon[30883]: pgmap v367: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 774 MiB/s wr, 546 op/s 2024-09-05T12:59:01.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:01 smithi162 ceph-mon[34220]: pgmap v368: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 841 MiB/s wr, 462 op/s 2024-09-05T12:59:01.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:01 smithi169 ceph-mon[34823]: pgmap v368: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 841 MiB/s wr, 462 op/s 2024-09-05T12:59:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:01 smithi073 ceph-mon[30883]: pgmap v368: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 841 MiB/s wr, 462 op/s 2024-09-05T12:59:02.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:02 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:59:02.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:02 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:59:02.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:02 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:59:03.414 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:03 smithi073 ceph-mon[30883]: pgmap v369: 97 pgs: 97 active+clean; 13 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 886 MiB/s wr, 3.05k op/s 2024-09-05T12:59:03.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:03 smithi162 ceph-mon[34220]: pgmap v369: 97 pgs: 97 active+clean; 13 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 886 MiB/s wr, 3.05k op/s 2024-09-05T12:59:03.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:03 smithi169 ceph-mon[34823]: pgmap v369: 97 pgs: 97 active+clean; 13 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 886 MiB/s wr, 3.05k op/s 2024-09-05T12:59:04.081 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T12:59:04.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:04 smithi073 ceph-mon[30883]: pgmap v370: 97 pgs: 97 active+clean; 13 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 645 MiB/s wr, 3.83k op/s 2024-09-05T12:59:04.569 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:59:04.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:04 smithi162 ceph-mon[34220]: pgmap v370: 97 pgs: 97 active+clean; 13 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 645 MiB/s wr, 3.83k op/s 2024-09-05T12:59:04.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:04 smithi169 ceph-mon[34823]: pgmap v370: 97 pgs: 97 active+clean; 13 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 645 MiB/s wr, 3.83k op/s 2024-09-05T12:59:07.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:07 smithi162 ceph-mon[34220]: pgmap v371: 97 pgs: 97 active+clean; 13 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 687 MiB/s wr, 14.10k op/s 2024-09-05T12:59:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:07 smithi169 ceph-mon[34823]: pgmap v371: 97 pgs: 97 active+clean; 13 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 687 MiB/s wr, 14.10k op/s 2024-09-05T12:59:07.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:07 smithi073 ceph-mon[30883]: pgmap v371: 97 pgs: 97 active+clean; 13 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 687 MiB/s wr, 14.10k op/s 2024-09-05T12:59:09.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:09 smithi162 ceph-mon[34220]: pgmap v372: 97 pgs: 97 active+clean; 13 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 477 MiB/s wr, 18.59k op/s 2024-09-05T12:59:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:09 smithi169 ceph-mon[34823]: pgmap v372: 97 pgs: 97 active+clean; 13 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 477 MiB/s wr, 18.59k op/s 2024-09-05T12:59:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:09 smithi073 ceph-mon[30883]: pgmap v372: 97 pgs: 97 active+clean; 13 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 477 MiB/s wr, 18.59k op/s 2024-09-05T12:59:10.775 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T12:59:10.776 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2024-09-05T12:59:10.776 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2024-09-05T12:59:10.776 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T12:59:10.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.775+0000 7fdd193b5640 1 -- 172.21.15.73:0/604482350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd14109450 msgr2=0x7fdd14110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.775+0000 7fdd193b5640 1 --2- 172.21.15.73:0/604482350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd14109450 0x7fdd14110250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009860 tx=0x7fdcfc02a360 comp rx=0 tx=0).stop 2024-09-05T12:59:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.775+0000 7fdd193b5640 1 -- 172.21.15.73:0/604482350 shutdown_connections 2024-09-05T12:59:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.775+0000 7fdd193b5640 1 --2- 172.21.15.73:0/604482350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1411b140 0x7fdd1411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.775+0000 7fdd193b5640 1 --2- 172.21.15.73:0/604482350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd14109830 0x7fdd14109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.775+0000 7fdd193b5640 1 --2- 172.21.15.73:0/604482350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd14109450 0x7fdd14110250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.775+0000 7fdd193b5640 1 -- 172.21.15.73:0/604482350 >> 172.21.15.73:0/604482350 conn(0x7fdd1406e140 msgr2=0x7fdd1406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.776+0000 7fdd193b5640 1 -- 172.21.15.73:0/604482350 shutdown_connections 2024-09-05T12:59:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.776+0000 7fdd193b5640 1 -- 172.21.15.73:0/604482350 wait complete. 2024-09-05T12:59:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.777+0000 7fdd193b5640 1 Processor -- start 2024-09-05T12:59:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.777+0000 7fdd193b5640 1 -- start start 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd193b5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd14109450 0x7fdd141a7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd193b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd14109830 0x7fdd141a7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd193b5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd1411b140 0x7fdd141abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd193b5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14120d70 con 0x7fdd14109830 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd193b5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14120bf0 con 0x7fdd14109450 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd193b5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14120ef0 con 0x7fdd1411b140 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd0bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd14109830 0x7fdd141a7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd0bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd14109830 0x7fdd141a7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51902/0 (socket says 172.21.15.73:51902) 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd12ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd14109450 0x7fdd141a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd12ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd14109450 0x7fdd141a7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:51184/0 (socket says 172.21.15.73:51184) 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd12ffd640 1 -- 172.21.15.73:0/2742138238 learned_addr learned my addr 172.21.15.73:0/2742138238 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.778+0000 7fdd137fe640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd1411b140 0x7fdd141abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.779+0000 7fdd12ffd640 1 -- 172.21.15.73:0/2742138238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd1411b140 msgr2=0x7fdd141abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:10.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.779+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd1411b140 0x7fdd141abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.779+0000 7fdd12ffd640 1 -- 172.21.15.73:0/2742138238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd14109830 msgr2=0x7fdd141a7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:10.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.779+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd14109830 0x7fdd141a7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.779+0000 7fdd12ffd640 1 -- 172.21.15.73:0/2742138238 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd141ac2e0 con 0x7fdd14109450 2024-09-05T12:59:10.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.781+0000 7fdd137fe640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd1411b140 0x7fdd141abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:59:10.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.781+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd14109450 0x7fdd141a7330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc035040 tx=0x7fdcfc032760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:10.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.783+0000 7fdd10ff9640 1 -- 172.21.15.73:0/2742138238 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc037040 con 0x7fdd14109450 2024-09-05T12:59:10.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.783+0000 7fdd10ff9640 1 -- 172.21.15.73:0/2742138238 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcfc040070 con 0x7fdd14109450 2024-09-05T12:59:10.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.783+0000 7fdd10ff9640 1 -- 172.21.15.73:0/2742138238 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc0052b0 con 0x7fdd14109450 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.784+0000 7fdd193b5640 1 -- 172.21.15.73:0/2742138238 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd141ac570 con 0x7fdd14109450 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.784+0000 7fdd193b5640 1 -- 172.21.15.73:0/2742138238 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd141aca00 con 0x7fdd14109450 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.788+0000 7fdd1b78b740 1 Processor -- start 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.789+0000 7fdd1b78b740 1 -- start start 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.790+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 0x55e14b0d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.790+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 0x55e14b0dc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.790+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0dc680 0x55e14b0dea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.790+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e14b0372e0 con 0x55e14b0d1dc0 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.790+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e14afdece0 con 0x55e14b0dc680 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.790+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e14b0332a0 con 0x55e14b0d14a0 2024-09-05T12:59:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.791+0000 7fdd10ff9640 1 -- 172.21.15.73:0/2742138238 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdcfc005450 con 0x7fdd14109450 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.791+0000 7fdd0bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0dc680 0x55e14b0dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.791+0000 7fdd0bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0dc680 0x55e14b0dea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:51190/0 (socket says 172.21.15.73:51190) 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.791+0000 7fdd0bfff640 1 -- 172.21.15.73:0/359794484 learned_addr learned my addr 172.21.15.73:0/359794484 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.792+0000 7fdd137fe640 1 --2- 172.21.15.73:0/359794484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 0x55e14b0d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.792+0000 7fdd10ff9640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdd000a2d90 0x7fdd000a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.793+0000 7fdd10ff9640 1 -- 172.21.15.73:0/2742138238 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fdcfc0ee530 con 0x7fdd14109450 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.793+0000 7fdd137fe640 1 -- 172.21.15.73:0/359794484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0dc680 msgr2=0x55e14b0dea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.793+0000 7fdd137fe640 1 --2- 172.21.15.73:0/359794484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0dc680 0x55e14b0dea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.793+0000 7fdd137fe640 1 -- 172.21.15.73:0/359794484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 msgr2=0x55e14b0dc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.793+0000 7fdd137fe640 1 --2- 172.21.15.73:0/359794484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 0x55e14b0dc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.793+0000 7fdd137fe640 1 -- 172.21.15.73:0/359794484 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14afc3440 con 0x55e14b0d14a0 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.795+0000 7fdd137fe640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdd000a2d90 0x7fdd000a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.795+0000 7fdd137fe640 1 --2- 172.21.15.73:0/359794484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 0x55e14b0d1880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00e8d0 tx=0x7fdd0c00ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af16d1d8c9fd7484 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.795+0000 7fdd097fa640 1 -- 172.21.15.73:0/359794484 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c019500 con 0x55e14b0d14a0 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.796+0000 7fdd097fa640 1 -- 172.21.15.73:0/359794484 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd0c019c00 con 0x55e14b0d14a0 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.796+0000 7fdd097fa640 1 -- 172.21.15.73:0/359794484 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c00b360 con 0x55e14b0d14a0 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.796+0000 7fdd137fe640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdd000a2d90 0x7fdd000a5250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c021000 tx=0x7fdd0c00b5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.798+0000 7fdd1b78b740 1 -- 172.21.15.73:0/359794484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 msgr2=0x55e14b0d1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.798+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/359794484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 0x55e14b0d1880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00e8d0 tx=0x7fdd0c00ed90 comp rx=0 tx=0).stop 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.799+0000 7fdd1b78b740 1 -- 172.21.15.73:0/359794484 shutdown_connections 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.799+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/359794484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0dc680 0x55e14b0dea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.799+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/359794484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 0x55e14b0dc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.799+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/359794484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 0x55e14b0d1880 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.799+0000 7fdd1b78b740 1 -- 172.21.15.73:0/359794484 >> 172.21.15.73:0/359794484 conn(0x55e14b0cda30 msgr2=0x55e14b0cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.802+0000 7fdd1b78b740 1 -- 172.21.15.73:0/359794484 shutdown_connections 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.804+0000 7fdd1b78b740 1 -- 172.21.15.73:0/359794484 wait complete. 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.805+0000 7fdd1b78b740 1 -- start start 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.805+0000 7fdd1b78b740 1 Processor -- start 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.805+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0dc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.805+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 0x55e14b0d92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.805+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0dc680 0x55e14b0d98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.805+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e14b0f0260 con 0x55e14b0d1dc0 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.805+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e14aff2050 con 0x55e14b0d14a0 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.805+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e14b0f03e0 con 0x55e14b0dc680 2024-09-05T12:59:10.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.805+0000 7fdd1b78b740 10 client.0 _ll_register_callbacks cb 0x55e14b032160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.806+0000 7fdd137fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0dc680 0x55e14b0d98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.807+0000 7fdd12ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0dc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.807+0000 7fdd12ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0dc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:51196/0 (socket says 172.21.15.73:51196) 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.807+0000 7fdd12ffd640 1 -- 172.21.15.73:0/3115488772 learned_addr learned my addr 172.21.15.73:0/3115488772 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.807+0000 7fdd0bfff640 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 0x55e14b0d92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.808+0000 7fdd12ffd640 1 -- 172.21.15.73:0/3115488772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0dc680 msgr2=0x55e14b0d98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.808+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0dc680 0x55e14b0d98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.808+0000 7fdd12ffd640 1 -- 172.21.15.73:0/3115488772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 msgr2=0x55e14b0d92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.808+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 0x55e14b0d92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.808+0000 7fdd12ffd640 1 -- 172.21.15.73:0/3115488772 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e14ada83c0 con 0x55e14b0d14a0 2024-09-05T12:59:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.809+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0dc040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0b71c0 tx=0x7fdcfc0ba960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700cca3fef32f1ae server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.809+0000 7fdcfa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.809+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/3115488772 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc0bf110 con 0x55e14b0d14a0 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.809+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/3115488772 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fdcfc030520 con 0x55e14b0d14a0 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.810+0000 7fdd1b78b740 1 -- 172.21.15.73:0/3115488772 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd0c019c00 con 0x55e14b0d14a0 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.810+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/3115488772 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdcfc0c39d0 con 0x55e14b0d14a0 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.810+0000 7fdd1b78b740 10 client.25085 fetch_fsmap learned FSMap version 27 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.810+0000 7fdd1b78b740 1 -- 172.21.15.73:0/3115488772 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e14b0fbcb0 con 0x55e14b0d14a0 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.812+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/3115488772 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd0c019c00 con 0x55e14b0d14a0 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.813+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/3115488772 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fdcfc03a070 con 0x55e14b0d14a0 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.813+0000 7fdd1b78b740 10 client.25085 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.813+0000 7fdd1b78b740 10 client.25085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.813+0000 7fdd1b78b740 20 client.25085 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.813+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e14b0fd0c0 0x55e14b0ff4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.813+0000 7fdd1b78b740 4 client.25085 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.813+0000 7fdd1b78b740 1 -- 172.21.15.73:0/3115488772 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e14b044850 con 0x55e14b0fd0c0 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.817+0000 7fdd0bfff640 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e14b0fd0c0 0x55e14b0ff4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.824+0000 7fdd0bfff640 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e14b0fd0c0 0x55e14b0ff4e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ae387a83431d409 server_cookie=2276a16faae75f61 in_seq=0 out_seq=0 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.824+0000 7fdcfa7fc640 10 client.25085 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.825+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/3115488772 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e14b044850 con 0x55e14b0fd0c0 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.825+0000 7fdcfa7fc640 10 client.25085 handle_command_reply: tid=0 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.826+0000 7fdd1b78b740 1 client.25085 shutdown 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.827+0000 7fdd1b78b740 1 -- 172.21.15.73:0/3115488772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 msgr2=0x55e14b0dc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.827+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0dc040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0b71c0 tx=0x7fdcfc0ba960 comp rx=0 tx=0).stop 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.827+0000 7fdd1b78b740 1 -- 172.21.15.73:0/3115488772 shutdown_connections 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.827+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e14b0fd0c0 0x55e14b0ff4e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.827+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0dc680 0x55e14b0d98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.827+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 0x55e14b0d92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.827+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/3115488772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0dc040 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.827+0000 7fdcfa7fc640 0 client.25085 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.827+0000 7fdd1b78b740 1 -- 172.21.15.73:0/3115488772 >> 172.21.15.73:0/3115488772 conn(0x55e14b0cda30 msgr2=0x55e14b0d3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.828+0000 7fdd1b78b740 1 -- 172.21.15.73:0/3115488772 shutdown_connections 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.828+0000 7fdd1b78b740 1 -- 172.21.15.73:0/3115488772 wait complete. 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.829+0000 7fdd1b78b740 20 client.25085 trim_cache size 0 max 16384 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.865+0000 7fdd1b78b740 1 Processor -- start 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.865+0000 7fdd1b78b740 1 -- start start 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.866+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.866+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 0x55e14b104d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.866+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0dc680 0x55e14b1052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.867+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141b62b0 con 0x55e14b0d1dc0 2024-09-05T12:59:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.867+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14118ce0 con 0x55e14b0d14a0 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.867+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14116b50 con 0x55e14b0dc680 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.869+0000 7fdd12ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.869+0000 7fdd12ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0f94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:51202/0 (socket says 172.21.15.73:51202) 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.869+0000 7fdd12ffd640 1 -- 172.21.15.73:0/2732422242 learned_addr learned my addr 172.21.15.73:0/2732422242 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.869+0000 7fdd137fe640 1 --2- 172.21.15.73:0/2732422242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0dc680 0x55e14b1052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.870+0000 7fdd12ffd640 1 -- 172.21.15.73:0/2732422242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0dc680 msgr2=0x55e14b1052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.870+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/2732422242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0dc680 0x55e14b1052b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.870+0000 7fdd12ffd640 1 -- 172.21.15.73:0/2732422242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 msgr2=0x55e14b104d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.870+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/2732422242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 0x55e14b104d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.870+0000 7fdd12ffd640 1 -- 172.21.15.73:0/2732422242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14b0dea70 con 0x55e14b0d14a0 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.870+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/2732422242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0f94f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc033fa0 tx=0x7fdcfc0b9270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca52714aabd13f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.871+0000 7fdd08ff9640 1 -- 172.21.15.73:0/2732422242 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc0bf110 con 0x55e14b0d14a0 2024-09-05T12:59:10.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.871+0000 7fdd08ff9640 1 -- 172.21.15.73:0/2732422242 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcfc0c3540 con 0x55e14b0d14a0 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.871+0000 7fdd08ff9640 1 -- 172.21.15.73:0/2732422242 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc0b6ab0 con 0x55e14b0d14a0 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.872+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2732422242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 msgr2=0x55e14b0f94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.872+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/2732422242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0f94f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc033fa0 tx=0x7fdcfc0b9270 comp rx=0 tx=0).stop 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.873+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2732422242 shutdown_connections 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.873+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/2732422242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0dc680 0x55e14b1052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.873+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/2732422242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0d1dc0 0x55e14b104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.873+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/2732422242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d14a0 0x55e14b0f94f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.873+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2732422242 >> 172.21.15.73:0/2732422242 conn(0x55e14b0cda30 msgr2=0x55e14b0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.874+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2732422242 shutdown_connections 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.874+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2732422242 wait complete. 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.875+0000 7fdd1b78b740 1 -- start start 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.875+0000 7fdd1b78b740 1 Processor -- start 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.875+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 0x55e14b0f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.875+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d1dc0 0x55e14b0f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.875+0000 7fdd1b78b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0dc680 0x55e14b160d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.875+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141171a0 con 0x55e14b0dc680 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.875+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14118610 con 0x55e14b0d1dc0 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.875+0000 7fdd1b78b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14117870 con 0x55e14b0d14a0 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.875+0000 7fdd1b78b740 10 client.0 _ll_register_callbacks cb 0x7fdcfc005f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.876+0000 7fdd0bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d1dc0 0x55e14b0f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.876+0000 7fdd0bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d1dc0 0x55e14b0f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:51210/0 (socket says 172.21.15.73:51210) 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.876+0000 7fdd0bfff640 1 -- 172.21.15.73:0/2207772984 learned_addr learned my addr 172.21.15.73:0/2207772984 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.876+0000 7fdd137fe640 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0dc680 0x55e14b160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.876+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 0x55e14b0f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.876+0000 7fdd0bfff640 1 -- 172.21.15.73:0/2207772984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 msgr2=0x55e14b0f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.876+0000 7fdd0bfff640 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 0x55e14b0f1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.876+0000 7fdd0bfff640 1 -- 172.21.15.73:0/2207772984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0dc680 msgr2=0x55e14b160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.876+0000 7fdd0bfff640 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0dc680 0x55e14b160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.876+0000 7fdd0bfff640 1 -- 172.21.15.73:0/2207772984 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e14b1613c0 con 0x55e14b0d1dc0 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.877+0000 7fdd0bfff640 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d1dc0 0x55e14b0f21f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009b00 tx=0x7fdd04009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dbd9af87f1d4bac server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.877+0000 7fdcfa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.879+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/2207772984 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04022020 con 0x55e14b0d1dc0 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.879+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2207772984 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcfc0c3540 con 0x55e14b0d1dc0 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.879+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/2207772984 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fdd0401e5a0 con 0x55e14b0d1dc0 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.880+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/2207772984 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdd0401e7a0 con 0x55e14b0d1dc0 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.880+0000 7fdd1b78b740 10 client.25091 fetch_fsmap learned FSMap version 27 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.880+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2207772984 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e14b1687d0 con 0x55e14b0d1dc0 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.881+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/2207772984 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcfc0c3540 con 0x55e14b0d1dc0 2024-09-05T12:59:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.881+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/2207772984 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fdd040263a0 con 0x55e14b0d1dc0 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.881+0000 7fdd1b78b740 10 client.25091 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.881+0000 7fdd1b78b740 10 client.25091 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.881+0000 7fdd1b78b740 20 client.25091 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.881+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e14b168f40 0x55e14b16b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.881+0000 7fdd1b78b740 4 client.25091 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.881+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2207772984 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e14b03ed60 con 0x55e14b168f40 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.882+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e14b168f40 0x55e14b16b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.882+0000 7fdd12ffd640 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e14b168f40 0x55e14b16b360 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccb81e6d64ce36a2 server_cookie=5c7c5b92ded016f5 in_seq=0 out_seq=0 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.882+0000 7fdcfa7fc640 10 client.25091 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdcfa7fc640 1 -- 172.21.15.73:0/2207772984 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e14b03ed60 con 0x55e14b168f40 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdcfa7fc640 10 client.25091 handle_command_reply: tid=0 2024-09-05T12:59:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 client.25091 shutdown 2024-09-05T12:59:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2207772984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d1dc0 msgr2=0x55e14b0f21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d1dc0 0x55e14b0f21f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009b00 tx=0x7fdd04009f90 comp rx=0 tx=0).stop 2024-09-05T12:59:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2207772984 shutdown_connections 2024-09-05T12:59:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e14b168f40 0x55e14b16b360 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e14b0dc680 0x55e14b160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e14b0d1dc0 0x55e14b0f21f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdcfa7fc640 0 client.25091 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 --2- 172.21.15.73:0/2207772984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e14b0d14a0 0x55e14b0f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2207772984 >> 172.21.15.73:0/2207772984 conn(0x55e14b0cda30 msgr2=0x55e14b0cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2207772984 shutdown_connections 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 1 -- 172.21.15.73:0/2207772984 wait complete. 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.883+0000 7fdd1b78b740 20 client.25091 trim_cache size 0 max 16384 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 -- 172.21.15.73:0/2742138238 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdd000a2d90 msgr2=0x7fdd000a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdd000a2d90 0x7fdd000a5250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c021000 tx=0x7fdd0c00b5c0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 -- 172.21.15.73:0/2742138238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd14109450 msgr2=0x7fdd141a7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd14109450 0x7fdd141a7330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc035040 tx=0x7fdcfc032760 comp rx=0 tx=0).stop 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 -- 172.21.15.73:0/2742138238 shutdown_connections 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdd000a2d90 0x7fdd000a5250 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd1411b140 0x7fdd141abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd14109830 0x7fdd141a7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 --2- 172.21.15.73:0/2742138238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd14109450 0x7fdd141a7330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:10.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 -- 172.21.15.73:0/2742138238 >> 172.21.15.73:0/2742138238 conn(0x7fdd1406e140 msgr2=0x7fdd1411bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:10.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 -- 172.21.15.73:0/2742138238 shutdown_connections 2024-09-05T12:59:10.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:09.884+0000 7fdd193b5640 1 -- 172.21.15.73:0/2742138238 wait complete. 2024-09-05T12:59:11.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:11 smithi169 ceph-mon[34823]: pgmap v373: 97 pgs: 97 active+clean; 13 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 418 MiB/s wr, 23.67k op/s 2024-09-05T12:59:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:11 smithi073 ceph-mon[30883]: pgmap v373: 97 pgs: 97 active+clean; 13 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 418 MiB/s wr, 23.67k op/s 2024-09-05T12:59:11.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:11 smithi162 ceph-mon[34220]: pgmap v373: 97 pgs: 97 active+clean; 13 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 418 MiB/s wr, 23.67k op/s 2024-09-05T12:59:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.764+0000 7f801c439640 1 -- 172.21.15.73:0/393084163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80141056c0 msgr2=0x7f8014105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:11.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.764+0000 7f801c439640 1 --2- 172.21.15.73:0/393084163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80141056c0 0x7f8014105b70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f800c009ca0 tx=0x7f800c02a8d0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.764+0000 7f801c439640 1 -- 172.21.15.73:0/393084163 shutdown_connections 2024-09-05T12:59:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.764+0000 7f801c439640 1 --2- 172.21.15.73:0/393084163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80141056c0 0x7f8014105b70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.764+0000 7f801c439640 1 --2- 172.21.15.73:0/393084163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8014102d10 0x7f8014105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.764+0000 7f801c439640 1 --2- 172.21.15.73:0/393084163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80141003c0 0x7f80141027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.764+0000 7f801c439640 1 -- 172.21.15.73:0/393084163 >> 172.21.15.73:0/393084163 conn(0x7f80140fc1b0 msgr2=0x7f80140fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:11.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.770+0000 7f801c439640 1 -- 172.21.15.73:0/393084163 shutdown_connections 2024-09-05T12:59:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.771+0000 7f801c439640 1 -- 172.21.15.73:0/393084163 wait complete. 2024-09-05T12:59:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.772+0000 7f801c439640 1 Processor -- start 2024-09-05T12:59:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.772+0000 7f801c439640 1 -- start start 2024-09-05T12:59:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.772+0000 7f801c439640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80141003c0 0x7f801410b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.772+0000 7f801c439640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8014102d10 0x7f801410be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.772+0000 7f801c439640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80141056c0 0x7f80141ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.772+0000 7f801c439640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8014113ec0 con 0x7f80141003c0 2024-09-05T12:59:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.772+0000 7f801c439640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8014113d40 con 0x7f8014102d10 2024-09-05T12:59:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.772+0000 7f801c439640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8014114040 con 0x7f80141056c0 2024-09-05T12:59:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.773+0000 7f801a1d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80141003c0 0x7f801410b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.773+0000 7f801a1d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80141003c0 0x7f801410b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51946/0 (socket says 172.21.15.73:51946) 2024-09-05T12:59:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.773+0000 7f801a1d5640 1 -- 172.21.15.73:0/2361690904 learned_addr learned my addr 172.21.15.73:0/2361690904 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.773+0000 7f801a1d5640 1 -- 172.21.15.73:0/2361690904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80141056c0 msgr2=0x7f80141ae5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T12:59:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.773+0000 7f801a1d5640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80141056c0 0x7f80141ae5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.773+0000 7f801a1d5640 1 -- 172.21.15.73:0/2361690904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8014102d10 msgr2=0x7f801410be70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T12:59:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.773+0000 7f801a1d5640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8014102d10 0x7f801410be70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.773+0000 7f801a1d5640 1 -- 172.21.15.73:0/2361690904 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80141aeb10 con 0x7f80141003c0 2024-09-05T12:59:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.773+0000 7f801a1d5640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80141003c0 0x7f801410b930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f800400b450 tx=0x7f800400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.775+0000 7f800b7fe640 1 -- 172.21.15.73:0/2361690904 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8004015020 con 0x7f80141003c0 2024-09-05T12:59:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.775+0000 7f800b7fe640 1 -- 172.21.15.73:0/2361690904 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8004011d70 con 0x7f80141003c0 2024-09-05T12:59:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.775+0000 7f800b7fe640 1 -- 172.21.15.73:0/2361690904 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800400f340 con 0x7f80141003c0 2024-09-05T12:59:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.776+0000 7f801c439640 1 -- 172.21.15.73:0/2361690904 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80141aece0 con 0x7f80141003c0 2024-09-05T12:59:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.776+0000 7f801c439640 1 -- 172.21.15.73:0/2361690904 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80141af150 con 0x7f80141003c0 2024-09-05T12:59:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.780+0000 7f801f1c9740 1 Processor -- start 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.781+0000 7f801f1c9740 1 -- start start 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.781+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e269a0 0x556658e26da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.781+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e272e0 0x556658e2bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.781+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e2e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.781+0000 7f801f1c9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556658d8a2f0 con 0x556658e272e0 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.781+0000 7f801f1c9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556658d32270 con 0x556658e2c370 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.781+0000 7f801f1c9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556658d862b0 con 0x556658e269a0 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.781+0000 7f80199d4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e2e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.781+0000 7f80199d4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e2e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:51224/0 (socket says 172.21.15.73:51224) 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.781+0000 7f80199d4640 1 -- 172.21.15.73:0/2925041266 learned_addr learned my addr 172.21.15.73:0/2925041266 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.782+0000 7f80199d4640 1 -- 172.21.15.73:0/2925041266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e269a0 msgr2=0x556658e26da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T12:59:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.782+0000 7f80199d4640 1 --2- 172.21.15.73:0/2925041266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e269a0 0x556658e26da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.782+0000 7f80199d4640 1 -- 172.21.15.73:0/2925041266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e272e0 msgr2=0x556658e2bda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T12:59:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.782+0000 7f80199d4640 1 --2- 172.21.15.73:0/2925041266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e272e0 0x556658e2bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.782+0000 7f80199d4640 1 -- 172.21.15.73:0/2925041266 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556658d31340 con 0x556658e2c370 2024-09-05T12:59:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.782+0000 7f80199d4640 1 --2- 172.21.15.73:0/2925041266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e2e830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8010009770 tx=0x7f8010009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f0b9297a55df280 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.783+0000 7f8008bfe640 1 -- 172.21.15.73:0/2925041266 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8010015020 con 0x556658e2c370 2024-09-05T12:59:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.783+0000 7f8008bfe640 1 -- 172.21.15.73:0/2925041266 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8010011420 con 0x556658e2c370 2024-09-05T12:59:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.783+0000 7f8008bfe640 1 -- 172.21.15.73:0/2925041266 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80100105c0 con 0x556658e2c370 2024-09-05T12:59:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.784+0000 7f801f1c9740 1 -- 172.21.15.73:0/2925041266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 msgr2=0x556658e2e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.784+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2925041266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e2e830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8010009770 tx=0x7f8010009c30 comp rx=0 tx=0).stop 2024-09-05T12:59:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.787+0000 7f800b7fe640 1 -- 172.21.15.73:0/2361690904 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8004018020 con 0x7f80141003c0 2024-09-05T12:59:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.788+0000 7f800b7fe640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f80000a2e70 0x7f80000a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.788+0000 7f800b7fe640 1 -- 172.21.15.73:0/2361690904 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f80040d0b30 con 0x7f80141003c0 2024-09-05T12:59:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.790+0000 7f801f1c9740 1 -- 172.21.15.73:0/2925041266 shutdown_connections 2024-09-05T12:59:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.790+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2925041266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e2e830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.790+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2925041266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e272e0 0x556658e2bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.790+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2925041266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e269a0 0x556658e26da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.790+0000 7f801f1c9740 1 -- 172.21.15.73:0/2925041266 >> 172.21.15.73:0/2925041266 conn(0x556658e22010 msgr2=0x556658e22410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.790+0000 7f801a9d6640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f80000a2e70 0x7f80000a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.791+0000 7f801a9d6640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f80000a2e70 0x7f80000a5330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f800c004af0 tx=0x7f800c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.793+0000 7f801f1c9740 1 -- 172.21.15.73:0/2925041266 shutdown_connections 2024-09-05T12:59:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.794+0000 7f801f1c9740 1 -- 172.21.15.73:0/2925041266 wait complete. 2024-09-05T12:59:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.795+0000 7f801f1c9740 1 -- start start 2024-09-05T12:59:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.795+0000 7f801f1c9740 1 Processor -- start 2024-09-05T12:59:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.796+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e30bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.796+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 0x556658e31110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.796+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e38150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.796+0000 7f801f1c9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556658e2f340 con 0x556658e269a0 2024-09-05T12:59:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.796+0000 7f801f1c9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556658d13290 con 0x556658e2c370 2024-09-05T12:59:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.796+0000 7f801f1c9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556658e2f4c0 con 0x556658e272e0 2024-09-05T12:59:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.796+0000 7f801f1c9740 10 client.0 _ll_register_callbacks cb 0x556658d44140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.799+0000 7f80199d4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 0x556658e31110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.800+0000 7f801a9d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e38150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.801+0000 7f80199d4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 0x556658e31110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:33592/0 (socket says 172.21.15.73:33592) 2024-09-05T12:59:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.801+0000 7f80199d4640 1 -- 172.21.15.73:0/2067773195 learned_addr learned my addr 172.21.15.73:0/2067773195 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.801+0000 7f801a1d5640 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e30bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.803+0000 7f80199d4640 1 -- 172.21.15.73:0/2067773195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 msgr2=0x556658e38150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.803+0000 7f80199d4640 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e38150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.803+0000 7f80199d4640 1 -- 172.21.15.73:0/2067773195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 msgr2=0x556658e30bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.803+0000 7f80199d4640 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e30bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.803+0000 7f80199d4640 1 -- 172.21.15.73:0/2067773195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556658a9d210 con 0x556658e272e0 2024-09-05T12:59:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.806+0000 7f80199d4640 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 0x556658e31110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8010011c20 tx=0x7f8010011800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97167ee5af72c702 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.808+0000 7f7ffdffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T12:59:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.814+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2067773195 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8010027060 con 0x556658e272e0 2024-09-05T12:59:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.814+0000 7f801f1c9740 1 -- 172.21.15.73:0/2067773195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8010011420 con 0x556658e272e0 2024-09-05T12:59:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.814+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2067773195 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f801000bce0 con 0x556658e272e0 2024-09-05T12:59:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.818+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2067773195 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8010015040 con 0x556658e272e0 2024-09-05T12:59:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.818+0000 7f801f1c9740 10 client.25147 fetch_fsmap learned FSMap version 27 2024-09-05T12:59:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.818+0000 7f801f1c9740 1 -- 172.21.15.73:0/2067773195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556658b69620 con 0x556658e272e0 2024-09-05T12:59:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.820+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2067773195 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8010011420 con 0x556658e272e0 2024-09-05T12:59:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.820+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2067773195 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f801001a420 con 0x556658e272e0 2024-09-05T12:59:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.820+0000 7f801f1c9740 10 client.25147 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T12:59:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.820+0000 7f801f1c9740 10 client.25147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:59:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.820+0000 7f801f1c9740 20 client.25147 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.820+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556658e3cbe0 0x556658e3f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.820+0000 7f801f1c9740 4 client.25147 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:59:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.820+0000 7f801f1c9740 1 -- 172.21.15.73:0/2067773195 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556658d97a20 con 0x556658e3cbe0 2024-09-05T12:59:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.825+0000 7f801a1d5640 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556658e3cbe0 0x556658e3f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.831+0000 7f7ffdffb640 10 client.25147 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.831+0000 7f801a1d5640 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556658e3cbe0 0x556658e3f000 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1c65dfd45725543 server_cookie=d056b8a599917688 in_seq=0 out_seq=0 2024-09-05T12:59:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.837+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2067773195 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556658d97a20 con 0x556658e3cbe0 2024-09-05T12:59:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.837+0000 7f7ffdffb640 10 client.25147 handle_command_reply: tid=0 2024-09-05T12:59:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.837+0000 7f801f1c9740 1 client.25147 shutdown 2024-09-05T12:59:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.839+0000 7f801f1c9740 1 -- 172.21.15.73:0/2067773195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 msgr2=0x556658e31110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.839+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 0x556658e31110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8010011c20 tx=0x7f8010011800 comp rx=0 tx=0).stop 2024-09-05T12:59:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.841+0000 7f801f1c9740 1 -- 172.21.15.73:0/2067773195 shutdown_connections 2024-09-05T12:59:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.841+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556658e3cbe0 0x556658e3f000 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.841+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e38150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.841+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 0x556658e31110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.841+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2067773195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e30bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.841+0000 7f801f1c9740 1 -- 172.21.15.73:0/2067773195 >> 172.21.15.73:0/2067773195 conn(0x556658e22010 msgr2=0x556658e23820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:11.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.842+0000 7f7ffdffb640 0 client.25147 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.843+0000 7f801f1c9740 1 -- 172.21.15.73:0/2067773195 shutdown_connections 2024-09-05T12:59:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.844+0000 7f801f1c9740 1 -- 172.21.15.73:0/2067773195 wait complete. 2024-09-05T12:59:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.844+0000 7f801f1c9740 20 client.25147 trim_cache size 0 max 16384 2024-09-05T12:59:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.880+0000 7f801f1c9740 1 Processor -- start 2024-09-05T12:59:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.881+0000 7f801f1c9740 1 -- start start 2024-09-05T12:59:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.881+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e26d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.881+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 0x556658e38110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.881+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e223f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.881+0000 7f801f1c9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff8010d30 con 0x556658e269a0 2024-09-05T12:59:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.881+0000 7f801f1c9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff800e600 con 0x556658e2c370 2024-09-05T12:59:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.881+0000 7f801f1c9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff800c450 con 0x556658e272e0 2024-09-05T12:59:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.882+0000 7f801a9d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.882+0000 7f801a9d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e223f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:51240/0 (socket says 172.21.15.73:51240) 2024-09-05T12:59:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.882+0000 7f801a9d6640 1 -- 172.21.15.73:0/4128687061 learned_addr learned my addr 172.21.15.73:0/4128687061 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.883+0000 7f80199d4640 1 --2- 172.21.15.73:0/4128687061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 0x556658e38110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.883+0000 7f801a9d6640 1 -- 172.21.15.73:0/4128687061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 msgr2=0x556658e38110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.883+0000 7f801a9d6640 1 --2- 172.21.15.73:0/4128687061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 0x556658e38110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.883+0000 7f801a9d6640 1 -- 172.21.15.73:0/4128687061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 msgr2=0x556658e26d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T12:59:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.883+0000 7f801a9d6640 1 --2- 172.21.15.73:0/4128687061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e26d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.883+0000 7f801a9d6640 1 -- 172.21.15.73:0/4128687061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556658e2f680 con 0x556658e2c370 2024-09-05T12:59:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.886+0000 7f801a9d6640 1 --2- 172.21.15.73:0/4128687061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e223f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f800c035000 tx=0x7f800c03d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664f21ca112bd394 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.887+0000 7f7ffffff640 1 -- 172.21.15.73:0/4128687061 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c02f820 con 0x556658e2c370 2024-09-05T12:59:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.887+0000 7f7ffffff640 1 -- 172.21.15.73:0/4128687061 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f800c04d070 con 0x556658e2c370 2024-09-05T12:59:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.887+0000 7f7ffffff640 1 -- 172.21.15.73:0/4128687061 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c052470 con 0x556658e2c370 2024-09-05T12:59:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.888+0000 7f801f1c9740 1 -- 172.21.15.73:0/4128687061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 msgr2=0x556658e223f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.888+0000 7f801f1c9740 1 --2- 172.21.15.73:0/4128687061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e223f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f800c035000 tx=0x7f800c03d000 comp rx=0 tx=0).stop 2024-09-05T12:59:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.889+0000 7f801f1c9740 1 -- 172.21.15.73:0/4128687061 shutdown_connections 2024-09-05T12:59:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.889+0000 7f801f1c9740 1 --2- 172.21.15.73:0/4128687061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e2c370 0x556658e223f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.889+0000 7f801f1c9740 1 --2- 172.21.15.73:0/4128687061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e272e0 0x556658e38110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.889+0000 7f801f1c9740 1 --2- 172.21.15.73:0/4128687061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e26d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.889+0000 7f801f1c9740 1 -- 172.21.15.73:0/4128687061 >> 172.21.15.73:0/4128687061 conn(0x556658e22010 msgr2=0x556658e28420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.890+0000 7f801f1c9740 1 -- 172.21.15.73:0/4128687061 shutdown_connections 2024-09-05T12:59:11.892 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.890+0000 7f801f1c9740 1 -- 172.21.15.73:0/4128687061 wait complete. 2024-09-05T12:59:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.890+0000 7f801f1c9740 1 -- start start 2024-09-05T12:59:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.891+0000 7f801f1c9740 1 Processor -- start 2024-09-05T12:59:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.891+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e381b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.891+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e272e0 0x556658e34c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.892+0000 7f801f1c9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e2c370 0x556658e35280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.892+0000 7f801f1c9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff800cac0 con 0x556658e269a0 2024-09-05T12:59:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.892+0000 7f801f1c9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff800df30 con 0x556658e272e0 2024-09-05T12:59:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.892+0000 7f801f1c9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff800d190 con 0x556658e2c370 2024-09-05T12:59:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.892+0000 7f801f1c9740 10 client.0 _ll_register_callbacks cb 0x7f80100095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.892+0000 7f801a9d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e2c370 0x556658e35280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.893+0000 7f801a9d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e2c370 0x556658e35280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:33612/0 (socket says 172.21.15.73:33612) 2024-09-05T12:59:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.893+0000 7f801a9d6640 1 -- 172.21.15.73:0/2370955923 learned_addr learned my addr 172.21.15.73:0/2370955923 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.894+0000 7f801a1d5640 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.894+0000 7f801a9d6640 1 -- 172.21.15.73:0/2370955923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e272e0 msgr2=0x556658e34c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.894+0000 7f801a9d6640 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e272e0 0x556658e34c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.894+0000 7f801a9d6640 1 -- 172.21.15.73:0/2370955923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 msgr2=0x556658e381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.894+0000 7f801a9d6640 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e381b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.894+0000 7f801a9d6640 1 -- 172.21.15.73:0/2370955923 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556658ea5950 con 0x556658e2c370 2024-09-05T12:59:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.897+0000 7f801a9d6640 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e2c370 0x556658e35280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f800c02aec0 tx=0x7f800c030f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcc56bca173d9d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.897+0000 7f7ffdffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T12:59:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.900+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2370955923 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c060060 con 0x556658e2c370 2024-09-05T12:59:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.900+0000 7f801f1c9740 1 -- 172.21.15.73:0/2370955923 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f800c04d070 con 0x556658e2c370 2024-09-05T12:59:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.900+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2370955923 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f800c02fd40 con 0x556658e2c370 2024-09-05T12:59:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.902+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2370955923 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f800c052470 con 0x556658e2c370 2024-09-05T12:59:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.902+0000 7f801f1c9740 10 client.25153 fetch_fsmap learned FSMap version 27 2024-09-05T12:59:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.902+0000 7f801f1c9740 1 -- 172.21.15.73:0/2370955923 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556658ea6c60 con 0x556658e2c370 2024-09-05T12:59:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.904+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2370955923 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f800c04d070 con 0x556658e2c370 2024-09-05T12:59:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.904+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2370955923 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f800c05b850 con 0x556658e2c370 2024-09-05T12:59:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.904+0000 7f801f1c9740 10 client.25153 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T12:59:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.904+0000 7f801f1c9740 10 client.25153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:59:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.904+0000 7f801f1c9740 20 client.25153 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.904+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556658ea7550 0x556658ea9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.904+0000 7f801f1c9740 4 client.25153 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T12:59:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.904+0000 7f801f1c9740 1 -- 172.21.15.73:0/2370955923 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556658d91d70 con 0x556658ea7550 2024-09-05T12:59:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.905+0000 7f801a1d5640 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556658ea7550 0x556658ea9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.909+0000 7f801a1d5640 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556658ea7550 0x556658ea9970 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c4fab4e53b20511 server_cookie=ece29651ec6f2ed3 in_seq=0 out_seq=0 2024-09-05T12:59:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:11.909+0000 7f7ffdffb640 10 client.25153 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f7ffdffb640 1 -- 172.21.15.73:0/2370955923 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556658d91d70 con 0x556658ea7550 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f7ffdffb640 10 client.25153 handle_command_reply: tid=0 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 client.25153 shutdown 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 -- 172.21.15.73:0/2370955923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e2c370 msgr2=0x556658e35280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e2c370 0x556658e35280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f800c02aec0 tx=0x7f800c030f50 comp rx=0 tx=0).stop 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 -- 172.21.15.73:0/2370955923 shutdown_connections 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556658ea7550 0x556658ea9970 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556658e2c370 0x556658e35280 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556658e272e0 0x556658e34c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 --2- 172.21.15.73:0/2370955923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556658e269a0 0x556658e381b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f7ffdffb640 0 client.25153 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 -- 172.21.15.73:0/2370955923 >> 172.21.15.73:0/2370955923 conn(0x556658e22010 msgr2=0x556658e209a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 -- 172.21.15.73:0/2370955923 shutdown_connections 2024-09-05T12:59:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 1 -- 172.21.15.73:0/2370955923 wait complete. 2024-09-05T12:59:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.111+0000 7f801f1c9740 20 client.25153 trim_cache size 0 max 16384 2024-09-05T12:59:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T12:59:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T12:59:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T12:59:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T12:59:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 -- 172.21.15.73:0/2361690904 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f80000a2e70 msgr2=0x7f80000a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f80000a2e70 0x7f80000a5330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f800c004af0 tx=0x7f800c005ef0 comp rx=0 tx=0).stop 2024-09-05T12:59:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 -- 172.21.15.73:0/2361690904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80141003c0 msgr2=0x7f801410b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80141003c0 0x7f801410b930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f800400b450 tx=0x7f800400b910 comp rx=0 tx=0).stop 2024-09-05T12:59:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 -- 172.21.15.73:0/2361690904 shutdown_connections 2024-09-05T12:59:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f80000a2e70 0x7f80000a5330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80141056c0 0x7f80141ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8014102d10 0x7f801410be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 --2- 172.21.15.73:0/2361690904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80141003c0 0x7f801410b930 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 -- 172.21.15.73:0/2361690904 >> 172.21.15.73:0/2361690904 conn(0x7f80140fc1b0 msgr2=0x7f8014100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 -- 172.21.15.73:0/2361690904 shutdown_connections 2024-09-05T12:59:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:12.112+0000 7f801c439640 1 -- 172.21.15.73:0/2361690904 wait complete. 2024-09-05T12:59:12.867 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:59:12 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: ignoring --setuser ceph since I am not root 2024-09-05T12:59:12.867 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:59:12 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: ignoring --setgroup ceph since I am not root 2024-09-05T12:59:12.867 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:59:12 smithi169 ceph-mds[65207]: -- 172.21.15.169:0/2122516514 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b21a2f1c20 con 0x55b21a2cf000 2024-09-05T12:59:12.868 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 12:59:12 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: starting mds.c at 2024-09-05T12:59:13.412 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:13 smithi162 ceph-mon[34220]: pgmap v374: 97 pgs: 97 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 380 MiB/s wr, 33.56k op/s 2024-09-05T12:59:13.412 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:13 smithi162 ceph-mon[34220]: daemon mds.c restarted 2024-09-05T12:59:13.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:13 smithi073 ceph-mon[30883]: pgmap v374: 97 pgs: 97 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 380 MiB/s wr, 33.56k op/s 2024-09-05T12:59:13.515 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:13 smithi073 ceph-mon[30883]: daemon mds.c restarted 2024-09-05T12:59:13.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:13 smithi169 ceph-mon[34823]: pgmap v374: 97 pgs: 97 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 380 MiB/s wr, 33.56k op/s 2024-09-05T12:59:13.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:13 smithi169 ceph-mon[34823]: daemon mds.c restarted 2024-09-05T12:59:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:14 smithi073 ceph-mon[30883]: osdmap e81: 12 total, 12 up, 12 in 2024-09-05T12:59:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:14 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.169:6836/4110365542,v1:172.21.15.169:6837/4110365542] up:boot 2024-09-05T12:59:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:14 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-09-05T12:59:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T12:59:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:14 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:59:14.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:14 smithi073 ceph-mon[30883]: pgmap v376: 97 pgs: 97 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 252 MiB/s wr, 35.95k op/s 2024-09-05T12:59:14.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:14 smithi162 ceph-mon[34220]: osdmap e81: 12 total, 12 up, 12 in 2024-09-05T12:59:14.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:14 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.169:6836/4110365542,v1:172.21.15.169:6837/4110365542] up:boot 2024-09-05T12:59:14.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:14 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-09-05T12:59:14.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T12:59:14.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:14 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:59:14.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:14 smithi162 ceph-mon[34220]: pgmap v376: 97 pgs: 97 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 252 MiB/s wr, 35.95k op/s 2024-09-05T12:59:14.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:14 smithi169 ceph-mon[34823]: osdmap e81: 12 total, 12 up, 12 in 2024-09-05T12:59:14.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:14 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.169:6836/4110365542,v1:172.21.15.169:6837/4110365542] up:boot 2024-09-05T12:59:14.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:14 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-09-05T12:59:14.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T12:59:14.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:14 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T12:59:14.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:14 smithi169 ceph-mon[34823]: pgmap v376: 97 pgs: 97 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 252 MiB/s wr, 35.95k op/s 2024-09-05T12:59:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:17 smithi162 ceph-mon[34220]: pgmap v377: 97 pgs: 97 active+clean; 13 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 256 MiB/s wr, 33.92k op/s 2024-09-05T12:59:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:17 smithi169 ceph-mon[34823]: pgmap v377: 97 pgs: 97 active+clean; 13 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 256 MiB/s wr, 33.92k op/s 2024-09-05T12:59:17.516 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:17 smithi073 ceph-mon[30883]: pgmap v377: 97 pgs: 97 active+clean; 13 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 256 MiB/s wr, 33.92k op/s 2024-09-05T12:59:19.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:19 smithi162 ceph-mon[34220]: pgmap v378: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 273 MiB/s wr, 34.62k op/s 2024-09-05T12:59:19.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:19 smithi169 ceph-mon[34823]: pgmap v378: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 273 MiB/s wr, 34.62k op/s 2024-09-05T12:59:19.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:19 smithi073 ceph-mon[30883]: pgmap v378: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 273 MiB/s wr, 34.62k op/s 2024-09-05T12:59:21.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:21 smithi162 ceph-mon[34220]: pgmap v379: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 272 MiB/s wr, 33.34k op/s 2024-09-05T12:59:21.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:21 smithi169 ceph-mon[34823]: pgmap v379: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 272 MiB/s wr, 33.34k op/s 2024-09-05T12:59:21.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:21 smithi073 ceph-mon[30883]: pgmap v379: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 272 MiB/s wr, 33.34k op/s 2024-09-05T12:59:21.729 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T12:59:21.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T12:59:22.266 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:59:23.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:23 smithi162 ceph-mon[34220]: pgmap v380: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 261 MiB/s wr, 30.38k op/s 2024-09-05T12:59:23.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:23 smithi169 ceph-mon[34823]: pgmap v380: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 261 MiB/s wr, 30.38k op/s 2024-09-05T12:59:23.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:23 smithi073 ceph-mon[30883]: pgmap v380: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 261 MiB/s wr, 30.38k op/s 2024-09-05T12:59:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.269+0000 7f3eabe08640 1 -- 172.21.15.73:0/2306518373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4072ce0 msgr2=0x7f3ea4073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.269+0000 7f3eabe08640 1 --2- 172.21.15.73:0/2306518373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4072ce0 0x7f3ea4073160 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009900 tx=0x7f3ea002a400 comp rx=0 tx=0).stop 2024-09-05T12:59:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.275+0000 7f3eabe08640 1 -- 172.21.15.73:0/2306518373 shutdown_connections 2024-09-05T12:59:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.275+0000 7f3eabe08640 1 --2- 172.21.15.73:0/2306518373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ea40736a0 0x7f3ea4119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.275+0000 7f3eabe08640 1 --2- 172.21.15.73:0/2306518373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4072ce0 0x7f3ea4073160 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.275+0000 7f3eabe08640 1 --2- 172.21.15.73:0/2306518373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ea4109700 0x7f3ea4109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.275+0000 7f3eabe08640 1 -- 172.21.15.73:0/2306518373 >> 172.21.15.73:0/2306518373 conn(0x7f3ea406ece0 msgr2=0x7f3ea4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.281+0000 7f3eabe08640 1 -- 172.21.15.73:0/2306518373 shutdown_connections 2024-09-05T12:59:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.283+0000 7f3eabe08640 1 -- 172.21.15.73:0/2306518373 wait complete. 2024-09-05T12:59:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.283+0000 7f3eabe08640 1 Processor -- start 2024-09-05T12:59:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.286+0000 7f3eabe08640 1 -- start start 2024-09-05T12:59:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.286+0000 7f3eabe08640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4072ce0 0x7f3ea4115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.286+0000 7f3eabe08640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ea40736a0 0x7f3ea4115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.286+0000 7f3eabe08640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ea4109700 0x7f3ea41b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.286+0000 7f3eabe08640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea411c610 con 0x7f3ea4072ce0 2024-09-05T12:59:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.286+0000 7f3eabe08640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea411c490 con 0x7f3ea40736a0 2024-09-05T12:59:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.286+0000 7f3eabe08640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea411c790 con 0x7f3ea4109700 2024-09-05T12:59:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.287+0000 7f3eaa3a5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ea4109700 0x7f3ea41b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.287+0000 7f3eaa3a5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ea4109700 0x7f3ea41b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:56584/0 (socket says 172.21.15.73:56584) 2024-09-05T12:59:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.287+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/145535586 learned_addr learned my addr 172.21.15.73:0/145535586 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.287+0000 7f3ea9ba4640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4072ce0 0x7f3ea4115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.288+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/145535586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ea40736a0 msgr2=0x7f3ea4115d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T12:59:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.288+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ea40736a0 0x7f3ea4115d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.288+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/145535586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4072ce0 msgr2=0x7f3ea4115810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.288+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4072ce0 0x7f3ea4115810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.288+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/145535586 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea4118ed0 con 0x7f3ea4109700 2024-09-05T12:59:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.289+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ea4109700 0x7f3ea41b6d20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00eb10 tx=0x7f3e9c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.290+0000 7f3e9affd640 1 -- 172.21.15.73:0/145535586 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c004b20 con 0x7f3ea4109700 2024-09-05T12:59:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.290+0000 7f3eabe08640 1 -- 172.21.15.73:0/145535586 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea41b7320 con 0x7f3ea4109700 2024-09-05T12:59:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.290+0000 7f3eabe08640 1 -- 172.21.15.73:0/145535586 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea41b7840 con 0x7f3ea4109700 2024-09-05T12:59:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.290+0000 7f3e9affd640 1 -- 172.21.15.73:0/145535586 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e9c004cc0 con 0x7f3ea4109700 2024-09-05T12:59:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.290+0000 7f3e9affd640 1 -- 172.21.15.73:0/145535586 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c010760 con 0x7f3ea4109700 2024-09-05T12:59:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.296+0000 7f3e9affd640 1 -- 172.21.15.73:0/145535586 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3e9c010900 con 0x7f3ea4109700 2024-09-05T12:59:25.298 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.297+0000 7f3eaec7b740 1 Processor -- start 2024-09-05T12:59:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.297+0000 7f3eaec7b740 1 -- start start 2024-09-05T12:59:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.297+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d510169a0 0x564d51016da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.297+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d5101bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.297+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d5101c370 0x564d5101e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.297+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x564d50f7a2f0 con 0x564d510172e0 2024-09-05T12:59:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.297+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564d50f22270 con 0x564d510169a0 2024-09-05T12:59:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.297+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564d50f762b0 con 0x564d5101c370 2024-09-05T12:59:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.298+0000 7f3ea9ba4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d5101bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.298+0000 7f3ea9ba4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d5101bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56036/0 (socket says 172.21.15.73:56036) 2024-09-05T12:59:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.298+0000 7f3ea9ba4640 1 -- 172.21.15.73:0/3737928238 learned_addr learned my addr 172.21.15.73:0/3737928238 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.298+0000 7f3ea93a3640 1 --2- 172.21.15.73:0/3737928238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d5101c370 0x564d5101e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.300+0000 7f3ea93a3640 1 --2- 172.21.15.73:0/3737928238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d510169a0 0x564d51016da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.300+0000 7f3ea93a3640 1 -- 172.21.15.73:0/3737928238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d510169a0 msgr2=0x564d51016da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.300+0000 7f3ea93a3640 1 --2- 172.21.15.73:0/3737928238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d510169a0 0x564d51016da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.300+0000 7f3ea93a3640 1 -- 172.21.15.73:0/3737928238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 msgr2=0x564d5101bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.300+0000 7f3ea93a3640 1 --2- 172.21.15.73:0/3737928238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d5101bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.300+0000 7f3ea93a3640 1 -- 172.21.15.73:0/3737928238 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d50f21340 con 0x564d5101c370 2024-09-05T12:59:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.301+0000 7f3e9affd640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3e900a2d80 0x7f3e900a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.301+0000 7f3e9affd640 1 -- 172.21.15.73:0/145535586 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f3e9c0d06a0 con 0x7f3ea4109700 2024-09-05T12:59:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.302+0000 7f3ea9ba4640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3e900a2d80 0x7f3e900a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.304+0000 7f3ea93a3640 1 --2- 172.21.15.73:0/3737928238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d5101c370 0x564d5101e830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009850 tx=0x7f3ea0031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=275adb195e61cbe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.305+0000 7f3e8ffff640 1 -- 172.21.15.73:0/3737928238 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0035040 con 0x564d5101c370 2024-09-05T12:59:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.305+0000 7f3e8ffff640 1 -- 172.21.15.73:0/3737928238 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ea0031e30 con 0x564d5101c370 2024-09-05T12:59:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.305+0000 7f3e8ffff640 1 -- 172.21.15.73:0/3737928238 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea003cda0 con 0x564d5101c370 2024-09-05T12:59:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.307+0000 7f3eaec7b740 1 -- 172.21.15.73:0/3737928238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d5101c370 msgr2=0x564d5101e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.307+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/3737928238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d5101c370 0x564d5101e830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009850 tx=0x7f3ea0031400 comp rx=0 tx=0).stop 2024-09-05T12:59:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.307+0000 7f3eaec7b740 1 -- 172.21.15.73:0/3737928238 shutdown_connections 2024-09-05T12:59:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.307+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/3737928238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d5101c370 0x564d5101e830 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.307+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/3737928238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d5101bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.307+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/3737928238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d510169a0 0x564d51016da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.307+0000 7f3eaec7b740 1 -- 172.21.15.73:0/3737928238 >> 172.21.15.73:0/3737928238 conn(0x564d51012010 msgr2=0x564d51012410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.308+0000 7f3eaec7b740 1 -- 172.21.15.73:0/3737928238 shutdown_connections 2024-09-05T12:59:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.308+0000 7f3eaec7b740 1 -- 172.21.15.73:0/3737928238 wait complete. 2024-09-05T12:59:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.309+0000 7f3eaec7b740 1 -- start start 2024-09-05T12:59:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.309+0000 7f3eaec7b740 1 Processor -- start 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.310+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d510169a0 0x564d51020c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.310+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510172e0 0x564d51021170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.310+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d5101c370 0x564d510281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.310+0000 7f3ea9ba4640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3e900a2d80 0x7f3e900a5240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x564d51017d10 tx=0x7f3e94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.310+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x564d5101f2e0 con 0x564d5101c370 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.310+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564d50f03290 con 0x564d510169a0 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.310+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564d5101f460 con 0x564d510172e0 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.310+0000 7f3eaa3a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d5101c370 0x564d510281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.311+0000 7f3eaa3a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d5101c370 0x564d510281b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56038/0 (socket says 172.21.15.73:56038) 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.311+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/308717447 learned_addr learned my addr 172.21.15.73:0/308717447 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.311+0000 7f3ea9ba4640 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d510169a0 0x564d51020c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.311+0000 7f3eaec7b740 10 client.0 _ll_register_callbacks cb 0x564d50f34140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.312+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/308717447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510172e0 msgr2=0x564d51021170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.312+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510172e0 0x564d51021170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.312+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/308717447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d510169a0 msgr2=0x564d51020c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.312+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d510169a0 0x564d51020c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.312+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/308717447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d50c8d210 con 0x564d5101c370 2024-09-05T12:59:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.312+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d5101c370 0x564d510281b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00cfd0 tx=0x7f3e9c09c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ce8e44b682c5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.312+0000 7f3e8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:59:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.317+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/308717447 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c0b5020 con 0x564d5101c370 2024-09-05T12:59:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.318+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/308717447 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f3e9c0a56b0 con 0x564d5101c370 2024-09-05T12:59:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.318+0000 7f3eaec7b740 1 -- 172.21.15.73:0/308717447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ea0031e30 con 0x564d5101c370 2024-09-05T12:59:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.319+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/308717447 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3e9c0a1280 con 0x564d5101c370 2024-09-05T12:59:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.319+0000 7f3eaec7b740 10 client.15576 fetch_fsmap learned FSMap version 29 2024-09-05T12:59:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.319+0000 7f3eaec7b740 1 -- 172.21.15.73:0/308717447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564d50d59620 con 0x564d5101c370 2024-09-05T12:59:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.320+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/308717447 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ea0031e30 con 0x564d5101c370 2024-09-05T12:59:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.321+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/308717447 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3e9c098c20 con 0x564d5101c370 2024-09-05T12:59:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.321+0000 7f3eaec7b740 10 client.15576 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T12:59:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.321+0000 7f3eaec7b740 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:59:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.321+0000 7f3eaec7b740 20 client.15576 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.321+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564d5102ce70 0x564d5102f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.321+0000 7f3eaec7b740 4 client.15576 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:59:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.321+0000 7f3eaec7b740 1 -- 172.21.15.73:0/308717447 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d50f87a20 con 0x564d5102ce70 2024-09-05T12:59:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.323+0000 7f3ea9ba4640 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564d5102ce70 0x564d5102f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.329+0000 7f3e8d7fa640 10 client.15576 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.329+0000 7f3ea9ba4640 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564d5102ce70 0x564d5102f310 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27ebdc2b3bd851ad server_cookie=849e96befcfda3ca in_seq=0 out_seq=0 2024-09-05T12:59:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.337+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/308717447 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d50f87a20 con 0x564d5102ce70 2024-09-05T12:59:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.337+0000 7f3e8d7fa640 10 client.15576 handle_command_reply: tid=0 2024-09-05T12:59:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.337+0000 7f3eaec7b740 1 client.15576 shutdown 2024-09-05T12:59:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.342+0000 7f3eaec7b740 1 -- 172.21.15.73:0/308717447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d5101c370 msgr2=0x564d510281b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.342+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d5101c370 0x564d510281b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00cfd0 tx=0x7f3e9c09c830 comp rx=0 tx=0).stop 2024-09-05T12:59:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.345+0000 7f3eaec7b740 1 -- 172.21.15.73:0/308717447 shutdown_connections 2024-09-05T12:59:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.345+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564d5102ce70 0x564d5102f310 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.345+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d5101c370 0x564d510281b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.345+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510172e0 0x564d51021170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.345+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/308717447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d510169a0 0x564d51020c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.345+0000 7f3eaec7b740 1 -- 172.21.15.73:0/308717447 >> 172.21.15.73:0/308717447 conn(0x564d51012010 msgr2=0x564d51013820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.345+0000 7f3e8d7fa640 0 client.15576 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.345+0000 7f3eaec7b740 1 -- 172.21.15.73:0/308717447 shutdown_connections 2024-09-05T12:59:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.346+0000 7f3eaec7b740 1 -- 172.21.15.73:0/308717447 wait complete. 2024-09-05T12:59:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.349+0000 7f3eaec7b740 20 client.15576 trim_cache size 0 max 16384 2024-09-05T12:59:25.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:25 smithi169 ceph-mon[34823]: pgmap v381: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 239 MiB/s wr, 27.88k op/s 2024-09-05T12:59:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.386+0000 7f3eaec7b740 1 Processor -- start 2024-09-05T12:59:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.387+0000 7f3eaec7b740 1 -- start start 2024-09-05T12:59:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.387+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510169a0 0x564d510110b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.387+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d51028170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.387+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51033c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.387+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3e88010d50 con 0x564d510172e0 2024-09-05T12:59:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.387+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8800e5c0 con 0x564d5101c370 2024-09-05T12:59:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.387+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8800c410 con 0x564d510169a0 2024-09-05T12:59:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.388+0000 7f3eaa3a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51033c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.388+0000 7f3ea93a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d51028170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.388+0000 7f3eaa3a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51033c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42020/0 (socket says 172.21.15.73:42020) 2024-09-05T12:59:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.388+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/3213607171 learned_addr learned my addr 172.21.15.73:0/3213607171 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.389+0000 7f3ea9ba4640 1 --2- 172.21.15.73:0/3213607171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510169a0 0x564d510110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.390+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/3213607171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510169a0 msgr2=0x564d510110b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.390+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/3213607171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510169a0 0x564d510110b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.390+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/3213607171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 msgr2=0x564d51028170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.390+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/3213607171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d51028170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.390+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/3213607171 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d51020770 con 0x564d5101c370 2024-09-05T12:59:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.394+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/3213607171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51033c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0049d0 tx=0x7f3e9c00efd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=133d1d35559d275a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.395+0000 7f3e8f7fe640 1 -- 172.21.15.73:0/3213607171 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c0b5070 con 0x564d5101c370 2024-09-05T12:59:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.395+0000 7f3e8f7fe640 1 -- 172.21.15.73:0/3213607171 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e9c0a5b40 con 0x564d5101c370 2024-09-05T12:59:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.395+0000 7f3e8f7fe640 1 -- 172.21.15.73:0/3213607171 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c0a5910 con 0x564d5101c370 2024-09-05T12:59:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.397+0000 7f3eaec7b740 1 -- 172.21.15.73:0/3213607171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 msgr2=0x564d51033c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.397+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/3213607171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51033c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0049d0 tx=0x7f3e9c00efd0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.398+0000 7f3eaec7b740 1 -- 172.21.15.73:0/3213607171 shutdown_connections 2024-09-05T12:59:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.398+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/3213607171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51033c10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.398+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/3213607171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d51028170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.398+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/3213607171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510169a0 0x564d510110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.398+0000 7f3eaec7b740 1 -- 172.21.15.73:0/3213607171 >> 172.21.15.73:0/3213607171 conn(0x564d51012010 msgr2=0x564d510109a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.401+0000 7f3eaec7b740 1 -- 172.21.15.73:0/3213607171 shutdown_connections 2024-09-05T12:59:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.401+0000 7f3eaec7b740 1 -- 172.21.15.73:0/3213607171 wait complete. 2024-09-05T12:59:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.401+0000 7f3eaec7b740 1 -- start start 2024-09-05T12:59:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.402+0000 7f3eaec7b740 1 Processor -- start 2024-09-05T12:59:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.402+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510169a0 0x564d510253d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.402+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d51025910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.402+0000 7f3eaec7b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51026920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.402+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8800ca80 con 0x564d510172e0 2024-09-05T12:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.402+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8800def0 con 0x564d5101c370 2024-09-05T12:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.402+0000 7f3eaec7b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8800d150 con 0x564d510169a0 2024-09-05T12:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.402+0000 7f3eaec7b740 10 client.0 _ll_register_callbacks cb 0x7f3e9c09cca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.404+0000 7f3eaa3a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51026920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.404+0000 7f3ea93a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d51025910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.404+0000 7f3ea93a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d51025910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56052/0 (socket says 172.21.15.73:56052) 2024-09-05T12:59:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.404+0000 7f3ea93a3640 1 -- 172.21.15.73:0/1207931602 learned_addr learned my addr 172.21.15.73:0/1207931602 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.404+0000 7f3ea9ba4640 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510169a0 0x564d510253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.404+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/1207931602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510169a0 msgr2=0x564d510253d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.404+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510169a0 0x564d510253d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.404+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/1207931602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 msgr2=0x564d51025910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.404+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d51025910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.405+0000 7f3eaa3a5640 1 -- 172.21.15.73:0/1207931602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d51026f30 con 0x564d5101c370 2024-09-05T12:59:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.407+0000 7f3eaa3a5640 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51026920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c098ff0 tx=0x7f3e9c09d050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee19344c390fc855 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.409+0000 7f3e8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T12:59:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.412+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/1207931602 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c0b5070 con 0x564d5101c370 2024-09-05T12:59:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.412+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/1207931602 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f3e9c09c530 con 0x564d5101c370 2024-09-05T12:59:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.413+0000 7f3eaec7b740 1 -- 172.21.15.73:0/1207931602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e9c0a5b40 con 0x564d5101c370 2024-09-05T12:59:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.415+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/1207931602 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3e9c09d5d0 con 0x564d5101c370 2024-09-05T12:59:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.416+0000 7f3eaec7b740 10 client.25121 fetch_fsmap learned FSMap version 29 2024-09-05T12:59:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.416+0000 7f3eaec7b740 1 -- 172.21.15.73:0/1207931602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564d51026f30 con 0x564d5101c370 2024-09-05T12:59:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.420+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/1207931602 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e9c0a5b40 con 0x564d5101c370 2024-09-05T12:59:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.420+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/1207931602 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3e9c0a2410 con 0x564d5101c370 2024-09-05T12:59:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.420+0000 7f3eaec7b740 10 client.25121 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T12:59:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.420+0000 7f3eaec7b740 10 client.25121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:59:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.420+0000 7f3eaec7b740 20 client.25121 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.420+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564d51097d20 0x564d5109a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.420+0000 7f3eaec7b740 4 client.25121 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T12:59:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.420+0000 7f3eaec7b740 1 -- 172.21.15.73:0/1207931602 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d50f81d70 con 0x564d51097d20 2024-09-05T12:59:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.422+0000 7f3ea9ba4640 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564d51097d20 0x564d5109a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.427+0000 7f3e8d7fa640 10 client.25121 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:25.427+0000 7f3ea9ba4640 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564d51097d20 0x564d5109a140 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50795f87def98e75 server_cookie=10f737c1e8feb722 in_seq=0 out_seq=0 2024-09-05T12:59:25.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:25 smithi073 ceph-mon[30883]: pgmap v381: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 239 MiB/s wr, 27.88k op/s 2024-09-05T12:59:25.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:25 smithi162 ceph-mon[34220]: pgmap v381: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 239 MiB/s wr, 27.88k op/s 2024-09-05T12:59:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.608+0000 7f3e8d7fa640 1 -- 172.21.15.73:0/1207931602 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d50f81d70 con 0x564d51097d20 2024-09-05T12:59:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.608+0000 7f3e8d7fa640 10 client.25121 handle_command_reply: tid=0 2024-09-05T12:59:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.608+0000 7f3eaec7b740 1 client.25121 shutdown 2024-09-05T12:59:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3eaec7b740 1 -- 172.21.15.73:0/1207931602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 msgr2=0x564d51026920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51026920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c098ff0 tx=0x7f3e9c09d050 comp rx=0 tx=0).stop 2024-09-05T12:59:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3eaec7b740 1 -- 172.21.15.73:0/1207931602 shutdown_connections 2024-09-05T12:59:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564d51097d20 0x564d5109a140 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d5101c370 0x564d51026920 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564d510172e0 0x564d51025910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3eaec7b740 1 --2- 172.21.15.73:0/1207931602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564d510169a0 0x564d510253d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3eaec7b740 1 -- 172.21.15.73:0/1207931602 >> 172.21.15.73:0/1207931602 conn(0x564d51012010 msgr2=0x564d510136e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3e8d7fa640 0 client.25121 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3eaec7b740 1 -- 172.21.15.73:0/1207931602 shutdown_connections 2024-09-05T12:59:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.609+0000 7f3eaec7b740 1 -- 172.21.15.73:0/1207931602 wait complete. 2024-09-05T12:59:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.610+0000 7f3eaec7b740 20 client.25121 trim_cache size 0 max 16384 2024-09-05T12:59:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T12:59:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T12:59:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T12:59:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T12:59:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.611+0000 7f3eabe08640 1 -- 172.21.15.73:0/145535586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3e900a2d80 msgr2=0x7f3e900a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.611+0000 7f3eabe08640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3e900a2d80 0x7f3e900a5240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x564d51017d10 tx=0x7f3e94005f90 comp rx=0 tx=0).stop 2024-09-05T12:59:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.611+0000 7f3eabe08640 1 -- 172.21.15.73:0/145535586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ea4109700 msgr2=0x7f3ea41b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.611+0000 7f3eabe08640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ea4109700 0x7f3ea41b6d20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00eb10 tx=0x7f3e9c00c2d0 comp rx=0 tx=0).stop 2024-09-05T12:59:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.614+0000 7f3eabe08640 1 -- 172.21.15.73:0/145535586 shutdown_connections 2024-09-05T12:59:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.614+0000 7f3eabe08640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3e900a2d80 0x7f3e900a5240 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.614+0000 7f3eabe08640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ea4109700 0x7f3ea41b6d20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.614+0000 7f3eabe08640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ea40736a0 0x7f3ea4115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.614+0000 7f3eabe08640 1 --2- 172.21.15.73:0/145535586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4072ce0 0x7f3ea4115810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.614+0000 7f3eabe08640 1 -- 172.21.15.73:0/145535586 >> 172.21.15.73:0/145535586 conn(0x7f3ea406ece0 msgr2=0x7f3ea40716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.614+0000 7f3eabe08640 1 -- 172.21.15.73:0/145535586 shutdown_connections 2024-09-05T12:59:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:26.614+0000 7f3eabe08640 1 -- 172.21.15.73:0/145535586 wait complete. 2024-09-05T12:59:27.368 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:27 smithi073 ceph-mon[30883]: pgmap v382: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 274 MiB/s wr, 32.27k op/s 2024-09-05T12:59:27.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:27 smithi162 ceph-mon[34220]: pgmap v382: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 274 MiB/s wr, 32.27k op/s 2024-09-05T12:59:27.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:27 smithi169 ceph-mon[34823]: pgmap v382: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 274 MiB/s wr, 32.27k op/s 2024-09-05T12:59:28.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:28 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/220787473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:59:28.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:28 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/220787473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:59:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T12:59:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":29,"btime":"2024-09-05T12:59:13:137917+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T12:59:13.137897+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25159":{"gid":25159,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/4110365542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":4110365542},{"type":"v1","addr":"172.21.15.169:6837","nonce":4110365542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T12:59:28.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.361+0000 7f2f19107640 1 -- 172.21.15.73:0/408240736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f14102570 msgr2=0x7f2f141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:28.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.361+0000 7f2f19107640 1 --2- 172.21.15.73:0/408240736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f14102570 0x7f2f141029b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009900 tx=0x7f2f0802a480 comp rx=0 tx=0).stop 2024-09-05T12:59:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.361+0000 7f2f19107640 1 -- 172.21.15.73:0/408240736 shutdown_connections 2024-09-05T12:59:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.361+0000 7f2f19107640 1 --2- 172.21.15.73:0/408240736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f14102ef0 0x7f2f1410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.361+0000 7f2f19107640 1 --2- 172.21.15.73:0/408240736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f14102570 0x7f2f141029b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.361+0000 7f2f19107640 1 --2- 172.21.15.73:0/408240736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f14100e20 0x7f2f14101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.361+0000 7f2f19107640 1 -- 172.21.15.73:0/408240736 >> 172.21.15.73:0/408240736 conn(0x7f2f140fc7d0 msgr2=0x7f2f140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.361+0000 7f2f19107640 1 -- 172.21.15.73:0/408240736 shutdown_connections 2024-09-05T12:59:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.361+0000 7f2f19107640 1 -- 172.21.15.73:0/408240736 wait complete. 2024-09-05T12:59:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.361+0000 7f2f19107640 1 Processor -- start 2024-09-05T12:59:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f19107640 1 -- start start 2024-09-05T12:59:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f19107640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f14100e20 0x7f2f141993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f19107640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f14102570 0x7f2f141998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f19107640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f14102ef0 0x7f2f141a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f19107640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14110f50 con 0x7f2f14102ef0 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f19107640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14110dd0 con 0x7f2f14102570 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f19107640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f141110d0 con 0x7f2f14100e20 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f1359e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f14102ef0 0x7f2f141a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f1359e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f14102ef0 0x7f2f141a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56078/0 (socket says 172.21.15.73:56078) 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f1359e640 1 -- 172.21.15.73:0/220787473 learned_addr learned my addr 172.21.15.73:0/220787473 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f12d9d640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f14100e20 0x7f2f141993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f1259c640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f14102570 0x7f2f141998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f1359e640 1 -- 172.21.15.73:0/220787473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f14100e20 msgr2=0x7f2f141993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f1359e640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f14100e20 0x7f2f141993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:28.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f1359e640 1 -- 172.21.15.73:0/220787473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f14102570 msgr2=0x7f2f141998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f1359e640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f14102570 0x7f2f141998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.362+0000 7f2f1359e640 1 -- 172.21.15.73:0/220787473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f141a4960 con 0x7f2f14102ef0 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.363+0000 7f2f1359e640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f14102ef0 0x7f2f141a4420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00eaa0 tx=0x7f2f0c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.363+0000 7f2efbfff640 1 -- 172.21.15.73:0/220787473 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00cdb0 con 0x7f2f14102ef0 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.363+0000 7f2efbfff640 1 -- 172.21.15.73:0/220787473 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f0c005020 con 0x7f2f14102ef0 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.363+0000 7f2f19107640 1 -- 172.21.15.73:0/220787473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f141a4b30 con 0x7f2f14102ef0 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.363+0000 7f2efbfff640 1 -- 172.21.15.73:0/220787473 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0116b0 con 0x7f2f14102ef0 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.363+0000 7f2f19107640 1 -- 172.21.15.73:0/220787473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f141a4ff0 con 0x7f2f14102ef0 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.364+0000 7f2f19107640 1 -- 172.21.15.73:0/220787473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f14101200 con 0x7f2f14102ef0 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.365+0000 7f2efbfff640 1 -- 172.21.15.73:0/220787473 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2f0c005560 con 0x7f2f14102ef0 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.366+0000 7f2efbfff640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2efc0a2b80 0x7f2efc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.366+0000 7f2efbfff640 1 -- 172.21.15.73:0/220787473 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f2f0c0cf520 con 0x7f2f14102ef0 2024-09-05T12:59:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.366+0000 7f2f12d9d640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2efc0a2b80 0x7f2efc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.367+0000 7f2f12d9d640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2efc0a2b80 0x7f2efc0a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400bbe0 tx=0x7f2f0400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.369+0000 7f2efbfff640 1 -- 172.21.15.73:0/220787473 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f0c016030 con 0x7f2f14102ef0 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.721+0000 7f2f19107640 1 -- 172.21.15.73:0/220787473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f1406a580 con 0x7f2f14102ef0 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.722+0000 7f2efbfff640 1 -- 172.21.15.73:0/220787473 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11929 (secure 0 0 0) 0x7f2f1406a580 con 0x7f2f14102ef0 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 29 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.728+0000 7f2f19107640 1 -- 172.21.15.73:0/220787473 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2efc0a2b80 msgr2=0x7f2efc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.728+0000 7f2f19107640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2efc0a2b80 0x7f2efc0a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400bbe0 tx=0x7f2f0400b390 comp rx=0 tx=0).stop 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.728+0000 7f2f19107640 1 -- 172.21.15.73:0/220787473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f14102ef0 msgr2=0x7f2f141a4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.728+0000 7f2f19107640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f14102ef0 0x7f2f141a4420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00eaa0 tx=0x7f2f0c00ef60 comp rx=0 tx=0).stop 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.729+0000 7f2f19107640 1 -- 172.21.15.73:0/220787473 shutdown_connections 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.729+0000 7f2f19107640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2efc0a2b80 0x7f2efc0a5040 secure :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400bbe0 tx=0x7f2f0400b390 comp rx=0 tx=0).stop 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.729+0000 7f2f19107640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f14102ef0 0x7f2f141a4420 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.729+0000 7f2f19107640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f14102570 0x7f2f141998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.729+0000 7f2f19107640 1 --2- 172.21.15.73:0/220787473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f14100e20 0x7f2f141993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.729+0000 7f2f19107640 1 -- 172.21.15.73:0/220787473 >> 172.21.15.73:0/220787473 conn(0x7f2f140fc7d0 msgr2=0x7f2f140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.730+0000 7f2f19107640 1 -- 172.21.15.73:0/220787473 shutdown_connections 2024-09-05T12:59:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:27.731+0000 7f2f19107640 1 -- 172.21.15.73:0/220787473 wait complete. 2024-09-05T12:59:28.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:28 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/220787473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T12:59:29.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:29 smithi073 ceph-mon[30883]: pgmap v383: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 239 MiB/s wr, 28.50k op/s 2024-09-05T12:59:29.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:29 smithi162 ceph-mon[34220]: pgmap v383: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 239 MiB/s wr, 28.50k op/s 2024-09-05T12:59:29.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:29 smithi169 ceph-mon[34823]: pgmap v383: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 239 MiB/s wr, 28.50k op/s 2024-09-05T12:59:31.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:31 smithi073 ceph-mon[30883]: pgmap v384: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 220 MiB/s wr, 27.32k op/s 2024-09-05T12:59:31.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:31 smithi162 ceph-mon[34220]: pgmap v384: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 220 MiB/s wr, 27.32k op/s 2024-09-05T12:59:31.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:31 smithi169 ceph-mon[34823]: pgmap v384: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 220 MiB/s wr, 27.32k op/s 2024-09-05T12:59:32.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:32 smithi073 ceph-mon[30883]: pgmap v385: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 232 MiB/s wr, 30.75k op/s 2024-09-05T12:59:32.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:32 smithi162 ceph-mon[34220]: pgmap v385: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 232 MiB/s wr, 30.75k op/s 2024-09-05T12:59:32.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:32 smithi169 ceph-mon[34823]: pgmap v385: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 232 MiB/s wr, 30.75k op/s 2024-09-05T12:59:35.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:35 smithi073 ceph-mon[30883]: pgmap v386: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 167 MiB/s wr, 23.29k op/s 2024-09-05T12:59:35.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:35 smithi162 ceph-mon[34220]: pgmap v386: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 167 MiB/s wr, 23.29k op/s 2024-09-05T12:59:35.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:35 smithi169 ceph-mon[34823]: pgmap v386: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 167 MiB/s wr, 23.29k op/s 2024-09-05T12:59:37.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:37 smithi162 ceph-mon[34220]: pgmap v387: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 199 MiB/s wr, 28.78k op/s 2024-09-05T12:59:37.362 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T12:59:37.363 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:37 smithi073 ceph-mon[30883]: pgmap v387: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 199 MiB/s wr, 28.78k op/s 2024-09-05T12:59:37.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:37 smithi169 ceph-mon[34823]: pgmap v387: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 199 MiB/s wr, 28.78k op/s 2024-09-05T12:59:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:59:39.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:39 smithi162 ceph-mon[34220]: pgmap v388: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 171 MiB/s wr, 27.11k op/s 2024-09-05T12:59:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:39 smithi169 ceph-mon[34823]: pgmap v388: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 171 MiB/s wr, 27.11k op/s 2024-09-05T12:59:39.409 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:39 smithi073 ceph-mon[30883]: pgmap v388: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 171 MiB/s wr, 27.11k op/s 2024-09-05T12:59:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.768+0000 7f5adffff640 1 -- 172.21.15.73:0/2984197031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ad80a5ff0 msgr2=0x7f5ad80aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.768+0000 7f5adffff640 1 --2- 172.21.15.73:0/2984197031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ad80a5ff0 0x7f5ad80aa8b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0067960 tx=0x7f5ae008e430 comp rx=0 tx=0).stop 2024-09-05T12:59:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.768+0000 7f5adffff640 1 -- 172.21.15.73:0/2984197031 shutdown_connections 2024-09-05T12:59:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.768+0000 7f5adffff640 1 --2- 172.21.15.73:0/2984197031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ad80a5ff0 0x7f5ad80aa8b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.768+0000 7f5adffff640 1 --2- 172.21.15.73:0/2984197031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad80a5650 0x7f5ad80a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.768+0000 7f5adffff640 1 --2- 172.21.15.73:0/2984197031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad80a4520 0x7f5ad80a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.768+0000 7f5adffff640 1 -- 172.21.15.73:0/2984197031 >> 172.21.15.73:0/2984197031 conn(0x7f5ad809fba0 msgr2=0x7f5ad80a2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.770+0000 7f5adffff640 1 -- 172.21.15.73:0/2984197031 shutdown_connections 2024-09-05T12:59:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.770+0000 7f5adffff640 1 -- 172.21.15.73:0/2984197031 wait complete. 2024-09-05T12:59:39.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.771+0000 7f5adffff640 1 Processor -- start 2024-09-05T12:59:39.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.772+0000 7f5adffff640 1 -- start start 2024-09-05T12:59:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.773+0000 7f5adffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad80a4520 0x7f5ad8143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.773+0000 7f5adffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad80a5650 0x7f5ad8143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.773+0000 7f5adffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ad80a5ff0 0x7f5ad814a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.773+0000 7f5adffff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80b8910 con 0x7f5ad80a5650 2024-09-05T12:59:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.773+0000 7f5adffff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80b8790 con 0x7f5ad80a5ff0 2024-09-05T12:59:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.773+0000 7f5adffff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80b8a90 con 0x7f5ad80a4520 2024-09-05T12:59:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.773+0000 7f5adeffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad80a4520 0x7f5ad8143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.773+0000 7f5adeffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad80a4520 0x7f5ad8143050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:56970/0 (socket says 172.21.15.73:56970) 2024-09-05T12:59:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.773+0000 7f5adeffd640 1 -- 172.21.15.73:0/1697710420 learned_addr learned my addr 172.21.15.73:0/1697710420 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.773+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad80a5650 0x7f5ad8143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.774+0000 7f5adeffd640 1 -- 172.21.15.73:0/1697710420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ad80a5ff0 msgr2=0x7f5ad814a600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T12:59:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.774+0000 7f5adeffd640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ad80a5ff0 0x7f5ad814a600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.774+0000 7f5adeffd640 1 -- 172.21.15.73:0/1697710420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad80a5650 msgr2=0x7f5ad8143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.774+0000 7f5adeffd640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad80a5650 0x7f5ad8143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.774+0000 7f5adeffd640 1 -- 172.21.15.73:0/1697710420 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad814ac70 con 0x7f5ad80a4520 2024-09-05T12:59:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.774+0000 7f5adeffd640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad80a4520 0x7f5ad8143050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000b4a0 tx=0x7f5ad000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.775+0000 7f5ac7fff640 1 -- 172.21.15.73:0/1697710420 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0015030 con 0x7f5ad80a4520 2024-09-05T12:59:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.776+0000 7f5adffff640 1 -- 172.21.15.73:0/1697710420 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad814af60 con 0x7f5ad80a4520 2024-09-05T12:59:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.776+0000 7f5adffff640 1 -- 172.21.15.73:0/1697710420 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad814b4a0 con 0x7f5ad80a4520 2024-09-05T12:59:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.776+0000 7f5ac7fff640 1 -- 172.21.15.73:0/1697710420 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ad0011630 con 0x7f5ad80a4520 2024-09-05T12:59:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.776+0000 7f5ac7fff640 1 -- 172.21.15.73:0/1697710420 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00062a0 con 0x7f5ad80a4520 2024-09-05T12:59:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.781+0000 7f5ae8252740 1 Processor -- start 2024-09-05T12:59:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.781+0000 7f5ae8252740 1 -- start start 2024-09-05T12:59:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165eb70 0x55c1f165ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 0x55c1f1663f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 0x55c1f1666a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5ae8252740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c1f15c22f0 con 0x55c1f165f4b0 2024-09-05T12:59:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5ae8252740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c1f156a270 con 0x55c1f165eb70 2024-09-05T12:59:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5ae8252740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c1f15be2b0 con 0x55c1f1664540 2024-09-05T12:59:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5ac7fff640 1 -- 172.21.15.73:0/1697710420 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5ad0018070 con 0x7f5ad80a4520 2024-09-05T12:59:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5ade7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 0x55c1f1666a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5ade7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 0x55c1f1666a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:56984/0 (socket says 172.21.15.73:56984) 2024-09-05T12:59:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5adf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165eb70 0x55c1f165ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5ade7fc640 1 -- 172.21.15.73:0/3945423182 learned_addr learned my addr 172.21.15.73:0/3945423182 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.782+0000 7f5adeffd640 1 --2- 172.21.15.73:0/3945423182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 0x55c1f1663f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.783+0000 7f5adf7fe640 1 -- 172.21.15.73:0/3945423182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 msgr2=0x55c1f1666a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.783+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/3945423182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 0x55c1f1666a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.783+0000 7f5adf7fe640 1 -- 172.21.15.73:0/3945423182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 msgr2=0x55c1f1663f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.783+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/3945423182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 0x55c1f1663f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.783+0000 7f5adf7fe640 1 -- 172.21.15.73:0/3945423182 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1f1569340 con 0x55c1f165eb70 2024-09-05T12:59:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.783+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/3945423182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165eb70 0x55c1f165ef70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0067b40 tx=0x7f5ae0063640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ea656613a7daef server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.783+0000 7f5ac57fa640 1 -- 172.21.15.73:0/3945423182 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00a7070 con 0x55c1f165eb70 2024-09-05T12:59:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.783+0000 7f5ac57fa640 1 -- 172.21.15.73:0/3945423182 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae009c040 con 0x55c1f165eb70 2024-09-05T12:59:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.784+0000 7f5ac57fa640 1 -- 172.21.15.73:0/3945423182 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00a2bb0 con 0x55c1f165eb70 2024-09-05T12:59:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.784+0000 7f5ac7fff640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5ac80a2ce0 0x7f5ac80a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.784+0000 7f5ac7fff640 1 -- 172.21.15.73:0/1697710420 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f5ad00ce4c0 con 0x7f5ad80a4520 2024-09-05T12:59:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.785+0000 7f5ae8252740 1 -- 172.21.15.73:0/3945423182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165eb70 msgr2=0x55c1f165ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.785+0000 7f5ae8252740 1 --2- 172.21.15.73:0/3945423182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165eb70 0x55c1f165ef70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0067b40 tx=0x7f5ae0063640 comp rx=0 tx=0).stop 2024-09-05T12:59:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.786+0000 7f5adeffd640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5ac80a2ce0 0x7f5ac80a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.787+0000 7f5adeffd640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5ac80a2ce0 0x7f5ac80a51a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0005ff0 tx=0x7f5ad0004820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.787+0000 7f5ae8252740 1 -- 172.21.15.73:0/3945423182 shutdown_connections 2024-09-05T12:59:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.787+0000 7f5ae8252740 1 --2- 172.21.15.73:0/3945423182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 0x55c1f1666a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.787+0000 7f5ae8252740 1 --2- 172.21.15.73:0/3945423182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 0x55c1f1663f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.787+0000 7f5ae8252740 1 --2- 172.21.15.73:0/3945423182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165eb70 0x55c1f165ef70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.787+0000 7f5ae8252740 1 -- 172.21.15.73:0/3945423182 >> 172.21.15.73:0/3945423182 conn(0x55c1f165a1e0 msgr2=0x55c1f165a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.788+0000 7f5ae8252740 1 -- 172.21.15.73:0/3945423182 shutdown_connections 2024-09-05T12:59:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.788+0000 7f5ae8252740 1 -- 172.21.15.73:0/3945423182 wait complete. 2024-09-05T12:59:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.789+0000 7f5ae8252740 1 -- start start 2024-09-05T12:59:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.789+0000 7f5ae8252740 1 Processor -- start 2024-09-05T12:59:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.789+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 0x55c1f1679de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.789+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 0x55c1f167a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f1664540 0x55c1f1681360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5ae8252740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c1f16784c0 con 0x55c1f165f4b0 2024-09-05T12:59:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5ae8252740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c1f154b290 con 0x55c1f1664540 2024-09-05T12:59:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5ae8252740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1678640 con 0x55c1f165eb70 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5adf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 0x55c1f1679de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5adf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 0x55c1f1679de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:56990/0 (socket says 172.21.15.73:56990) 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5adf7fe640 1 -- 172.21.15.73:0/1068949554 learned_addr learned my addr 172.21.15.73:0/1068949554 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5ae8252740 10 client.0 _ll_register_callbacks cb 0x55c1f157c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f1664540 0x55c1f1681360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 0x55c1f167a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5adf7fe640 1 -- 172.21.15.73:0/1068949554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f1664540 msgr2=0x55c1f1681360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f1664540 0x55c1f1681360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5adf7fe640 1 -- 172.21.15.73:0/1068949554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 msgr2=0x55c1f167a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 0x55c1f167a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5adf7fe640 1 -- 172.21.15.73:0/1068949554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1f12d5210 con 0x55c1f165eb70 2024-09-05T12:59:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.790+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 0x55c1f167a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:59:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.791+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 0x55c1f1679de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0051500 tx=0x7f5ae008e430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28e41da08d1a5f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.791+0000 7f5ac2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T12:59:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.791+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/1068949554 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00a7070 con 0x55c1f165eb70 2024-09-05T12:59:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.791+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/1068949554 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f5ae00a2ab0 con 0x55c1f165eb70 2024-09-05T12:59:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.791+0000 7f5ae8252740 1 -- 172.21.15.73:0/1068949554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae009c040 con 0x55c1f165eb70 2024-09-05T12:59:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.792+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/1068949554 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ae00a2cb0 con 0x55c1f165eb70 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.793+0000 7f5ae8252740 10 client.25186 fetch_fsmap learned FSMap version 29 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.793+0000 7f5ae8252740 1 -- 172.21.15.73:0/1068949554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c1f13a1620 con 0x55c1f165eb70 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.793+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/1068949554 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae009c040 con 0x55c1f165eb70 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.794+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/1068949554 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5ae006a2f0 con 0x55c1f165eb70 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.794+0000 7f5ae8252740 10 client.25186 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.794+0000 7f5ae8252740 10 client.25186 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.794+0000 7f5ae8252740 20 client.25186 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.794+0000 7f5ae8252740 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c1f1685ad0 0x55c1f1687ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.794+0000 7f5ae8252740 4 client.25186 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.794+0000 7f5ae8252740 1 -- 172.21.15.73:0/1068949554 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1f15cfa20 con 0x55c1f1685ad0 2024-09-05T12:59:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.794+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c1f1685ad0 0x55c1f1687ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.795+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c1f1685ad0 0x55c1f1687ef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dafaa9cb917718d server_cookie=13e0340a7970c093 in_seq=0 out_seq=0 2024-09-05T12:59:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.795+0000 7f5ac2ff5640 10 client.25186 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.796+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/1068949554 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1f15cfa20 con 0x55c1f1685ad0 2024-09-05T12:59:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.796+0000 7f5ac2ff5640 10 client.25186 handle_command_reply: tid=0 2024-09-05T12:59:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.796+0000 7f5ae8252740 1 client.25186 shutdown 2024-09-05T12:59:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.797+0000 7f5ae8252740 1 -- 172.21.15.73:0/1068949554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 msgr2=0x55c1f1679de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.797+0000 7f5ae8252740 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 0x55c1f1679de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0051500 tx=0x7f5ae008e430 comp rx=0 tx=0).stop 2024-09-05T12:59:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.798+0000 7f5ae8252740 1 -- 172.21.15.73:0/1068949554 shutdown_connections 2024-09-05T12:59:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.798+0000 7f5ae8252740 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c1f1685ad0 0x55c1f1687ef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.798+0000 7f5ae8252740 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f1664540 0x55c1f1681360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.798+0000 7f5ae8252740 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165f4b0 0x55c1f167a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.798+0000 7f5ae8252740 1 --2- 172.21.15.73:0/1068949554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 0x55c1f1679de0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.798+0000 7f5ae8252740 1 -- 172.21.15.73:0/1068949554 >> 172.21.15.73:0/1068949554 conn(0x55c1f165a1e0 msgr2=0x55c1f165b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.799+0000 7f5ac2ff5640 0 client.25186 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.799+0000 7f5ae8252740 1 -- 172.21.15.73:0/1068949554 shutdown_connections 2024-09-05T12:59:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.799+0000 7f5ae8252740 1 -- 172.21.15.73:0/1068949554 wait complete. 2024-09-05T12:59:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.799+0000 7f5ae8252740 20 client.25186 trim_cache size 0 max 16384 2024-09-05T12:59:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5ae8252740 1 Processor -- start 2024-09-05T12:59:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5ae8252740 1 -- start start 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 0x55c1f16606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 0x55c1f1660bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f1664540 0x55c1f16812f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5ae8252740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc010cc0 con 0x55c1f1664540 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5ae8252740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc00e530 con 0x55c1f165f4b0 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5ae8252740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc00c380 con 0x55c1f165eb70 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5adf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f1664540 0x55c1f16812f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5adf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f1664540 0x55c1f16812f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50776/0 (socket says 172.21.15.73:50776) 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5adf7fe640 1 -- 172.21.15.73:0/2872340729 learned_addr learned my addr 172.21.15.73:0/2872340729 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.814+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/2872340729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 0x55c1f1660bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.815+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/2872340729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 0x55c1f16606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.815+0000 7f5ade7fc640 1 -- 172.21.15.73:0/2872340729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 msgr2=0x55c1f16606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.815+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/2872340729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 0x55c1f16606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.815+0000 7f5ade7fc640 1 -- 172.21.15.73:0/2872340729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f1664540 msgr2=0x55c1f16812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.815+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/2872340729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f1664540 0x55c1f16812f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.815+0000 7f5ade7fc640 1 -- 172.21.15.73:0/2872340729 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1f1679920 con 0x55c1f165f4b0 2024-09-05T12:59:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.815+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/2872340729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 0x55c1f1660bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55c1f1688720 tx=0x7f5ad4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5cb47f7d29a217a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.815+0000 7f5ac4ff9640 1 -- 172.21.15.73:0/2872340729 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4009d50 con 0x55c1f165f4b0 2024-09-05T12:59:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.815+0000 7f5ac4ff9640 1 -- 172.21.15.73:0/2872340729 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ad4021030 con 0x55c1f165f4b0 2024-09-05T12:59:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.815+0000 7f5ac4ff9640 1 -- 172.21.15.73:0/2872340729 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad401d250 con 0x55c1f165f4b0 2024-09-05T12:59:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 -- 172.21.15.73:0/2872340729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 msgr2=0x55c1f1660bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 --2- 172.21.15.73:0/2872340729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 0x55c1f1660bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55c1f1688720 tx=0x7f5ad4008040 comp rx=0 tx=0).stop 2024-09-05T12:59:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 -- 172.21.15.73:0/2872340729 shutdown_connections 2024-09-05T12:59:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 --2- 172.21.15.73:0/2872340729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f1664540 0x55c1f16812f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 --2- 172.21.15.73:0/2872340729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 0x55c1f1660bf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 --2- 172.21.15.73:0/2872340729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f165eb70 0x55c1f16606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 -- 172.21.15.73:0/2872340729 >> 172.21.15.73:0/2872340729 conn(0x55c1f165a1e0 msgr2=0x55c1f1679da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 -- 172.21.15.73:0/2872340729 shutdown_connections 2024-09-05T12:59:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 -- 172.21.15.73:0/2872340729 wait complete. 2024-09-05T12:59:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 -- start start 2024-09-05T12:59:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.816+0000 7f5ae8252740 1 Processor -- start 2024-09-05T12:59:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165eb70 0x55c1f1680fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 0x55c1f167da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ae8252740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 0x55c1f167dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ae8252740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc00c9f0 con 0x55c1f165eb70 2024-09-05T12:59:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ae8252740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc00de60 con 0x55c1f165f4b0 2024-09-05T12:59:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ae8252740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc00d0c0 con 0x55c1f1664540 2024-09-05T12:59:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ae8252740 10 client.0 _ll_register_callbacks cb 0x7f5ae00a5070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5adf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165eb70 0x55c1f1680fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5adf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165eb70 0x55c1f1680fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50784/0 (socket says 172.21.15.73:50784) 2024-09-05T12:59:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5adf7fe640 1 -- 172.21.15.73:0/3700427114 learned_addr learned my addr 172.21.15.73:0/3700427114 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 0x55c1f167da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 0x55c1f167dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5adf7fe640 1 -- 172.21.15.73:0/3700427114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 msgr2=0x55c1f167dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 0x55c1f167dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5adf7fe640 1 -- 172.21.15.73:0/3700427114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 msgr2=0x55c1f167da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 0x55c1f167da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5adf7fe640 1 -- 172.21.15.73:0/3700427114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1f167e4f0 con 0x55c1f165eb70 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 0x55c1f167da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5adf7fe640 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165eb70 0x55c1f1680fd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0068ab0 tx=0x7f5ae00b5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64738b1429c5209 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ac2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/3700427114 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00c3070 con 0x55c1f165eb70 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ae8252740 1 -- 172.21.15.73:0/3700427114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ad4021030 con 0x55c1f165eb70 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.817+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/3700427114 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f5ae00a2890 con 0x55c1f165eb70 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/3700427114 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ae00a7070 con 0x55c1f165eb70 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ae8252740 10 client.15603 fetch_fsmap learned FSMap version 29 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ae8252740 1 -- 172.21.15.73:0/3700427114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c1f16ef780 con 0x55c1f165eb70 2024-09-05T12:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/3700427114 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ad4021030 con 0x55c1f165eb70 2024-09-05T12:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/3700427114 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5ae00b3620 con 0x55c1f165eb70 2024-09-05T12:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ae8252740 10 client.15603 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T12:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ae8252740 10 client.15603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ae8252740 20 client.15603 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ae8252740 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c1f16f0130 0x55c1f16f2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ae8252740 4 client.15603 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T12:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ae8252740 1 -- 172.21.15.73:0/3700427114 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c1f15c9d70 con 0x55c1f16f0130 2024-09-05T12:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.818+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c1f16f0130 0x55c1f16f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.819+0000 7f5ade7fc640 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c1f16f0130 0x55c1f16f2550 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c51440c2550158b8 server_cookie=49c01e8c212bcab7 in_seq=0 out_seq=0 2024-09-05T12:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.819+0000 7f5ac2ff5640 10 client.15603 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.869+0000 7f5ac2ff5640 1 -- 172.21.15.73:0/3700427114 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c1f15c9d70 con 0x55c1f16f0130 2024-09-05T12:59:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.869+0000 7f5ac2ff5640 10 client.15603 handle_command_reply: tid=0 2024-09-05T12:59:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.869+0000 7f5ae8252740 1 client.15603 shutdown 2024-09-05T12:59:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.870+0000 7f5ae8252740 1 -- 172.21.15.73:0/3700427114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165eb70 msgr2=0x55c1f1680fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.870+0000 7f5ae8252740 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165eb70 0x55c1f1680fd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0068ab0 tx=0x7f5ae00b5040 comp rx=0 tx=0).stop 2024-09-05T12:59:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.871+0000 7f5ae8252740 1 -- 172.21.15.73:0/3700427114 shutdown_connections 2024-09-05T12:59:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.871+0000 7f5ae8252740 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55c1f16f0130 0x55c1f16f2550 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.871+0000 7f5ac2ff5640 0 client.15603 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.871+0000 7f5ae8252740 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1f1664540 0x55c1f167dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.871+0000 7f5ae8252740 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1f165f4b0 0x55c1f167da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.871+0000 7f5ae8252740 1 --2- 172.21.15.73:0/3700427114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1f165eb70 0x55c1f1680fd0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.871+0000 7f5ae8252740 1 -- 172.21.15.73:0/3700427114 >> 172.21.15.73:0/3700427114 conn(0x55c1f165a1e0 msgr2=0x55c1f1679da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.873+0000 7f5ae8252740 1 -- 172.21.15.73:0/3700427114 shutdown_connections 2024-09-05T12:59:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.873+0000 7f5ae8252740 1 -- 172.21.15.73:0/3700427114 wait complete. 2024-09-05T12:59:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T12:59:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T12:59:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T12:59:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T12:59:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.873+0000 7f5ae8252740 20 client.15603 trim_cache size 0 max 16384 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.875+0000 7f5adffff640 1 -- 172.21.15.73:0/1697710420 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5ac80a2ce0 msgr2=0x7f5ac80a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.875+0000 7f5adffff640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5ac80a2ce0 0x7f5ac80a51a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0005ff0 tx=0x7f5ad0004820 comp rx=0 tx=0).stop 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.875+0000 7f5adffff640 1 -- 172.21.15.73:0/1697710420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad80a4520 msgr2=0x7f5ad8143050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.875+0000 7f5adffff640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad80a4520 0x7f5ad8143050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000b4a0 tx=0x7f5ad000b8a0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.875+0000 7f5adffff640 1 -- 172.21.15.73:0/1697710420 shutdown_connections 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.875+0000 7f5adffff640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5ac80a2ce0 0x7f5ac80a51a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.875+0000 7f5adffff640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ad80a5ff0 0x7f5ad814a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.875+0000 7f5adffff640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad80a5650 0x7f5ad8143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.875+0000 7f5adffff640 1 --2- 172.21.15.73:0/1697710420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad80a4520 0x7f5ad8143050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.875+0000 7f5adffff640 1 -- 172.21.15.73:0/1697710420 >> 172.21.15.73:0/1697710420 conn(0x7f5ad809fba0 msgr2=0x7f5ad80a6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.876+0000 7f5adffff640 1 -- 172.21.15.73:0/1697710420 shutdown_connections 2024-09-05T12:59:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:39.876+0000 7f5adffff640 1 -- 172.21.15.73:0/1697710420 wait complete. 2024-09-05T12:59:41.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:41 smithi162 ceph-mon[34220]: pgmap v389: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 153 MiB/s wr, 25.83k op/s 2024-09-05T12:59:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:41 smithi169 ceph-mon[34823]: pgmap v389: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 153 MiB/s wr, 25.83k op/s 2024-09-05T12:59:41.516 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:41 smithi073 ceph-mon[30883]: pgmap v389: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 153 MiB/s wr, 25.83k op/s 2024-09-05T12:59:43.364 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:43 smithi162 ceph-mon[34220]: pgmap v390: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 150 MiB/s wr, 26.37k op/s 2024-09-05T12:59:43.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:43 smithi169 ceph-mon[34823]: pgmap v390: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 150 MiB/s wr, 26.37k op/s 2024-09-05T12:59:43.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:43 smithi073 ceph-mon[30883]: pgmap v390: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 150 MiB/s wr, 26.37k op/s 2024-09-05T12:59:43.515 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T12:59:43.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.202+0000 7fb7948d5640 1 -- 172.21.15.73:0/2527293050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790100a60 msgr2=0x7fb790100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:43.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.202+0000 7fb7948d5640 1 --2- 172.21.15.73:0/2527293050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790100a60 0x7fb790100ec0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb784009930 tx=0x7fb78402a420 comp rx=0 tx=0).stop 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.202+0000 7fb7948d5640 1 -- 172.21.15.73:0/2527293050 shutdown_connections 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.202+0000 7fb7948d5640 1 --2- 172.21.15.73:0/2527293050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb790101400 0x7fb79010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.202+0000 7fb7948d5640 1 --2- 172.21.15.73:0/2527293050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790100a60 0x7fb790100ec0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.202+0000 7fb7948d5640 1 --2- 172.21.15.73:0/2527293050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb790106a60 0x7fb790106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.202+0000 7fb7948d5640 1 -- 172.21.15.73:0/2527293050 >> 172.21.15.73:0/2527293050 conn(0x7fb7900fc780 msgr2=0x7fb7900feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.202+0000 7fb7948d5640 1 -- 172.21.15.73:0/2527293050 shutdown_connections 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.202+0000 7fb7948d5640 1 -- 172.21.15.73:0/2527293050 wait complete. 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.202+0000 7fb7948d5640 1 Processor -- start 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb7948d5640 1 -- start start 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb7948d5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb790100a60 0x7fb7901973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb7948d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb790101400 0x7fb7901978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb7948d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790106a60 0x7fb79019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb7948d5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb790110e60 con 0x7fb790106a60 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb7948d5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb790110ce0 con 0x7fb790101400 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb7948d5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb790110fe0 con 0x7fb790100a60 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb78ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790106a60 0x7fb79019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb78ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790106a60 0x7fb79019bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50806/0 (socket says 172.21.15.73:50806) 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb78ed9d640 1 -- 172.21.15.73:0/1750859691 learned_addr learned my addr 172.21.15.73:0/1750859691 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb78e59c640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb790100a60 0x7fb7901973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb78ed9d640 1 -- 172.21.15.73:0/1750859691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb790100a60 msgr2=0x7fb7901973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb78ed9d640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb790100a60 0x7fb7901973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb78ed9d640 1 -- 172.21.15.73:0/1750859691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb790101400 msgr2=0x7fb7901978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb78ed9d640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb790101400 0x7fb7901978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb78ed9d640 1 -- 172.21.15.73:0/1750859691 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79019c350 con 0x7fb790106a60 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb78ed9d640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790106a60 0x7fb79019bc70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb78800eca0 tx=0x7fb78800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.203+0000 7fb77f7fe640 1 -- 172.21.15.73:0/1750859691 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788004b20 con 0x7fb790106a60 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.204+0000 7fb77f7fe640 1 -- 172.21.15.73:0/1750859691 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb788004cc0 con 0x7fb790106a60 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.204+0000 7fb7948d5640 1 -- 172.21.15.73:0/1750859691 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79019c640 con 0x7fb790106a60 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.204+0000 7fb77f7fe640 1 -- 172.21.15.73:0/1750859691 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788017650 con 0x7fb790106a60 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.204+0000 7fb7948d5640 1 -- 172.21.15.73:0/1750859691 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79006a790 con 0x7fb790106a60 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.206+0000 7fb77f7fe640 1 -- 172.21.15.73:0/1750859691 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb788005020 con 0x7fb790106a60 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.206+0000 7fb796cab740 1 Processor -- start 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.206+0000 7fb796cab740 1 -- start start 2024-09-05T12:59:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb77f7fe640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7780a2b80 0x7fb7780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb796cab740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb796cab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb796cab740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7c0780 0x55a6ed7c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb796cab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a6ed7172f0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb796cab740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a6ed6becf0 con 0x55a6ed7c0780 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb796cab740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a6ed7132b0 con 0x55a6ed7b2b80 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb77f7fe640 1 -- 172.21.15.73:0/1750859691 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb7880d0b20 con 0x7fb790106a60 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78e59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78e59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:57054/0 (socket says 172.21.15.73:57054) 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78e59c640 1 -- 172.21.15.73:0/1138107260 learned_addr learned my addr 172.21.15.73:0/1138107260 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78dd9b640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7780a2b80 0x7fb7780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78ed9d640 1 --2- 172.21.15.73:0/1138107260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7c0780 0x55a6ed7c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78dd9b640 1 --2- 172.21.15.73:0/1138107260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78e59c640 1 -- 172.21.15.73:0/1138107260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7c0780 msgr2=0x55a6ed7c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78e59c640 1 --2- 172.21.15.73:0/1138107260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7c0780 0x55a6ed7c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78e59c640 1 -- 172.21.15.73:0/1138107260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 msgr2=0x55a6ed7b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78e59c640 1 --2- 172.21.15.73:0/1138107260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78e59c640 1 -- 172.21.15.73:0/1138107260 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ed6a33a0 con 0x55a6ed7b2b80 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78ed9d640 1 --2- 172.21.15.73:0/1138107260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7c0780 0x55a6ed7c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.207+0000 7fb78dd9b640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7780a2b80 0x7fb7780a5040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb784005940 tx=0x7fb7840095e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.208+0000 7fb78e59c640 1 --2- 172.21.15.73:0/1138107260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7b1090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb78000bc60 tx=0x7fb78000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c2b9c3b558ff706 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.208+0000 7fb77cff9640 1 -- 172.21.15.73:0/1138107260 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780015070 con 0x55a6ed7b2b80 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.208+0000 7fb77cff9640 1 -- 172.21.15.73:0/1138107260 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb780011920 con 0x55a6ed7b2b80 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.208+0000 7fb77cff9640 1 -- 172.21.15.73:0/1138107260 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780010830 con 0x55a6ed7b2b80 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.208+0000 7fb796cab740 1 -- 172.21.15.73:0/1138107260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 msgr2=0x55a6ed7b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:43.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.208+0000 7fb796cab740 1 --2- 172.21.15.73:0/1138107260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7b1090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb78000bc60 tx=0x7fb78000f730 comp rx=0 tx=0).stop 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.208+0000 7fb796cab740 1 -- 172.21.15.73:0/1138107260 shutdown_connections 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 --2- 172.21.15.73:0/1138107260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7c0780 0x55a6ed7c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 --2- 172.21.15.73:0/1138107260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 --2- 172.21.15.73:0/1138107260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7b1090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 -- 172.21.15.73:0/1138107260 >> 172.21.15.73:0/1138107260 conn(0x55a6ed77a310 msgr2=0x55a6ed7adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 -- 172.21.15.73:0/1138107260 shutdown_connections 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 -- 172.21.15.73:0/1138107260 wait complete. 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 -- start start 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 Processor -- start 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7bd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7c0780 0x55a6ed7bda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a6ed7c34e0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a6ed6d2060 con 0x55a6ed7c0780 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.209+0000 7fb796cab740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a6ed7c3660 con 0x55a6ed7b2b80 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb796cab740 10 client.0 _ll_register_callbacks cb 0x55a6ed4258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb78e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb78e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50822/0 (socket says 172.21.15.73:50822) 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb78e59c640 1 -- 172.21.15.73:0/2901625194 learned_addr learned my addr 172.21.15.73:0/2901625194 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb78dd9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7bd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb78e59c640 1 -- 172.21.15.73:0/2901625194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 msgr2=0x55a6ed7bd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb78e59c640 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7bd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb78e59c640 1 -- 172.21.15.73:0/2901625194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7c0780 msgr2=0x55a6ed7bda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb78e59c640 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7c0780 0x55a6ed7bda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb78e59c640 1 -- 172.21.15.73:0/2901625194 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6ed4883c0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb78e59c640 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c0190 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb780000c00 tx=0x7fb78000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29465b726f22b43c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb775ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb775ffb640 1 -- 172.21.15.73:0/2901625194 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780015070 con 0x55a6ed7b15d0 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb775ffb640 1 -- 172.21.15.73:0/2901625194 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb780011ad0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb796cab740 1 -- 172.21.15.73:0/2901625194 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb780011920 con 0x55a6ed7b15d0 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb775ffb640 1 -- 172.21.15.73:0/2901625194 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb780011cd0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb796cab740 10 client.15615 fetch_fsmap learned FSMap version 29 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.210+0000 7fb796cab740 1 -- 172.21.15.73:0/2901625194 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a6ed7cef20 con 0x55a6ed7b15d0 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.211+0000 7fb775ffb640 1 -- 172.21.15.73:0/2901625194 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb780011920 con 0x55a6ed7b15d0 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.211+0000 7fb775ffb640 1 -- 172.21.15.73:0/2901625194 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fb780004af0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.211+0000 7fb796cab740 10 client.15615 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.211+0000 7fb796cab740 10 client.15615 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.211+0000 7fb796cab740 20 client.15615 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.211+0000 7fb796cab740 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55a6ed7d02d0 0x55a6ed7d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.211+0000 7fb796cab740 4 client.15615 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.211+0000 7fb796cab740 1 -- 172.21.15.73:0/2901625194 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6ed724860 con 0x55a6ed7d02d0 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.211+0000 7fb78dd9b640 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55a6ed7d02d0 0x55a6ed7d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.212+0000 7fb775ffb640 10 client.15615 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.212+0000 7fb78dd9b640 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55a6ed7d02d0 0x55a6ed7d26c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=165a3bdea2b905c server_cookie=c9a781e381e65599 in_seq=0 out_seq=0 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb775ffb640 1 -- 172.21.15.73:0/2901625194 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a6ed724860 con 0x55a6ed7d02d0 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb775ffb640 10 client.15615 handle_command_reply: tid=0 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 client.15615 shutdown 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 -- 172.21.15.73:0/2901625194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 msgr2=0x55a6ed7c0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c0190 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb780000c00 tx=0x7fb78000b920 comp rx=0 tx=0).stop 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 -- 172.21.15.73:0/2901625194 shutdown_connections 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7c0780 0x55a6ed7bda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55a6ed7d02d0 0x55a6ed7d26c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7bd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb775ffb640 0 client.15615 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 --2- 172.21.15.73:0/2901625194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c0190 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 -- 172.21.15.73:0/2901625194 >> 172.21.15.73:0/2901625194 conn(0x55a6ed77a310 msgr2=0x55a6ed7b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 -- 172.21.15.73:0/2901625194 shutdown_connections 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 1 -- 172.21.15.73:0/2901625194 wait complete. 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.215+0000 7fb796cab740 20 client.15615 trim_cache size 0 max 16384 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb796cab740 1 Processor -- start 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb796cab740 1 -- start start 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb796cab740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb796cab740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7bcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb796cab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7d7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb796cab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb7901adcd0 con 0x55a6ed7c0780 2024-09-05T12:59:43.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb796cab740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb7901ab540 con 0x55a6ed7b2b80 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb796cab740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb7901a9390 con 0x55a6ed7b15d0 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb78ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7d7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb78ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7d7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50826/0 (socket says 172.21.15.73:50826) 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb78ed9d640 1 -- 172.21.15.73:0/622635515 learned_addr learned my addr 172.21.15.73:0/622635515 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.228+0000 7fb78e59c640 1 --2- 172.21.15.73:0/622635515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb78dd9b640 1 --2- 172.21.15.73:0/622635515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7bcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb78ed9d640 1 -- 172.21.15.73:0/622635515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 msgr2=0x55a6ed7cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb78ed9d640 1 --2- 172.21.15.73:0/622635515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb78ed9d640 1 -- 172.21.15.73:0/622635515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7b2b80 msgr2=0x55a6ed7bcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb78ed9d640 1 --2- 172.21.15.73:0/622635515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7bcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb78ed9d640 1 -- 172.21.15.73:0/622635515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ed7be3e0 con 0x55a6ed7c0780 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb78e59c640 1 --2- 172.21.15.73:0/622635515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb78ed9d640 1 --2- 172.21.15.73:0/622635515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7d7d20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb788005ba0 tx=0x7fb78809d180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d682a66edcfa8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:43.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb777fff640 1 -- 172.21.15.73:0/622635515 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788062900 con 0x55a6ed7c0780 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb777fff640 1 -- 172.21.15.73:0/622635515 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb78809dab0 con 0x55a6ed7c0780 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb777fff640 1 -- 172.21.15.73:0/622635515 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7880676f0 con 0x55a6ed7c0780 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb796cab740 1 -- 172.21.15.73:0/622635515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 msgr2=0x55a6ed7d7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb796cab740 1 --2- 172.21.15.73:0/622635515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7d7d20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb788005ba0 tx=0x7fb78809d180 comp rx=0 tx=0).stop 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb796cab740 1 -- 172.21.15.73:0/622635515 shutdown_connections 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb796cab740 1 --2- 172.21.15.73:0/622635515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7d7d20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb796cab740 1 --2- 172.21.15.73:0/622635515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7bcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb796cab740 1 --2- 172.21.15.73:0/622635515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.229+0000 7fb796cab740 1 -- 172.21.15.73:0/622635515 >> 172.21.15.73:0/622635515 conn(0x55a6ed77a310 msgr2=0x55a6ed7bc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 1 -- 172.21.15.73:0/622635515 shutdown_connections 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 1 -- 172.21.15.73:0/622635515 wait complete. 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 1 -- start start 2024-09-05T12:59:43.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 1 Processor -- start 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7ba290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7ba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb7901a9a00 con 0x55a6ed7c0780 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb7901aae70 con 0x55a6ed7b2b80 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb7901aa0d0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb796cab740 10 client.0 _ll_register_callbacks cb 0x7fb7880093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb78ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7ba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb78e59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb78e59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:57076/0 (socket says 172.21.15.73:57076) 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb78ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7ba8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50836/0 (socket says 172.21.15.73:50836) 2024-09-05T12:59:43.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb78e59c640 1 -- 172.21.15.73:0/2359604051 learned_addr learned my addr 172.21.15.73:0/2359604051 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.230+0000 7fb78dd9b640 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7ba290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb78e59c640 1 -- 172.21.15.73:0/2359604051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7b2b80 msgr2=0x55a6ed7ba290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb78e59c640 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7ba290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb78e59c640 1 -- 172.21.15.73:0/2359604051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 msgr2=0x55a6ed7ba8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb78e59c640 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7ba8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb78e59c640 1 -- 172.21.15.73:0/2359604051 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6ed7bb0d0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb78ed9d640 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7ba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb78e59c640 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c9170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb78000fc30 tx=0x7fb78000bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a2dc61b7d9cb98c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb775ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb775ffb640 1 -- 172.21.15.73:0/2359604051 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780033070 con 0x55a6ed7b15d0 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb775ffb640 1 -- 172.21.15.73:0/2359604051 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb780010b30 con 0x55a6ed7b15d0 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb796cab740 1 -- 172.21.15.73:0/2359604051 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb78809dab0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb775ffb640 1 -- 172.21.15.73:0/2359604051 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb78003e070 con 0x55a6ed7b15d0 2024-09-05T12:59:43.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb796cab740 10 client.25210 fetch_fsmap learned FSMap version 29 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb796cab740 1 -- 172.21.15.73:0/2359604051 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a6ed83ae20 con 0x55a6ed7b15d0 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.231+0000 7fb775ffb640 1 -- 172.21.15.73:0/2359604051 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb78809dab0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.232+0000 7fb775ffb640 1 -- 172.21.15.73:0/2359604051 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fb780004fc0 con 0x55a6ed7b15d0 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.232+0000 7fb796cab740 10 client.25210 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.232+0000 7fb796cab740 10 client.25210 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.232+0000 7fb796cab740 20 client.25210 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.232+0000 7fb796cab740 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55a6ed83b480 0x55a6ed83d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.232+0000 7fb796cab740 4 client.25210 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.232+0000 7fb796cab740 1 -- 172.21.15.73:0/2359604051 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a6ed71ed70 con 0x55a6ed83b480 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.232+0000 7fb78dd9b640 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55a6ed83b480 0x55a6ed83d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.233+0000 7fb78dd9b640 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55a6ed83b480 0x55a6ed83d8a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=470bb00d0478da3b server_cookie=1fd7d34da58460dd in_seq=0 out_seq=0 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.233+0000 7fb775ffb640 10 client.25210 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb775ffb640 1 -- 172.21.15.73:0/2359604051 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a6ed71ed70 con 0x55a6ed83b480 2024-09-05T12:59:43.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb775ffb640 10 client.25210 handle_command_reply: tid=0 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 client.25210 shutdown 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 -- 172.21.15.73:0/2359604051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 msgr2=0x55a6ed7c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c9170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb78000fc30 tx=0x7fb78000bfd0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 -- 172.21.15.73:0/2359604051 shutdown_connections 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a6ed7c0780 0x55a6ed7ba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6ed7b2b80 0x55a6ed7ba290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55a6ed83b480 0x55a6ed83d8a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 --2- 172.21.15.73:0/2359604051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a6ed7b15d0 0x55a6ed7c9170 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb775ffb640 0 client.25210 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 -- 172.21.15.73:0/2359604051 >> 172.21.15.73:0/2359604051 conn(0x55a6ed77a310 msgr2=0x55a6ed7b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 -- 172.21.15.73:0/2359604051 shutdown_connections 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 1 -- 172.21.15.73:0/2359604051 wait complete. 2024-09-05T12:59:43.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb796cab740 20 client.25210 trim_cache size 0 max 16384 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb7948d5640 1 -- 172.21.15.73:0/1750859691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7780a2b80 msgr2=0x7fb7780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb7948d5640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7780a2b80 0x7fb7780a5040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb784005940 tx=0x7fb7840095e0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb7948d5640 1 -- 172.21.15.73:0/1750859691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790106a60 msgr2=0x7fb79019bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.234+0000 7fb7948d5640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790106a60 0x7fb79019bc70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb78800eca0 tx=0x7fb78800b690 comp rx=0 tx=0).stop 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.235+0000 7fb7948d5640 1 -- 172.21.15.73:0/1750859691 shutdown_connections 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.235+0000 7fb7948d5640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb7780a2b80 0x7fb7780a5040 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.235+0000 7fb7948d5640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790106a60 0x7fb79019bc70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.235+0000 7fb7948d5640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb790101400 0x7fb7901978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.235+0000 7fb7948d5640 1 --2- 172.21.15.73:0/1750859691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb790100a60 0x7fb7901973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.235+0000 7fb7948d5640 1 -- 172.21.15.73:0/1750859691 >> 172.21.15.73:0/1750859691 conn(0x7fb7900fc780 msgr2=0x7fb7900fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.235+0000 7fb7948d5640 1 -- 172.21.15.73:0/1750859691 shutdown_connections 2024-09-05T12:59:43.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:42.235+0000 7fb7948d5640 1 -- 172.21.15.73:0/1750859691 wait complete. 2024-09-05T12:59:45.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:45 smithi169 ceph-mon[34823]: pgmap v391: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 115 MiB/s wr, 21.38k op/s 2024-09-05T12:59:45.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:45 smithi073 ceph-mon[30883]: pgmap v391: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 115 MiB/s wr, 21.38k op/s 2024-09-05T12:59:45.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:45 smithi162 ceph-mon[34220]: pgmap v391: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 115 MiB/s wr, 21.38k op/s 2024-09-05T12:59:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:47 smithi169 ceph-mon[34823]: pgmap v392: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 133 MiB/s wr, 25.58k op/s 2024-09-05T12:59:47.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:47 smithi073 ceph-mon[30883]: pgmap v392: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 133 MiB/s wr, 25.58k op/s 2024-09-05T12:59:47.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:47 smithi162 ceph-mon[34220]: pgmap v392: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 133 MiB/s wr, 25.58k op/s 2024-09-05T12:59:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:49 smithi073 ceph-mon[30883]: pgmap v393: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 120 MiB/s wr, 24.46k op/s 2024-09-05T12:59:49.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:49 smithi162 ceph-mon[34220]: pgmap v393: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 120 MiB/s wr, 24.46k op/s 2024-09-05T12:59:49.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:49 smithi169 ceph-mon[34823]: pgmap v393: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 120 MiB/s wr, 24.46k op/s 2024-09-05T12:59:51.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:51 smithi073 ceph-mon[30883]: pgmap v394: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 MiB/s wr, 20.20k op/s 2024-09-05T12:59:51.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:51 smithi162 ceph-mon[34220]: pgmap v394: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 MiB/s wr, 20.20k op/s 2024-09-05T12:59:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:51 smithi169 ceph-mon[34823]: pgmap v394: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 MiB/s wr, 20.20k op/s 2024-09-05T12:59:51.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T12:59:52.128 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T12:59:52.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:52 smithi073 ceph-mon[30883]: pgmap v395: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 MiB/s wr, 17.28k op/s 2024-09-05T12:59:52.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:52 smithi162 ceph-mon[34220]: pgmap v395: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 MiB/s wr, 17.28k op/s 2024-09-05T12:59:52.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:52 smithi169 ceph-mon[34823]: pgmap v395: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 MiB/s wr, 17.28k op/s 2024-09-05T12:59:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.024+0000 7fc6bb959640 1 -- 172.21.15.73:0/71371087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6b410e130 msgr2=0x7fc6b4110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.024+0000 7fc6bb959640 1 --2- 172.21.15.73:0/71371087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6b410e130 0x7fc6b4110520 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009ca0 tx=0x7fc6ac02a8f0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.024+0000 7fc6bb959640 1 -- 172.21.15.73:0/71371087 shutdown_connections 2024-09-05T12:59:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.024+0000 7fc6bb959640 1 --2- 172.21.15.73:0/71371087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6b410e130 0x7fc6b4110520 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.024+0000 7fc6bb959640 1 --2- 172.21.15.73:0/71371087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6b4074c50 0x7fc6b40750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.024+0000 7fc6bb959640 1 --2- 172.21.15.73:0/71371087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6b4076230 0x7fc6b4074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.024+0000 7fc6bb959640 1 -- 172.21.15.73:0/71371087 >> 172.21.15.73:0/71371087 conn(0x7fc6b40fd2e0 msgr2=0x7fc6b40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.025+0000 7fc6bb959640 1 -- 172.21.15.73:0/71371087 shutdown_connections 2024-09-05T12:59:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.025+0000 7fc6bb959640 1 -- 172.21.15.73:0/71371087 wait complete. 2024-09-05T12:59:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.027+0000 7fc6bb959640 1 Processor -- start 2024-09-05T12:59:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.027+0000 7fc6bb959640 1 -- start start 2024-09-05T12:59:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.027+0000 7fc6bb959640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6b4074c50 0x7fc6b410bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.027+0000 7fc6bb959640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6b4076230 0x7fc6b410c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.027+0000 7fc6bb959640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6b410e130 0x7fc6b410d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.027+0000 7fc6bb959640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4106370 con 0x7fc6b4074c50 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.027+0000 7fc6bb959640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b41061f0 con 0x7fc6b410e130 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.027+0000 7fc6bb959640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b41064f0 con 0x7fc6b4076230 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.028+0000 7fc6b9ef6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6b410e130 0x7fc6b410d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.028+0000 7fc6b9ef6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6b410e130 0x7fc6b410d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:40038/0 (socket says 172.21.15.73:40038) 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.028+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/122811265 learned_addr learned my addr 172.21.15.73:0/122811265 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.028+0000 7fc6b96f5640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6b4074c50 0x7fc6b410bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.029+0000 7fc6b8ef4640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6b4076230 0x7fc6b410c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.029+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/122811265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6b4076230 msgr2=0x7fc6b410c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.029+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6b4076230 0x7fc6b410c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.029+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/122811265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6b4074c50 msgr2=0x7fc6b410bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.029+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6b4074c50 0x7fc6b410bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.029+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/122811265 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b410d770 con 0x7fc6b410e130 2024-09-05T12:59:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.030+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6b410e130 0x7fc6b410d100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac02aee0 tx=0x7fc6ac003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.030+0000 7fc6aa7fc640 1 -- 172.21.15.73:0/122811265 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac004040 con 0x7fc6b410e130 2024-09-05T12:59:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.030+0000 7fc6bb959640 1 -- 172.21.15.73:0/122811265 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b410da00 con 0x7fc6b410e130 2024-09-05T12:59:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.030+0000 7fc6bb959640 1 -- 172.21.15.73:0/122811265 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b41af1f0 con 0x7fc6b410e130 2024-09-05T12:59:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.030+0000 7fc6aa7fc640 1 -- 172.21.15.73:0/122811265 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6ac02d070 con 0x7fc6b410e130 2024-09-05T12:59:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.030+0000 7fc6aa7fc640 1 -- 172.21.15.73:0/122811265 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac004040 con 0x7fc6b410e130 2024-09-05T12:59:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.034+0000 7fc6aa7fc640 1 -- 172.21.15.73:0/122811265 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc6ac02fa40 con 0x7fc6b410e130 2024-09-05T12:59:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.035+0000 7fc6aa7fc640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a00a2f10 0x7fc6a00a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.035+0000 7fc6aa7fc640 1 -- 172.21.15.73:0/122811265 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fc6ac0f02c0 con 0x7fc6b410e130 2024-09-05T12:59:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.035+0000 7fc6b96f5640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a00a2f10 0x7fc6a00a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6be7cd740 1 Processor -- start 2024-09-05T12:59:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6be7cd740 1 -- start start 2024-09-05T12:59:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf94da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf952e0 0x563bdcf99da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf9a370 0x563bdcf9c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6be7cd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563bdcef82f0 con 0x563bdcf949a0 2024-09-05T12:59:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6be7cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563bdcea0270 con 0x563bdcf9a370 2024-09-05T12:59:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6be7cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563bdcef42b0 con 0x563bdcf952e0 2024-09-05T12:59:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6b9ef6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf9a370 0x563bdcf9c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6b9ef6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf9a370 0x563bdcf9c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:40040/0 (socket says 172.21.15.73:40040) 2024-09-05T12:59:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/3942808915 learned_addr learned my addr 172.21.15.73:0/3942808915 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.037+0000 7fc6b96f5640 1 --2- 172.21.15.73:0/3942808915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf94da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.036+0000 7fc6b8ef4640 1 --2- 172.21.15.73:0/3942808915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf952e0 0x563bdcf99da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.037+0000 7fc6b96f5640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a00a2f10 0x7fc6a00a53d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0006fd0 tx=0x7fc6b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.037+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/3942808915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf952e0 msgr2=0x563bdcf99da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.037+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/3942808915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf952e0 0x563bdcf99da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.037+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/3942808915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 msgr2=0x563bdcf94da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.037+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/3942808915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf94da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.037+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/3942808915 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bdce9f340 con 0x563bdcf9a370 2024-09-05T12:59:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.037+0000 7fc6b96f5640 1 --2- 172.21.15.73:0/3942808915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf94da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:59:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.037+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/3942808915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf9a370 0x563bdcf9c830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0ba490 tx=0x7fc6ac0bd9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63c409cb27af6442 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.038+0000 7fc69f7fe640 1 -- 172.21.15.73:0/3942808915 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0be1c0 con 0x563bdcf9a370 2024-09-05T12:59:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.038+0000 7fc69f7fe640 1 -- 172.21.15.73:0/3942808915 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6ac036040 con 0x563bdcf9a370 2024-09-05T12:59:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.038+0000 7fc69f7fe640 1 -- 172.21.15.73:0/3942808915 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0ba130 con 0x563bdcf9a370 2024-09-05T12:59:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.039+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3942808915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf9a370 msgr2=0x563bdcf9c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.039+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3942808915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf9a370 0x563bdcf9c830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0ba490 tx=0x7fc6ac0bd9c0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.039+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3942808915 shutdown_connections 2024-09-05T12:59:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.039+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3942808915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf9a370 0x563bdcf9c830 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.039+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3942808915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf952e0 0x563bdcf99da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.039+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3942808915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf94da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.039+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3942808915 >> 172.21.15.73:0/3942808915 conn(0x563bdcf90010 msgr2=0x563bdcf90410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.039+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3942808915 shutdown_connections 2024-09-05T12:59:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.040+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3942808915 wait complete. 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.040+0000 7fc6be7cd740 1 -- start start 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.040+0000 7fc6be7cd740 1 Processor -- start 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.040+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf9e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.040+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcf9ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfa5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b96f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf9e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6be7cd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563bdcf9d100 con 0x563bdcf949a0 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6be7cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563bdce81290 con 0x563bdcf952e0 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6be7cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563bdcf9d280 con 0x563bdcf9a370 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b9ef6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfa5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b9ef6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfa5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:46984/0 (socket says 172.21.15.73:46984) 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/919515397 learned_addr learned my addr 172.21.15.73:0/919515397 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6be7cd740 10 client.0 _ll_register_callbacks cb 0x563bdceb2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b96f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf9e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46096/0 (socket says 172.21.15.73:46096) 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b8ef4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcf9ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/919515397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 msgr2=0x563bdcf9ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcf9ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/919515397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 msgr2=0x563bdcf9e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf9e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.041+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/919515397 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bdcc0b210 con 0x563bdcf9a370 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.042+0000 7fc6be7cd740 1 -- 172.21.15.73:0/919515397 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6ac036040 con 0x563bdcf9a370 2024-09-05T12:59:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.042+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfa5e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac04a040 tx=0x7fc6ac0bdac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f267ae77a0435fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.042+0000 7fc69cff9640 10 client.25219 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T12:59:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.042+0000 7fc69cff9640 1 -- 172.21.15.73:0/919515397 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0a1060 con 0x563bdcf9a370 2024-09-05T12:59:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.042+0000 7fc69cff9640 1 -- 172.21.15.73:0/919515397 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fc6ac0445d0 con 0x563bdcf9a370 2024-09-05T12:59:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.042+0000 7fc69cff9640 1 -- 172.21.15.73:0/919515397 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc6ac0be1c0 con 0x563bdcf9a370 2024-09-05T12:59:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.043+0000 7fc6be7cd740 10 client.25219 fetch_fsmap learned FSMap version 29 2024-09-05T12:59:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.043+0000 7fc6be7cd740 1 -- 172.21.15.73:0/919515397 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563bdccd7620 con 0x563bdcf9a370 2024-09-05T12:59:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.043+0000 7fc69cff9640 1 -- 172.21.15.73:0/919515397 <== mon.1 v2:172.21.15.169:3300/0 4 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc6ac0bdd20 con 0x563bdcf9a370 2024-09-05T12:59:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.043+0000 7fc6be7cd740 10 client.25219 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T12:59:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.043+0000 7fc6be7cd740 10 client.25219 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.043+0000 7fc6be7cd740 20 client.25219 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.043+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563bdcfbb340 0x563bdcfbd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.043+0000 7fc6be7cd740 4 client.25219 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.043+0000 7fc6be7cd740 1 -- 172.21.15.73:0/919515397 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bdcf05a20 con 0x563bdcfbb340 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.043+0000 7fc6b96f5640 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563bdcfbb340 0x563bdcfbd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.044+0000 7fc69cff9640 10 client.25219 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.044+0000 7fc6b96f5640 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563bdcfbb340 0x563bdcfbd760 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a2ee1702eeb2f89 server_cookie=e79d398467e52d84 in_seq=0 out_seq=0 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc69cff9640 1 -- 172.21.15.73:0/919515397 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563bdcf05a20 con 0x563bdcfbb340 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc69cff9640 10 client.25219 handle_command_reply: tid=0 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc6be7cd740 1 client.25219 shutdown 2024-09-05T12:59:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc6be7cd740 1 -- 172.21.15.73:0/919515397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 msgr2=0x563bdcfa5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfa5e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac04a040 tx=0x7fc6ac0bdac0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc6be7cd740 1 -- 172.21.15.73:0/919515397 shutdown_connections 2024-09-05T12:59:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563bdcfbb340 0x563bdcfbd760 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc69cff9640 0 client.25219 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfa5e40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcf9ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/919515397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf9e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.045+0000 7fc6be7cd740 1 -- 172.21.15.73:0/919515397 >> 172.21.15.73:0/919515397 conn(0x563bdcf90010 msgr2=0x563bdcf91820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.046+0000 7fc6be7cd740 1 -- 172.21.15.73:0/919515397 shutdown_connections 2024-09-05T12:59:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.046+0000 7fc6be7cd740 1 -- 172.21.15.73:0/919515397 wait complete. 2024-09-05T12:59:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.046+0000 7fc6be7cd740 20 client.25219 trim_cache size 0 max 16384 2024-09-05T12:59:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.074+0000 7fc6be7cd740 1 Processor -- start 2024-09-05T12:59:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.074+0000 7fc6be7cd740 1 -- start start 2024-09-05T12:59:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.074+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf8f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.074+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcfa5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.074+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfc2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.074+0000 7fc6be7cd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc698010bf0 con 0x563bdcf949a0 2024-09-05T12:59:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.074+0000 7fc6be7cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc69800e460 con 0x563bdcf952e0 2024-09-05T12:59:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.074+0000 7fc6be7cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc69800c2b0 con 0x563bdcf9a370 2024-09-05T12:59:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.075+0000 7fc6b9ef6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfc2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.075+0000 7fc6b9ef6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfc2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:47000/0 (socket says 172.21.15.73:47000) 2024-09-05T12:59:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.075+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/600966765 learned_addr learned my addr 172.21.15.73:0/600966765 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.075+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/600966765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 msgr2=0x563bdcfa5e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T12:59:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.075+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/600966765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcfa5e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.075+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/600966765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 msgr2=0x563bdcf8f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.075+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/600966765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf8f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.075+0000 7fc6b9ef6640 1 -- 172.21.15.73:0/600966765 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bdcf94500 con 0x563bdcf9a370 2024-09-05T12:59:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.075+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/600966765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfc2020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0c2030 tx=0x7fc6ac046000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e061eea6f971e7ec server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.076+0000 7fc69effd640 1 -- 172.21.15.73:0/600966765 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0a1020 con 0x563bdcf9a370 2024-09-05T12:59:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.076+0000 7fc69effd640 1 -- 172.21.15.73:0/600966765 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6ac036040 con 0x563bdcf9a370 2024-09-05T12:59:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.076+0000 7fc69effd640 1 -- 172.21.15.73:0/600966765 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac044630 con 0x563bdcf9a370 2024-09-05T12:59:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.077+0000 7fc6be7cd740 1 -- 172.21.15.73:0/600966765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 msgr2=0x563bdcfc2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.077+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/600966765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfc2020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0c2030 tx=0x7fc6ac046000 comp rx=0 tx=0).stop 2024-09-05T12:59:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.077+0000 7fc6be7cd740 1 -- 172.21.15.73:0/600966765 shutdown_connections 2024-09-05T12:59:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.077+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/600966765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf9a370 0x563bdcfc2020 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.077+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/600966765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcfa5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.077+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/600966765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf949a0 0x563bdcf8f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.077+0000 7fc6be7cd740 1 -- 172.21.15.73:0/600966765 >> 172.21.15.73:0/600966765 conn(0x563bdcf90010 msgr2=0x563bdcf8e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.077+0000 7fc6be7cd740 1 -- 172.21.15.73:0/600966765 shutdown_connections 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.077+0000 7fc6be7cd740 1 -- 172.21.15.73:0/600966765 wait complete. 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.078+0000 7fc6be7cd740 1 -- start start 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.078+0000 7fc6be7cd740 1 Processor -- start 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.078+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf949a0 0x563bdcfa37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.079+0000 7fc6be7cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcfa3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.079+0000 7fc6b96f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf949a0 0x563bdcfa37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.079+0000 7fc6b96f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf949a0 0x563bdcfa37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:47002/0 (socket says 172.21.15.73:47002) 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.079+0000 7fc6b8ef4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcfa3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.079+0000 7fc6b8ef4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcfa3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:40064/0 (socket says 172.21.15.73:40064) 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.079+0000 7fc6b8ef4640 1 -- 172.21.15.73:0/3365700867 learned_addr learned my addr 172.21.15.73:0/3365700867 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.079+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf9a370 0x563bdcfa4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.079+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc69800c920 con 0x563bdcf9a370 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.079+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc69800dd90 con 0x563bdcf952e0 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.079+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc69800cff0 con 0x563bdcf949a0 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.080+0000 7fc6b9ef6640 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf9a370 0x563bdcfa4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.080+0000 7fc6be7cd740 10 client.0 _ll_register_callbacks cb 0x7fc6b0009180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.080+0000 7fc6b8ef4640 1 -- 172.21.15.73:0/3365700867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf949a0 msgr2=0x563bdcfa37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.080+0000 7fc6b8ef4640 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf949a0 0x563bdcfa37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.080+0000 7fc6b8ef4640 1 -- 172.21.15.73:0/3365700867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf9a370 msgr2=0x563bdcfa4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.080+0000 7fc6b8ef4640 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf9a370 0x563bdcfa4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.080+0000 7fc6b8ef4640 1 -- 172.21.15.73:0/3365700867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bdcfa5340 con 0x563bdcf952e0 2024-09-05T12:59:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.081+0000 7fc6b8ef4640 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcfa3d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x563bdcf95d10 tx=0x7fc6a4013830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac78b6c7a098f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.081+0000 7fc69cff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T12:59:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.081+0000 7fc69cff9640 1 -- 172.21.15.73:0/3365700867 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4004440 con 0x563bdcf952e0 2024-09-05T12:59:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.081+0000 7fc69cff9640 1 -- 172.21.15.73:0/3365700867 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fc6a40035f0 con 0x563bdcf952e0 2024-09-05T12:59:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.081+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6ac036040 con 0x563bdcf952e0 2024-09-05T12:59:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.082+0000 7fc69cff9640 1 -- 172.21.15.73:0/3365700867 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc6a4023070 con 0x563bdcf952e0 2024-09-05T12:59:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.082+0000 7fc6be7cd740 10 client.25169 fetch_fsmap learned FSMap version 29 2024-09-05T12:59:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.082+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563bdd0263c0 con 0x563bdcf952e0 2024-09-05T12:59:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.082+0000 7fc69cff9640 1 -- 172.21.15.73:0/3365700867 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6ac036040 con 0x563bdcf952e0 2024-09-05T12:59:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.082+0000 7fc69cff9640 1 -- 172.21.15.73:0/3365700867 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc6a401a020 con 0x563bdcf952e0 2024-09-05T12:59:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.082+0000 7fc6be7cd740 10 client.25169 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T12:59:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.082+0000 7fc6be7cd740 10 client.25169 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T12:59:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.082+0000 7fc6be7cd740 20 client.25169 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.082+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563bdcfbb340 0x563bdd028e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.083+0000 7fc6be7cd740 4 client.25169 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T12:59:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.083+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563bdceffd70 con 0x563bdcfbb340 2024-09-05T12:59:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.084+0000 7fc6b96f5640 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563bdcfbb340 0x563bdd028e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.084+0000 7fc69cff9640 10 client.25169 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.084+0000 7fc6b96f5640 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563bdcfbb340 0x563bdd028e60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a4b0f8d22a85470 server_cookie=796c4aed83a6f60 in_seq=0 out_seq=0 2024-09-05T12:59:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.110+0000 7fc69cff9640 1 -- 172.21.15.73:0/3365700867 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563bdceffd70 con 0x563bdcfbb340 2024-09-05T12:59:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.110+0000 7fc69cff9640 10 client.25169 handle_command_reply: tid=0 2024-09-05T12:59:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.110+0000 7fc6be7cd740 1 client.25169 shutdown 2024-09-05T12:59:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.111+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 msgr2=0x563bdcfa3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.111+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcfa3d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x563bdcf95d10 tx=0x7fc6a4013830 comp rx=0 tx=0).stop 2024-09-05T12:59:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.111+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 shutdown_connections 2024-09-05T12:59:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.111+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563bdcfbb340 0x563bdd028e60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.111+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563bdcf9a370 0x563bdcfa4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.111+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bdcf952e0 0x563bdcfa3d20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.111+0000 7fc6be7cd740 1 --2- 172.21.15.73:0/3365700867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bdcf949a0 0x563bdcfa37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.111+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 >> 172.21.15.73:0/3365700867 conn(0x563bdcf90010 msgr2=0x563bdcf916e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.112+0000 7fc69cff9640 0 client.25169 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T12:59:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.112+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 shutdown_connections 2024-09-05T12:59:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.113+0000 7fc6be7cd740 1 -- 172.21.15.73:0/3365700867 wait complete. 2024-09-05T12:59:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.113+0000 7fc6be7cd740 20 client.25169 trim_cache size 0 max 16384 2024-09-05T12:59:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T12:59:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T12:59:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T12:59:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T12:59:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.116+0000 7fc6bb959640 1 -- 172.21.15.73:0/122811265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a00a2f10 msgr2=0x7fc6a00a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.116+0000 7fc6bb959640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a00a2f10 0x7fc6a00a53d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0006fd0 tx=0x7fc6b0008040 comp rx=0 tx=0).stop 2024-09-05T12:59:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.116+0000 7fc6bb959640 1 -- 172.21.15.73:0/122811265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6b410e130 msgr2=0x7fc6b410d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.116+0000 7fc6bb959640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6b410e130 0x7fc6b410d100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac02aee0 tx=0x7fc6ac003ba0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.117+0000 7fc6bb959640 1 -- 172.21.15.73:0/122811265 shutdown_connections 2024-09-05T12:59:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.117+0000 7fc6bb959640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a00a2f10 0x7fc6a00a53d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.117+0000 7fc6bb959640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6b410e130 0x7fc6b410d100 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.117+0000 7fc6bb959640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6b4076230 0x7fc6b410c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.117+0000 7fc6bb959640 1 --2- 172.21.15.73:0/122811265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6b4074c50 0x7fc6b410bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.117+0000 7fc6bb959640 1 -- 172.21.15.73:0/122811265 >> 172.21.15.73:0/122811265 conn(0x7fc6b40fd2e0 msgr2=0x7fc6b41014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.119+0000 7fc6bb959640 1 -- 172.21.15.73:0/122811265 shutdown_connections 2024-09-05T12:59:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T12:59:53.119+0000 7fc6bb959640 1 -- 172.21.15.73:0/122811265 wait complete. 2024-09-05T12:59:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:55 smithi162 ceph-mon[34220]: pgmap v396: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 58 MiB/s wr, 13.05k op/s 2024-09-05T12:59:55.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:55 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:59:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:55 smithi169 ceph-mon[34823]: pgmap v396: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 58 MiB/s wr, 13.05k op/s 2024-09-05T12:59:55.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:55 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:59:55.503 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:55 smithi073 ceph-mon[30883]: pgmap v396: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 58 MiB/s wr, 13.05k op/s 2024-09-05T12:59:55.503 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:55 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T12:59:56.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:56 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:56 smithi073 ceph-mon[30883]: pgmap v397: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 51 MiB/s wr, 12.04k op/s 2024-09-05T12:59:56.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:56 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:56 smithi162 ceph-mon[34220]: pgmap v397: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 51 MiB/s wr, 12.04k op/s 2024-09-05T12:59:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:56 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T12:59:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:56 smithi169 ceph-mon[34823]: pgmap v397: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 51 MiB/s wr, 12.04k op/s 2024-09-05T12:59:58.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.274+0000 7f6c9707f640 1 -- 172.21.15.73:0/2493742095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c90106f00 msgr2=0x7f6c9010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.274+0000 7f6c9707f640 1 --2- 172.21.15.73:0/2493742095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c90106f00 0x7f6c9010ea80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009ca0 tx=0x7f6c8802a8c0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.274+0000 7f6c9707f640 1 -- 172.21.15.73:0/2493742095 shutdown_connections 2024-09-05T12:59:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.274+0000 7f6c9707f640 1 --2- 172.21.15.73:0/2493742095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c90106f00 0x7f6c9010ea80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.274+0000 7f6c9707f640 1 --2- 172.21.15.73:0/2493742095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c90102780 0x7f6c901067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.274+0000 7f6c9707f640 1 --2- 172.21.15.73:0/2493742095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c90101dd0 0x7f6c901021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.274+0000 7f6c9707f640 1 -- 172.21.15.73:0/2493742095 >> 172.21.15.73:0/2493742095 conn(0x7f6c900fd8b0 msgr2=0x7f6c900ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.275+0000 7f6c9707f640 1 -- 172.21.15.73:0/2493742095 shutdown_connections 2024-09-05T12:59:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.275+0000 7f6c9707f640 1 -- 172.21.15.73:0/2493742095 wait complete. 2024-09-05T12:59:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.275+0000 7f6c9707f640 1 Processor -- start 2024-09-05T12:59:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.275+0000 7f6c9707f640 1 -- start start 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.275+0000 7f6c9707f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c90101dd0 0x7f6c900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.275+0000 7f6c9707f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c90102780 0x7f6c90074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.275+0000 7f6c9707f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c90106f00 0x7f6c90074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.275+0000 7f6c9707f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c90111f60 con 0x7f6c90101dd0 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.275+0000 7f6c9707f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c90111de0 con 0x7f6c90106f00 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.275+0000 7f6c9707f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6c901120e0 con 0x7f6c90102780 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c94e1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c90101dd0 0x7f6c900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c94e1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c90101dd0 0x7f6c900744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49232/0 (socket says 172.21.15.73:49232) 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c94e1b640 1 -- 172.21.15.73:0/3452593082 learned_addr learned my addr 172.21.15.73:0/3452593082 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c9561c640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c90106f00 0x7f6c90074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c8ffff640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c90102780 0x7f6c90074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c94e1b640 1 -- 172.21.15.73:0/3452593082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c90102780 msgr2=0x7f6c90074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:58.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c90102780 0x7f6c90074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c94e1b640 1 -- 172.21.15.73:0/3452593082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c90106f00 msgr2=0x7f6c90074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c90106f00 0x7f6c90074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c94e1b640 1 -- 172.21.15.73:0/3452593082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c901a6870 con 0x7f6c90101dd0 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c90101dd0 0x7f6c900744f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c890 tx=0x7f6c8400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c8dffb640 1 -- 172.21.15.73:0/3452593082 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84004220 con 0x7f6c90101dd0 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c8dffb640 1 -- 172.21.15.73:0/3452593082 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c840043c0 con 0x7f6c90101dd0 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c9707f640 1 -- 172.21.15.73:0/3452593082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c901a6b60 con 0x7f6c90101dd0 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.276+0000 7f6c8dffb640 1 -- 172.21.15.73:0/3452593082 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c840049e0 con 0x7f6c90101dd0 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.277+0000 7f6c9707f640 1 -- 172.21.15.73:0/3452593082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c901a70f0 con 0x7f6c90101dd0 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.278+0000 7f6c8dffb640 1 -- 172.21.15.73:0/3452593082 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6c840079b0 con 0x7f6c90101dd0 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.279+0000 7f6c99455740 1 Processor -- start 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.279+0000 7f6c8dffb640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6c800a2c00 0x7f6c800a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.279+0000 7f6c99455740 1 -- start start 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c9561c640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6c800a2c00 0x7f6c800a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c8dffb640 1 -- 172.21.15.73:0/3452593082 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f6c840cefa0 con 0x7f6c90101dd0 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c99455740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe970090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c99455740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe970a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c99455740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe97d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c99455740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558efe8d62f0 con 0x558efe97b370 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c99455740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558efe87dcf0 con 0x558efe9705d0 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c99455740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558efe8d22b0 con 0x558efe971b80 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c8ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe970a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c94e1b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe970090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c9561c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe97d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c8ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe970a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:37838/0 (socket says 172.21.15.73:37838) 2024-09-05T12:59:58.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c8ffff640 1 -- 172.21.15.73:0/483928642 learned_addr learned my addr 172.21.15.73:0/483928642 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c9561c640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6c800a2c00 0x7f6c800a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6c88004af0 tx=0x7f6c88004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c94e1b640 1 -- 172.21.15.73:0/483928642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 msgr2=0x558efe970a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/483928642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe970a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c94e1b640 1 -- 172.21.15.73:0/483928642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 msgr2=0x558efe97d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/483928642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe97d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c94e1b640 1 -- 172.21.15.73:0/483928642 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558efe8623a0 con 0x558efe971b80 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c8ffff640 1 --2- 172.21.15.73:0/483928642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe970a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c9561c640 1 --2- 172.21.15.73:0/483928642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe97d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.280+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/483928642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe970090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6c84007590 tx=0x7f6c8409b2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=846c03018cc6804 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c7affd640 1 -- 172.21.15.73:0/483928642 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8401d040 con 0x558efe971b80 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c7affd640 1 -- 172.21.15.73:0/483928642 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c84099b80 con 0x558efe971b80 2024-09-05T12:59:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c7affd640 1 -- 172.21.15.73:0/483928642 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c840a3fb0 con 0x558efe971b80 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c99455740 1 -- 172.21.15.73:0/483928642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 msgr2=0x558efe970090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c99455740 1 --2- 172.21.15.73:0/483928642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe970090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6c84007590 tx=0x7f6c8409b2a0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c99455740 1 -- 172.21.15.73:0/483928642 shutdown_connections 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c99455740 1 --2- 172.21.15.73:0/483928642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe97d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c99455740 1 --2- 172.21.15.73:0/483928642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe970a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c99455740 1 --2- 172.21.15.73:0/483928642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe970090 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c99455740 1 -- 172.21.15.73:0/483928642 >> 172.21.15.73:0/483928642 conn(0x558efe939310 msgr2=0x558efe96cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c99455740 1 -- 172.21.15.73:0/483928642 shutdown_connections 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.281+0000 7f6c99455740 1 -- 172.21.15.73:0/483928642 wait complete. 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c99455740 1 -- start start 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c99455740 1 Processor -- start 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c99455740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe97ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c99455740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe978010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c99455740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe978600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c99455740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558efe97e0d0 con 0x558efe97b370 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c99455740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558efe891060 con 0x558efe9705d0 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c99455740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558efe97e250 con 0x558efe971b80 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c99455740 10 client.0 _ll_register_callbacks cb 0x558efe5e48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c8ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe978010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c9561c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe978600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c8ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe978010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:36802/0 (socket says 172.21.15.73:36802) 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c8ffff640 1 -- 172.21.15.73:0/1936518436 learned_addr learned my addr 172.21.15.73:0/1936518436 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c9561c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe978600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49254/0 (socket says 172.21.15.73:49254) 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.282+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe97ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c8ffff640 1 -- 172.21.15.73:0/1936518436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 msgr2=0x558efe97ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c8ffff640 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe97ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c8ffff640 1 -- 172.21.15.73:0/1936518436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 msgr2=0x558efe978600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c8ffff640 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe978600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c8ffff640 1 -- 172.21.15.73:0/1936518436 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558efe6473c0 con 0x558efe971b80 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c9561c640 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe978600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c8ffff640 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe978010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00ba10 tx=0x7f6c7c00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aac0677dd09f5c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c6ffff640 1 -- 172.21.15.73:0/1936518436 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c003e00 con 0x558efe971b80 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c6ffff640 1 -- 172.21.15.73:0/1936518436 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f6c7c011440 con 0x558efe971b80 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c99455740 1 -- 172.21.15.73:0/1936518436 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c84099b80 con 0x558efe971b80 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c6ffff640 1 -- 172.21.15.73:0/1936518436 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c7c011640 con 0x558efe971b80 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c99455740 10 client.25237 fetch_fsmap learned FSMap version 29 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c99455740 1 -- 172.21.15.73:0/1936518436 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558efe989bd0 con 0x558efe971b80 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.283+0000 7f6c6ffff640 1 -- 172.21.15.73:0/1936518436 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c84099b80 con 0x558efe971b80 2024-09-05T12:59:58.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.284+0000 7f6c6ffff640 1 -- 172.21.15.73:0/1936518436 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6c7c026a70 con 0x558efe971b80 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.284+0000 7f6c99455740 10 client.25237 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.284+0000 7f6c99455740 10 client.25237 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.284+0000 7f6c99455740 20 client.25237 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.284+0000 7f6c99455740 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x558efe98b130 0x558efe98d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.284+0000 7f6c99455740 4 client.25237 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.284+0000 7f6c99455740 1 -- 172.21.15.73:0/1936518436 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558efe8e3860 con 0x558efe98b130 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.284+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x558efe98b130 0x558efe98d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.284+0000 7f6c6ffff640 10 client.25237 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.284+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x558efe98b130 0x558efe98d570 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aef53cf39116f98a server_cookie=db4e14c559368308 in_seq=0 out_seq=0 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c6ffff640 1 -- 172.21.15.73:0/1936518436 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558efe8e3860 con 0x558efe98b130 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c6ffff640 10 client.25237 handle_command_reply: tid=0 2024-09-05T12:59:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 client.25237 shutdown 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 -- 172.21.15.73:0/1936518436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 msgr2=0x558efe978010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe978010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00ba10 tx=0x7f6c7c00bed0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 -- 172.21.15.73:0/1936518436 shutdown_connections 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x558efe98b130 0x558efe98d570 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe97b370 0x558efe978600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe978010 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 --2- 172.21.15.73:0/1936518436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe97ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c6ffff640 0 client.25237 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 -- 172.21.15.73:0/1936518436 >> 172.21.15.73:0/1936518436 conn(0x558efe939310 msgr2=0x558efe9729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 -- 172.21.15.73:0/1936518436 shutdown_connections 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 1 -- 172.21.15.73:0/1936518436 wait complete. 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.285+0000 7f6c99455740 20 client.25237 trim_cache size 0 max 16384 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c99455740 1 Processor -- start 2024-09-05T12:59:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c99455740 1 -- start start 2024-09-05T12:59:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c99455740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe9705d0 0x558efe987370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c99455740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe973160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c99455740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe97b370 0x558efe9736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c99455740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c901b2030 con 0x558efe9705d0 2024-09-05T12:59:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c99455740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c901af8a0 con 0x558efe97b370 2024-09-05T12:59:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c99455740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6c901ad6f0 con 0x558efe971b80 2024-09-05T12:59:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c94e1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe9705d0 0x558efe987370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c94e1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe9705d0 0x558efe987370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49262/0 (socket says 172.21.15.73:49262) 2024-09-05T12:59:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c94e1b640 1 -- 172.21.15.73:0/3228926069 learned_addr learned my addr 172.21.15.73:0/3228926069 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c9561c640 1 --2- 172.21.15.73:0/3228926069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe97b370 0x558efe9736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.298+0000 7f6c8ffff640 1 --2- 172.21.15.73:0/3228926069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe973160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.299+0000 7f6c94e1b640 1 -- 172.21.15.73:0/3228926069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 msgr2=0x558efe973160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.299+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/3228926069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe973160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.299+0000 7f6c94e1b640 1 -- 172.21.15.73:0/3228926069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe97b370 msgr2=0x558efe9736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.299+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/3228926069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe97b370 0x558efe9736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.299+0000 7f6c94e1b640 1 -- 172.21.15.73:0/3228926069 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558efe96d960 con 0x558efe9705d0 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.299+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/3228926069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe9705d0 0x558efe987370 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6c8409b580 tx=0x7f6c840045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9e68352b210224 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.299+0000 7f6c7a7fc640 1 -- 172.21.15.73:0/3228926069 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c840b4070 con 0x558efe9705d0 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.299+0000 7f6c7a7fc640 1 -- 172.21.15.73:0/3228926069 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c84007ca0 con 0x558efe9705d0 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.299+0000 7f6c7a7fc640 1 -- 172.21.15.73:0/3228926069 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8401d040 con 0x558efe9705d0 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.299+0000 7f6c99455740 1 -- 172.21.15.73:0/3228926069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe9705d0 msgr2=0x558efe987370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 --2- 172.21.15.73:0/3228926069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe9705d0 0x558efe987370 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6c8409b580 tx=0x7f6c840045d0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 -- 172.21.15.73:0/3228926069 shutdown_connections 2024-09-05T12:59:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 --2- 172.21.15.73:0/3228926069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe97b370 0x558efe9736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 --2- 172.21.15.73:0/3228926069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe971b80 0x558efe973160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 --2- 172.21.15.73:0/3228926069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe9705d0 0x558efe987370 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 -- 172.21.15.73:0/3228926069 >> 172.21.15.73:0/3228926069 conn(0x558efe939310 msgr2=0x558efe977100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 -- 172.21.15.73:0/3228926069 shutdown_connections 2024-09-05T12:59:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 -- 172.21.15.73:0/3228926069 wait complete. 2024-09-05T12:59:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 -- start start 2024-09-05T12:59:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 Processor -- start 2024-09-05T12:59:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe983960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe971b80 0x558efe97ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe97b370 0x558efe97f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c901add60 con 0x558efe971b80 2024-09-05T12:59:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c901af1d0 con 0x558efe9705d0 2024-09-05T12:59:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6c901ae430 con 0x558efe97b370 2024-09-05T12:59:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c99455740 10 client.0 _ll_register_callbacks cb 0x7f6c7c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T12:59:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c8ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe971b80 0x558efe97ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c8ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe971b80 0x558efe97ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49268/0 (socket says 172.21.15.73:49268) 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.300+0000 7f6c8ffff640 1 -- 172.21.15.73:0/3004390929 learned_addr learned my addr 172.21.15.73:0/3004390929 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe983960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c9561c640 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe97b370 0x558efe97f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c8ffff640 1 -- 172.21.15.73:0/3004390929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe97b370 msgr2=0x558efe97f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c8ffff640 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe97b370 0x558efe97f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c8ffff640 1 -- 172.21.15.73:0/3004390929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 msgr2=0x558efe983960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c8ffff640 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe983960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c8ffff640 1 -- 172.21.15.73:0/3004390929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558efe97f710 con 0x558efe971b80 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c8ffff640 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe971b80 0x558efe97ec90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c026f60 tx=0x7f6c7c011560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80d8f530446a728 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c6ffff640 1 -- 172.21.15.73:0/3004390929 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c02b070 con 0x558efe971b80 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c6ffff640 1 -- 172.21.15.73:0/3004390929 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f6c7c01b470 con 0x558efe971b80 2024-09-05T12:59:58.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c99455740 1 -- 172.21.15.73:0/3004390929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c84007ca0 con 0x558efe971b80 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c6ffff640 1 -- 172.21.15.73:0/3004390929 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c7c037070 con 0x558efe971b80 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c99455740 10 client.15654 fetch_fsmap learned FSMap version 29 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c99455740 1 -- 172.21.15.73:0/3004390929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558efe9f5b70 con 0x558efe971b80 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.301+0000 7f6c6ffff640 1 -- 172.21.15.73:0/3004390929 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c84007ca0 con 0x558efe971b80 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c6ffff640 1 -- 172.21.15.73:0/3004390929 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6c7c01bb00 con 0x558efe971b80 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c99455740 10 client.15654 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c99455740 10 client.15654 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c99455740 20 client.15654 populate_metadata read hostname 'smithi073' 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c99455740 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x558efe9f6320 0x558efe9f8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c99455740 4 client.15654 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c99455740 1 -- 172.21.15.73:0/3004390929 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558efe8ddd70 con 0x558efe9f6320 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x558efe9f6320 0x558efe9f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c94e1b640 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x558efe9f6320 0x558efe9f8740 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=837983a3af7f0a2a server_cookie=d9e6f05829c37b6 in_seq=0 out_seq=0 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c6ffff640 10 client.15654 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T12:59:58.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c6ffff640 1 -- 172.21.15.73:0/3004390929 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558efe8ddd70 con 0x558efe9f6320 2024-09-05T12:59:58.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c6ffff640 10 client.15654 handle_command_reply: tid=0 2024-09-05T12:59:58.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.302+0000 7f6c99455740 1 client.15654 shutdown 2024-09-05T12:59:58.648 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T12:59:58.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 1 -- 172.21.15.73:0/3004390929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe971b80 msgr2=0x558efe97ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:58.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe971b80 0x558efe97ec90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c026f60 tx=0x7f6c7c011560 comp rx=0 tx=0).stop 2024-09-05T12:59:58.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 1 -- 172.21.15.73:0/3004390929 shutdown_connections 2024-09-05T12:59:58.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x558efe9f6320 0x558efe9f8740 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558efe97b370 0x558efe97f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558efe971b80 0x558efe97ec90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c6ffff640 0 client.15654 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 1 --2- 172.21.15.73:0/3004390929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558efe9705d0 0x558efe983960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 1 -- 172.21.15.73:0/3004390929 >> 172.21.15.73:0/3004390929 conn(0x558efe939310 msgr2=0x558efe979870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 1 -- 172.21.15.73:0/3004390929 shutdown_connections 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 1 -- 172.21.15.73:0/3004390929 wait complete. 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c99455740 20 client.15654 trim_cache size 0 max 16384 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 -- 172.21.15.73:0/3452593082 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6c800a2c00 msgr2=0x7f6c800a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6c800a2c00 0x7f6c800a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6c88004af0 tx=0x7f6c88004a80 comp rx=0 tx=0).stop 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 -- 172.21.15.73:0/3452593082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c90101dd0 msgr2=0x7f6c900744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c90101dd0 0x7f6c900744f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c890 tx=0x7f6c8400cd50 comp rx=0 tx=0).stop 2024-09-05T12:59:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 -- 172.21.15.73:0/3452593082 shutdown_connections 2024-09-05T12:59:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6c800a2c00 0x7f6c800a50c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c90106f00 0x7f6c90074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c90102780 0x7f6c90074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 --2- 172.21.15.73:0/3452593082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c90101dd0 0x7f6c900744f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T12:59:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 -- 172.21.15.73:0/3452593082 >> 172.21.15.73:0/3452593082 conn(0x7f6c900fd8b0 msgr2=0x7f6c900fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T12:59:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 -- 172.21.15.73:0/3452593082 shutdown_connections 2024-09-05T12:59:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T12:59:57.303+0000 7f6c9707f640 1 -- 172.21.15.73:0/3452593082 wait complete. 2024-09-05T12:59:59.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 12:59:59 smithi162 ceph-mon[34220]: pgmap v398: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 38 MiB/s wr, 9.18k op/s 2024-09-05T12:59:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 12:59:59 smithi169 ceph-mon[34823]: pgmap v398: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 38 MiB/s wr, 9.18k op/s 2024-09-05T12:59:59.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 12:59:59 smithi073 ceph-mon[30883]: pgmap v398: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 38 MiB/s wr, 9.18k op/s 2024-09-05T13:00:00.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:00 smithi073 ceph-mon[30883]: overall HEALTH_OK 2024-09-05T13:00:00.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:00 smithi073 ceph-mon[30883]: pgmap v399: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 20 MiB/s wr, 5.13k op/s 2024-09-05T13:00:00.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:00 smithi162 ceph-mon[34220]: overall HEALTH_OK 2024-09-05T13:00:00.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:00 smithi162 ceph-mon[34220]: pgmap v399: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 20 MiB/s wr, 5.13k op/s 2024-09-05T13:00:00.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:00 smithi169 ceph-mon[34823]: overall HEALTH_OK 2024-09-05T13:00:00.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:00 smithi169 ceph-mon[34823]: pgmap v399: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 20 MiB/s wr, 5.13k op/s 2024-09-05T13:00:02.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:02 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:00:02.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:02 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:00:02.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:02 smithi073 ceph-mon[30883]: pgmap v400: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 19 MiB/s wr, 4.69k op/s 2024-09-05T13:00:02.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:02 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:00:02.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:02 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:00:02.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:02 smithi162 ceph-mon[34220]: pgmap v400: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 19 MiB/s wr, 4.69k op/s 2024-09-05T13:00:02.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:02 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:00:02.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:02 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:00:02.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:02 smithi169 ceph-mon[34823]: pgmap v400: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 19 MiB/s wr, 4.69k op/s 2024-09-05T13:00:03.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:03 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:03.860 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:03 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:03.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:03 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:04.616 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:04 smithi073 ceph-mon[30883]: pgmap v401: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2024-09-05T13:00:04.860 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:04 smithi162 ceph-mon[34220]: pgmap v401: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2024-09-05T13:00:04.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:04 smithi169 ceph-mon[34823]: pgmap v401: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2024-09-05T13:00:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.263+0000 7f6e6e26c640 1 -- 172.21.15.73:0/171735446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e68102620 msgr2=0x7f6e68104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.263+0000 7f6e6e26c640 1 --2- 172.21.15.73:0/171735446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e68102620 0x7f6e68104a10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800dc90 tx=0x7f6e5802e3b0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.264+0000 7f6e6e26c640 1 -- 172.21.15.73:0/171735446 shutdown_connections 2024-09-05T13:00:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.264+0000 7f6e6e26c640 1 --2- 172.21.15.73:0/171735446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e68107880 0x7f6e68109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.264+0000 7f6e6e26c640 1 --2- 172.21.15.73:0/171735446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e68104f50 0x7f6e68107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.264+0000 7f6e6e26c640 1 --2- 172.21.15.73:0/171735446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e68102620 0x7f6e68104a10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.264+0000 7f6e6e26c640 1 -- 172.21.15.73:0/171735446 >> 172.21.15.73:0/171735446 conn(0x7f6e680fc1e0 msgr2=0x7f6e680fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.264+0000 7f6e6e26c640 1 -- 172.21.15.73:0/171735446 shutdown_connections 2024-09-05T13:00:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.264+0000 7f6e6e26c640 1 -- 172.21.15.73:0/171735446 wait complete. 2024-09-05T13:00:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.265+0000 7f6e6e26c640 1 Processor -- start 2024-09-05T13:00:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.265+0000 7f6e6e26c640 1 -- start start 2024-09-05T13:00:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.265+0000 7f6e6e26c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e68102620 0x7f6e68195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e6e26c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e68104f50 0x7f6e68196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e6e26c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e68107880 0x7f6e6819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e6e26c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810b6b0 con 0x7f6e68102620 2024-09-05T13:00:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e6e26c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810b530 con 0x7f6e68107880 2024-09-05T13:00:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e6e26c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810b830 con 0x7f6e68104f50 2024-09-05T13:00:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e68102620 0x7f6e68195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e68102620 0x7f6e68195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37232/0 (socket says 172.21.15.73:37232) 2024-09-05T13:00:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e67fff640 1 -- 172.21.15.73:0/1725491084 learned_addr learned my addr 172.21.15.73:0/1725491084 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e677fe640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e68104f50 0x7f6e68196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e6c809640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e68107880 0x7f6e6819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e67fff640 1 -- 172.21.15.73:0/1725491084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e68104f50 msgr2=0x7f6e68196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e67fff640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e68104f50 0x7f6e68196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.266+0000 7f6e67fff640 1 -- 172.21.15.73:0/1725491084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e68107880 msgr2=0x7f6e6819d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.267+0000 7f6e67fff640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e68107880 0x7f6e6819d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.267+0000 7f6e67fff640 1 -- 172.21.15.73:0/1725491084 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6819d6f0 con 0x7f6e68102620 2024-09-05T13:00:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.267+0000 7f6e677fe640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e68104f50 0x7f6e68196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.267+0000 7f6e6c809640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e68107880 0x7f6e6819d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.267+0000 7f6e67fff640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e68102620 0x7f6e68195ad0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6e580052d0 tx=0x7f6e58005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.268+0000 7f6e657fa640 1 -- 172.21.15.73:0/1725491084 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58004260 con 0x7f6e68102620 2024-09-05T13:00:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.268+0000 7f6e657fa640 1 -- 172.21.15.73:0/1725491084 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e58043070 con 0x7f6e68102620 2024-09-05T13:00:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.268+0000 7f6e657fa640 1 -- 172.21.15.73:0/1725491084 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800bbb0 con 0x7f6e68102620 2024-09-05T13:00:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.268+0000 7f6e6e26c640 1 -- 172.21.15.73:0/1725491084 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6819d980 con 0x7f6e68102620 2024-09-05T13:00:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.268+0000 7f6e6e26c640 1 -- 172.21.15.73:0/1725491084 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6819de70 con 0x7f6e68102620 2024-09-05T13:00:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.272+0000 7f6e657fa640 1 -- 172.21.15.73:0/1725491084 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6e580035f0 con 0x7f6e68102620 2024-09-05T13:00:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.272+0000 7f6e71000740 1 Processor -- start 2024-09-05T13:00:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.272+0000 7f6e71000740 1 -- start start 2024-09-05T13:00:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.272+0000 7f6e71000740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355d55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.272+0000 7f6e71000740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355da5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.272+0000 7f6e71000740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355dd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.272+0000 7f6e71000740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559b355302f0 con 0x559b355dab80 2024-09-05T13:00:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.272+0000 7f6e71000740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559b354d8270 con 0x559b355d51b0 2024-09-05T13:00:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.272+0000 7f6e71000740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b3552c2b0 con 0x559b355d5af0 2024-09-05T13:00:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355da5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355da5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:37522/0 (socket says 172.21.15.73:37522) 2024-09-05T13:00:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e677fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355dd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e677fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355dd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37238/0 (socket says 172.21.15.73:37238) 2024-09-05T13:00:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e677fe640 1 -- 172.21.15.73:0/2373102179 learned_addr learned my addr 172.21.15.73:0/2373102179 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e6c809640 1 --2- 172.21.15.73:0/2373102179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355d55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e67fff640 1 -- 172.21.15.73:0/2373102179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 msgr2=0x559b355d55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e67fff640 1 --2- 172.21.15.73:0/2373102179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355d55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e67fff640 1 -- 172.21.15.73:0/2373102179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 msgr2=0x559b355dd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e67fff640 1 --2- 172.21.15.73:0/2373102179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355dd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.273+0000 7f6e67fff640 1 -- 172.21.15.73:0/2373102179 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b354d7340 con 0x559b355d5af0 2024-09-05T13:00:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.274+0000 7f6e677fe640 1 --2- 172.21.15.73:0/2373102179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355dd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.274+0000 7f6e657fa640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6e500a2e70 0x7f6e500a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.275+0000 7f6e657fa640 1 -- 172.21.15.73:0/1725491084 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f6e58009290 con 0x7f6e68102620 2024-09-05T13:00:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.276+0000 7f6e6c809640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6e500a2e70 0x7f6e500a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.276+0000 7f6e67fff640 1 --2- 172.21.15.73:0/2373102179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355da5b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6e580f0c00 tx=0x7f6e5800b220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8200f0ac0fa164d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.277+0000 7f6e4e7fc640 1 -- 172.21.15.73:0/2373102179 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e580f7040 con 0x559b355d5af0 2024-09-05T13:00:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.277+0000 7f6e4e7fc640 1 -- 172.21.15.73:0/2373102179 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e5800b470 con 0x559b355d5af0 2024-09-05T13:00:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.277+0000 7f6e4e7fc640 1 -- 172.21.15.73:0/2373102179 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e580f7040 con 0x559b355d5af0 2024-09-05T13:00:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.278+0000 7f6e6c809640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6e500a2e70 0x7f6e500a5330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e6806a980 tx=0x7f6e6000a4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.278+0000 7f6e71000740 1 -- 172.21.15.73:0/2373102179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 msgr2=0x559b355da5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.278+0000 7f6e71000740 1 --2- 172.21.15.73:0/2373102179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355da5b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6e580f0c00 tx=0x7f6e5800b220 comp rx=0 tx=0).stop 2024-09-05T13:00:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.279+0000 7f6e71000740 1 -- 172.21.15.73:0/2373102179 shutdown_connections 2024-09-05T13:00:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.279+0000 7f6e71000740 1 --2- 172.21.15.73:0/2373102179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355dd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.279+0000 7f6e71000740 1 --2- 172.21.15.73:0/2373102179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355da5b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.279+0000 7f6e71000740 1 --2- 172.21.15.73:0/2373102179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355d55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.279+0000 7f6e71000740 1 -- 172.21.15.73:0/2373102179 >> 172.21.15.73:0/2373102179 conn(0x559b355d0820 msgr2=0x559b355d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.279+0000 7f6e71000740 1 -- 172.21.15.73:0/2373102179 shutdown_connections 2024-09-05T13:00:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.279+0000 7f6e71000740 1 -- 172.21.15.73:0/2373102179 wait complete. 2024-09-05T13:00:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.280+0000 7f6e71000740 1 -- start start 2024-09-05T13:00:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.280+0000 7f6e71000740 1 Processor -- start 2024-09-05T13:00:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.281+0000 7f6e71000740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d51b0 0x559b355df130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.281+0000 7f6e71000740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355d5af0 0x559b355df670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.281+0000 7f6e71000740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355dab80 0x559b355e6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.281+0000 7f6e71000740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559b355dd910 con 0x559b355d5af0 2024-09-05T13:00:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.281+0000 7f6e71000740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559b354b9290 con 0x559b355dab80 2024-09-05T13:00:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.281+0000 7f6e71000740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b355dda90 con 0x559b355d51b0 2024-09-05T13:00:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.281+0000 7f6e71000740 10 client.0 _ll_register_callbacks cb 0x559b354ea140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.281+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d51b0 0x559b355df130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.281+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d51b0 0x559b355df130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:37528/0 (socket says 172.21.15.73:37528) 2024-09-05T13:00:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.282+0000 7f6e677fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355d5af0 0x559b355df670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.282+0000 7f6e67fff640 1 -- 172.21.15.73:0/2171364830 learned_addr learned my addr 172.21.15.73:0/2171364830 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.282+0000 7f6e677fe640 1 -- 172.21.15.73:0/2171364830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d51b0 msgr2=0x559b355df130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.282+0000 7f6e677fe640 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d51b0 0x559b355df130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.282+0000 7f6e677fe640 1 -- 172.21.15.73:0/2171364830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355dab80 msgr2=0x559b355e6640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:00:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.282+0000 7f6e677fe640 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355dab80 0x559b355e6640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.282+0000 7f6e677fe640 1 -- 172.21.15.73:0/2171364830 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b35243210 con 0x559b355d5af0 2024-09-05T13:00:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.283+0000 7f6e677fe640 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355d5af0 0x559b355df670 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c006ca0 tx=0x7f6e5c011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff66521aaf9b64eb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.283+0000 7f6e477fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.283+0000 7f6e477fe640 1 -- 172.21.15.73:0/2171364830 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c00fa30 con 0x559b355d5af0 2024-09-05T13:00:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.283+0000 7f6e477fe640 1 -- 172.21.15.73:0/2171364830 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f6e5c00fbd0 con 0x559b355d5af0 2024-09-05T13:00:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.284+0000 7f6e71000740 1 -- 172.21.15.73:0/2171364830 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e5800b470 con 0x559b355d5af0 2024-09-05T13:00:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.284+0000 7f6e477fe640 1 -- 172.21.15.73:0/2171364830 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6e5c00fdd0 con 0x559b355d5af0 2024-09-05T13:00:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.284+0000 7f6e71000740 10 client.15666 fetch_fsmap learned FSMap version 30 2024-09-05T13:00:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.284+0000 7f6e71000740 1 -- 172.21.15.73:0/2171364830 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559b3530f620 con 0x559b355d5af0 2024-09-05T13:00:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.285+0000 7f6e477fe640 1 -- 172.21.15.73:0/2171364830 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e5800b470 con 0x559b355d5af0 2024-09-05T13:00:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.285+0000 7f6e477fe640 1 -- 172.21.15.73:0/2171364830 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f6e5c027680 con 0x559b355d5af0 2024-09-05T13:00:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.285+0000 7f6e71000740 10 client.15666 fetch_fsmap finished waiting for FSMap version 30 2024-09-05T13:00:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.285+0000 7f6e71000740 10 client.15666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.285+0000 7f6e71000740 20 client.15666 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.285+0000 7f6e71000740 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559b355fbdc0 0x559b355fe1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.285+0000 7f6e71000740 4 client.15666 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:00:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.286+0000 7f6e71000740 1 -- 172.21.15.73:0/2171364830 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b3553da20 con 0x559b355fbdc0 2024-09-05T13:00:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.286+0000 7f6e67fff640 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559b355fbdc0 0x559b355fe1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.287+0000 7f6e477fe640 10 client.15666 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.287+0000 7f6e67fff640 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559b355fbdc0 0x559b355fe1f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5896e5815310fd67 server_cookie=f9c7439f2b37fcf4 in_seq=0 out_seq=0 2024-09-05T13:00:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e477fe640 1 -- 172.21.15.73:0/2171364830 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b3553da20 con 0x559b355fbdc0 2024-09-05T13:00:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e477fe640 10 client.15666 handle_command_reply: tid=0 2024-09-05T13:00:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 client.15666 shutdown 2024-09-05T13:00:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 -- 172.21.15.73:0/2171364830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355d5af0 msgr2=0x559b355df670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355d5af0 0x559b355df670 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c006ca0 tx=0x7f6e5c011d40 comp rx=0 tx=0).stop 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 -- 172.21.15.73:0/2171364830 shutdown_connections 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559b355fbdc0 0x559b355fe1f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355dab80 0x559b355e6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355d5af0 0x559b355df670 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 --2- 172.21.15.73:0/2171364830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d51b0 0x559b355df130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e477fe640 0 client.15666 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 -- 172.21.15.73:0/2171364830 >> 172.21.15.73:0/2171364830 conn(0x559b355d0820 msgr2=0x559b355d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 -- 172.21.15.73:0/2171364830 shutdown_connections 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 1 -- 172.21.15.73:0/2171364830 wait complete. 2024-09-05T13:00:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.288+0000 7f6e71000740 20 client.15666 trim_cache size 0 max 16384 2024-09-05T13:00:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e71000740 1 Processor -- start 2024-09-05T13:00:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e71000740 1 -- start start 2024-09-05T13:00:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e71000740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e71000740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355e6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e71000740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:45492/0 (socket says 172.21.15.73:45492) 2024-09-05T13:00:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e6c809640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e677fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e677fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355e6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:37530/0 (socket says 172.21.15.73:37530) 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e6c809640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355d1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37260/0 (socket says 172.21.15.73:37260) 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e67fff640 1 -- 172.21.15.73:0/70018383 learned_addr learned my addr 172.21.15.73:0/70018383 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.314+0000 7f6e71000740 1 -- 172.21.15.73:0/70018383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6e681a0c30 con 0x559b355dab80 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e71000740 1 -- 172.21.15.73:0/70018383 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6819e470 con 0x559b355d51b0 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e71000740 1 -- 172.21.15.73:0/70018383 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6e680725d0 con 0x559b355d5af0 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e677fe640 1 -- 172.21.15.73:0/70018383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 msgr2=0x559b355d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e677fe640 1 --2- 172.21.15.73:0/70018383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e677fe640 1 -- 172.21.15.73:0/70018383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 msgr2=0x559b355d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e677fe640 1 --2- 172.21.15.73:0/70018383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355d1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e677fe640 1 -- 172.21.15.73:0/70018383 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b355d9fd0 con 0x559b355d5af0 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e67fff640 1 --2- 172.21.15.73:0/70018383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e6c809640 1 --2- 172.21.15.73:0/70018383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e677fe640 1 --2- 172.21.15.73:0/70018383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355e6600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c006c70 tx=0x7f6e5c011550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfdce0e69cf25bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.315+0000 7f6e4dffb640 1 -- 172.21.15.73:0/70018383 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c00fa30 con 0x559b355d5af0 2024-09-05T13:00:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.316+0000 7f6e4dffb640 1 -- 172.21.15.73:0/70018383 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e5c00fbd0 con 0x559b355d5af0 2024-09-05T13:00:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.316+0000 7f6e4dffb640 1 -- 172.21.15.73:0/70018383 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c014c50 con 0x559b355d5af0 2024-09-05T13:00:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.316+0000 7f6e71000740 1 -- 172.21.15.73:0/70018383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 msgr2=0x559b355e6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.316+0000 7f6e71000740 1 --2- 172.21.15.73:0/70018383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355e6600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c006c70 tx=0x7f6e5c011550 comp rx=0 tx=0).stop 2024-09-05T13:00:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.316+0000 7f6e71000740 1 -- 172.21.15.73:0/70018383 shutdown_connections 2024-09-05T13:00:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.316+0000 7f6e71000740 1 --2- 172.21.15.73:0/70018383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.317+0000 7f6e71000740 1 --2- 172.21.15.73:0/70018383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355e6600 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.317+0000 7f6e71000740 1 --2- 172.21.15.73:0/70018383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.317+0000 7f6e71000740 1 -- 172.21.15.73:0/70018383 >> 172.21.15.73:0/70018383 conn(0x559b355d0820 msgr2=0x559b355df130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.317+0000 7f6e71000740 1 -- 172.21.15.73:0/70018383 shutdown_connections 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.317+0000 7f6e71000740 1 -- 172.21.15.73:0/70018383 wait complete. 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.317+0000 7f6e71000740 1 -- start start 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.317+0000 7f6e71000740 1 Processor -- start 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e71000740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355e4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e71000740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355e46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e71000740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355e56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e71000740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6e68072c40 con 0x559b355dab80 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e71000740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6e680740b0 con 0x559b355d51b0 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e71000740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6e68073310 con 0x559b355d5af0 2024-09-05T13:00:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e6c809640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355e56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e6c809640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355e56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37262/0 (socket says 172.21.15.73:37262) 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355e4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:45504/0 (socket says 172.21.15.73:45504) 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e6c809640 1 -- 172.21.15.73:0/146595026 learned_addr learned my addr 172.21.15.73:0/146595026 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e71000740 10 client.0 _ll_register_callbacks cb 0x7f6e5c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e677fe640 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355e46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e6c809640 1 -- 172.21.15.73:0/146595026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 msgr2=0x559b355e46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e6c809640 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355e46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e6c809640 1 -- 172.21.15.73:0/146595026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 msgr2=0x559b355e4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e6c809640 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355e4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e6c809640 1 -- 172.21.15.73:0/146595026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b355e5cc0 con 0x559b355dab80 2024-09-05T13:00:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.318+0000 7f6e67fff640 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355e4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.319+0000 7f6e6c809640 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355e56b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000ff80 tx=0x7f6e60013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9780d9893a92a532 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.319+0000 7f6e477fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.320+0000 7f6e477fe640 1 -- 172.21.15.73:0/146595026 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6002c060 con 0x559b355dab80 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.320+0000 7f6e71000740 1 -- 172.21.15.73:0/146595026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e5c00fbd0 con 0x559b355dab80 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.320+0000 7f6e477fe640 1 -- 172.21.15.73:0/146595026 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f6e6001a7a0 con 0x559b355dab80 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.320+0000 7f6e477fe640 1 -- 172.21.15.73:0/146595026 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6e6001a9e0 con 0x559b355dab80 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.320+0000 7f6e71000740 10 client.15672 fetch_fsmap learned FSMap version 30 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.320+0000 7f6e71000740 1 -- 172.21.15.73:0/146595026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559b35667060 con 0x559b355dab80 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e477fe640 1 -- 172.21.15.73:0/146595026 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e5c00fbd0 con 0x559b355dab80 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e477fe640 1 -- 172.21.15.73:0/146595026 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f6e60026070 con 0x559b355dab80 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e71000740 10 client.15672 fetch_fsmap finished waiting for FSMap version 30 2024-09-05T13:00:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e71000740 10 client.15672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e71000740 20 client.15672 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e71000740 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559b35667a20 0x559b35669e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e71000740 4 client.15672 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:00:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e71000740 1 -- 172.21.15.73:0/146595026 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b35537d70 con 0x559b35667a20 2024-09-05T13:00:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e67fff640 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559b35667a20 0x559b35669e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e477fe640 10 client.15672 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.321+0000 7f6e67fff640 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559b35667a20 0x559b35669e40 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c0ba3733001c8b8 server_cookie=130a11c7a8028f59 in_seq=0 out_seq=0 2024-09-05T13:00:06.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e477fe640 1 -- 172.21.15.73:0/146595026 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559b35537d70 con 0x559b35667a20 2024-09-05T13:00:06.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e477fe640 10 client.15672 handle_command_reply: tid=0 2024-09-05T13:00:06.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e71000740 1 client.15672 shutdown 2024-09-05T13:00:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e71000740 1 -- 172.21.15.73:0/146595026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 msgr2=0x559b355e56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e71000740 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355e56b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000ff80 tx=0x7f6e60013040 comp rx=0 tx=0).stop 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e71000740 1 -- 172.21.15.73:0/146595026 shutdown_connections 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e71000740 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559b35667a20 0x559b35669e40 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e71000740 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b355dab80 0x559b355e56b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e71000740 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b355d5af0 0x559b355e46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e71000740 1 --2- 172.21.15.73:0/146595026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b355d51b0 0x559b355e4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.349+0000 7f6e71000740 1 -- 172.21.15.73:0/146595026 >> 172.21.15.73:0/146595026 conn(0x559b355d0820 msgr2=0x559b355c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.350+0000 7f6e477fe640 0 client.15672 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.350+0000 7f6e71000740 1 -- 172.21.15.73:0/146595026 shutdown_connections 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.350+0000 7f6e71000740 1 -- 172.21.15.73:0/146595026 wait complete. 2024-09-05T13:00:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.350+0000 7f6e71000740 20 client.15672 trim_cache size 0 max 16384 2024-09-05T13:00:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:00:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:00:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:00:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:00:06.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 -- 172.21.15.73:0/1725491084 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6e500a2e70 msgr2=0x7f6e500a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:06.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6e500a2e70 0x7f6e500a5330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e6806a980 tx=0x7f6e6000a4d0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 -- 172.21.15.73:0/1725491084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e68102620 msgr2=0x7f6e68195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:06.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e68102620 0x7f6e68195ad0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6e580052d0 tx=0x7f6e58005300 comp rx=0 tx=0).stop 2024-09-05T13:00:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 -- 172.21.15.73:0/1725491084 shutdown_connections 2024-09-05T13:00:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6e500a2e70 0x7f6e500a5330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e68107880 0x7f6e6819d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e68104f50 0x7f6e68196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 --2- 172.21.15.73:0/1725491084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e68102620 0x7f6e68195ad0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 -- 172.21.15.73:0/1725491084 >> 172.21.15.73:0/1725491084 conn(0x7f6e680fc1e0 msgr2=0x7f6e681057d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.351+0000 7f6e6e26c640 1 -- 172.21.15.73:0/1725491084 shutdown_connections 2024-09-05T13:00:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:06.352+0000 7f6e6e26c640 1 -- 172.21.15.73:0/1725491084 wait complete. 2024-09-05T13:00:07.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:07 smithi162 ceph-mon[34220]: pgmap v402: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 24 MiB/s wr, 5.98k op/s 2024-09-05T13:00:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:07 smithi169 ceph-mon[34823]: pgmap v402: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 24 MiB/s wr, 5.98k op/s 2024-09-05T13:00:07.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:07 smithi073 ceph-mon[30883]: pgmap v402: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 24 MiB/s wr, 5.98k op/s 2024-09-05T13:00:08.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:08 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:00:08.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:08 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:00:08.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:08 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:00:08.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:08 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:00:08.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:08 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:00:08.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:08 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:00:08.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:08 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:00:08.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:08 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:00:08.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:08 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:00:08.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T13:00:09.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:09 smithi073 ceph-mon[30883]: pgmap v403: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 21 MiB/s wr, 5.32k op/s 2024-09-05T13:00:09.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:09 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:09.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:09 smithi162 ceph-mon[34220]: pgmap v403: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 21 MiB/s wr, 5.32k op/s 2024-09-05T13:00:09.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:09 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:09 smithi169 ceph-mon[34823]: pgmap v403: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 21 MiB/s wr, 5.32k op/s 2024-09-05T13:00:09.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:09 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:09.387 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:00:11.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:11 smithi169 ceph-mon[34823]: pgmap v404: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 17 MiB/s wr, 4.26k op/s 2024-09-05T13:00:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:11 smithi073 ceph-mon[30883]: pgmap v404: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 17 MiB/s wr, 4.26k op/s 2024-09-05T13:00:11.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:11 smithi162 ceph-mon[34220]: pgmap v404: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 17 MiB/s wr, 4.26k op/s 2024-09-05T13:00:13.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:13 smithi169 ceph-mon[34823]: pgmap v405: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2024-09-05T13:00:13.412 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:13 smithi162 ceph-mon[34220]: pgmap v405: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2024-09-05T13:00:13.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:13 smithi073 ceph-mon[30883]: pgmap v405: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2024-09-05T13:00:15.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:15 smithi162 ceph-mon[34220]: pgmap v406: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 16 MiB/s wr, 3.88k op/s 2024-09-05T13:00:15.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:15 smithi169 ceph-mon[34823]: pgmap v406: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 16 MiB/s wr, 3.88k op/s 2024-09-05T13:00:15.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:15 smithi073 ceph-mon[30883]: pgmap v406: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 16 MiB/s wr, 3.88k op/s 2024-09-05T13:00:15.606 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:00:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.228+0000 7fd7bb172640 1 -- 172.21.15.73:0/2409159480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7b4074510 msgr2=0x7fd7b40748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.228+0000 7fd7bb172640 1 --2- 172.21.15.73:0/2409159480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7b4074510 0x7fd7b40748f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009900 tx=0x7fd7a802a480 comp rx=0 tx=0).stop 2024-09-05T13:00:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.228+0000 7fd7bb172640 1 -- 172.21.15.73:0/2409159480 shutdown_connections 2024-09-05T13:00:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.228+0000 7fd7bb172640 1 --2- 172.21.15.73:0/2409159480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b410e450 0x7fd7b4110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.228+0000 7fd7bb172640 1 --2- 172.21.15.73:0/2409159480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7b4074e30 0x7fd7b410df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.228+0000 7fd7bb172640 1 --2- 172.21.15.73:0/2409159480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7b4074510 0x7fd7b40748f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.228+0000 7fd7bb172640 1 -- 172.21.15.73:0/2409159480 >> 172.21.15.73:0/2409159480 conn(0x7fd7b40fd8f0 msgr2=0x7fd7b40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.228+0000 7fd7bb172640 1 -- 172.21.15.73:0/2409159480 shutdown_connections 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.228+0000 7fd7bb172640 1 -- 172.21.15.73:0/2409159480 wait complete. 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7bb172640 1 Processor -- start 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7bb172640 1 -- start start 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7bb172640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7b4074510 0x7fd7b419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7bb172640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7b4074e30 0x7fd7b419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7bb172640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b410e450 0x7fd7b419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7bb172640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4114180 con 0x7fd7b4074e30 2024-09-05T13:00:15.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7bb172640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4114000 con 0x7fd7b410e450 2024-09-05T13:00:15.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7bb172640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4114300 con 0x7fd7b4074510 2024-09-05T13:00:15.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7b3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7b4074e30 0x7fd7b419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7b3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7b4074e30 0x7fd7b419ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56704/0 (socket says 172.21.15.73:56704) 2024-09-05T13:00:15.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7b3fff640 1 -- 172.21.15.73:0/3850352639 learned_addr learned my addr 172.21.15.73:0/3850352639 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:15.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7b8f0e640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7b4074510 0x7fd7b419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7b970f640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b410e450 0x7fd7b419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7b3fff640 1 -- 172.21.15.73:0/3850352639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7b4074510 msgr2=0x7fd7b419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:15.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7b4074510 0x7fd7b419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7b3fff640 1 -- 172.21.15.73:0/3850352639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b410e450 msgr2=0x7fd7b419efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.229+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b410e450 0x7fd7b419efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.230+0000 7fd7b3fff640 1 -- 172.21.15.73:0/3850352639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b419f6a0 con 0x7fd7b4074e30 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.230+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7b4074e30 0x7fd7b419ac30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000d770 tx=0x7fd7a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.230+0000 7fd7b1ffb640 1 -- 172.21.15.73:0/3850352639 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0017070 con 0x7fd7b4074e30 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.230+0000 7fd7b1ffb640 1 -- 172.21.15.73:0/3850352639 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a0005500 con 0x7fd7b4074e30 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.230+0000 7fd7bb172640 1 -- 172.21.15.73:0/3850352639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b419f990 con 0x7fd7b4074e30 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.230+0000 7fd7b1ffb640 1 -- 172.21.15.73:0/3850352639 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0004e00 con 0x7fd7b4074e30 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.230+0000 7fd7bb172640 1 -- 172.21.15.73:0/3850352639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b41a7270 con 0x7fd7b4074e30 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.232+0000 7fd7b1ffb640 1 -- 172.21.15.73:0/3850352639 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd7a0004fa0 con 0x7fd7b4074e30 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7bd548740 1 Processor -- start 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7bd548740 1 -- start start 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f7b80 0x564c1f6f6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 0x564c1f6f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f701370 0x564c1f703760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7bd548740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x564c1f65c2f0 con 0x564c1f6f7b80 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7bd548740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564c1f603cf0 con 0x564c1f701370 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7bd548740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564c1f6582b0 con 0x564c1f6f65d0 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b1ffb640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7a40a2b80 0x7fd7a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b8f0e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 0x564c1f6f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b970f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f7b80 0x564c1f6f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b8f0e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 0x564c1f6f6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:51078/0 (socket says 172.21.15.73:51078) 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b8f0e640 1 -- 172.21.15.73:0/2422804933 learned_addr learned my addr 172.21.15.73:0/2422804933 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b970f640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7a40a2b80 0x7fd7a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b1ffb640 1 -- 172.21.15.73:0/3850352639 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd7a00ce9e0 con 0x7fd7b4074e30 2024-09-05T13:00:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/2422804933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f701370 0x564c1f703760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b8f0e640 1 -- 172.21.15.73:0/2422804933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f701370 msgr2=0x564c1f703760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b8f0e640 1 --2- 172.21.15.73:0/2422804933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f701370 0x564c1f703760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b8f0e640 1 -- 172.21.15.73:0/2422804933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f7b80 msgr2=0x564c1f6f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b8f0e640 1 --2- 172.21.15.73:0/2422804933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f7b80 0x564c1f6f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b8f0e640 1 -- 172.21.15.73:0/2422804933 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1f5e83a0 con 0x564c1f6f65d0 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.233+0000 7fd7b970f640 1 --2- 172.21.15.73:0/2422804933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f7b80 0x564c1f6f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.234+0000 7fd7b970f640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7a40a2b80 0x7fd7a40a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009fd0 tx=0x7fd7ac009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.234+0000 7fd7b8f0e640 1 --2- 172.21.15.73:0/2422804933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 0x564c1f6f6a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009900 tx=0x7fd7a8005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=643a819de93ebf14 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.234+0000 7fd79effd640 1 -- 172.21.15.73:0/2422804933 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8040070 con 0x564c1f6f65d0 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.234+0000 7fd79effd640 1 -- 172.21.15.73:0/2422804933 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a80319f0 con 0x564c1f6f65d0 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.234+0000 7fd79effd640 1 -- 172.21.15.73:0/2422804933 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8035040 con 0x564c1f6f65d0 2024-09-05T13:00:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 -- 172.21.15.73:0/2422804933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 msgr2=0x564c1f6f6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 --2- 172.21.15.73:0/2422804933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 0x564c1f6f6a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009900 tx=0x7fd7a8005e80 comp rx=0 tx=0).stop 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 -- 172.21.15.73:0/2422804933 shutdown_connections 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 --2- 172.21.15.73:0/2422804933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f701370 0x564c1f703760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 --2- 172.21.15.73:0/2422804933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 0x564c1f6f6a30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 --2- 172.21.15.73:0/2422804933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f7b80 0x564c1f6f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 -- 172.21.15.73:0/2422804933 >> 172.21.15.73:0/2422804933 conn(0x564c1f6bf310 msgr2=0x564c1f6f2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 -- 172.21.15.73:0/2422804933 shutdown_connections 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 -- 172.21.15.73:0/2422804933 wait complete. 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 -- start start 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 Processor -- start 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f65d0 0x564c1f700cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 0x564c1f6fdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f701370 0x564c1f6fe4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x564c1f704070 con 0x564c1f6f65d0 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564c1f617060 con 0x564c1f701370 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564c1f7041f0 con 0x564c1f6f7b80 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.235+0000 7fd7bd548740 10 client.0 _ll_register_callbacks cb 0x564c1f36a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b8f0e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f65d0 0x564c1f700cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b8f0e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f65d0 0x564c1f700cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56722/0 (socket says 172.21.15.73:56722) 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b8f0e640 1 -- 172.21.15.73:0/3181602174 learned_addr learned my addr 172.21.15.73:0/3181602174 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b970f640 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f701370 0x564c1f6fe4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 0x564c1f6fdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b8f0e640 1 -- 172.21.15.73:0/3181602174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 msgr2=0x564c1f6fdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b8f0e640 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 0x564c1f6fdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b8f0e640 1 -- 172.21.15.73:0/3181602174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f701370 msgr2=0x564c1f6fe4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b8f0e640 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f701370 0x564c1f6fe4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b8f0e640 1 -- 172.21.15.73:0/3181602174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c1f3cd3c0 con 0x564c1f6f65d0 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7b8f0e640 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f65d0 0x564c1f700cd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7a802a4c0 tx=0x7fd7a8005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c5e4532d0c7ec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd793fff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd793fff640 1 -- 172.21.15.73:0/3181602174 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a804b070 con 0x564c1f6f65d0 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd793fff640 1 -- 172.21.15.73:0/3181602174 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd7a8004250 con 0x564c1f6f65d0 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7bd548740 1 -- 172.21.15.73:0/3181602174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7a80319f0 con 0x564c1f6f65d0 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd793fff640 1 -- 172.21.15.73:0/3181602174 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd7a8057050 con 0x564c1f6f65d0 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7bd548740 10 client.15684 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.236+0000 7fd7bd548740 1 -- 172.21.15.73:0/3181602174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564c1f70fa80 con 0x564c1f6f65d0 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.237+0000 7fd793fff640 1 -- 172.21.15.73:0/3181602174 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a80319f0 con 0x564c1f6f65d0 2024-09-05T13:00:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.237+0000 7fd793fff640 1 -- 172.21.15.73:0/3181602174 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fd7a80036a0 con 0x564c1f6f65d0 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.237+0000 7fd7bd548740 10 client.15684 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.237+0000 7fd7bd548740 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.237+0000 7fd7bd548740 20 client.15684 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.237+0000 7fd7bd548740 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564c1f710dd0 0x564c1f7131c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.237+0000 7fd7bd548740 4 client.15684 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.237+0000 7fd7bd548740 1 -- 172.21.15.73:0/3181602174 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c1f669860 con 0x564c1f710dd0 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.237+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564c1f710dd0 0x564c1f7131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.238+0000 7fd793fff640 10 client.15684 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.238+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564c1f710dd0 0x564c1f7131c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca35154b9d40e8a server_cookie=6bd651f5d7e649f8 in_seq=0 out_seq=0 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd793fff640 1 -- 172.21.15.73:0/3181602174 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c1f669860 con 0x564c1f710dd0 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd793fff640 10 client.15684 handle_command_reply: tid=0 2024-09-05T13:00:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 client.15684 shutdown 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 -- 172.21.15.73:0/3181602174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f65d0 msgr2=0x564c1f700cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f65d0 0x564c1f700cd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7a802a4c0 tx=0x7fd7a8005230 comp rx=0 tx=0).stop 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 -- 172.21.15.73:0/3181602174 shutdown_connections 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564c1f710dd0 0x564c1f7131c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f701370 0x564c1f6fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 0x564c1f6fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd793fff640 0 client.15684 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 --2- 172.21.15.73:0/3181602174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f6f65d0 0x564c1f700cd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 -- 172.21.15.73:0/3181602174 >> 172.21.15.73:0/3181602174 conn(0x564c1f6bf310 msgr2=0x564c1f6f89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 -- 172.21.15.73:0/3181602174 shutdown_connections 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 1 -- 172.21.15.73:0/3181602174 wait complete. 2024-09-05T13:00:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.239+0000 7fd7bd548740 20 client.15684 trim_cache size 0 max 16384 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7bd548740 1 Processor -- start 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7bd548740 1 -- start start 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f65d0 0x564c1f70d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 0x564c1f702760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f702ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7bd548740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41b2050 con 0x564c1f701370 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7bd548740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41af860 con 0x564c1f6f65d0 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7bd548740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41ad6b0 con 0x564c1f6f7b80 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b970f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f702ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b970f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f702ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56726/0 (socket says 172.21.15.73:56726) 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b970f640 1 -- 172.21.15.73:0/961231585 learned_addr learned my addr 172.21.15.73:0/961231585 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/961231585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 0x564c1f702760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b8f0e640 1 --2- 172.21.15.73:0/961231585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f65d0 0x564c1f70d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b970f640 1 -- 172.21.15.73:0/961231585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 msgr2=0x564c1f702760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b970f640 1 --2- 172.21.15.73:0/961231585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 0x564c1f702760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b970f640 1 -- 172.21.15.73:0/961231585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f65d0 msgr2=0x564c1f70d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b970f640 1 --2- 172.21.15.73:0/961231585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f65d0 0x564c1f70d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b970f640 1 -- 172.21.15.73:0/961231585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1f703ba0 con 0x564c1f701370 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.252+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/961231585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 0x564c1f702760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.253+0000 7fd7b970f640 1 --2- 172.21.15.73:0/961231585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f702ca0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac012a00 tx=0x7fd7ac009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d40cc16dd2c8c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.253+0000 7fd79e7fc640 1 -- 172.21.15.73:0/961231585 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac00ae50 con 0x564c1f701370 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.253+0000 7fd79e7fc640 1 -- 172.21.15.73:0/961231585 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7ac01f900 con 0x564c1f701370 2024-09-05T13:00:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.253+0000 7fd79e7fc640 1 -- 172.21.15.73:0/961231585 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac005550 con 0x564c1f701370 2024-09-05T13:00:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.253+0000 7fd7bd548740 1 -- 172.21.15.73:0/961231585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 msgr2=0x564c1f702ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.253+0000 7fd7bd548740 1 --2- 172.21.15.73:0/961231585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f702ca0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac012a00 tx=0x7fd7ac009960 comp rx=0 tx=0).stop 2024-09-05T13:00:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.253+0000 7fd7bd548740 1 -- 172.21.15.73:0/961231585 shutdown_connections 2024-09-05T13:00:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 --2- 172.21.15.73:0/961231585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f702ca0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 --2- 172.21.15.73:0/961231585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f7b80 0x564c1f702760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 --2- 172.21.15.73:0/961231585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f65d0 0x564c1f70d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 -- 172.21.15.73:0/961231585 >> 172.21.15.73:0/961231585 conn(0x564c1f6bf310 msgr2=0x564c1f6f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 -- 172.21.15.73:0/961231585 shutdown_connections 2024-09-05T13:00:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 -- 172.21.15.73:0/961231585 wait complete. 2024-09-05T13:00:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 -- start start 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 Processor -- start 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 0x564c1f709790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f7b80 0x564c1f709cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f717e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41add20 con 0x564c1f701370 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41af190 con 0x564c1f6f7b80 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41ae3f0 con 0x564c1f6f65d0 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.254+0000 7fd7bd548740 10 client.0 _ll_register_callbacks cb 0x7fd7ac009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b970f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f717e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b8f0e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 0x564c1f709790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b970f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f717e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56732/0 (socket says 172.21.15.73:56732) 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b970f640 1 -- 172.21.15.73:0/4196903609 learned_addr learned my addr 172.21.15.73:0/4196903609 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f7b80 0x564c1f709cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b970f640 1 -- 172.21.15.73:0/4196903609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 msgr2=0x564c1f709790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b970f640 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 0x564c1f709790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b970f640 1 -- 172.21.15.73:0/4196903609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f7b80 msgr2=0x564c1f709cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b970f640 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f7b80 0x564c1f709cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b970f640 1 -- 172.21.15.73:0/4196903609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c1f7186c0 con 0x564c1f701370 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b3fff640 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f7b80 0x564c1f709cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7b970f640 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f717e90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac01fce0 tx=0x7fd7ac01fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36730cb01cc07606 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd793fff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd793fff640 1 -- 172.21.15.73:0/4196903609 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac01b040 con 0x564c1f701370 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd793fff640 1 -- 172.21.15.73:0/4196903609 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd7ac004c10 con 0x564c1f701370 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7bd548740 1 -- 172.21.15.73:0/4196903609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7ac01f900 con 0x564c1f701370 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd793fff640 1 -- 172.21.15.73:0/4196903609 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd7ac004e10 con 0x564c1f701370 2024-09-05T13:00:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7bd548740 10 client.15690 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.255+0000 7fd7bd548740 1 -- 172.21.15.73:0/4196903609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564c1f709130 con 0x564c1f701370 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.256+0000 7fd793fff640 1 -- 172.21.15.73:0/4196903609 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7ac01f900 con 0x564c1f701370 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.256+0000 7fd793fff640 1 -- 172.21.15.73:0/4196903609 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fd7ac03b030 con 0x564c1f701370 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.256+0000 7fd7bd548740 10 client.15690 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.256+0000 7fd7bd548740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.256+0000 7fd7bd548740 20 client.15690 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.256+0000 7fd7bd548740 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564c1f77bbb0 0x564c1f77dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.256+0000 7fd7bd548740 4 client.15690 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.256+0000 7fd7bd548740 1 -- 172.21.15.73:0/4196903609 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564c1f663d70 con 0x564c1f77bbb0 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.256+0000 7fd7b8f0e640 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564c1f77bbb0 0x564c1f77dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd793fff640 10 client.15690 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7b8f0e640 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564c1f77bbb0 0x564c1f77dfd0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b8160d3e7f44036 server_cookie=c1dd6d2158dcc5e2 in_seq=0 out_seq=0 2024-09-05T13:00:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd793fff640 1 -- 172.21.15.73:0/4196903609 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564c1f663d70 con 0x564c1f77bbb0 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd793fff640 10 client.15690 handle_command_reply: tid=0 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 client.15690 shutdown 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 -- 172.21.15.73:0/4196903609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 msgr2=0x564c1f717e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f717e90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac01fce0 tx=0x7fd7ac01fd10 comp rx=0 tx=0).stop 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 -- 172.21.15.73:0/4196903609 shutdown_connections 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x564c1f77bbb0 0x564c1f77dfd0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564c1f701370 0x564c1f717e90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564c1f6f7b80 0x564c1f709cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd793fff640 0 client.15690 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 --2- 172.21.15.73:0/4196903609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1f6f65d0 0x564c1f709790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 -- 172.21.15.73:0/4196903609 >> 172.21.15.73:0/4196903609 conn(0x564c1f6bf310 msgr2=0x564c1f6f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:15.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 -- 172.21.15.73:0/4196903609 shutdown_connections 2024-09-05T13:00:15.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 1 -- 172.21.15.73:0/4196903609 wait complete. 2024-09-05T13:00:15.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.257+0000 7fd7bd548740 20 client.15690 trim_cache size 0 max 16384 2024-09-05T13:00:15.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 -- 172.21.15.73:0/3850352639 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7a40a2b80 msgr2=0x7fd7a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:15.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7a40a2b80 0x7fd7a40a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009fd0 tx=0x7fd7ac009600 comp rx=0 tx=0).stop 2024-09-05T13:00:15.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 -- 172.21.15.73:0/3850352639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7b4074e30 msgr2=0x7fd7b419ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:15.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7b4074e30 0x7fd7b419ac30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000d770 tx=0x7fd7a000dc30 comp rx=0 tx=0).stop 2024-09-05T13:00:15.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 -- 172.21.15.73:0/3850352639 shutdown_connections 2024-09-05T13:00:15.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7a40a2b80 0x7fd7a40a5040 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b410e450 0x7fd7b419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7b4074e30 0x7fd7b419ac30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 --2- 172.21.15.73:0/3850352639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7b4074510 0x7fd7b419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:15.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 -- 172.21.15.73:0/3850352639 >> 172.21.15.73:0/3850352639 conn(0x7fd7b40fd8f0 msgr2=0x7fd7b40ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:15.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 -- 172.21.15.73:0/3850352639 shutdown_connections 2024-09-05T13:00:15.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:14.258+0000 7fd7bb172640 1 -- 172.21.15.73:0/3850352639 wait complete. 2024-09-05T13:00:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:17 smithi073 ceph-mon[30883]: pgmap v407: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 19 MiB/s wr, 4.58k op/s 2024-09-05T13:00:17.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:17 smithi162 ceph-mon[34220]: pgmap v407: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 19 MiB/s wr, 4.58k op/s 2024-09-05T13:00:17.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:17 smithi169 ceph-mon[34823]: pgmap v407: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 19 MiB/s wr, 4.58k op/s 2024-09-05T13:00:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.483+0000 7f157e230640 1 -- 172.21.15.73:0/1853197446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1578102600 msgr2=0x7f1578108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.483+0000 7f157e230640 1 --2- 172.21.15.73:0/1853197446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1578102600 0x7f1578108e90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1570009ca0 tx=0x7f157002a8c0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.483+0000 7f157e230640 1 -- 172.21.15.73:0/1853197446 shutdown_connections 2024-09-05T13:00:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.483+0000 7f157e230640 1 --2- 172.21.15.73:0/1853197446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1578102600 0x7f1578108e90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.483+0000 7f157e230640 1 --2- 172.21.15.73:0/1853197446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1578101c40 0x7f15781020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.483+0000 7f157e230640 1 --2- 172.21.15.73:0/1853197446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1578100a50 0x7f1578100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.483+0000 7f157e230640 1 -- 172.21.15.73:0/1853197446 >> 172.21.15.73:0/1853197446 conn(0x7f15780fc1b0 msgr2=0x7f15780fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f157e230640 1 -- 172.21.15.73:0/1853197446 shutdown_connections 2024-09-05T13:00:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f157e230640 1 -- 172.21.15.73:0/1853197446 wait complete. 2024-09-05T13:00:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f157e230640 1 Processor -- start 2024-09-05T13:00:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f157e230640 1 -- start start 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f157e230640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1578100a50 0x7f157806ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f157e230640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1578101c40 0x7f157819cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f157e230640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1578102600 0x7f157819f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f157e230640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f157810c6d0 con 0x7f1578100a50 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f157e230640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f157810c550 con 0x7f1578101c40 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f157e230640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f157810c850 con 0x7f1578102600 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.484+0000 7f15777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1578100a50 0x7f157806ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f15777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1578100a50 0x7f157806ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56764/0 (socket says 172.21.15.73:56764) 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f15777fe640 1 -- 172.21.15.73:0/2118719045 learned_addr learned my addr 172.21.15.73:0/2118719045 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f1577fff640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1578102600 0x7f157819f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f1576ffd640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1578101c40 0x7f157819cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f15777fe640 1 -- 172.21.15.73:0/2118719045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1578102600 msgr2=0x7f157819f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f15777fe640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1578102600 0x7f157819f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f15777fe640 1 -- 172.21.15.73:0/2118719045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1578101c40 msgr2=0x7f157819cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f15777fe640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1578101c40 0x7f157819cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f15777fe640 1 -- 172.21.15.73:0/2118719045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157819f9c0 con 0x7f1578100a50 2024-09-05T13:00:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f15777fe640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1578100a50 0x7f157806ac50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f156800d950 tx=0x7f156800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f1574ff9640 1 -- 172.21.15.73:0/2118719045 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1568017070 con 0x7f1578100a50 2024-09-05T13:00:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f1574ff9640 1 -- 172.21.15.73:0/2118719045 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1568009c30 con 0x7f1578100a50 2024-09-05T13:00:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f1574ff9640 1 -- 172.21.15.73:0/2118719045 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156800f600 con 0x7f1578100a50 2024-09-05T13:00:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f157e230640 1 -- 172.21.15.73:0/2118719045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157819fcb0 con 0x7f1578100a50 2024-09-05T13:00:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.485+0000 7f157e230640 1 -- 172.21.15.73:0/2118719045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15781a01b0 con 0x7f1578100a50 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.487+0000 7f1574ff9640 1 -- 172.21.15.73:0/2118719045 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f156801a070 con 0x7f1578100a50 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1580fc8740 1 Processor -- start 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1580fc8740 1 -- start start 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6d9a0 0x563048b6dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b72da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b73370 0x563048b75830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1580fc8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563048ad12f0 con 0x563048b6d9a0 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1580fc8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563048a79270 con 0x563048b73370 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1580fc8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563048acd2b0 con 0x563048b6e2e0 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f15777fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b72da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1577fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6d9a0 0x563048b6dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f15777fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b72da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:51128/0 (socket says 172.21.15.73:51128) 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f15777fe640 1 -- 172.21.15.73:0/2261133539 learned_addr learned my addr 172.21.15.73:0/2261133539 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1577fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6d9a0 0x563048b6dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56778/0 (socket says 172.21.15.73:56778) 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1576ffd640 1 --2- 172.21.15.73:0/2261133539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b73370 0x563048b75830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1574ff9640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15600a2cb0 0x7f15600a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1576ffd640 1 -- 172.21.15.73:0/2261133539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 msgr2=0x563048b72da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1574ff9640 1 -- 172.21.15.73:0/2118719045 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f15680ce940 con 0x7f1578100a50 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1576ffd640 1 --2- 172.21.15.73:0/2261133539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b72da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1576ffd640 1 -- 172.21.15.73:0/2261133539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6d9a0 msgr2=0x563048b6dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1576ffd640 1 --2- 172.21.15.73:0/2261133539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6d9a0 0x563048b6dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1576ffd640 1 -- 172.21.15.73:0/2261133539 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563048a78340 con 0x563048b73370 2024-09-05T13:00:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f15777fe640 1 --2- 172.21.15.73:0/2261133539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b72da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.488+0000 7f1577fff640 1 --2- 172.21.15.73:0/2261133539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6d9a0 0x563048b6dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1577fff640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15600a2cb0 0x7f15600a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1576ffd640 1 --2- 172.21.15.73:0/2261133539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b73370 0x563048b75830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f156c00bbc0 tx=0x7f156c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6024bfe69908eaa server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f155dffb640 1 -- 172.21.15.73:0/2261133539 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c004030 con 0x563048b73370 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f155dffb640 1 -- 172.21.15.73:0/2261133539 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f156c0041d0 con 0x563048b73370 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1580fc8740 1 -- 172.21.15.73:0/2261133539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b73370 msgr2=0x563048b75830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1577fff640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15600a2cb0 0x7f15600a5170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1570005e30 tx=0x7f15700095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1580fc8740 1 --2- 172.21.15.73:0/2261133539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b73370 0x563048b75830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f156c00bbc0 tx=0x7f156c0107a0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f155dffb640 1 -- 172.21.15.73:0/2261133539 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c011640 con 0x563048b73370 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1580fc8740 1 -- 172.21.15.73:0/2261133539 shutdown_connections 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1580fc8740 1 --2- 172.21.15.73:0/2261133539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b73370 0x563048b75830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1580fc8740 1 --2- 172.21.15.73:0/2261133539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b72da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1580fc8740 1 --2- 172.21.15.73:0/2261133539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6d9a0 0x563048b6dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1580fc8740 1 -- 172.21.15.73:0/2261133539 >> 172.21.15.73:0/2261133539 conn(0x563048b69010 msgr2=0x563048b69410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1580fc8740 1 -- 172.21.15.73:0/2261133539 shutdown_connections 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.489+0000 7f1580fc8740 1 -- 172.21.15.73:0/2261133539 wait complete. 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1580fc8740 1 -- start start 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1580fc8740 1 Processor -- start 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6d9a0 0x563048b77bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6e2e0 0x563048b78110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048b7f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1580fc8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563048b76390 con 0x563048b73370 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1580fc8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563048a5a290 con 0x563048b6e2e0 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1580fc8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563048b76510 con 0x563048b6d9a0 2024-09-05T13:00:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1580fc8740 10 client.0 _ll_register_callbacks cb 0x563048a8b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1577fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048b7f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1577fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048b7f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56792/0 (socket says 172.21.15.73:56792) 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1577fff640 1 -- 172.21.15.73:0/2089186932 learned_addr learned my addr 172.21.15.73:0/2089186932 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f1576ffd640 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6e2e0 0x563048b78110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.490+0000 7f15777fe640 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6d9a0 0x563048b77bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1577fff640 1 -- 172.21.15.73:0/2089186932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6d9a0 msgr2=0x563048b77bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1577fff640 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6d9a0 0x563048b77bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1577fff640 1 -- 172.21.15.73:0/2089186932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6e2e0 msgr2=0x563048b78110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1577fff640 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6e2e0 0x563048b78110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1577fff640 1 -- 172.21.15.73:0/2089186932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630487e4210 con 0x563048b73370 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1576ffd640 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6e2e0 0x563048b78110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1577fff640 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048b7f150 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1570035000 tx=0x7f157002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eaebcbe291a26d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1556ffd640 1 -- 172.21.15.73:0/2089186932 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570031db0 con 0x563048b73370 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1580fc8740 1 -- 172.21.15.73:0/2089186932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f156c0041d0 con 0x563048b73370 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1556ffd640 1 -- 172.21.15.73:0/2089186932 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f15700307d0 con 0x563048b73370 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1556ffd640 1 -- 172.21.15.73:0/2089186932 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f15700309d0 con 0x563048b73370 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1580fc8740 10 client.15702 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1580fc8740 1 -- 172.21.15.73:0/2089186932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5630488b0620 con 0x563048b73370 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1556ffd640 1 -- 172.21.15.73:0/2089186932 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f156c0041d0 con 0x563048b73370 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.491+0000 7f1556ffd640 1 -- 172.21.15.73:0/2089186932 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f1570045070 con 0x563048b73370 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.492+0000 7f1580fc8740 10 client.15702 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.492+0000 7f1580fc8740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.492+0000 7f1580fc8740 20 client.15702 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.492+0000 7f1580fc8740 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563048b83860 0x563048b85cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.492+0000 7f1580fc8740 4 client.15702 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.492+0000 7f1580fc8740 1 -- 172.21.15.73:0/2089186932 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563048adea20 con 0x563048b83860 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.492+0000 7f15777fe640 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563048b83860 0x563048b85cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.492+0000 7f15777fe640 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563048b83860 0x563048b85cb0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fff946168cefe05a server_cookie=b2ad4f6a55bf38c1 in_seq=0 out_seq=0 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.492+0000 7f1556ffd640 10 client.15702 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1556ffd640 1 -- 172.21.15.73:0/2089186932 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563048adea20 con 0x563048b83860 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1556ffd640 10 client.15702 handle_command_reply: tid=0 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 client.15702 shutdown 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 -- 172.21.15.73:0/2089186932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 msgr2=0x563048b7f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048b7f150 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1570035000 tx=0x7f157002a8c0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 -- 172.21.15.73:0/2089186932 shutdown_connections 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563048b83860 0x563048b85cb0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048b7f150 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6e2e0 0x563048b78110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 --2- 172.21.15.73:0/2089186932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6d9a0 0x563048b77bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1556ffd640 0 client.15702 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 -- 172.21.15.73:0/2089186932 >> 172.21.15.73:0/2089186932 conn(0x563048b69010 msgr2=0x563048b6a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 -- 172.21.15.73:0/2089186932 shutdown_connections 2024-09-05T13:00:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 1 -- 172.21.15.73:0/2089186932 wait complete. 2024-09-05T13:00:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.493+0000 7f1580fc8740 20 client.15702 trim_cache size 0 max 16384 2024-09-05T13:00:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1580fc8740 1 Processor -- start 2024-09-05T13:00:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1580fc8740 1 -- start start 2024-09-05T13:00:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 0x563048b6dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6e2e0 0x563048b7f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b73370 0x563048b77bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1580fc8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f15781ab840 con 0x563048b6e2e0 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1580fc8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15781a9050 con 0x563048b6d9a0 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1580fc8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15781a6ea0 con 0x563048b73370 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1576ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6e2e0 0x563048b7f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1576ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6e2e0 0x563048b7f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56800/0 (socket says 172.21.15.73:56800) 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1576ffd640 1 -- 172.21.15.73:0/742773892 learned_addr learned my addr 172.21.15.73:0/742773892 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.507+0000 7f1577fff640 1 --2- 172.21.15.73:0/742773892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b73370 0x563048b77bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f15777fe640 1 --2- 172.21.15.73:0/742773892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 0x563048b6dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f1576ffd640 1 -- 172.21.15.73:0/742773892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b73370 msgr2=0x563048b77bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f1576ffd640 1 --2- 172.21.15.73:0/742773892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b73370 0x563048b77bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f1576ffd640 1 -- 172.21.15.73:0/742773892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 msgr2=0x563048b6dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f1576ffd640 1 --2- 172.21.15.73:0/742773892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 0x563048b6dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f1576ffd640 1 -- 172.21.15.73:0/742773892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563048b69ca0 con 0x563048b6e2e0 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f15777fe640 1 --2- 172.21.15.73:0/742773892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 0x563048b6dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f1576ffd640 1 --2- 172.21.15.73:0/742773892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6e2e0 0x563048b7f110 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f156c00bbc0 tx=0x7f156c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3c0b9b974ead5c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f155d7fa640 1 -- 172.21.15.73:0/742773892 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c02b070 con 0x563048b6e2e0 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f155d7fa640 1 -- 172.21.15.73:0/742773892 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f156c005520 con 0x563048b6e2e0 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f155d7fa640 1 -- 172.21.15.73:0/742773892 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c0116a0 con 0x563048b6e2e0 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f1580fc8740 1 -- 172.21.15.73:0/742773892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6e2e0 msgr2=0x563048b7f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.508+0000 7f1580fc8740 1 --2- 172.21.15.73:0/742773892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6e2e0 0x563048b7f110 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f156c00bbc0 tx=0x7f156c00b900 comp rx=0 tx=0).stop 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 -- 172.21.15.73:0/742773892 shutdown_connections 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 --2- 172.21.15.73:0/742773892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b73370 0x563048b77bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 --2- 172.21.15.73:0/742773892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b6e2e0 0x563048b7f110 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 --2- 172.21.15.73:0/742773892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 0x563048b6dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 -- 172.21.15.73:0/742773892 >> 172.21.15.73:0/742773892 conn(0x563048b69010 msgr2=0x563048b6f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 -- 172.21.15.73:0/742773892 shutdown_connections 2024-09-05T13:00:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 -- 172.21.15.73:0/742773892 wait complete. 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 -- start start 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 Processor -- start 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 0x563048b7c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b7c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048bec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f15781a7510 con 0x563048b73370 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15781a8980 con 0x563048b6d9a0 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15781a7be0 con 0x563048b6e2e0 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1580fc8740 10 client.0 _ll_register_callbacks cb 0x7f1570009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1577fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048bec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1576ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b7c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1577fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048bec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56810/0 (socket says 172.21.15.73:56810) 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f1577fff640 1 -- 172.21.15.73:0/3015591679 learned_addr learned my addr 172.21.15.73:0/3015591679 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.509+0000 7f15777fe640 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 0x563048b7c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1576ffd640 1 -- 172.21.15.73:0/3015591679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 msgr2=0x563048b7c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1576ffd640 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 0x563048b7c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1576ffd640 1 -- 172.21.15.73:0/3015591679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 msgr2=0x563048bec580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1576ffd640 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048bec580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1576ffd640 1 -- 172.21.15.73:0/3015591679 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563048becac0 con 0x563048b6e2e0 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1577fff640 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048bec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1576ffd640 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b7c540 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f156c005940 tx=0x7f156c003da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eb25ec1260ed6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1556ffd640 1 -- 172.21.15.73:0/3015591679 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c02b040 con 0x563048b6e2e0 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1580fc8740 1 -- 172.21.15.73:0/3015591679 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f156c005520 con 0x563048b6e2e0 2024-09-05T13:00:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1556ffd640 1 -- 172.21.15.73:0/3015591679 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f156c0052b0 con 0x563048b6e2e0 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1556ffd640 1 -- 172.21.15.73:0/3015591679 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f156c011440 con 0x563048b6e2e0 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1580fc8740 10 client.25294 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1580fc8740 1 -- 172.21.15.73:0/3015591679 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563048bedd80 con 0x563048b6e2e0 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.510+0000 7f1556ffd640 1 -- 172.21.15.73:0/3015591679 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f156c005520 con 0x563048b6e2e0 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.511+0000 7f1556ffd640 1 -- 172.21.15.73:0/3015591679 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f156c02e070 con 0x563048b6e2e0 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.511+0000 7f1580fc8740 10 client.25294 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.511+0000 7f1580fc8740 10 client.25294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.511+0000 7f1580fc8740 20 client.25294 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.511+0000 7f1580fc8740 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563048bee4e0 0x563048bf0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.511+0000 7f1580fc8740 4 client.25294 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:00:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.511+0000 7f1580fc8740 1 -- 172.21.15.73:0/3015591679 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563048ad8d70 con 0x563048bee4e0 2024-09-05T13:00:19.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:19 smithi073 ceph-mon[30883]: pgmap v408: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-05T13:00:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.511+0000 7f15777fe640 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563048bee4e0 0x563048bf0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.511+0000 7f1556ffd640 10 client.25294 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.511+0000 7f15777fe640 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563048bee4e0 0x563048bf0900 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=750e93d2cbdd744f server_cookie=a5467348d35e232d in_seq=0 out_seq=0 2024-09-05T13:00:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.528+0000 7f1556ffd640 1 -- 172.21.15.73:0/3015591679 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563048ad8d70 con 0x563048bee4e0 2024-09-05T13:00:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.528+0000 7f1556ffd640 10 client.25294 handle_command_reply: tid=0 2024-09-05T13:00:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.528+0000 7f1580fc8740 1 client.25294 shutdown 2024-09-05T13:00:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.528+0000 7f1580fc8740 1 -- 172.21.15.73:0/3015591679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 msgr2=0x563048b7c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.528+0000 7f1580fc8740 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b7c540 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f156c005940 tx=0x7f156c003da0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.528+0000 7f1580fc8740 1 -- 172.21.15.73:0/3015591679 shutdown_connections 2024-09-05T13:00:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.529+0000 7f1580fc8740 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563048bee4e0 0x563048bf0900 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.529+0000 7f1556ffd640 0 client.25294 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.529+0000 7f1580fc8740 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563048b73370 0x563048bec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.529+0000 7f1580fc8740 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563048b6e2e0 0x563048b7c540 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.529+0000 7f1580fc8740 1 --2- 172.21.15.73:0/3015591679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563048b6d9a0 0x563048b7c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.529+0000 7f1580fc8740 1 -- 172.21.15.73:0/3015591679 >> 172.21.15.73:0/3015591679 conn(0x563048b69010 msgr2=0x563048b72600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.529+0000 7f1580fc8740 1 -- 172.21.15.73:0/3015591679 shutdown_connections 2024-09-05T13:00:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.529+0000 7f1580fc8740 1 -- 172.21.15.73:0/3015591679 wait complete. 2024-09-05T13:00:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.530+0000 7f1580fc8740 20 client.25294 trim_cache size 0 max 16384 2024-09-05T13:00:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:00:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:00:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:00:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.530+0000 7f157e230640 1 -- 172.21.15.73:0/2118719045 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15600a2cb0 msgr2=0x7f15600a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.530+0000 7f157e230640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15600a2cb0 0x7f15600a5170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1570005e30 tx=0x7f15700095c0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.530+0000 7f157e230640 1 -- 172.21.15.73:0/2118719045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1578100a50 msgr2=0x7f157806ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.530+0000 7f157e230640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1578100a50 0x7f157806ac50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f156800d950 tx=0x7f156800de10 comp rx=0 tx=0).stop 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.530+0000 7f157e230640 1 -- 172.21.15.73:0/2118719045 shutdown_connections 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.530+0000 7f157e230640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f15600a2cb0 0x7f15600a5170 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.531+0000 7f157e230640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1578102600 0x7f157819f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.531+0000 7f157e230640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1578101c40 0x7f157819cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.531+0000 7f157e230640 1 --2- 172.21.15.73:0/2118719045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1578100a50 0x7f157806ac50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.531+0000 7f157e230640 1 -- 172.21.15.73:0/2118719045 >> 172.21.15.73:0/2118719045 conn(0x7f15780fc1b0 msgr2=0x7f1578104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.531+0000 7f157e230640 1 -- 172.21.15.73:0/2118719045 shutdown_connections 2024-09-05T13:00:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:19.531+0000 7f157e230640 1 -- 172.21.15.73:0/2118719045 wait complete. 2024-09-05T13:00:19.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:19 smithi162 ceph-mon[34220]: pgmap v408: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-05T13:00:19.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:19 smithi169 ceph-mon[34823]: pgmap v408: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2024-09-05T13:00:21.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:21 smithi073 ceph-mon[30883]: pgmap v409: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.75k op/s 2024-09-05T13:00:21.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:21 smithi162 ceph-mon[34220]: pgmap v409: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.75k op/s 2024-09-05T13:00:21.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:21 smithi169 ceph-mon[34823]: pgmap v409: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.75k op/s 2024-09-05T13:00:23.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:23 smithi073 ceph-mon[30883]: pgmap v410: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.05k op/s 2024-09-05T13:00:23.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:23 smithi162 ceph-mon[34220]: pgmap v410: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.05k op/s 2024-09-05T13:00:23.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:23 smithi169 ceph-mon[34823]: pgmap v410: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.05k op/s 2024-09-05T13:00:25.406 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:25 smithi162 ceph-mon[34220]: pgmap v411: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.07k op/s 2024-09-05T13:00:25.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:25 smithi073 ceph-mon[30883]: pgmap v411: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.07k op/s 2024-09-05T13:00:25.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:25 smithi169 ceph-mon[34823]: pgmap v411: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.07k op/s 2024-09-05T13:00:26.722 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T13:00:26.723 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T13:00:27.330 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:00:27.461 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:27 smithi073 ceph-mon[30883]: pgmap v412: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 5.07k op/s 2024-09-05T13:00:27.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:27 smithi162 ceph-mon[34220]: pgmap v412: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 5.07k op/s 2024-09-05T13:00:27.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:27 smithi169 ceph-mon[34823]: pgmap v412: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 5.07k op/s 2024-09-05T13:00:29.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:29 smithi073 ceph-mon[30883]: pgmap v413: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 4.80k op/s 2024-09-05T13:00:29.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:29 smithi162 ceph-mon[34220]: pgmap v413: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 4.80k op/s 2024-09-05T13:00:29.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:29 smithi169 ceph-mon[34823]: pgmap v413: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 4.80k op/s 2024-09-05T13:00:30.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:30 smithi073 ceph-mon[30883]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 3.73k op/s 2024-09-05T13:00:30.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:30 smithi162 ceph-mon[34220]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 3.73k op/s 2024-09-05T13:00:30.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:30 smithi169 ceph-mon[34823]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 3.73k op/s 2024-09-05T13:00:31.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:31 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:00:31.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:31 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:31.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:31 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:00:31.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:31 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:31.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:31 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:00:31.763 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:31 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:32.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.054+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/3695795745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7ec102790 msgr2=0x7fe7ec1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:32.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.054+0000 7fe7f2ae0640 1 --2- 172.21.15.73:0/3695795745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7ec102790 0x7fe7ec1067e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009ca0 tx=0x7fe7dc02a8c0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.054+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/3695795745 shutdown_connections 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.054+0000 7fe7f2ae0640 1 --2- 172.21.15.73:0/3695795745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec106f10 0x7fe7ec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.054+0000 7fe7f2ae0640 1 --2- 172.21.15.73:0/3695795745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7ec102790 0x7fe7ec1067e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.054+0000 7fe7f2ae0640 1 --2- 172.21.15.73:0/3695795745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ec101de0 0x7fe7ec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.054+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/3695795745 >> 172.21.15.73:0/3695795745 conn(0x7fe7ec0fd8c0 msgr2=0x7fe7ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.054+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/3695795745 shutdown_connections 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.054+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/3695795745 wait complete. 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f2ae0640 1 Processor -- start 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f2ae0640 1 -- start start 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f2ae0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ec101de0 0x7fe7ec198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f2ae0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec102790 0x7fe7ec198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f2ae0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7ec106f10 0x7fe7ec19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f2ae0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec111fb0 con 0x7fe7ec106f10 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f2ae0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec111e30 con 0x7fe7ec101de0 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f2ae0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec112130 con 0x7fe7ec102790 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f107d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7ec106f10 0x7fe7ec19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f107d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7ec106f10 0x7fe7ec19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53486/0 (socket says 172.21.15.73:53486) 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f107d640 1 -- 172.21.15.73:0/2339218189 learned_addr learned my addr 172.21.15.73:0/2339218189 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec102790 0x7fe7ec198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.055+0000 7fe7f087c640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ec101de0 0x7fe7ec198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7f107d640 1 -- 172.21.15.73:0/2339218189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec102790 msgr2=0x7fe7ec198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7f107d640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec102790 0x7fe7ec198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7f107d640 1 -- 172.21.15.73:0/2339218189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ec101de0 msgr2=0x7fe7ec198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:32.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7f107d640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ec101de0 0x7fe7ec198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7f107d640 1 -- 172.21.15.73:0/2339218189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec19d4d0 con 0x7fe7ec106f10 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7f087c640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ec101de0 0x7fe7ec198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7f107d640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7ec106f10 0x7fe7ec19cdf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400c970 tx=0x7fe7d400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7e9ffb640 1 -- 172.21.15.73:0/2339218189 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4007bb0 con 0x7fe7ec106f10 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7e9ffb640 1 -- 172.21.15.73:0/2339218189 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7d4007d50 con 0x7fe7ec106f10 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/2339218189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ec19d7c0 con 0x7fe7ec106f10 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7e9ffb640 1 -- 172.21.15.73:0/2339218189 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400f450 con 0x7fe7ec106f10 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.056+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/2339218189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ec1a50a0 con 0x7fe7ec106f10 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.059+0000 7fe7e9ffb640 1 -- 172.21.15.73:0/2339218189 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe7d4004f20 con 0x7fe7ec106f10 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.059+0000 7fe7f4eb6740 1 Processor -- start 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.059+0000 7fe7f4eb6740 1 -- start start 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.059+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca0662e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 0x55cca0671c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca0674540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cca05c8280 con 0x55cca0672150 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cca056fb10 con 0x55cca0663340 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cca05c4240 con 0x55cca0662a20 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7e9ffb640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7d80a2b80 0x7fe7d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7ebfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca0674540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7ebfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca0674540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53498/0 (socket says 172.21.15.73:53498) 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7ebfff640 1 -- 172.21.15.73:0/3949831586 learned_addr learned my addr 172.21.15.73:0/3949831586 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7f107d640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7d80a2b80 0x7fe7d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7f087c640 1 --2- 172.21.15.73:0/3949831586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 0x55cca0671c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3949831586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca0662e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7e9ffb640 1 -- 172.21.15.73:0/2339218189 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fe7d40ced90 con 0x7fe7ec106f10 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7ebfff640 1 -- 172.21.15.73:0/3949831586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 msgr2=0x55cca0662e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3949831586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca0662e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7ebfff640 1 -- 172.21.15.73:0/3949831586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 msgr2=0x55cca0671c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3949831586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 0x55cca0671c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7ebfff640 1 -- 172.21.15.73:0/3949831586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca057c1f0 con 0x55cca0672150 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7f087c640 1 --2- 172.21.15.73:0/3949831586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 0x55cca0671c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7f107d640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7d80a2b80 0x7fe7d80a5040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400c940 tx=0x7fe7d4004940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3949831586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca0674540 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009430 tx=0x7fe7dc005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0158e77ee59a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7e2ffd640 1 -- 172.21.15.73:0/3949831586 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc004b40 con 0x55cca0672150 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7e2ffd640 1 -- 172.21.15.73:0/3949831586 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7dc036040 con 0x55cca0672150 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.060+0000 7fe7e2ffd640 1 -- 172.21.15.73:0/3949831586 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0319a0 con 0x55cca0672150 2024-09-05T13:00:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.061+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3949831586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 msgr2=0x55cca0674540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.061+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3949831586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca0674540 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009430 tx=0x7fe7dc005c30 comp rx=0 tx=0).stop 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.061+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3949831586 shutdown_connections 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.061+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3949831586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca0674540 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.061+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3949831586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 0x55cca0671c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.061+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3949831586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca0662e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.061+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3949831586 >> 172.21.15.73:0/3949831586 conn(0x55cca065f0f0 msgr2=0x55cca065f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.061+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3949831586 shutdown_connections 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.061+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3949831586 wait complete. 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f4eb6740 1 -- start start 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f4eb6740 1 Processor -- start 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca066f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca066f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0672150 0x55cca066fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cca0674b70 con 0x55cca0663340 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cca0582f10 con 0x55cca0672150 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cca0674cf0 con 0x55cca0662a20 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f4eb6740 10 client.0 _ll_register_callbacks cb 0x55cca054ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f087c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca066f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f087c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca066f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53514/0 (socket says 172.21.15.73:53514) 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7f087c640 1 -- 172.21.15.73:0/237955181 learned_addr learned my addr 172.21.15.73:0/237955181 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0672150 0x55cca066fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.062+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca066f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7f087c640 1 -- 172.21.15.73:0/237955181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 msgr2=0x55cca066f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7f087c640 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca066f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7f087c640 1 -- 172.21.15.73:0/237955181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0672150 msgr2=0x55cca066fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7f087c640 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0672150 0x55cca066fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7f087c640 1 -- 172.21.15.73:0/237955181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca03396a0 con 0x55cca0663340 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7f087c640 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca066f610 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400d4a0 tx=0x7fe7e400d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88892e90aa7dbedd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7cbfff640 1 -- 172.21.15.73:0/237955181 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e401c060 con 0x55cca0663340 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7cbfff640 1 -- 172.21.15.73:0/237955181 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fe7e40146f0 con 0x55cca0663340 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/237955181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7dc036040 con 0x55cca0663340 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7cbfff640 1 -- 172.21.15.73:0/237955181 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe7e40148f0 con 0x55cca0663340 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7f4eb6740 10 client.15720 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/237955181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cca06808c0 con 0x55cca0663340 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7cbfff640 1 -- 172.21.15.73:0/237955181 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7dc036040 con 0x55cca0663340 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7cbfff640 1 -- 172.21.15.73:0/237955181 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fe7e4022bc0 con 0x55cca0663340 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.063+0000 7fe7f4eb6740 10 client.15720 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.064+0000 7fe7f4eb6740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:32.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.064+0000 7fe7f4eb6740 20 client.15720 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.064+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cca0681e70 0x55cca0684290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.064+0000 7fe7f4eb6740 4 client.15720 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.064+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/237955181 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cca05d57f0 con 0x55cca0681e70 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.064+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cca0681e70 0x55cca0684290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.064+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cca0681e70 0x55cca0684290 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=526965c5418cd6b9 server_cookie=46c0a23806b2db5c in_seq=0 out_seq=0 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.064+0000 7fe7cbfff640 10 client.15720 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7cbfff640 1 -- 172.21.15.73:0/237955181 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cca05d57f0 con 0x55cca0681e70 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7cbfff640 10 client.15720 handle_command_reply: tid=0 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 client.15720 shutdown 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/237955181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 msgr2=0x55cca066f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca066f610 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400d4a0 tx=0x7fe7e400d960 comp rx=0 tx=0).stop 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/237955181 shutdown_connections 2024-09-05T13:00:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cca0681e70 0x55cca0684290 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0672150 0x55cca066fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca066f610 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/237955181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca066f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7cbfff640 0 client.15720 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/237955181 >> 172.21.15.73:0/237955181 conn(0x55cca065f0f0 msgr2=0x55cca065e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/237955181 shutdown_connections 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/237955181 wait complete. 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.065+0000 7fe7f4eb6740 20 client.15720 trim_cache size 0 max 16384 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.082+0000 7fe7f4eb6740 1 Processor -- start 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.082+0000 7fe7f4eb6740 1 -- start start 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.082+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca066f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.082+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 0x55cca0689b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca068a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec1adbf0 con 0x55cca0672150 2024-09-05T13:00:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec1ab400 con 0x55cca0663340 2024-09-05T13:00:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec1a9250 con 0x55cca0662a20 2024-09-05T13:00:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7ebfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca068a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7ebfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca068a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53522/0 (socket says 172.21.15.73:53522) 2024-09-05T13:00:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7ebfff640 1 -- 172.21.15.73:0/3117882402 learned_addr learned my addr 172.21.15.73:0/3117882402 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7f087c640 1 --2- 172.21.15.73:0/3117882402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 0x55cca0689b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3117882402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca066f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7ebfff640 1 -- 172.21.15.73:0/3117882402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 msgr2=0x55cca066f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3117882402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca066f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7ebfff640 1 -- 172.21.15.73:0/3117882402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 msgr2=0x55cca0689b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3117882402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 0x55cca0689b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7ebfff640 1 -- 172.21.15.73:0/3117882402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca06719a0 con 0x55cca0672150 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3117882402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca068a0a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x55cca06640c0 tx=0x7fe7dc042040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bbdee9b361a0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7e27fc640 1 -- 172.21.15.73:0/3117882402 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc004d40 con 0x55cca0672150 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7e27fc640 1 -- 172.21.15.73:0/3117882402 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7dc036030 con 0x55cca0672150 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.083+0000 7fe7e27fc640 1 -- 172.21.15.73:0/3117882402 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc030940 con 0x55cca0672150 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3117882402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 msgr2=0x55cca068a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3117882402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca068a0a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x55cca06640c0 tx=0x7fe7dc042040 comp rx=0 tx=0).stop 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3117882402 shutdown_connections 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3117882402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0672150 0x55cca068a0a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3117882402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0663340 0x55cca0689b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3117882402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0662a20 0x55cca066f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3117882402 >> 172.21.15.73:0/3117882402 conn(0x55cca065f0f0 msgr2=0x55cca0671040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3117882402 shutdown_connections 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3117882402 wait complete. 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 -- start start 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.084+0000 7fe7f4eb6740 1 Processor -- start 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0662a20 0x55cca06763b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca06768f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f4eb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0672150 0x55cca06ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec1a98c0 con 0x55cca0663340 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec1aad30 con 0x55cca0662a20 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f4eb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec1a9f90 con 0x55cca0672150 2024-09-05T13:00:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f4eb6740 10 client.0 _ll_register_callbacks cb 0x7fe7e4007500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f087c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca06768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f087c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca06768f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53536/0 (socket says 172.21.15.73:53536) 2024-09-05T13:00:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0672150 0x55cca06ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f087c640 1 -- 172.21.15.73:0/3425997225 learned_addr learned my addr 172.21.15.73:0/3425997225 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0662a20 0x55cca06763b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f087c640 1 -- 172.21.15.73:0/3425997225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0672150 msgr2=0x55cca06ebb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f087c640 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0672150 0x55cca06ebb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f087c640 1 -- 172.21.15.73:0/3425997225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0662a20 msgr2=0x55cca06763b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f087c640 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0662a20 0x55cca06763b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.085+0000 7fe7f087c640 1 -- 172.21.15.73:0/3425997225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca06ec070 con 0x55cca0663340 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7f087c640 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca06768f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4023020 tx=0x7fe7e4007280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36afeeded617e4db server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7cbfff640 1 -- 172.21.15.73:0/3425997225 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4031060 con 0x55cca0663340 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3425997225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7dc036030 con 0x55cca0663340 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7cbfff640 1 -- 172.21.15.73:0/3425997225 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fe7e4014c90 con 0x55cca0663340 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7cbfff640 1 -- 172.21.15.73:0/3425997225 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe7e400de60 con 0x55cca0663340 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7f4eb6740 10 client.15726 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3425997225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cca06ed330 con 0x55cca0663340 2024-09-05T13:00:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7cbfff640 1 -- 172.21.15.73:0/3425997225 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7dc036030 con 0x55cca0663340 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7cbfff640 1 -- 172.21.15.73:0/3425997225 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fe7e4017480 con 0x55cca0663340 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7f4eb6740 10 client.15726 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7f4eb6740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7f4eb6740 20 client.15726 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cca06edae0 0x55cca06eff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7f4eb6740 4 client.15726 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.086+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3425997225 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cca05cfd00 con 0x55cca06edae0 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.087+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cca06edae0 0x55cca06eff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.087+0000 7fe7cbfff640 10 client.15726 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.087+0000 7fe7ebfff640 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cca06edae0 0x55cca06eff00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90bd11c916c35f1c server_cookie=13347bc7e883752a in_seq=0 out_seq=0 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.087+0000 7fe7cbfff640 1 -- 172.21.15.73:0/3425997225 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cca05cfd00 con 0x55cca06edae0 2024-09-05T13:00:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.087+0000 7fe7cbfff640 10 client.15726 handle_command_reply: tid=0 2024-09-05T13:00:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.087+0000 7fe7f4eb6740 1 client.15726 shutdown 2024-09-05T13:00:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3425997225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 msgr2=0x55cca06768f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca06768f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4023020 tx=0x7fe7e4007280 comp rx=0 tx=0).stop 2024-09-05T13:00:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3425997225 shutdown_connections 2024-09-05T13:00:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55cca06edae0 0x55cca06eff00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca0672150 0x55cca06ebb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cca0663340 0x55cca06768f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7cbfff640 0 client.15726 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 1 --2- 172.21.15.73:0/3425997225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca0662a20 0x55cca06763b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3425997225 >> 172.21.15.73:0/3425997225 conn(0x55cca065f0f0 msgr2=0x55cca065da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:32.094 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:00:32.094 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2024-09-05T13:00:32.094 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "5c476cdb-c78e-4495-a2fb-e9be80e84297", 2024-09-05T13:00:32.094 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2024-09-05T13:00:32.094 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:00:32.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3425997225 shutdown_connections 2024-09-05T13:00:32.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 1 -- 172.21.15.73:0/3425997225 wait complete. 2024-09-05T13:00:32.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.088+0000 7fe7f4eb6740 20 client.15726 trim_cache size 0 max 16384 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/2339218189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7d80a2b80 msgr2=0x7fe7d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7d80a2b80 0x7fe7d80a5040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400c940 tx=0x7fe7d4004940 comp rx=0 tx=0).stop 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/2339218189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7ec106f10 msgr2=0x7fe7ec19cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7ec106f10 0x7fe7ec19cdf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400c970 tx=0x7fe7d400ce30 comp rx=0 tx=0).stop 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/2339218189 shutdown_connections 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe7d80a2b80 0x7fe7d80a5040 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7ec106f10 0x7fe7ec19cdf0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec102790 0x7fe7ec198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 --2- 172.21.15.73:0/2339218189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ec101de0 0x7fe7ec198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/2339218189 >> 172.21.15.73:0/2339218189 conn(0x7fe7ec0fd8c0 msgr2=0x7fe7ec0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/2339218189 shutdown_connections 2024-09-05T13:00:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:31.089+0000 7fe7f2ae0640 1 -- 172.21.15.73:0/2339218189 wait complete. 2024-09-05T13:00:32.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:32 smithi073 ceph-mon[30883]: scrub queued for path: / 2024-09-05T13:00:32.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:32 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:32.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:32 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:00:32.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:32 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:00:32.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:32 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:32.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:32 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:32.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:32 smithi073 ceph-mon[30883]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 3.74k op/s 2024-09-05T13:00:32.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:32 smithi162 ceph-mon[34220]: scrub queued for path: / 2024-09-05T13:00:32.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:32 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:32.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:32 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:00:32.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:32 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:00:32.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:32 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:32.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:32 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:32.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:32 smithi162 ceph-mon[34220]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 3.74k op/s 2024-09-05T13:00:32.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:32 smithi169 ceph-mon[34823]: scrub queued for path: / 2024-09-05T13:00:32.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:32 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:32.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:32 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:00:32.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:32 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:00:32.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:32 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:32.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:32 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:00:32.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:32 smithi169 ceph-mon[34823]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 3.74k op/s 2024-09-05T13:00:33.063 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.062+0000 7fab638f4640 1 -- 172.21.15.73:0/1659819076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab5c1025f0 msgr2=0x7fab5c108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.062+0000 7fab638f4640 1 --2- 172.21.15.73:0/1659819076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab5c1025f0 0x7fab5c108e80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab54009ca0 tx=0x7fab5402a8b0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.063+0000 7fab638f4640 1 -- 172.21.15.73:0/1659819076 shutdown_connections 2024-09-05T13:00:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.063+0000 7fab638f4640 1 --2- 172.21.15.73:0/1659819076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab5c1025f0 0x7fab5c108e80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.063+0000 7fab638f4640 1 --2- 172.21.15.73:0/1659819076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c101c30 0x7fab5c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.063+0000 7fab638f4640 1 --2- 172.21.15.73:0/1659819076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab5c100a40 0x7fab5c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.063+0000 7fab638f4640 1 -- 172.21.15.73:0/1659819076 >> 172.21.15.73:0/1659819076 conn(0x7fab5c0fc1e0 msgr2=0x7fab5c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.063+0000 7fab638f4640 1 -- 172.21.15.73:0/1659819076 shutdown_connections 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.063+0000 7fab638f4640 1 -- 172.21.15.73:0/1659819076 wait complete. 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab638f4640 1 Processor -- start 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab638f4640 1 -- start start 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab638f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c100a40 0x7fab5c071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab638f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab5c101c30 0x7fab5c072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab638f4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab5c1025f0 0x7fab5c0730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab638f4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c06c330 con 0x7fab5c100a40 2024-09-05T13:00:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab638f4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c06c1b0 con 0x7fab5c101c30 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab638f4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c06c4b0 con 0x7fab5c1025f0 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab61690640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c100a40 0x7fab5c071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab61690640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c100a40 0x7fab5c071b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53550/0 (socket says 172.21.15.73:53550) 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab61e91640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab5c1025f0 0x7fab5c0730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab61690640 1 -- 172.21.15.73:0/2470441829 learned_addr learned my addr 172.21.15.73:0/2470441829 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.064+0000 7fab60e8f640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab5c101c30 0x7fab5c072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.065+0000 7fab61690640 1 -- 172.21.15.73:0/2470441829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab5c1025f0 msgr2=0x7fab5c0730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.065+0000 7fab61690640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab5c1025f0 0x7fab5c0730c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.065+0000 7fab61690640 1 -- 172.21.15.73:0/2470441829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab5c101c30 msgr2=0x7fab5c072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.065+0000 7fab61690640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab5c101c30 0x7fab5c072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.065+0000 7fab61690640 1 -- 172.21.15.73:0/2470441829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c073730 con 0x7fab5c100a40 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.065+0000 7fab61e91640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab5c1025f0 0x7fab5c0730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.065+0000 7fab60e8f640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab5c101c30 0x7fab5c072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:33.070 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.065+0000 7fab61690640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c100a40 0x7fab5c071b40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fab5800a8d0 tx=0x7fab5800ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:33.070 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.066+0000 7fab527fc640 1 -- 172.21.15.73:0/2470441829 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58004020 con 0x7fab5c100a40 2024-09-05T13:00:33.070 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.066+0000 7fab638f4640 1 -- 172.21.15.73:0/2470441829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5c073a20 con 0x7fab5c100a40 2024-09-05T13:00:33.070 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.066+0000 7fab527fc640 1 -- 172.21.15.73:0/2470441829 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab580041c0 con 0x7fab5c100a40 2024-09-05T13:00:33.070 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.066+0000 7fab638f4640 1 -- 172.21.15.73:0/2470441829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab5c073f70 con 0x7fab5c100a40 2024-09-05T13:00:33.070 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.066+0000 7fab527fc640 1 -- 172.21.15.73:0/2470441829 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58004020 con 0x7fab5c100a40 2024-09-05T13:00:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.070+0000 7fab527fc640 1 -- 172.21.15.73:0/2470441829 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fab58003b40 con 0x7fab5c100a40 2024-09-05T13:00:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.071+0000 7fab527fc640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fab480a2ec0 0x7fab480a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.071+0000 7fab527fc640 1 -- 172.21.15.73:0/2470441829 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fab580cf0a0 con 0x7fab5c100a40 2024-09-05T13:00:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.071+0000 7fab60e8f640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fab480a2ec0 0x7fab480a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.110+0000 7fab60e8f640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fab480a2ec0 0x7fab480a5380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fab5c073050 tx=0x7fab4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab66689740 1 Processor -- start 2024-09-05T13:00:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab66689740 1 -- start start 2024-09-05T13:00:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab66689740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 0x557f23aefda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab66689740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23af4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab66689740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af5370 0x557f23af7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab66689740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557f23a532f0 con 0x557f23af5370 2024-09-05T13:00:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab66689740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557f239fb270 con 0x557f23af02e0 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab61690640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 0x557f23aefda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab61690640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 0x557f23aefda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:42038/0 (socket says 172.21.15.73:42038) 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab61690640 1 -- 172.21.15.73:0/3229611029 learned_addr learned my addr 172.21.15.73:0/3229611029 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.112+0000 7fab66689740 1 -- 172.21.15.73:0/3229611029 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557f23a4f2b0 con 0x557f23aef9a0 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.113+0000 7fab60e8f640 1 --2- 172.21.15.73:0/3229611029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23af4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.113+0000 7fab61e91640 1 --2- 172.21.15.73:0/3229611029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af5370 0x557f23af7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.113+0000 7fab60e8f640 1 -- 172.21.15.73:0/3229611029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 msgr2=0x557f23aefda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.113+0000 7fab60e8f640 1 --2- 172.21.15.73:0/3229611029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 0x557f23aefda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.113+0000 7fab60e8f640 1 -- 172.21.15.73:0/3229611029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af5370 msgr2=0x557f23af7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.113+0000 7fab60e8f640 1 --2- 172.21.15.73:0/3229611029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af5370 0x557f23af7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.113+0000 7fab60e8f640 1 -- 172.21.15.73:0/3229611029 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f239fa340 con 0x557f23af02e0 2024-09-05T13:00:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.113+0000 7fab60e8f640 1 --2- 172.21.15.73:0/3229611029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23af4da0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0041e0 tx=0x7fab4c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23cae5e22c49c157 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.114+0000 7fab477fe640 1 -- 172.21.15.73:0/3229611029 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00f480 con 0x557f23af02e0 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.114+0000 7fab477fe640 1 -- 172.21.15.73:0/3229611029 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab4c00fb00 con 0x557f23af02e0 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.114+0000 7fab477fe640 1 -- 172.21.15.73:0/3229611029 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c01cad0 con 0x557f23af02e0 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.115+0000 7fab66689740 1 -- 172.21.15.73:0/3229611029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 msgr2=0x557f23af4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.115+0000 7fab66689740 1 --2- 172.21.15.73:0/3229611029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23af4da0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0041e0 tx=0x7fab4c014000 comp rx=0 tx=0).stop 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.115+0000 7fab66689740 1 -- 172.21.15.73:0/3229611029 shutdown_connections 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.115+0000 7fab66689740 1 --2- 172.21.15.73:0/3229611029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af5370 0x557f23af7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.115+0000 7fab66689740 1 --2- 172.21.15.73:0/3229611029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23af4da0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.115+0000 7fab66689740 1 --2- 172.21.15.73:0/3229611029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 0x557f23aefda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.115+0000 7fab66689740 1 -- 172.21.15.73:0/3229611029 >> 172.21.15.73:0/3229611029 conn(0x557f23aeb010 msgr2=0x557f23aeb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.115+0000 7fab66689740 1 -- 172.21.15.73:0/3229611029 shutdown_connections 2024-09-05T13:00:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.115+0000 7fab66689740 1 -- 172.21.15.73:0/3229611029 wait complete. 2024-09-05T13:00:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.116+0000 7fab66689740 1 -- start start 2024-09-05T13:00:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.116+0000 7fab66689740 1 Processor -- start 2024-09-05T13:00:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.116+0000 7fab66689740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23b02460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.116+0000 7fab66689740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 0x557f23b029a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab66689740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 0x557f23b09970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab66689740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557f23af8340 con 0x557f23af02e0 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab66689740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557f239dc290 con 0x557f23aef9a0 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab66689740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557f23af84c0 con 0x557f23af5370 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab61690640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23b02460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab61690640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23b02460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:53258/0 (socket says 172.21.15.73:53258) 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab61690640 1 -- 172.21.15.73:0/4005834035 learned_addr learned my addr 172.21.15.73:0/4005834035 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab66689740 10 client.0 _ll_register_callbacks cb 0x557f23a0d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab61e91640 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 0x557f23b09970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab60e8f640 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 0x557f23b029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab61690640 1 -- 172.21.15.73:0/4005834035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 msgr2=0x557f23b09970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab61690640 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 0x557f23b09970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab61690640 1 -- 172.21.15.73:0/4005834035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 msgr2=0x557f23b029a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab61690640 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 0x557f23b029a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.117+0000 7fab61690640 1 -- 172.21.15.73:0/4005834035 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f23766210 con 0x557f23aef9a0 2024-09-05T13:00:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.118+0000 7fab61e91640 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 0x557f23b09970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.118+0000 7fab61690640 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23b02460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab580a4010 tx=0x7fab5809b3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb7edd629df87522 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.118+0000 7fab44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:00:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.118+0000 7fab44ff9640 1 -- 172.21.15.73:0/4005834035 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab580b4060 con 0x557f23aef9a0 2024-09-05T13:00:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.118+0000 7fab44ff9640 1 -- 172.21.15.73:0/4005834035 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fab580860c0 con 0x557f23aef9a0 2024-09-05T13:00:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.118+0000 7fab66689740 1 -- 172.21.15.73:0/4005834035 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab4c00fb00 con 0x557f23aef9a0 2024-09-05T13:00:33.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.118+0000 7fab44ff9640 1 -- 172.21.15.73:0/4005834035 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fab58003e30 con 0x557f23aef9a0 2024-09-05T13:00:33.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.118+0000 7fab66689740 10 client.25259 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:33.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.118+0000 7fab66689740 1 -- 172.21.15.73:0/4005834035 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557f23832620 con 0x557f23aef9a0 2024-09-05T13:00:33.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.119+0000 7fab44ff9640 1 -- 172.21.15.73:0/4005834035 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab580862c0 con 0x557f23aef9a0 2024-09-05T13:00:33.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.119+0000 7fab44ff9640 1 -- 172.21.15.73:0/4005834035 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fab5809ae60 con 0x557f23aef9a0 2024-09-05T13:00:33.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.119+0000 7fab66689740 10 client.25259 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:33.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.119+0000 7fab66689740 10 client.25259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:33.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.119+0000 7fab66689740 20 client.25259 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:33.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.119+0000 7fab66689740 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557f23b0e060 0x557f23b10450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.119+0000 7fab66689740 4 client.25259 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:00:33.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.119+0000 7fab66689740 1 -- 172.21.15.73:0/4005834035 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fab4c00fb00 con 0x557f23b0e060 2024-09-05T13:00:33.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.119+0000 7fab60e8f640 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557f23b0e060 0x557f23b10450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.120+0000 7fab60e8f640 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557f23b0e060 0x557f23b10450 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d6f344e29eb131a server_cookie=42bf06b10ba5cd3a in_seq=0 out_seq=0 2024-09-05T13:00:33.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.120+0000 7fab44ff9640 10 client.25259 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:33.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.121+0000 7fab44ff9640 1 -- 172.21.15.73:0/4005834035 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fab4c00fb00 con 0x557f23b0e060 2024-09-05T13:00:33.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.121+0000 7fab44ff9640 10 client.25259 handle_command_reply: tid=0 2024-09-05T13:00:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.122+0000 7fab66689740 1 client.25259 shutdown 2024-09-05T13:00:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.122+0000 7fab66689740 1 -- 172.21.15.73:0/4005834035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 msgr2=0x557f23b02460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.122+0000 7fab66689740 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23b02460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab580a4010 tx=0x7fab5809b3a0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.122+0000 7fab66689740 1 -- 172.21.15.73:0/4005834035 shutdown_connections 2024-09-05T13:00:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.122+0000 7fab66689740 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557f23b0e060 0x557f23b10450 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.123+0000 7fab66689740 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 0x557f23b09970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.123+0000 7fab44ff9640 0 client.25259 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.123+0000 7fab66689740 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 0x557f23b029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.123+0000 7fab66689740 1 --2- 172.21.15.73:0/4005834035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23b02460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.123+0000 7fab66689740 1 -- 172.21.15.73:0/4005834035 >> 172.21.15.73:0/4005834035 conn(0x557f23aeb010 msgr2=0x557f23aec820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.123+0000 7fab66689740 1 -- 172.21.15.73:0/4005834035 shutdown_connections 2024-09-05T13:00:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.123+0000 7fab66689740 1 -- 172.21.15.73:0/4005834035 wait complete. 2024-09-05T13:00:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.123+0000 7fab66689740 20 client.25259 trim_cache size 0 max 16384 2024-09-05T13:00:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.154+0000 7fab66689740 1 Processor -- start 2024-09-05T13:00:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.155+0000 7fab66689740 1 -- start start 2024-09-05T13:00:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.155+0000 7fab66689740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23aea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.155+0000 7fab66689740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 0x557f23b09930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.155+0000 7fab61690640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23aea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.155+0000 7fab66689740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 0x557f23aec400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.155+0000 7fab61690640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23aea0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:53260/0 (socket says 172.21.15.73:53260) 2024-09-05T13:00:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab66689740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1b1f20 con 0x557f23af02e0 2024-09-05T13:00:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab66689740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1af730 con 0x557f23aef9a0 2024-09-05T13:00:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab66689740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1ad580 con 0x557f23af5370 2024-09-05T13:00:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab60e8f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 0x557f23b09930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab60e8f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 0x557f23b09930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53580/0 (socket says 172.21.15.73:53580) 2024-09-05T13:00:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab60e8f640 1 -- 172.21.15.73:0/878726787 learned_addr learned my addr 172.21.15.73:0/878726787 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab61e91640 1 --2- 172.21.15.73:0/878726787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 0x557f23aec400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab60e8f640 1 -- 172.21.15.73:0/878726787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 msgr2=0x557f23aec400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab60e8f640 1 --2- 172.21.15.73:0/878726787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 0x557f23aec400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab60e8f640 1 -- 172.21.15.73:0/878726787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 msgr2=0x557f23aea0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab60e8f640 1 --2- 172.21.15.73:0/878726787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23aea0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.156+0000 7fab60e8f640 1 -- 172.21.15.73:0/878726787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f23b107c0 con 0x557f23af02e0 2024-09-05T13:00:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.157+0000 7fab60e8f640 1 --2- 172.21.15.73:0/878726787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 0x557f23b09930 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009730 tx=0x7fab4c0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7661dac84b746cc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.158+0000 7fab46ffd640 1 -- 172.21.15.73:0/878726787 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c034070 con 0x557f23af02e0 2024-09-05T13:00:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.158+0000 7fab46ffd640 1 -- 172.21.15.73:0/878726787 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab4c01c3f0 con 0x557f23af02e0 2024-09-05T13:00:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.158+0000 7fab46ffd640 1 -- 172.21.15.73:0/878726787 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00f6f0 con 0x557f23af02e0 2024-09-05T13:00:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.159+0000 7fab66689740 1 -- 172.21.15.73:0/878726787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 msgr2=0x557f23b09930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.159+0000 7fab66689740 1 --2- 172.21.15.73:0/878726787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 0x557f23b09930 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009730 tx=0x7fab4c0096c0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.159+0000 7fab66689740 1 -- 172.21.15.73:0/878726787 shutdown_connections 2024-09-05T13:00:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.159+0000 7fab66689740 1 --2- 172.21.15.73:0/878726787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23af5370 0x557f23aec400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.159+0000 7fab66689740 1 --2- 172.21.15.73:0/878726787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af02e0 0x557f23b09930 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.159+0000 7fab66689740 1 --2- 172.21.15.73:0/878726787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23aef9a0 0x557f23aea0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.159+0000 7fab66689740 1 -- 172.21.15.73:0/878726787 >> 172.21.15.73:0/878726787 conn(0x557f23aeb010 msgr2=0x557f23ae99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.159+0000 7fab66689740 1 -- 172.21.15.73:0/878726787 shutdown_connections 2024-09-05T13:00:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.159+0000 7fab66689740 1 -- 172.21.15.73:0/878726787 wait complete. 2024-09-05T13:00:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.160+0000 7fab66689740 1 -- start start 2024-09-05T13:00:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.160+0000 7fab66689740 1 Processor -- start 2024-09-05T13:00:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.160+0000 7fab66689740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 0x557f23b06720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.160+0000 7fab66689740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23b06c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab61690640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 0x557f23b06720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab61690640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 0x557f23b06720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:42056/0 (socket says 172.21.15.73:42056) 2024-09-05T13:00:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab66689740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af5370 0x557f23afc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab66689740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1adbf0 con 0x557f23af5370 2024-09-05T13:00:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab66689740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1af060 con 0x557f23af02e0 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab66689740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1ae2c0 con 0x557f23aef9a0 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab66689740 10 client.0 _ll_register_callbacks cb 0x7fab5809b4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab60e8f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23b06c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab60e8f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23b06c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:53272/0 (socket says 172.21.15.73:53272) 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab60e8f640 1 -- 172.21.15.73:0/455467186 learned_addr learned my addr 172.21.15.73:0/455467186 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab61e91640 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af5370 0x557f23afc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab60e8f640 1 -- 172.21.15.73:0/455467186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 msgr2=0x557f23b06720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab60e8f640 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 0x557f23b06720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab60e8f640 1 -- 172.21.15.73:0/455467186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af5370 msgr2=0x557f23afc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab60e8f640 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af5370 0x557f23afc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.161+0000 7fab60e8f640 1 -- 172.21.15.73:0/455467186 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f23afce70 con 0x557f23af02e0 2024-09-05T13:00:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.162+0000 7fab60e8f640 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23b06c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab4c003a80 tx=0x7fab4c003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8633918b2e9689e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.162+0000 7fab44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:00:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.162+0000 7fab44ff9640 1 -- 172.21.15.73:0/455467186 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c03f060 con 0x557f23af02e0 2024-09-05T13:00:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.162+0000 7fab44ff9640 1 -- 172.21.15.73:0/455467186 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fab4c00fdb0 con 0x557f23af02e0 2024-09-05T13:00:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.162+0000 7fab66689740 1 -- 172.21.15.73:0/455467186 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f23a60a20 con 0x557f23af02e0 2024-09-05T13:00:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.162+0000 7fab44ff9640 1 -- 172.21.15.73:0/455467186 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fab4c034070 con 0x557f23af02e0 2024-09-05T13:00:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.162+0000 7fab66689740 10 client.25265 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.162+0000 7fab66689740 1 -- 172.21.15.73:0/455467186 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557f23afe180 con 0x557f23af02e0 2024-09-05T13:00:33.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.163+0000 7fab44ff9640 1 -- 172.21.15.73:0/455467186 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557f23a60a20 con 0x557f23af02e0 2024-09-05T13:00:33.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.163+0000 7fab44ff9640 1 -- 172.21.15.73:0/455467186 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fab4c01a070 con 0x557f23af02e0 2024-09-05T13:00:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.163+0000 7fab66689740 10 client.25265 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.163+0000 7fab66689740 10 client.25265 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.163+0000 7fab66689740 20 client.25265 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.163+0000 7fab66689740 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557f23b0e060 0x557f23b006a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.163+0000 7fab66689740 4 client.25265 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:00:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.163+0000 7fab66689740 1 -- 172.21.15.73:0/455467186 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f23a5ad70 con 0x557f23b0e060 2024-09-05T13:00:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.163+0000 7fab61690640 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557f23b0e060 0x557f23b006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.164+0000 7fab61690640 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557f23b0e060 0x557f23b006a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9efc4fc511c38e37 server_cookie=c8d0fdf87e62f1cf in_seq=0 out_seq=0 2024-09-05T13:00:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.165+0000 7fab44ff9640 10 client.25265 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.196+0000 7fab44ff9640 1 -- 172.21.15.73:0/455467186 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f23a5ad70 con 0x557f23b0e060 2024-09-05T13:00:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.196+0000 7fab44ff9640 10 client.25265 handle_command_reply: tid=0 2024-09-05T13:00:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.196+0000 7fab66689740 1 client.25265 shutdown 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.196+0000 7fab66689740 1 -- 172.21.15.73:0/455467186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 msgr2=0x557f23b06c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.196+0000 7fab66689740 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23b06c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab4c003a80 tx=0x7fab4c003bb0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.196+0000 7fab66689740 1 -- 172.21.15.73:0/455467186 shutdown_connections 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.196+0000 7fab66689740 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557f23b0e060 0x557f23b006a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.197+0000 7fab66689740 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f23af5370 0x557f23afc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.197+0000 7fab66689740 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f23af02e0 0x557f23b06c60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.197+0000 7fab66689740 1 --2- 172.21.15.73:0/455467186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f23aef9a0 0x557f23b06720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.197+0000 7fab66689740 1 -- 172.21.15.73:0/455467186 >> 172.21.15.73:0/455467186 conn(0x557f23aeb010 msgr2=0x557f23aea1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.197+0000 7fab44ff9640 0 client.25265 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.197+0000 7fab66689740 1 -- 172.21.15.73:0/455467186 shutdown_connections 2024-09-05T13:00:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.197+0000 7fab66689740 1 -- 172.21.15.73:0/455467186 wait complete. 2024-09-05T13:00:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.197+0000 7fab66689740 20 client.25265 trim_cache size 0 max 16384 2024-09-05T13:00:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:00:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:00:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:00:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:00:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 -- 172.21.15.73:0/2470441829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fab480a2ec0 msgr2=0x7fab480a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fab480a2ec0 0x7fab480a5380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fab5c073050 tx=0x7fab4c005f90 comp rx=0 tx=0).stop 2024-09-05T13:00:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 -- 172.21.15.73:0/2470441829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c100a40 msgr2=0x7fab5c071b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c100a40 0x7fab5c071b40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fab5800a8d0 tx=0x7fab5800ad90 comp rx=0 tx=0).stop 2024-09-05T13:00:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 -- 172.21.15.73:0/2470441829 shutdown_connections 2024-09-05T13:00:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fab480a2ec0 0x7fab480a5380 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab5c1025f0 0x7fab5c0730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab5c101c30 0x7fab5c072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 --2- 172.21.15.73:0/2470441829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c100a40 0x7fab5c071b40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 -- 172.21.15.73:0/2470441829 >> 172.21.15.73:0/2470441829 conn(0x7fab5c0fc1e0 msgr2=0x7fab5c0fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 -- 172.21.15.73:0/2470441829 shutdown_connections 2024-09-05T13:00:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:33.198+0000 7fab638f4640 1 -- 172.21.15.73:0/2470441829 wait complete. 2024-09-05T13:00:35.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:35 smithi073 ceph-mon[30883]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-05T13:00:35.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:35 smithi162 ceph-mon[34220]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-05T13:00:35.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:35 smithi169 ceph-mon[34823]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 3.30k op/s 2024-09-05T13:00:37.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:37 smithi162 ceph-mon[34220]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 3.86k op/s 2024-09-05T13:00:37.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:37 smithi169 ceph-mon[34823]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 3.86k op/s 2024-09-05T13:00:37.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:37 smithi073 ceph-mon[30883]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 3.86k op/s 2024-09-05T13:00:39.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:39 smithi169 ceph-mon[34823]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 17 MiB/s wr, 4.11k op/s 2024-09-05T13:00:39.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:39 smithi073 ceph-mon[30883]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 17 MiB/s wr, 4.11k op/s 2024-09-05T13:00:39.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:39 smithi162 ceph-mon[34220]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 17 MiB/s wr, 4.11k op/s 2024-09-05T13:00:41.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:41 smithi169 ceph-mon[34823]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 3.38k op/s 2024-09-05T13:00:41.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:41 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:00:41.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:41 smithi073 ceph-mon[30883]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 3.38k op/s 2024-09-05T13:00:41.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:41 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:00:41.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:41 smithi162 ceph-mon[34220]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 3.38k op/s 2024-09-05T13:00:41.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:41 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:00:42.173 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T13:00:42.371 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:42 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:00:42.371 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:42 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:00:42.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:42 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:00:42.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:42 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:00:42.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:42 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:00:42.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:42 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:00:43.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:43 smithi073 ceph-mon[30883]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2024-09-05T13:00:43.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:43 smithi162 ceph-mon[34220]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2024-09-05T13:00:43.518 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:43 smithi169 ceph-mon[34823]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2024-09-05T13:00:43.761 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:00:45.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:45 smithi169 ceph-mon[34823]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 20 MiB/s wr, 4.92k op/s 2024-09-05T13:00:45.423 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:45 smithi073 ceph-mon[30883]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 20 MiB/s wr, 4.92k op/s 2024-09-05T13:00:45.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:45 smithi162 ceph-mon[34220]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 20 MiB/s wr, 4.92k op/s 2024-09-05T13:00:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.566+0000 7f1dfda15640 1 -- 172.21.15.73:0/3975960974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df8101c80 msgr2=0x7f1df8102100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.566+0000 7f1dfda15640 1 --2- 172.21.15.73:0/3975960974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df8101c80 0x7f1df8102100 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009900 tx=0x7f1dec02a480 comp rx=0 tx=0).stop 2024-09-05T13:00:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.566+0000 7f1dfda15640 1 -- 172.21.15.73:0/3975960974 shutdown_connections 2024-09-05T13:00:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.566+0000 7f1dfda15640 1 --2- 172.21.15.73:0/3975960974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df8102640 0x7f1df8108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.566+0000 7f1dfda15640 1 --2- 172.21.15.73:0/3975960974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df8101c80 0x7f1df8102100 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.566+0000 7f1dfda15640 1 --2- 172.21.15.73:0/3975960974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1df8100f70 0x7f1df8101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.566+0000 7f1dfda15640 1 -- 172.21.15.73:0/3975960974 >> 172.21.15.73:0/3975960974 conn(0x7f1df80fb930 msgr2=0x7f1df80fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.566+0000 7f1dfda15640 1 -- 172.21.15.73:0/3975960974 shutdown_connections 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.566+0000 7f1dfda15640 1 -- 172.21.15.73:0/3975960974 wait complete. 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1dfda15640 1 Processor -- start 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1dfda15640 1 -- start start 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1dfda15640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df8100f70 0x7f1df8197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1dfda15640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1df8101c80 0x7f1df8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1dfda15640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df8102640 0x7f1df819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1dfda15640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1df810d830 con 0x7f1df8102640 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1dfda15640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1df810d6b0 con 0x7f1df8100f70 2024-09-05T13:00:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1dfda15640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1df810d9b0 con 0x7f1df8101c80 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1df67fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1df8101c80 0x7f1df8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1df77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df8102640 0x7f1df819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1df67fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1df8101c80 0x7f1df8198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:60158/0 (socket says 172.21.15.73:60158) 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1df67fc640 1 -- 172.21.15.73:0/3231771504 learned_addr learned my addr 172.21.15.73:0/3231771504 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.567+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df8100f70 0x7f1df8197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1df77fe640 1 -- 172.21.15.73:0/3231771504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1df8101c80 msgr2=0x7f1df8198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1df77fe640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1df8101c80 0x7f1df8198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1df77fe640 1 -- 172.21.15.73:0/3231771504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df8100f70 msgr2=0x7f1df8197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1df77fe640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df8100f70 0x7f1df8197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1df77fe640 1 -- 172.21.15.73:0/3231771504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df819fa50 con 0x7f1df8102640 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1df67fc640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1df8101c80 0x7f1df8198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1df77fe640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df8102640 0x7f1df819f3e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1df000da10 tx=0x7f1df000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1dfca13640 1 -- 172.21.15.73:0/3231771504 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df000bd70 con 0x7f1df8102640 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1dfca13640 1 -- 172.21.15.73:0/3231771504 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df0003e50 con 0x7f1df8102640 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1dfda15640 1 -- 172.21.15.73:0/3231771504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df819fd40 con 0x7f1df8102640 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1dfca13640 1 -- 172.21.15.73:0/3231771504 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df00106a0 con 0x7f1df8102640 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.568+0000 7f1dfda15640 1 -- 172.21.15.73:0/3231771504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df81a01b0 con 0x7f1df8102640 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.570+0000 7f1dfca13640 1 -- 172.21.15.73:0/3231771504 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1df0003970 con 0x7f1df8102640 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.570+0000 7f1e00886740 1 Processor -- start 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.570+0000 7f1e00886740 1 -- start start 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.570+0000 7f1e00886740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cb9a0 0x55a09f0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1e00886740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 0x55a09f0d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1e00886740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0d3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1e00886740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a09f02f2f0 con 0x55a09f0cb9a0 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1e00886740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a09efd7270 con 0x55a09f0cc2e0 2024-09-05T13:00:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1e00886740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a09f02b2b0 con 0x55a09f0d1370 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cb9a0 0x55a09f0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cb9a0 0x55a09f0cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39592/0 (socket says 172.21.15.73:39592) 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df67fc640 1 -- 172.21.15.73:0/3024209010 learned_addr learned my addr 172.21.15.73:0/3024209010 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/3024209010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 0x55a09f0d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df67fc640 1 --2- 172.21.15.73:0/3024209010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0d3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1dfca13640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1de00a2c30 0x7f1de00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df67fc640 1 -- 172.21.15.73:0/3024209010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 msgr2=0x55a09f0d3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df67fc640 1 --2- 172.21.15.73:0/3024209010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0d3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df67fc640 1 -- 172.21.15.73:0/3024209010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 msgr2=0x55a09f0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df67fc640 1 --2- 172.21.15.73:0/3024209010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 0x55a09f0d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df67fc640 1 -- 172.21.15.73:0/3024209010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09efd6340 con 0x55a09f0cb9a0 2024-09-05T13:00:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df77fe640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1de00a2c30 0x7f1de00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1df67fc640 1 --2- 172.21.15.73:0/3024209010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cb9a0 0x55a09f0cbda0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0096c0 tx=0x7f1dec005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f912a2be88ae5830 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1dfca13640 1 -- 172.21.15.73:0/3231771504 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f1df00cf3c0 con 0x7f1df8102640 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1dddffb640 1 -- 172.21.15.73:0/3024209010 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec044030 con 0x55a09f0cb9a0 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1dddffb640 1 -- 172.21.15.73:0/3024209010 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dec005020 con 0x55a09f0cb9a0 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.571+0000 7f1dddffb640 1 -- 172.21.15.73:0/3024209010 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec035040 con 0x55a09f0cb9a0 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1e00886740 1 -- 172.21.15.73:0/3024209010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cb9a0 msgr2=0x55a09f0cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1df77fe640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1de00a2c30 0x7f1de00a50f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1df0098620 tx=0x7f1df006abd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1e00886740 1 --2- 172.21.15.73:0/3024209010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cb9a0 0x55a09f0cbda0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0096c0 tx=0x7f1dec005b90 comp rx=0 tx=0).stop 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1e00886740 1 -- 172.21.15.73:0/3024209010 shutdown_connections 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1e00886740 1 --2- 172.21.15.73:0/3024209010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0d3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1e00886740 1 --2- 172.21.15.73:0/3024209010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 0x55a09f0d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1e00886740 1 --2- 172.21.15.73:0/3024209010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cb9a0 0x55a09f0cbda0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1e00886740 1 -- 172.21.15.73:0/3024209010 >> 172.21.15.73:0/3024209010 conn(0x55a09f0c7010 msgr2=0x55a09f0c7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1e00886740 1 -- 172.21.15.73:0/3024209010 shutdown_connections 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1e00886740 1 -- 172.21.15.73:0/3024209010 wait complete. 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.572+0000 7f1e00886740 1 -- start start 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1e00886740 1 Processor -- start 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1e00886740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 0x55a09f0d5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1e00886740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 0x55a09f0d6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1e00886740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0dd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1e00886740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a09f0d42e0 con 0x55a09f0cc2e0 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1e00886740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a09efb8290 con 0x55a09f0cb9a0 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1e00886740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a09f0d4460 con 0x55a09f0d1370 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1e00886740 10 client.0 _ll_register_callbacks cb 0x55a09efe9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 0x55a09f0d6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 0x55a09f0d6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39604/0 (socket says 172.21.15.73:39604) 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df6ffd640 1 -- 172.21.15.73:0/4178086933 learned_addr learned my addr 172.21.15.73:0/4178086933 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df67fc640 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 0x55a09f0d5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df67fc640 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0dd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df6ffd640 1 -- 172.21.15.73:0/4178086933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 msgr2=0x55a09f0dd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0dd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df6ffd640 1 -- 172.21.15.73:0/4178086933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 msgr2=0x55a09f0d5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 0x55a09f0d5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df6ffd640 1 -- 172.21.15.73:0/4178086933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09ed42210 con 0x55a09f0cc2e0 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 0x55a09f0d6010 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1de800bf50 tx=0x7f1de80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda6fa32444ef9d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.573+0000 7f1dd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/4178086933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8005020 con 0x55a09f0cc2e0 2024-09-05T13:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/4178086933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f1de80051c0 con 0x55a09f0cc2e0 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1e00886740 1 -- 172.21.15.73:0/4178086933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dec005020 con 0x55a09f0cc2e0 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/4178086933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1de80053c0 con 0x55a09f0cc2e0 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1e00886740 10 client.15756 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1e00886740 1 -- 172.21.15.73:0/4178086933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a09ee0e620 con 0x55a09f0cc2e0 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/4178086933 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dec005020 con 0x55a09f0cc2e0 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/4178086933 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f1de8010a80 con 0x55a09f0cc2e0 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1e00886740 10 client.15756 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1e00886740 10 client.15756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1e00886740 20 client.15756 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1e00886740 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a09f0e1820 0x55a09f0e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1e00886740 4 client.15756 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1e00886740 1 -- 172.21.15.73:0/4178086933 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a09f03ca20 con 0x55a09f0e1820 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.574+0000 7f1df67fc640 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a09f0e1820 0x55a09f0e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.575+0000 7f1dd6ffd640 10 client.15756 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.575+0000 7f1df67fc640 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a09f0e1820 0x55a09f0e3c50 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c4b7b526ded8e15 server_cookie=dbc106524c0b7d40 in_seq=0 out_seq=0 2024-09-05T13:00:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.575+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/4178086933 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a09f03ca20 con 0x55a09f0e1820 2024-09-05T13:00:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.575+0000 7f1dd6ffd640 10 client.15756 handle_command_reply: tid=0 2024-09-05T13:00:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.575+0000 7f1e00886740 1 client.15756 shutdown 2024-09-05T13:00:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 1 -- 172.21.15.73:0/4178086933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 msgr2=0x55a09f0d6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 0x55a09f0d6010 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1de800bf50 tx=0x7f1de80118d0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 1 -- 172.21.15.73:0/4178086933 shutdown_connections 2024-09-05T13:00:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a09f0e1820 0x55a09f0e3c50 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0dd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 0x55a09f0d6010 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1dd6ffd640 0 client.15756 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 1 --2- 172.21.15.73:0/4178086933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 0x55a09f0d5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 1 -- 172.21.15.73:0/4178086933 >> 172.21.15.73:0/4178086933 conn(0x55a09f0c7010 msgr2=0x55a09f0c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 1 -- 172.21.15.73:0/4178086933 shutdown_connections 2024-09-05T13:00:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 1 -- 172.21.15.73:0/4178086933 wait complete. 2024-09-05T13:00:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.576+0000 7f1e00886740 20 client.15756 trim_cache size 0 max 16384 2024-09-05T13:00:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.591+0000 7f1e00886740 1 Processor -- start 2024-09-05T13:00:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.591+0000 7f1e00886740 1 -- start start 2024-09-05T13:00:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.591+0000 7f1e00886740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0cb9a0 0x55a09f0d4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.591+0000 7f1e00886740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 0x55a09f0dd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.591+0000 7f1e00886740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0d1370 0x55a09f0c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.591+0000 7f1e00886740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81ab720 con 0x55a09f0d1370 2024-09-05T13:00:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.591+0000 7f1e00886740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81a8f30 con 0x55a09f0cc2e0 2024-09-05T13:00:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.591+0000 7f1e00886740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81a6d80 con 0x55a09f0cb9a0 2024-09-05T13:00:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.592+0000 7f1df6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 0x55a09f0dd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.592+0000 7f1df6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 0x55a09f0dd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39656/0 (socket says 172.21.15.73:39656) 2024-09-05T13:00:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.592+0000 7f1df6ffd640 1 -- 172.21.15.73:0/1887822713 learned_addr learned my addr 172.21.15.73:0/1887822713 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.594+0000 7f1df67fc640 1 --2- 172.21.15.73:0/1887822713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0cb9a0 0x55a09f0d4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.594+0000 7f1df67fc640 1 --2- 172.21.15.73:0/1887822713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0d1370 0x55a09f0c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.594+0000 7f1df6ffd640 1 -- 172.21.15.73:0/1887822713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0cb9a0 msgr2=0x55a09f0d4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.594+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/1887822713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0cb9a0 0x55a09f0d4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.594+0000 7f1df6ffd640 1 -- 172.21.15.73:0/1887822713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0d1370 msgr2=0x55a09f0c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.594+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/1887822713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0d1370 0x55a09f0c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.594+0000 7f1df6ffd640 1 -- 172.21.15.73:0/1887822713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09f0d0690 con 0x55a09f0cc2e0 2024-09-05T13:00:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.595+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/1887822713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 0x55a09f0dd010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1de8000c00 tx=0x7f1de8005560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8539245cc05889f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.596+0000 7f1ddd7fa640 1 -- 172.21.15.73:0/1887822713 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de802c070 con 0x55a09f0cc2e0 2024-09-05T13:00:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.596+0000 7f1ddd7fa640 1 -- 172.21.15.73:0/1887822713 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de8010b20 con 0x55a09f0cc2e0 2024-09-05T13:00:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.596+0000 7f1ddd7fa640 1 -- 172.21.15.73:0/1887822713 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8004d20 con 0x55a09f0cc2e0 2024-09-05T13:00:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.597+0000 7f1e00886740 1 -- 172.21.15.73:0/1887822713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 msgr2=0x55a09f0dd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.597+0000 7f1e00886740 1 --2- 172.21.15.73:0/1887822713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 0x55a09f0dd010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1de8000c00 tx=0x7f1de8005560 comp rx=0 tx=0).stop 2024-09-05T13:00:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.597+0000 7f1e00886740 1 -- 172.21.15.73:0/1887822713 shutdown_connections 2024-09-05T13:00:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.597+0000 7f1e00886740 1 --2- 172.21.15.73:0/1887822713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0d1370 0x55a09f0c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.597+0000 7f1e00886740 1 --2- 172.21.15.73:0/1887822713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cc2e0 0x55a09f0dd010 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.597+0000 7f1e00886740 1 --2- 172.21.15.73:0/1887822713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0cb9a0 0x55a09f0d4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.597+0000 7f1e00886740 1 -- 172.21.15.73:0/1887822713 >> 172.21.15.73:0/1887822713 conn(0x55a09f0c7010 msgr2=0x55a09f0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.597+0000 7f1e00886740 1 -- 172.21.15.73:0/1887822713 shutdown_connections 2024-09-05T13:00:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.597+0000 7f1e00886740 1 -- 172.21.15.73:0/1887822713 wait complete. 2024-09-05T13:00:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.598+0000 7f1e00886740 1 -- start start 2024-09-05T13:00:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.598+0000 7f1e00886740 1 Processor -- start 2024-09-05T13:00:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.598+0000 7f1e00886740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 0x55a09f0da970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.598+0000 7f1e00886740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 0x55a09f0daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1e00886740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0dbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df67fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 0x55a09f0da970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df67fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 0x55a09f0da970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39658/0 (socket says 172.21.15.73:39658) 2024-09-05T13:00:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df67fc640 1 -- 172.21.15.73:0/1556908975 learned_addr learned my addr 172.21.15.73:0/1556908975 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81a73f0 con 0x55a09f0cc2e0 2024-09-05T13:00:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81a8860 con 0x55a09f0cb9a0 2024-09-05T13:00:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81a7ac0 con 0x55a09f0d1370 2024-09-05T13:00:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 0x55a09f0daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df67fc640 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0dbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1e00886740 10 client.0 _ll_register_callbacks cb 0x7f1de800bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df67fc640 1 -- 172.21.15.73:0/1556908975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 msgr2=0x55a09f0dbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df67fc640 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0dbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df67fc640 1 -- 172.21.15.73:0/1556908975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 msgr2=0x55a09f0daeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df67fc640 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 0x55a09f0daeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df67fc640 1 -- 172.21.15.73:0/1556908975 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09f0dc4d0 con 0x55a09f0cb9a0 2024-09-05T13:00:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.599+0000 7f1df67fc640 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 0x55a09f0da970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1dec031440 tx=0x7f1dec051e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ebef9dabd10c280 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.600+0000 7f1dd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:00:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.600+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/1556908975 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec044040 con 0x55a09f0cb9a0 2024-09-05T13:00:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.600+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/1556908975 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f1dec0035f0 con 0x55a09f0cb9a0 2024-09-05T13:00:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.600+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1de8010b20 con 0x55a09f0cb9a0 2024-09-05T13:00:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.600+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/1556908975 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1dec035040 con 0x55a09f0cb9a0 2024-09-05T13:00:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.600+0000 7f1e00886740 10 client.25283 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.600+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a09f14c7c0 con 0x55a09f0cb9a0 2024-09-05T13:00:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.603+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/1556908975 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de8010b20 con 0x55a09f0cb9a0 2024-09-05T13:00:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.603+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/1556908975 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f1dec049860 con 0x55a09f0cb9a0 2024-09-05T13:00:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.603+0000 7f1e00886740 10 client.25283 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.603+0000 7f1e00886740 10 client.25283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.603+0000 7f1e00886740 20 client.25283 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.603+0000 7f1e00886740 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a09f14ccf0 0x55a09f14d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.603+0000 7f1e00886740 4 client.25283 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:00:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.603+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a09f036d70 con 0x55a09f14ccf0 2024-09-05T13:00:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.604+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a09f14ccf0 0x55a09f14d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.604+0000 7f1df6ffd640 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a09f14ccf0 0x55a09f14d0d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3502061adbb64e7a server_cookie=7d612b3c77383dd7 in_seq=0 out_seq=0 2024-09-05T13:00:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.606+0000 7f1dd6ffd640 10 client.25283 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.621+0000 7f1dd6ffd640 1 -- 172.21.15.73:0/1556908975 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a09f036d70 con 0x55a09f14ccf0 2024-09-05T13:00:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.621+0000 7f1dd6ffd640 10 client.25283 handle_command_reply: tid=0 2024-09-05T13:00:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.621+0000 7f1e00886740 1 client.25283 shutdown 2024-09-05T13:00:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 msgr2=0x55a09f0da970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 0x55a09f0da970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1dec031440 tx=0x7f1dec051e80 comp rx=0 tx=0).stop 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 shutdown_connections 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a09f14ccf0 0x55a09f14d0d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a09f0d1370 0x55a09f0dbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a09f0cc2e0 0x55a09f0daeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 1 --2- 172.21.15.73:0/1556908975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a09f0cb9a0 0x55a09f0da970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 >> 172.21.15.73:0/1556908975 conn(0x55a09f0c7010 msgr2=0x55a09f0c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1dd6ffd640 0 client.25283 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 shutdown_connections 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 1 -- 172.21.15.73:0/1556908975 wait complete. 2024-09-05T13:00:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.623+0000 7f1e00886740 20 client.25283 trim_cache size 0 max 16384 2024-09-05T13:00:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:00:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:00:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:00:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.624+0000 7f1dfda15640 1 -- 172.21.15.73:0/3231771504 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1de00a2c30 msgr2=0x7f1de00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.624+0000 7f1dfda15640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1de00a2c30 0x7f1de00a50f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1df0098620 tx=0x7f1df006abd0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.624+0000 7f1dfda15640 1 -- 172.21.15.73:0/3231771504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df8102640 msgr2=0x7f1df819f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.624+0000 7f1dfda15640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df8102640 0x7f1df819f3e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1df000da10 tx=0x7f1df000ded0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.624+0000 7f1dfda15640 1 -- 172.21.15.73:0/3231771504 shutdown_connections 2024-09-05T13:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.624+0000 7f1dfda15640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1de00a2c30 0x7f1de00a50f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.624+0000 7f1dfda15640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df8102640 0x7f1df819f3e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.624+0000 7f1dfda15640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1df8101c80 0x7f1df8198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.624+0000 7f1dfda15640 1 --2- 172.21.15.73:0/3231771504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df8100f70 0x7f1df8197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.624+0000 7f1dfda15640 1 -- 172.21.15.73:0/3231771504 >> 172.21.15.73:0/3231771504 conn(0x7f1df80fb930 msgr2=0x7f1df8105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.625+0000 7f1dfda15640 1 -- 172.21.15.73:0/3231771504 shutdown_connections 2024-09-05T13:00:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:46.625+0000 7f1dfda15640 1 -- 172.21.15.73:0/3231771504 wait complete. 2024-09-05T13:00:47.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:47 smithi073 ceph-mon[30883]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 5.72k op/s 2024-09-05T13:00:47.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:47 smithi162 ceph-mon[34220]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 5.72k op/s 2024-09-05T13:00:47.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:47 smithi169 ceph-mon[34823]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 5.72k op/s 2024-09-05T13:00:48.788 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:00:48.788 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2024-09-05T13:00:48.788 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2024-09-05T13:00:48.788 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:00:48.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.120+0000 7f71eff45640 1 -- 172.21.15.73:0/1008349102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e8100b60 msgr2=0x7f71e8100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:48.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.120+0000 7f71eff45640 1 --2- 172.21.15.73:0/1008349102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e8100b60 0x7f71e8100f40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009900 tx=0x7f71e402a410 comp rx=0 tx=0).stop 2024-09-05T13:00:48.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.120+0000 7f71eff45640 1 -- 172.21.15.73:0/1008349102 shutdown_connections 2024-09-05T13:00:48.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.120+0000 7f71eff45640 1 --2- 172.21.15.73:0/1008349102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e810e540 0x7f71e8110930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.120+0000 7f71eff45640 1 --2- 172.21.15.73:0/1008349102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71e8101480 0x7f71e810df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.120+0000 7f71eff45640 1 --2- 172.21.15.73:0/1008349102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e8100b60 0x7f71e8100f40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.120+0000 7f71eff45640 1 -- 172.21.15.73:0/1008349102 >> 172.21.15.73:0/1008349102 conn(0x7f71e80fc7d0 msgr2=0x7f71e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.121+0000 7f71eff45640 1 -- 172.21.15.73:0/1008349102 shutdown_connections 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.121+0000 7f71eff45640 1 -- 172.21.15.73:0/1008349102 wait complete. 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71eff45640 1 Processor -- start 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71eff45640 1 -- start start 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71eff45640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e8100b60 0x7f71e81a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71eff45640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71e8101480 0x7f71e81a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71eff45640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e810e540 0x7f71e819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71eff45640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f71e81142c0 con 0x7f71e8100b60 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71edce1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e8100b60 0x7f71e81a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71edce1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e8100b60 0x7f71e81a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39638/0 (socket says 172.21.15.73:39638) 2024-09-05T13:00:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71edce1640 1 -- 172.21.15.73:0/598961617 learned_addr learned my addr 172.21.15.73:0/598961617 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71ed4e0640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71e8101480 0x7f71e81a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71eff45640 1 -- 172.21.15.73:0/598961617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8114140 con 0x7f71e810e540 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.122+0000 7f71eff45640 1 -- 172.21.15.73:0/598961617 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8114440 con 0x7f71e8101480 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e810e540 0x7f71e819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71edce1640 1 -- 172.21.15.73:0/598961617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71e8101480 msgr2=0x7f71e81a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71edce1640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71e8101480 0x7f71e81a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71edce1640 1 -- 172.21.15.73:0/598961617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e810e540 msgr2=0x7f71e819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71edce1640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e810e540 0x7f71e819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71edce1640 1 -- 172.21.15.73:0/598961617 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e819ace0 con 0x7f71e8100b60 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e810e540 0x7f71e819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71edce1640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e8100b60 0x7f71e81a03f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f71e4004770 tx=0x7f71e4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71deffd640 1 -- 172.21.15.73:0/598961617 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e403f070 con 0x7f71e8100b60 2024-09-05T13:00:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71eff45640 1 -- 172.21.15.73:0/598961617 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e819af70 con 0x7f71e8100b60 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.123+0000 7f71deffd640 1 -- 172.21.15.73:0/598961617 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71e4031ca0 con 0x7f71e8100b60 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.124+0000 7f71eff45640 1 -- 172.21.15.73:0/598961617 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e81a72c0 con 0x7f71e8100b60 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.124+0000 7f71deffd640 1 -- 172.21.15.73:0/598961617 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4035030 con 0x7f71e8100b60 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.129+0000 7f71deffd640 1 -- 172.21.15.73:0/598961617 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f71e4042070 con 0x7f71e8100b60 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.129+0000 7f71f231b740 1 Processor -- start 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.130+0000 7f71deffd640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71d40a2b80 0x7f71d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.130+0000 7f71deffd640 1 -- 172.21.15.73:0/598961617 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f71e40ef5d0 con 0x7f71e8100b60 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.131+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71d40a2b80 0x7f71d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.131+0000 7f71f231b740 1 -- start start 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.131+0000 7f71f231b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc6981cb0 0x562dc6982090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.131+0000 7f71f231b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc69825d0 0x562dc698c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.131+0000 7f71f231b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc698ce90 0x562dc698f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.131+0000 7f71f231b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x562dc68df2e0 con 0x562dc69825d0 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.131+0000 7f71f231b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562dc6886ce0 con 0x562dc6981cb0 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.131+0000 7f71f231b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562dc68db2a0 con 0x562dc698ce90 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71edce1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc6981cb0 0x562dc6982090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71ed4e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc69825d0 0x562dc698c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71edce1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc6981cb0 0x562dc6982090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39688/0 (socket says 172.21.15.73:39688) 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71ed4e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc69825d0 0x562dc698c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39648/0 (socket says 172.21.15.73:39648) 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71edce1640 1 -- 172.21.15.73:0/3874863250 learned_addr learned my addr 172.21.15.73:0/3874863250 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/3874863250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc698ce90 0x562dc698f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71d40a2b80 0x7f71d40a5040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f71e80699f0 tx=0x7f71e0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71edce1640 1 -- 172.21.15.73:0/3874863250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc698ce90 msgr2=0x562dc698f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71edce1640 1 --2- 172.21.15.73:0/3874863250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc698ce90 0x562dc698f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71edce1640 1 -- 172.21.15.73:0/3874863250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc69825d0 msgr2=0x562dc698c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71edce1640 1 --2- 172.21.15.73:0/3874863250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc69825d0 0x562dc698c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71edce1640 1 -- 172.21.15.73:0/3874863250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dc686b440 con 0x562dc6981cb0 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.132+0000 7f71edce1640 1 --2- 172.21.15.73:0/3874863250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc6981cb0 0x562dc6982090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71e40bbf60 tx=0x7f71e403b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e456fa4283381b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.134+0000 7f71d3fff640 1 -- 172.21.15.73:0/3874863250 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4049050 con 0x562dc6981cb0 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.134+0000 7f71d3fff640 1 -- 172.21.15.73:0/3874863250 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71e40c02d0 con 0x562dc6981cb0 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.134+0000 7f71d3fff640 1 -- 172.21.15.73:0/3874863250 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e40bc230 con 0x562dc6981cb0 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.135+0000 7f71f231b740 1 -- 172.21.15.73:0/3874863250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc6981cb0 msgr2=0x562dc6982090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.135+0000 7f71f231b740 1 --2- 172.21.15.73:0/3874863250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc6981cb0 0x562dc6982090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71e40bbf60 tx=0x7f71e403b460 comp rx=0 tx=0).stop 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.135+0000 7f71f231b740 1 -- 172.21.15.73:0/3874863250 shutdown_connections 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.135+0000 7f71f231b740 1 --2- 172.21.15.73:0/3874863250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc698ce90 0x562dc698f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.135+0000 7f71f231b740 1 --2- 172.21.15.73:0/3874863250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc69825d0 0x562dc698c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.135+0000 7f71f231b740 1 --2- 172.21.15.73:0/3874863250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc6981cb0 0x562dc6982090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.135+0000 7f71f231b740 1 -- 172.21.15.73:0/3874863250 >> 172.21.15.73:0/3874863250 conn(0x562dc697e240 msgr2=0x562dc697e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.136+0000 7f71f231b740 1 -- 172.21.15.73:0/3874863250 shutdown_connections 2024-09-05T13:00:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.136+0000 7f71f231b740 1 -- 172.21.15.73:0/3874863250 wait complete. 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.136+0000 7f71f231b740 1 -- start start 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.136+0000 7f71f231b740 1 Processor -- start 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.137+0000 7f71f231b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 0x562dc698c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.137+0000 7f71f231b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6989b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.137+0000 7f71f231b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 0x562dc698a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.137+0000 7f71f231b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x562dc698f820 con 0x562dc698ce90 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.137+0000 7f71f231b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562dc689a050 con 0x562dc69825d0 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.137+0000 7f71f231b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562dc698f9a0 con 0x562dc6981cb0 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.137+0000 7f71f231b740 10 client.0 _ll_register_callbacks cb 0x562dc68da160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71ed4e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6989b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71ed4e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6989b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39696/0 (socket says 172.21.15.73:39696) 2024-09-05T13:00:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71ed4e0640 1 -- 172.21.15.73:0/308945060 learned_addr learned my addr 172.21.15.73:0/308945060 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71edce1640 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 0x562dc698c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 0x562dc698a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71ee4e2640 1 -- 172.21.15.73:0/308945060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 msgr2=0x562dc698c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 0x562dc698c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71ee4e2640 1 -- 172.21.15.73:0/308945060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 msgr2=0x562dc6989b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6989b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71ee4e2640 1 -- 172.21.15.73:0/308945060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dc66503c0 con 0x562dc698ce90 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.138+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 0x562dc698a100 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f71e8069760 tx=0x7f71e0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebc2122a757e4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.139+0000 7f71d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.139+0000 7f71d17fa640 1 -- 172.21.15.73:0/308945060 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e000fb60 con 0x562dc698ce90 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.139+0000 7f71d17fa640 1 -- 172.21.15.73:0/308945060 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f71e000fd00 con 0x562dc698ce90 2024-09-05T13:00:48.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.139+0000 7f71f231b740 1 -- 172.21.15.73:0/308945060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71e40c02d0 con 0x562dc698ce90 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.139+0000 7f71d17fa640 1 -- 172.21.15.73:0/308945060 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f71e0027440 con 0x562dc698ce90 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.139+0000 7f71f231b740 10 client.15774 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.139+0000 7f71f231b740 1 -- 172.21.15.73:0/308945060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562dc699b220 con 0x562dc698ce90 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.140+0000 7f71d17fa640 1 -- 172.21.15.73:0/308945060 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71e0027ac0 con 0x562dc698ce90 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.140+0000 7f71d17fa640 1 -- 172.21.15.73:0/308945060 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f71e0025070 con 0x562dc698ce90 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.140+0000 7f71f231b740 10 client.15774 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.140+0000 7f71f231b740 10 client.15774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.140+0000 7f71f231b740 20 client.15774 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.140+0000 7f71f231b740 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x562dc699c780 0x562dc699eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.140+0000 7f71f231b740 4 client.15774 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.140+0000 7f71f231b740 1 -- 172.21.15.73:0/308945060 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f71e40c02d0 con 0x562dc699c780 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.140+0000 7f71edce1640 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x562dc699c780 0x562dc699eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.141+0000 7f71d17fa640 10 client.15774 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.141+0000 7f71edce1640 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x562dc699c780 0x562dc699eb70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44a83e0df0646712 server_cookie=e71d50e3cee18b76 in_seq=0 out_seq=0 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71d17fa640 1 -- 172.21.15.73:0/308945060 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f71e40c02d0 con 0x562dc699c780 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71d17fa640 10 client.15774 handle_command_reply: tid=0 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 client.15774 shutdown 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 -- 172.21.15.73:0/308945060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 msgr2=0x562dc698a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 0x562dc698a100 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f71e8069760 tx=0x7f71e0004ab0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 -- 172.21.15.73:0/308945060 shutdown_connections 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x562dc699c780 0x562dc699eb70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 0x562dc698a100 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6989b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 --2- 172.21.15.73:0/308945060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 0x562dc698c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 -- 172.21.15.73:0/308945060 >> 172.21.15.73:0/308945060 conn(0x562dc697e240 msgr2=0x562dc6974b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71d17fa640 0 client.15774 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 -- 172.21.15.73:0/308945060 shutdown_connections 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.142+0000 7f71f231b740 1 -- 172.21.15.73:0/308945060 wait complete. 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.143+0000 7f71f231b740 20 client.15774 trim_cache size 0 max 16384 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.171+0000 7f71f231b740 1 Processor -- start 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.171+0000 7f71f231b740 1 -- start start 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.171+0000 7f71f231b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc6981cb0 0x562dc6974b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.171+0000 7f71f231b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc69825d0 0x562dc69a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.171+0000 7f71edce1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc6981cb0 0x562dc6974b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.171+0000 7f71edce1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc6981cb0 0x562dc6974b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39678/0 (socket says 172.21.15.73:39678) 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.171+0000 7f71edce1640 1 -- 172.21.15.73:0/4148365985 learned_addr learned my addr 172.21.15.73:0/4148365985 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.171+0000 7f71f231b740 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc698ce90 0x562dc69a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.171+0000 7f71f231b740 1 -- 172.21.15.73:0/4148365985 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f71e81ade30 con 0x562dc6981cb0 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71f231b740 1 -- 172.21.15.73:0/4148365985 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71e81ab640 con 0x562dc698ce90 2024-09-05T13:00:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71f231b740 1 -- 172.21.15.73:0/4148365985 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71e81a94b0 con 0x562dc69825d0 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71ed4e0640 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc69825d0 0x562dc69a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc698ce90 0x562dc69a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71edce1640 1 -- 172.21.15.73:0/4148365985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc69825d0 msgr2=0x562dc69a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71edce1640 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc69825d0 0x562dc69a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71edce1640 1 -- 172.21.15.73:0/4148365985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc698ce90 msgr2=0x562dc69a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71edce1640 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc698ce90 0x562dc69a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71edce1640 1 -- 172.21.15.73:0/4148365985 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dc69823c0 con 0x562dc6981cb0 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71ee4e2640 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc698ce90 0x562dc69a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.172+0000 7f71edce1640 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc6981cb0 0x562dc6974b70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f71e40dc0d0 tx=0x7f71e402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb29749050dda01 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.173+0000 7f71d37fe640 1 -- 172.21.15.73:0/4148365985 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e40ab070 con 0x562dc6981cb0 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.173+0000 7f71d37fe640 1 -- 172.21.15.73:0/4148365985 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71e40c02d0 con 0x562dc6981cb0 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.173+0000 7f71d37fe640 1 -- 172.21.15.73:0/4148365985 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4049070 con 0x562dc6981cb0 2024-09-05T13:00:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.174+0000 7f71f231b740 1 -- 172.21.15.73:0/4148365985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc6981cb0 msgr2=0x562dc6974b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.174+0000 7f71f231b740 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc6981cb0 0x562dc6974b70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f71e40dc0d0 tx=0x7f71e402a410 comp rx=0 tx=0).stop 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.174+0000 7f71f231b740 1 -- 172.21.15.73:0/4148365985 shutdown_connections 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.174+0000 7f71f231b740 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc698ce90 0x562dc69a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.174+0000 7f71f231b740 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc69825d0 0x562dc69a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.174+0000 7f71f231b740 1 --2- 172.21.15.73:0/4148365985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc6981cb0 0x562dc6974b70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.174+0000 7f71f231b740 1 -- 172.21.15.73:0/4148365985 >> 172.21.15.73:0/4148365985 conn(0x562dc697e240 msgr2=0x562dc698bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.174+0000 7f71f231b740 1 -- 172.21.15.73:0/4148365985 shutdown_connections 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.174+0000 7f71f231b740 1 -- 172.21.15.73:0/4148365985 wait complete. 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.175+0000 7f71f231b740 1 -- start start 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.175+0000 7f71f231b740 1 Processor -- start 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.175+0000 7f71f231b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 0x562dc6992990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71f231b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6992ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71f231b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 0x562dc6993410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71ed4e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6992ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71edce1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 0x562dc6992990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71edce1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 0x562dc6992990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:60244/0 (socket says 172.21.15.73:60244) 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71edce1640 1 -- 172.21.15.73:0/1313352710 learned_addr learned my addr 172.21.15.73:0/1313352710 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71ed4e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6992ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39718/0 (socket says 172.21.15.73:39718) 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71ee4e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 0x562dc6993410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f71e81a9b00 con 0x562dc698ce90 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71e81aaf70 con 0x562dc69825d0 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71e81aa1d0 con 0x562dc6981cb0 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71f231b740 10 client.0 _ll_register_callbacks cb 0x7f71e0003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.176+0000 7f71ed4e0640 1 -- 172.21.15.73:0/1313352710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 msgr2=0x562dc6992990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71ed4e0640 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 0x562dc6992990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71ed4e0640 1 -- 172.21.15.73:0/1313352710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 msgr2=0x562dc6993410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71ed4e0640 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 0x562dc6993410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71ed4e0640 1 -- 172.21.15.73:0/1313352710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dc6a06540 con 0x562dc69825d0 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71edce1640 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 0x562dc6992990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71e40c02d0 con 0x562dc69825d0 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71ed4e0640 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6992ed0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x562dc697f0e0 tx=0x7f71d8010c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33d41b56054da152 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71d17fa640 10 client.25301 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71d17fa640 1 -- 172.21.15.73:0/1313352710 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8022060 con 0x562dc69825d0 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71d17fa640 1 -- 172.21.15.73:0/1313352710 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f71d800f8f0 con 0x562dc69825d0 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.177+0000 7f71d17fa640 1 -- 172.21.15.73:0/1313352710 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f71d800faf0 con 0x562dc69825d0 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.178+0000 7f71f231b740 10 client.25301 fetch_fsmap learned FSMap version 31 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.178+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=31}) -- 0x562dc6a077a0 con 0x562dc69825d0 2024-09-05T13:00:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.178+0000 7f71d17fa640 1 -- 172.21.15.73:0/1313352710 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f71d800fc90 con 0x562dc69825d0 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.178+0000 7f71f231b740 10 client.25301 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.178+0000 7f71f231b740 10 client.25301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.178+0000 7f71f231b740 20 client.25301 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.178+0000 7f71f231b740 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x562dc6a07e00 0x562dc6a0a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.178+0000 7f71f231b740 4 client.25301 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.178+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f71e40c02d0 con 0x562dc6a07e00 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.179+0000 7f71edce1640 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x562dc6a07e00 0x562dc6a0a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.179+0000 7f71d17fa640 10 client.25301 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.179+0000 7f71edce1640 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x562dc6a07e00 0x562dc6a0a220 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdd1bea25331a615 server_cookie=3f66c2306913b7da in_seq=0 out_seq=0 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71d17fa640 1 -- 172.21.15.73:0/1313352710 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f71e40c02d0 con 0x562dc6a07e00 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71d17fa640 10 client.25301 handle_command_reply: tid=0 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 client.25301 shutdown 2024-09-05T13:00:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 msgr2=0x562dc6992ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6992ed0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x562dc697f0e0 tx=0x7f71d8010c60 comp rx=0 tx=0).stop 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 shutdown_connections 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x562dc6a07e00 0x562dc6a0a220 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562dc698ce90 0x562dc6993410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562dc69825d0 0x562dc6992ed0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 --2- 172.21.15.73:0/1313352710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dc6981cb0 0x562dc6992990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 >> 172.21.15.73:0/1313352710 conn(0x562dc697e240 msgr2=0x562dc6974b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71d17fa640 0 client.25301 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 shutdown_connections 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 1 -- 172.21.15.73:0/1313352710 wait complete. 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.180+0000 7f71f231b740 20 client.25301 trim_cache size 0 max 16384 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.181+0000 7f71eff45640 1 -- 172.21.15.73:0/598961617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71d40a2b80 msgr2=0x7f71d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.181+0000 7f71eff45640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71d40a2b80 0x7f71d40a5040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f71e80699f0 tx=0x7f71e0009500 comp rx=0 tx=0).stop 2024-09-05T13:00:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.181+0000 7f71eff45640 1 -- 172.21.15.73:0/598961617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e8100b60 msgr2=0x7f71e81a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.181+0000 7f71eff45640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e8100b60 0x7f71e81a03f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f71e4004770 tx=0x7f71e4003c10 comp rx=0 tx=0).stop 2024-09-05T13:00:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.182+0000 7f71eff45640 1 -- 172.21.15.73:0/598961617 shutdown_connections 2024-09-05T13:00:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.182+0000 7f71eff45640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f71d40a2b80 0x7f71d40a5040 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.182+0000 7f71eff45640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e810e540 0x7f71e819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.182+0000 7f71eff45640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71e8101480 0x7f71e81a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.182+0000 7f71eff45640 1 --2- 172.21.15.73:0/598961617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71e8100b60 0x7f71e81a03f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.182+0000 7f71eff45640 1 -- 172.21.15.73:0/598961617 >> 172.21.15.73:0/598961617 conn(0x7f71e80fc7d0 msgr2=0x7f71e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.182+0000 7f71eff45640 1 -- 172.21.15.73:0/598961617 shutdown_connections 2024-09-05T13:00:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:48.182+0000 7f71eff45640 1 -- 172.21.15.73:0/598961617 wait complete. 2024-09-05T13:00:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:49 smithi073 ceph-mon[30883]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 5.39k op/s 2024-09-05T13:00:49.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:49 smithi162 ceph-mon[34220]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 5.39k op/s 2024-09-05T13:00:49.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:49 smithi169 ceph-mon[34823]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 5.39k op/s 2024-09-05T13:00:51.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:51 smithi073 ceph-mon[30883]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-09-05T13:00:51.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:51 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:51.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:51 smithi162 ceph-mon[34220]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-09-05T13:00:51.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:51 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:51 smithi169 ceph-mon[34823]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-09-05T13:00:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:51 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:52.267 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T13:00:52.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T13:00:52.816 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:00:53.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:53 smithi073 ceph-mon[30883]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2024-09-05T13:00:53.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.533+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/1581580897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd81008c0 msgr2=0x7f3cd8100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.533+0000 7f3cdc8fe640 1 --2- 172.21.15.73:0/1581580897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd81008c0 0x7f3cd8100ca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3cd001a940 tx=0x7f3cd003b470 comp rx=0 tx=0).stop 2024-09-05T13:00:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.533+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/1581580897 shutdown_connections 2024-09-05T13:00:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.533+0000 7f3cdc8fe640 1 --2- 172.21.15.73:0/1581580897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd8105ec0 0x7f3cd8106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.533+0000 7f3cdc8fe640 1 --2- 172.21.15.73:0/1581580897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81011e0 0x7f3cd8105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.533+0000 7f3cdc8fe640 1 --2- 172.21.15.73:0/1581580897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd81008c0 0x7f3cd8100ca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.533+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/1581580897 >> 172.21.15.73:0/1581580897 conn(0x7f3cd80fc7d0 msgr2=0x7f3cd80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:53.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.534+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/1581580897 shutdown_connections 2024-09-05T13:00:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.534+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/1581580897 wait complete. 2024-09-05T13:00:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cdc8fe640 1 Processor -- start 2024-09-05T13:00:53.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cdc8fe640 1 -- start start 2024-09-05T13:00:53.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cdc8fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81008c0 0x7f3cd8114e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:53.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cdc8fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd81011e0 0x7f3cd8110ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:53.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cdc8fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd8105ec0 0x7f3cd8111430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:53.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cdc8fe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd8109870 con 0x7f3cd81008c0 2024-09-05T13:00:53.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cdc8fe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd81096f0 con 0x7f3cd81011e0 2024-09-05T13:00:53.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cdc8fe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd81099f0 con 0x7f3cd8105ec0 2024-09-05T13:00:53.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cd659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81008c0 0x7f3cd8114e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:53.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cd659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81008c0 0x7f3cd8114e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52874/0 (socket says 172.21.15.73:52874) 2024-09-05T13:00:53.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.536+0000 7f3cd659c640 1 -- 172.21.15.73:0/3075895531 learned_addr learned my addr 172.21.15.73:0/3075895531 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:53.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.537+0000 7f3cd6d9d640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd8105ec0 0x7f3cd8111430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:53.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.537+0000 7f3cd659c640 1 -- 172.21.15.73:0/3075895531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd8105ec0 msgr2=0x7f3cd8111430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:53.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.537+0000 7f3cd659c640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd8105ec0 0x7f3cd8111430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:53.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.537+0000 7f3cd659c640 1 -- 172.21.15.73:0/3075895531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd81011e0 msgr2=0x7f3cd8110ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T13:00:53.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.537+0000 7f3cd659c640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd81011e0 0x7f3cd8110ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:53.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.537+0000 7f3cd659c640 1 -- 172.21.15.73:0/3075895531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd8111b60 con 0x7f3cd81008c0 2024-09-05T13:00:53.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.538+0000 7f3cd659c640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81008c0 0x7f3cd8114e50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0000c00 tx=0x7f3cd0040ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:53.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.538+0000 7f3cc77fe640 1 -- 172.21.15.73:0/3075895531 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd004f020 con 0x7f3cd81008c0 2024-09-05T13:00:53.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.538+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/3075895531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd81a2a60 con 0x7f3cd81008c0 2024-09-05T13:00:53.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.538+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/3075895531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd81a2e00 con 0x7f3cd81008c0 2024-09-05T13:00:53.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.539+0000 7f3cc77fe640 1 -- 172.21.15.73:0/3075895531 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cd0040eb0 con 0x7f3cd81008c0 2024-09-05T13:00:53.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.540+0000 7f3cc77fe640 1 -- 172.21.15.73:0/3075895531 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0046070 con 0x7f3cd81008c0 2024-09-05T13:00:53.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.540+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/3075895531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb8005290 con 0x7f3cd81008c0 2024-09-05T13:00:53.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.547+0000 7f3cc77fe640 1 -- 172.21.15.73:0/3075895531 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3cd0052020 con 0x7f3cd81008c0 2024-09-05T13:00:53.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.547+0000 7f3cc77fe640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cc00a2b20 0x7f3cc00a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:53.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.548+0000 7f3cc77fe640 1 -- 172.21.15.73:0/3075895531 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f3cd0100440 con 0x7f3cd81008c0 2024-09-05T13:00:53.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.549+0000 7f3cd5d9b640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cc00a2b20 0x7f3cc00a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:53.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.551+0000 7f3cd5d9b640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cc00a2b20 0x7f3cc00a4fe0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3cd81126b0 tx=0x7f3ccc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:53.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.553+0000 7f3cc77fe640 1 -- 172.21.15.73:0/3075895531 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3cd0059020 con 0x7f3cd81008c0 2024-09-05T13:00:53.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:53 smithi162 ceph-mon[34220]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2024-09-05T13:00:53.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:53 smithi169 ceph-mon[34823]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2024-09-05T13:00:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.939+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/3075895531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cb8005580 con 0x7f3cd81008c0 2024-09-05T13:00:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.939+0000 7f3cc77fe640 1 -- 172.21.15.73:0/3075895531 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11933 (secure 0 0 0) 0x7f3cd001a520 con 0x7f3cd81008c0 2024-09-05T13:00:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T13:00:53.941 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"btime":"2024-09-05T13:00:50:135193+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T13:00:49.542654+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25159":{"gid":25159,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/4110365542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":4110365542},{"type":"v1","addr":"172.21.15.169:6837","nonce":4110365542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24452,24466,24482]},"id":1}]} 2024-09-05T13:00:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 32 2024-09-05T13:00:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.941+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/3075895531 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cc00a2b20 msgr2=0x7f3cc00a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.941+0000 7f3cdc8fe640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cc00a2b20 0x7f3cc00a4fe0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3cd81126b0 tx=0x7f3ccc005f90 comp rx=0 tx=0).stop 2024-09-05T13:00:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.941+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/3075895531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81008c0 msgr2=0x7f3cd8114e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.941+0000 7f3cdc8fe640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81008c0 0x7f3cd8114e50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0000c00 tx=0x7f3cd0040ab0 comp rx=0 tx=0).stop 2024-09-05T13:00:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.942+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/3075895531 shutdown_connections 2024-09-05T13:00:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.942+0000 7f3cdc8fe640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3cc00a2b20 0x7f3cc00a4fe0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.942+0000 7f3cdc8fe640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd8105ec0 0x7f3cd8111430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.942+0000 7f3cdc8fe640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd81011e0 0x7f3cd8110ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.942+0000 7f3cdc8fe640 1 --2- 172.21.15.73:0/3075895531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81008c0 0x7f3cd8114e50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.942+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/3075895531 >> 172.21.15.73:0/3075895531 conn(0x7f3cd80fc7d0 msgr2=0x7f3cd810a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.942+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/3075895531 shutdown_connections 2024-09-05T13:00:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:53.942+0000 7f3cdc8fe640 1 -- 172.21.15.73:0/3075895531 wait complete. 2024-09-05T13:00:54.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:54 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3075895531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:00:54.264 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:54 smithi073 ceph-mon[30883]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-09-05T13:00:54.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:54 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3075895531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:00:54.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:54 smithi162 ceph-mon[34220]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-09-05T13:00:54.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:54 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3075895531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:00:54.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:54 smithi169 ceph-mon[34823]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-09-05T13:00:54.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T13:00:55.166 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:00:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.701+0000 7f43df871640 1 -- 172.21.15.73:0/3799803923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d8108450 msgr2=0x7f43d8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.701+0000 7f43df871640 1 --2- 172.21.15.73:0/3799803923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d8108450 0x7f43d8108830 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009900 tx=0x7f43d402a3f0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.701+0000 7f43df871640 1 -- 172.21.15.73:0/3799803923 shutdown_connections 2024-09-05T13:00:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.701+0000 7f43df871640 1 --2- 172.21.15.73:0/3799803923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d810d530 0x7f43d81150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.701+0000 7f43df871640 1 --2- 172.21.15.73:0/3799803923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43d8108e00 0x7f43d810ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.701+0000 7f43df871640 1 --2- 172.21.15.73:0/3799803923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d8108450 0x7f43d8108830 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.701+0000 7f43df871640 1 -- 172.21.15.73:0/3799803923 >> 172.21.15.73:0/3799803923 conn(0x7f43d8077ba0 msgr2=0x7f43d8079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.701+0000 7f43df871640 1 -- 172.21.15.73:0/3799803923 shutdown_connections 2024-09-05T13:00:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.702+0000 7f43df871640 1 -- 172.21.15.73:0/3799803923 wait complete. 2024-09-05T13:00:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.702+0000 7f43df871640 1 Processor -- start 2024-09-05T13:00:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.702+0000 7f43df871640 1 -- start start 2024-09-05T13:00:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.703+0000 7f43df871640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d8108450 0x7f43d81a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.703+0000 7f43df871640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43d8108e00 0x7f43d81a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.703+0000 7f43df871640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d810d530 0x7f43d819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.703+0000 7f43df871640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f43d81185b0 con 0x7f43d8108450 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.703+0000 7f43df871640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43d8118430 con 0x7f43d8108e00 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.703+0000 7f43df871640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43d8118730 con 0x7f43d810d530 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.703+0000 7f43dd60d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d8108450 0x7f43d81a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.703+0000 7f43dd60d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d8108450 0x7f43d81a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52896/0 (socket says 172.21.15.73:52896) 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.703+0000 7f43dd60d640 1 -- 172.21.15.73:0/1012589342 learned_addr learned my addr 172.21.15.73:0/1012589342 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.703+0000 7f43dde0e640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d810d530 0x7f43d819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.704+0000 7f43dd60d640 1 -- 172.21.15.73:0/1012589342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d810d530 msgr2=0x7f43d819e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.704+0000 7f43dd60d640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d810d530 0x7f43d819e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.704+0000 7f43dd60d640 1 -- 172.21.15.73:0/1012589342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43d8108e00 msgr2=0x7f43d81a4c60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.704+0000 7f43dd60d640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43d8108e00 0x7f43d81a4c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.704+0000 7f43dd60d640 1 -- 172.21.15.73:0/1012589342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d819f010 con 0x7f43d8108450 2024-09-05T13:00:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.704+0000 7f43dd60d640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d8108450 0x7f43d81a4720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f43d4006010 tx=0x7f43d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.706+0000 7f43ce7fc640 1 -- 172.21.15.73:0/1012589342 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d403f030 con 0x7f43d8108450 2024-09-05T13:00:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.706+0000 7f43df871640 1 -- 172.21.15.73:0/1012589342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d819f2a0 con 0x7f43d8108450 2024-09-05T13:00:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.706+0000 7f43df871640 1 -- 172.21.15.73:0/1012589342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d807aa40 con 0x7f43d8108450 2024-09-05T13:00:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.706+0000 7f43ce7fc640 1 -- 172.21.15.73:0/1012589342 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d4003ce0 con 0x7f43d8108450 2024-09-05T13:00:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.706+0000 7f43ce7fc640 1 -- 172.21.15.73:0/1012589342 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4035070 con 0x7f43d8108450 2024-09-05T13:00:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.709+0000 7f43ce7fc640 1 -- 172.21.15.73:0/1012589342 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f43d4042030 con 0x7f43d8108450 2024-09-05T13:00:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.710+0000 7f43e1c47740 1 Processor -- start 2024-09-05T13:00:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.710+0000 7f43e1c47740 1 -- start start 2024-09-05T13:00:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 0x559f894e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43ce7fc640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43c40a2d50 0x7f43c40a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894e1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 0x559f894ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43e1c47740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559f894472f0 con 0x559f894ec370 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43e1c47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559f893eecf0 con 0x559f894e15d0 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43e1c47740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f894432b0 con 0x559f894e2b80 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43dde0e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 0x559f894e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43dde0e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 0x559f894e1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39108/0 (socket says 172.21.15.73:39108) 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43dde0e640 1 -- 172.21.15.73:0/3209759944 learned_addr learned my addr 172.21.15.73:0/3209759944 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43dde0e640 1 --2- 172.21.15.73:0/3209759944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 0x559f894ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43dd60d640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43c40a2d50 0x7f43c40a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43dde0e640 1 -- 172.21.15.73:0/3209759944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 msgr2=0x559f894e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43dde0e640 1 --2- 172.21.15.73:0/3209759944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 0x559f894e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43dde0e640 1 -- 172.21.15.73:0/3209759944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 msgr2=0x559f894e1a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:00:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43dde0e640 1 --2- 172.21.15.73:0/3209759944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894e1a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.711+0000 7f43dde0e640 1 -- 172.21.15.73:0/3209759944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f893d33a0 con 0x559f894ec370 2024-09-05T13:00:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.712+0000 7f43ce7fc640 1 -- 172.21.15.73:0/1012589342 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f43d40ef3f0 con 0x7f43d8108450 2024-09-05T13:00:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.712+0000 7f43dde0e640 1 --2- 172.21.15.73:0/3209759944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 0x559f894ee760 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009930 tx=0x7f43d0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdced3c6346512a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.712+0000 7f43dd60d640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43c40a2d50 0x7f43c40a5210 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f43d408eeb0 tx=0x7f43d40e67b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.712+0000 7f43c37fe640 1 -- 172.21.15.73:0/3209759944 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0011dd0 con 0x559f894ec370 2024-09-05T13:00:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.713+0000 7f43c37fe640 1 -- 172.21.15.73:0/3209759944 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d0003970 con 0x559f894ec370 2024-09-05T13:00:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.713+0000 7f43c37fe640 1 -- 172.21.15.73:0/3209759944 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0004030 con 0x559f894ec370 2024-09-05T13:00:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.714+0000 7f43e1c47740 1 -- 172.21.15.73:0/3209759944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 msgr2=0x559f894ee760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.714+0000 7f43e1c47740 1 --2- 172.21.15.73:0/3209759944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 0x559f894ee760 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009930 tx=0x7f43d0009500 comp rx=0 tx=0).stop 2024-09-05T13:00:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.715+0000 7f43e1c47740 1 -- 172.21.15.73:0/3209759944 shutdown_connections 2024-09-05T13:00:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.715+0000 7f43e1c47740 1 --2- 172.21.15.73:0/3209759944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 0x559f894ee760 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.715+0000 7f43e1c47740 1 --2- 172.21.15.73:0/3209759944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894e1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.715+0000 7f43e1c47740 1 --2- 172.21.15.73:0/3209759944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 0x559f894e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.715+0000 7f43e1c47740 1 -- 172.21.15.73:0/3209759944 >> 172.21.15.73:0/3209759944 conn(0x559f894aa310 msgr2=0x559f894ddc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.716+0000 7f43e1c47740 1 -- 172.21.15.73:0/3209759944 shutdown_connections 2024-09-05T13:00:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.716+0000 7f43e1c47740 1 -- 172.21.15.73:0/3209759944 wait complete. 2024-09-05T13:00:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.716+0000 7f43e1c47740 1 -- start start 2024-09-05T13:00:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.717+0000 7f43e1c47740 1 Processor -- start 2024-09-05T13:00:55.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.717+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894ebe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.718+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894e90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.718+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894ec370 0x559f894e9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.718+0000 7f43e1c47740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559f894ef0d0 con 0x559f894e2b80 2024-09-05T13:00:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.718+0000 7f43e1c47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559f89402060 con 0x559f894e15d0 2024-09-05T13:00:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.718+0000 7f43e1c47740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f894ef250 con 0x559f894ec370 2024-09-05T13:00:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.718+0000 7f43e1c47740 10 client.0 _ll_register_callbacks cb 0x559f891558c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.718+0000 7f43dce0c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894e90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.718+0000 7f43dce0c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894e90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52912/0 (socket says 172.21.15.73:52912) 2024-09-05T13:00:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.718+0000 7f43dce0c640 1 -- 172.21.15.73:0/3457425556 learned_addr learned my addr 172.21.15.73:0/3457425556 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.718+0000 7f43dde0e640 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894ebe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.719+0000 7f43dce0c640 1 -- 172.21.15.73:0/3457425556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894ec370 msgr2=0x559f894e9840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:00:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.719+0000 7f43dce0c640 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894ec370 0x559f894e9840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.719+0000 7f43dce0c640 1 -- 172.21.15.73:0/3457425556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 msgr2=0x559f894ebe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.719+0000 7f43dce0c640 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894ebe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.719+0000 7f43dce0c640 1 -- 172.21.15.73:0/3457425556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f891b83c0 con 0x559f894e2b80 2024-09-05T13:00:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.719+0000 7f43dce0c640 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894e90b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009da0 tx=0x7f43c800b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7097a06aa2ec9a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.719+0000 7f43c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.719+0000 7f43c0ff9640 1 -- 172.21.15.73:0/3457425556 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8015020 con 0x559f894e2b80 2024-09-05T13:00:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.720+0000 7f43c0ff9640 1 -- 172.21.15.73:0/3457425556 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f43c8011420 con 0x559f894e2b80 2024-09-05T13:00:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.720+0000 7f43e1c47740 1 -- 172.21.15.73:0/3457425556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d0003970 con 0x559f894e2b80 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.720+0000 7f43c0ff9640 1 -- 172.21.15.73:0/3457425556 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f43c8011640 con 0x559f894e2b80 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.720+0000 7f43e1c47740 10 client.15798 fetch_fsmap learned FSMap version 33 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.720+0000 7f43e1c47740 1 -- 172.21.15.73:0/3457425556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559f894fad40 con 0x559f894e2b80 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.720+0000 7f43c0ff9640 1 -- 172.21.15.73:0/3457425556 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d0003970 con 0x559f894e2b80 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.721+0000 7f43c0ff9640 1 -- 172.21.15.73:0/3457425556 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f43c8019ad0 con 0x559f894e2b80 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.721+0000 7f43e1c47740 10 client.15798 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.721+0000 7f43e1c47740 10 client.15798 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.721+0000 7f43e1c47740 20 client.15798 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.721+0000 7f43e1c47740 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559f894fc200 0x559f894fe630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.721+0000 7f43e1c47740 4 client.15798 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:00:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.721+0000 7f43e1c47740 1 -- 172.21.15.73:0/3457425556 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f89454860 con 0x559f894fc200 2024-09-05T13:00:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.721+0000 7f43dde0e640 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559f894fc200 0x559f894fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.722+0000 7f43c0ff9640 10 client.15798 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T13:00:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.722+0000 7f43dde0e640 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559f894fc200 0x559f894fe630 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d11958a0e9b16883 server_cookie=e0ea0c2347e123f5 in_seq=0 out_seq=0 2024-09-05T13:00:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.722+0000 7f43c0ff9640 1 -- 172.21.15.73:0/3457425556 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f89454860 con 0x559f894fc200 2024-09-05T13:00:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.722+0000 7f43c0ff9640 10 client.15798 handle_command_reply: tid=0 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.723+0000 7f43e1c47740 1 client.15798 shutdown 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.723+0000 7f43e1c47740 1 -- 172.21.15.73:0/3457425556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 msgr2=0x559f894e90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.723+0000 7f43e1c47740 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894e90b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009da0 tx=0x7f43c800b4b0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.723+0000 7f43e1c47740 1 -- 172.21.15.73:0/3457425556 shutdown_connections 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.723+0000 7f43e1c47740 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559f894fc200 0x559f894fe630 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.723+0000 7f43e1c47740 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894ec370 0x559f894e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.723+0000 7f43e1c47740 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894e90b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.723+0000 7f43e1c47740 1 --2- 172.21.15.73:0/3457425556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894ebe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.723+0000 7f43e1c47740 1 -- 172.21.15.73:0/3457425556 >> 172.21.15.73:0/3457425556 conn(0x559f894aa310 msgr2=0x559f894e3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.723+0000 7f43c0ff9640 0 client.15798 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.724+0000 7f43e1c47740 1 -- 172.21.15.73:0/3457425556 shutdown_connections 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.724+0000 7f43e1c47740 1 -- 172.21.15.73:0/3457425556 wait complete. 2024-09-05T13:00:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.724+0000 7f43e1c47740 20 client.15798 trim_cache size 0 max 16384 2024-09-05T13:00:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.746+0000 7f43e1c47740 1 Processor -- start 2024-09-05T13:00:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.746+0000 7f43e1c47740 1 -- start start 2024-09-05T13:00:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 0x559f894e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 0x559f89503f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43e1c47740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc010dc0 con 0x559f894ec370 2024-09-05T13:00:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43e1c47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc00e5d0 con 0x559f894e15d0 2024-09-05T13:00:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43e1c47740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc00c420 con 0x559f894e2b80 2024-09-05T13:00:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43dce0c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 0x559f894e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43dce0c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 0x559f894e8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39114/0 (socket says 172.21.15.73:39114) 2024-09-05T13:00:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43dde0e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43dce0c640 1 -- 172.21.15.73:0/4069617570 learned_addr learned my addr 172.21.15.73:0/4069617570 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43dde0e640 1 --2- 172.21.15.73:0/4069617570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 0x559f89503f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43dde0e640 1 -- 172.21.15.73:0/4069617570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 msgr2=0x559f894e8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43dde0e640 1 --2- 172.21.15.73:0/4069617570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 0x559f894e8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43dde0e640 1 -- 172.21.15.73:0/4069617570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 msgr2=0x559f89503f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43dde0e640 1 --2- 172.21.15.73:0/4069617570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 0x559f89503f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.747+0000 7f43dde0e640 1 -- 172.21.15.73:0/4069617570 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f894e9bb0 con 0x559f894e15d0 2024-09-05T13:00:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.748+0000 7f43dde0e640 1 --2- 172.21.15.73:0/4069617570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894ddd70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009900 tx=0x7f43d0005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2823d0206ddb775e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.748+0000 7f43c2ffd640 1 -- 172.21.15.73:0/4069617570 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0003b70 con 0x559f894e15d0 2024-09-05T13:00:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.748+0000 7f43c2ffd640 1 -- 172.21.15.73:0/4069617570 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d0009e90 con 0x559f894e15d0 2024-09-05T13:00:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.748+0000 7f43c2ffd640 1 -- 172.21.15.73:0/4069617570 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0027750 con 0x559f894e15d0 2024-09-05T13:00:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.749+0000 7f43e1c47740 1 -- 172.21.15.73:0/4069617570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 msgr2=0x559f894ddd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.749+0000 7f43e1c47740 1 --2- 172.21.15.73:0/4069617570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894ddd70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009900 tx=0x7f43d0005040 comp rx=0 tx=0).stop 2024-09-05T13:00:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.749+0000 7f43e1c47740 1 -- 172.21.15.73:0/4069617570 shutdown_connections 2024-09-05T13:00:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.749+0000 7f43e1c47740 1 --2- 172.21.15.73:0/4069617570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894ec370 0x559f89503f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.749+0000 7f43e1c47740 1 --2- 172.21.15.73:0/4069617570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894e2b80 0x559f894e8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.749+0000 7f43e1c47740 1 --2- 172.21.15.73:0/4069617570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894ddd70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.749+0000 7f43e1c47740 1 -- 172.21.15.73:0/4069617570 >> 172.21.15.73:0/4069617570 conn(0x559f894aa310 msgr2=0x559f894e7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.749+0000 7f43e1c47740 1 -- 172.21.15.73:0/4069617570 shutdown_connections 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.750+0000 7f43e1c47740 1 -- 172.21.15.73:0/4069617570 wait complete. 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.750+0000 7f43e1c47740 1 -- start start 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.750+0000 7f43e1c47740 1 Processor -- start 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43e1c47740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894ec370 0x559f894efec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43e1c47740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc00ca90 con 0x559f894e2b80 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43e1c47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc00df00 con 0x559f894e15d0 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43e1c47740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc00d160 con 0x559f894ec370 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43e1c47740 10 client.0 _ll_register_callbacks cb 0x7f43c8006e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43dce0c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43dce0c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52936/0 (socket says 172.21.15.73:52936) 2024-09-05T13:00:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43dce0c640 1 -- 172.21.15.73:0/1502633705 learned_addr learned my addr 172.21.15.73:0/1502633705 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43dde0e640 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43dde0e640 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894ec370 0x559f894efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43dde0e640 1 -- 172.21.15.73:0/1502633705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894ec370 msgr2=0x559f894efec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43dde0e640 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894ec370 0x559f894efec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43dde0e640 1 -- 172.21.15.73:0/1502633705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 msgr2=0x559f894f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43dde0e640 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.751+0000 7f43dde0e640 1 -- 172.21.15.73:0/1502633705 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f894f06f0 con 0x559f894e15d0 2024-09-05T13:00:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.752+0000 7f43dde0e640 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894f48f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f43d0011790 tx=0x7f43d0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80a671e65c67edfd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.752+0000 7f43c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:00:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.752+0000 7f43c0ff9640 1 -- 172.21.15.73:0/1502633705 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0027720 con 0x559f894e15d0 2024-09-05T13:00:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.752+0000 7f43e1c47740 1 -- 172.21.15.73:0/1502633705 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d0009e90 con 0x559f894e15d0 2024-09-05T13:00:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.752+0000 7f43c0ff9640 1 -- 172.21.15.73:0/1502633705 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f43d0003970 con 0x559f894e15d0 2024-09-05T13:00:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.752+0000 7f43c0ff9640 1 -- 172.21.15.73:0/1502633705 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f43d0003b70 con 0x559f894e15d0 2024-09-05T13:00:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.754+0000 7f43e1c47740 10 client.25310 fetch_fsmap learned FSMap version 33 2024-09-05T13:00:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.754+0000 7f43e1c47740 1 -- 172.21.15.73:0/1502633705 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559f89566b70 con 0x559f894e15d0 2024-09-05T13:00:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.754+0000 7f43c0ff9640 1 -- 172.21.15.73:0/1502633705 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d0009e90 con 0x559f894e15d0 2024-09-05T13:00:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.754+0000 7f43c0ff9640 1 -- 172.21.15.73:0/1502633705 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f43d0033040 con 0x559f894e15d0 2024-09-05T13:00:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.754+0000 7f43e1c47740 10 client.25310 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:00:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.754+0000 7f43e1c47740 10 client.25310 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T13:00:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.755+0000 7f43e1c47740 20 client.25310 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.755+0000 7f43e1c47740 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559f89566f70 0x559f89569390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.755+0000 7f43e1c47740 4 client.25310 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:00:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.755+0000 7f43e1c47740 1 -- 172.21.15.73:0/1502633705 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f8944ed70 con 0x559f89566f70 2024-09-05T13:00:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.755+0000 7f43dce0c640 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559f89566f70 0x559f89569390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43dce0c640 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559f89566f70 0x559f89569390 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=72d3e4681f22fc17 server_cookie=71754bc5d1aff5dc in_seq=0 out_seq=0 2024-09-05T13:00:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43c0ff9640 10 client.25310 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T13:00:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43c0ff9640 1 -- 172.21.15.73:0/1502633705 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f8944ed70 con 0x559f89566f70 2024-09-05T13:00:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43c0ff9640 10 client.25310 handle_command_reply: tid=0 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43e1c47740 1 client.25310 shutdown 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43e1c47740 1 -- 172.21.15.73:0/1502633705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 msgr2=0x559f894f48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43e1c47740 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894f48f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f43d0011790 tx=0x7f43d0005fd0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43e1c47740 1 -- 172.21.15.73:0/1502633705 shutdown_connections 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43e1c47740 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x559f89566f70 0x559f89569390 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43e1c47740 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f894ec370 0x559f894efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43e1c47740 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f894e2b80 0x559f894f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43e1c47740 1 --2- 172.21.15.73:0/1502633705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f894e15d0 0x559f894f48f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43e1c47740 1 -- 172.21.15.73:0/1502633705 >> 172.21.15.73:0/1502633705 conn(0x559f894aa310 msgr2=0x559f894ea910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.756+0000 7f43c0ff9640 0 client.25310 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.757+0000 7f43e1c47740 1 -- 172.21.15.73:0/1502633705 shutdown_connections 2024-09-05T13:00:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.757+0000 7f43e1c47740 1 -- 172.21.15.73:0/1502633705 wait complete. 2024-09-05T13:00:55.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.757+0000 7f43e1c47740 20 client.25310 trim_cache size 0 max 16384 2024-09-05T13:00:55.762 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:00:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 -- 172.21.15.73:0/1012589342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43c40a2d50 msgr2=0x7f43c40a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43c40a2d50 0x7f43c40a5210 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f43d408eeb0 tx=0x7f43d40e67b0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 -- 172.21.15.73:0/1012589342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d8108450 msgr2=0x7f43d81a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d8108450 0x7f43d81a4720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f43d4006010 tx=0x7f43d40042f0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 -- 172.21.15.73:0/1012589342 shutdown_connections 2024-09-05T13:00:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f43c40a2d50 0x7f43c40a5210 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d810d530 0x7f43d819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43d8108e00 0x7f43d81a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 --2- 172.21.15.73:0/1012589342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d8108450 0x7f43d81a4720 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 -- 172.21.15.73:0/1012589342 >> 172.21.15.73:0/1012589342 conn(0x7f43d8077ba0 msgr2=0x7f43d8078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 -- 172.21.15.73:0/1012589342 shutdown_connections 2024-09-05T13:00:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:00:55.758+0000 7f43df871640 1 -- 172.21.15.73:0/1012589342 wait complete. 2024-09-05T13:00:56.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:56 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:56.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:56 smithi073 ceph-mon[30883]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-09-05T13:00:56.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:56 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:56.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:56 smithi162 ceph-mon[34220]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-09-05T13:00:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:56 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:00:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:56 smithi169 ceph-mon[34823]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-09-05T13:00:59.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:00:59 smithi169 ceph-mon[34823]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2024-09-05T13:00:59.499 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:00:59 smithi073 ceph-mon[30883]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2024-09-05T13:00:59.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T13:00:59.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:00:59 smithi162 ceph-mon[34220]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2024-09-05T13:00:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.767+0000 7f59c77fe640 1 -- 172.21.15.73:0/1776328813 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc030ac0 con 0x7f59c81001d0 2024-09-05T13:00:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.767+0000 7f59ceb01640 1 -- 172.21.15.73:0/1776328813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c81001d0 msgr2=0x7f59c81005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.767+0000 7f59ceb01640 1 --2- 172.21.15.73:0/1776328813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c81001d0 0x7f59c81005d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00aa10 tx=0x7f59bc02b760 comp rx=0 tx=0).stop 2024-09-05T13:00:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.767+0000 7f59ceb01640 1 -- 172.21.15.73:0/1776328813 shutdown_connections 2024-09-05T13:00:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.767+0000 7f59ceb01640 1 --2- 172.21.15.73:0/1776328813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59c8101d80 0x7f59c8108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.767+0000 7f59ceb01640 1 --2- 172.21.15.73:0/1776328813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c81013c0 0x7f59c8101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.767+0000 7f59ceb01640 1 --2- 172.21.15.73:0/1776328813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c81001d0 0x7f59c81005d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.767+0000 7f59ceb01640 1 -- 172.21.15.73:0/1776328813 >> 172.21.15.73:0/1776328813 conn(0x7f59c80fb930 msgr2=0x7f59c80fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.767+0000 7f59ceb01640 1 -- 172.21.15.73:0/1776328813 shutdown_connections 2024-09-05T13:00:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.767+0000 7f59ceb01640 1 -- 172.21.15.73:0/1776328813 wait complete. 2024-09-05T13:00:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.768+0000 7f59ceb01640 1 Processor -- start 2024-09-05T13:00:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.768+0000 7f59ceb01640 1 -- start start 2024-09-05T13:00:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59ceb01640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c81001d0 0x7f59c819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59ceb01640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c81013c0 0x7f59c819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59ceb01640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59c8101d80 0x7f59c81a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59ceb01640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f59c810b730 con 0x7f59c81013c0 2024-09-05T13:00:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59ceb01640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59c810b5b0 con 0x7f59c8101d80 2024-09-05T13:00:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59ceb01640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f59c810b8b0 con 0x7f59c81001d0 2024-09-05T13:00:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59cc89d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c81001d0 0x7f59c819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59cc89d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c81001d0 0x7f59c819a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39124/0 (socket says 172.21.15.73:39124) 2024-09-05T13:00:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59cc89d640 1 -- 172.21.15.73:0/1631072647 learned_addr learned my addr 172.21.15.73:0/1631072647 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59cc89d640 1 -- 172.21.15.73:0/1631072647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59c8101d80 msgr2=0x7f59c81a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59cc89d640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59c8101d80 0x7f59c81a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59cc89d640 1 -- 172.21.15.73:0/1631072647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c81013c0 msgr2=0x7f59c819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.769+0000 7f59cc89d640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c81013c0 0x7f59c819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.770+0000 7f59cc89d640 1 -- 172.21.15.73:0/1631072647 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c806bd40 con 0x7f59c81001d0 2024-09-05T13:00:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.770+0000 7f59cc89d640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c81001d0 0x7f59c819a160 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0305f0 tx=0x7f59bc030ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.770+0000 7f59c5ffb640 1 -- 172.21.15.73:0/1631072647 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc03f070 con 0x7f59c81001d0 2024-09-05T13:00:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.771+0000 7f59c5ffb640 1 -- 172.21.15.73:0/1631072647 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59bc032400 con 0x7f59c81001d0 2024-09-05T13:00:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.771+0000 7f59ceb01640 1 -- 172.21.15.73:0/1631072647 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c806bfd0 con 0x7f59c81001d0 2024-09-05T13:00:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.771+0000 7f59c5ffb640 1 -- 172.21.15.73:0/1631072647 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc036040 con 0x7f59c81001d0 2024-09-05T13:00:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.771+0000 7f59ceb01640 1 -- 172.21.15.73:0/1631072647 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c806c540 con 0x7f59c81001d0 2024-09-05T13:00:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59d1894740 1 Processor -- start 2024-09-05T13:00:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59d1894740 1 -- start start 2024-09-05T13:00:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59d1894740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7d9a0 0x55e620e7dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59d1894740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e7e2e0 0x55e620e82da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59d1894740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 0x55e620e85830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59d1894740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e620de12f0 con 0x55e620e7e2e0 2024-09-05T13:00:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59d1894740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e620d89270 con 0x55e620e7d9a0 2024-09-05T13:00:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59d1894740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e620ddd2b0 con 0x55e620e83370 2024-09-05T13:00:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59cd09e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7d9a0 0x55e620e7dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59cd09e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7d9a0 0x55e620e7dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:58162/0 (socket says 172.21.15.73:58162) 2024-09-05T13:00:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.774+0000 7f59cd09e640 1 -- 172.21.15.73:0/1355892513 learned_addr learned my addr 172.21.15.73:0/1355892513 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.775+0000 7f59c7fff640 1 --2- 172.21.15.73:0/1355892513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 0x55e620e85830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.775+0000 7f59c7fff640 1 -- 172.21.15.73:0/1355892513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7d9a0 msgr2=0x55e620e7dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.775+0000 7f59c7fff640 1 --2- 172.21.15.73:0/1355892513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7d9a0 0x55e620e7dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.775+0000 7f59c7fff640 1 -- 172.21.15.73:0/1355892513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e7e2e0 msgr2=0x55e620e82da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:00:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.775+0000 7f59c7fff640 1 --2- 172.21.15.73:0/1355892513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e7e2e0 0x55e620e82da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.775+0000 7f59c7fff640 1 -- 172.21.15.73:0/1355892513 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e620d88340 con 0x55e620e83370 2024-09-05T13:00:59.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.775+0000 7f59c7fff640 1 --2- 172.21.15.73:0/1355892513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 0x55e620e85830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59b80096f0 tx=0x7f59b8009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3847b60cf6e50a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:59.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.776+0000 7f59aeffd640 1 -- 172.21.15.73:0/1355892513 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8015020 con 0x55e620e83370 2024-09-05T13:00:59.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.776+0000 7f59aeffd640 1 -- 172.21.15.73:0/1355892513 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59b800bdb0 con 0x55e620e83370 2024-09-05T13:00:59.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.776+0000 7f59aeffd640 1 -- 172.21.15.73:0/1355892513 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80105c0 con 0x55e620e83370 2024-09-05T13:00:59.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.776+0000 7f59c5ffb640 1 -- 172.21.15.73:0/1631072647 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f59bc042070 con 0x7f59c81001d0 2024-09-05T13:00:59.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.777+0000 7f59c5ffb640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59b00a2e70 0x7f59b00a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.777+0000 7f59c5ffb640 1 -- 172.21.15.73:0/1631072647 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f59bc0ef670 con 0x7f59c81001d0 2024-09-05T13:00:59.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.778+0000 7f59cd09e640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59b00a2e70 0x7f59b00a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.779+0000 7f59cd09e640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59b00a2e70 0x7f59b00a5330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f59c0014770 tx=0x7f59c0016040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:59.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.782+0000 7f59d1894740 1 -- 172.21.15.73:0/1355892513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 msgr2=0x55e620e85830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:59.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.782+0000 7f59d1894740 1 --2- 172.21.15.73:0/1355892513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 0x55e620e85830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59b80096f0 tx=0x7f59b8009bb0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.782+0000 7f59d1894740 1 -- 172.21.15.73:0/1355892513 shutdown_connections 2024-09-05T13:00:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.782+0000 7f59d1894740 1 --2- 172.21.15.73:0/1355892513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 0x55e620e85830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.783+0000 7f59d1894740 1 --2- 172.21.15.73:0/1355892513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e7e2e0 0x55e620e82da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.783+0000 7f59d1894740 1 --2- 172.21.15.73:0/1355892513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7d9a0 0x55e620e7dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.783+0000 7f59d1894740 1 -- 172.21.15.73:0/1355892513 >> 172.21.15.73:0/1355892513 conn(0x55e620e79010 msgr2=0x55e620e79410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.783+0000 7f59d1894740 1 -- 172.21.15.73:0/1355892513 shutdown_connections 2024-09-05T13:00:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.783+0000 7f59d1894740 1 -- 172.21.15.73:0/1355892513 wait complete. 2024-09-05T13:00:59.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.783+0000 7f59d1894740 1 -- start start 2024-09-05T13:00:59.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.783+0000 7f59d1894740 1 Processor -- start 2024-09-05T13:00:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.784+0000 7f59d1894740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e7d9a0 0x55e620e87c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.784+0000 7f59d1894740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e881c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.784+0000 7f59d1894740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 0x55e620e8f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.784+0000 7f59d1894740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e620e86340 con 0x55e620e7d9a0 2024-09-05T13:00:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.784+0000 7f59c7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e881c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.784+0000 7f59d1894740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e620d6a290 con 0x55e620e7e2e0 2024-09-05T13:00:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.784+0000 7f59d1894740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e620e864c0 con 0x55e620e83370 2024-09-05T13:00:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59c7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e881c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:58170/0 (socket says 172.21.15.73:58170) 2024-09-05T13:00:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59c7fff640 1 -- 172.21.15.73:0/3401503728 learned_addr learned my addr 172.21.15.73:0/3401503728 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59d1894740 10 client.0 _ll_register_callbacks cb 0x55e620d9b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59cd09e640 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 0x55e620e8f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59c7fff640 1 -- 172.21.15.73:0/3401503728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 msgr2=0x55e620e8f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59c7fff640 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 0x55e620e8f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59c7fff640 1 -- 172.21.15.73:0/3401503728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e7d9a0 msgr2=0x55e620e87c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:00:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59c7fff640 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e7d9a0 0x55e620e87c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59c7fff640 1 -- 172.21.15.73:0/3401503728 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e620af4210 con 0x55e620e7e2e0 2024-09-05T13:00:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59cd09e640 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 0x55e620e8f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:00:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.785+0000 7f59c7fff640 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e881c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f59b8007fd0 tx=0x7f59b8011940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=919c28f9801de586 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:59.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.786+0000 7f59a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:00:59.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.786+0000 7f59a7fff640 1 -- 172.21.15.73:0/3401503728 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8020070 con 0x55e620e7e2e0 2024-09-05T13:00:59.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.787+0000 7f59d1894740 1 -- 172.21.15.73:0/3401503728 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59b800bdb0 con 0x55e620e7e2e0 2024-09-05T13:00:59.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.787+0000 7f59a7fff640 1 -- 172.21.15.73:0/3401503728 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f59b800b8d0 con 0x55e620e7e2e0 2024-09-05T13:00:59.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.788+0000 7f59a7fff640 1 -- 172.21.15.73:0/3401503728 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f59b802c070 con 0x55e620e7e2e0 2024-09-05T13:00:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.790+0000 7f59d1894740 10 client.25316 fetch_fsmap learned FSMap version 33 2024-09-05T13:00:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.790+0000 7f59d1894740 1 -- 172.21.15.73:0/3401503728 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e620bc0620 con 0x55e620e7e2e0 2024-09-05T13:00:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.790+0000 7f59a7fff640 1 -- 172.21.15.73:0/3401503728 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59b800bdb0 con 0x55e620e7e2e0 2024-09-05T13:00:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.790+0000 7f59a7fff640 1 -- 172.21.15.73:0/3401503728 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f59b801a500 con 0x55e620e7e2e0 2024-09-05T13:00:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.791+0000 7f59d1894740 10 client.25316 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:00:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.791+0000 7f59d1894740 10 client.25316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.791+0000 7f59d1894740 20 client.25316 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.791+0000 7f59d1894740 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e620e93cc0 0x55e620e96140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.791+0000 7f59d1894740 4 client.25316 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:00:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.791+0000 7f59d1894740 1 -- 172.21.15.73:0/3401503728 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e620deea20 con 0x55e620e93cc0 2024-09-05T13:00:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.791+0000 7f59cc89d640 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e620e93cc0 0x55e620e96140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.795+0000 7f59cc89d640 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e620e93cc0 0x55e620e96140 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca2643ec03d442d server_cookie=d9de6a1b4a9a2e6b in_seq=0 out_seq=0 2024-09-05T13:00:59.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.795+0000 7f59a7fff640 10 client.25316 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:59.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.797+0000 7f59a7fff640 1 -- 172.21.15.73:0/3401503728 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e620deea20 con 0x55e620e93cc0 2024-09-05T13:00:59.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.797+0000 7f59a7fff640 10 client.25316 handle_command_reply: tid=0 2024-09-05T13:00:59.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.798+0000 7f59d1894740 1 client.25316 shutdown 2024-09-05T13:00:59.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.798+0000 7f59d1894740 1 -- 172.21.15.73:0/3401503728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 msgr2=0x55e620e881c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:59.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.798+0000 7f59d1894740 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e881c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f59b8007fd0 tx=0x7f59b8011940 comp rx=0 tx=0).stop 2024-09-05T13:00:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.801+0000 7f59d1894740 1 -- 172.21.15.73:0/3401503728 shutdown_connections 2024-09-05T13:00:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.801+0000 7f59d1894740 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e620e93cc0 0x55e620e96140 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.801+0000 7f59d1894740 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e83370 0x55e620e8f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.801+0000 7f59d1894740 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e881c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.801+0000 7f59d1894740 1 --2- 172.21.15.73:0/3401503728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e7d9a0 0x55e620e87c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.801+0000 7f59d1894740 1 -- 172.21.15.73:0/3401503728 >> 172.21.15.73:0/3401503728 conn(0x55e620e79010 msgr2=0x55e620e7a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:59.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.801+0000 7f59a7fff640 0 client.25316 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.802+0000 7f59d1894740 1 -- 172.21.15.73:0/3401503728 shutdown_connections 2024-09-05T13:00:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.803+0000 7f59d1894740 1 -- 172.21.15.73:0/3401503728 wait complete. 2024-09-05T13:00:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.803+0000 7f59d1894740 20 client.25316 trim_cache size 0 max 16384 2024-09-05T13:00:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59d1894740 1 Processor -- start 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59d1894740 1 -- start start 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59d1894740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e7d9a0 0x55e620e7f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59d1894740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e8f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59d1894740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e7fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59d1894740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f59c8073850 con 0x55e620e83370 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59d1894740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59c8071060 con 0x55e620e7e2e0 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59d1894740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f59c806eeb0 con 0x55e620e7d9a0 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59cd09e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e7fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59cd09e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e7fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52964/0 (socket says 172.21.15.73:52964) 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59cd09e640 1 -- 172.21.15.73:0/1786354254 learned_addr learned my addr 172.21.15.73:0/1786354254 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.836+0000 7f59c7fff640 1 --2- 172.21.15.73:0/1786354254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e8f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.838+0000 7f59cd09e640 1 -- 172.21.15.73:0/1786354254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e7d9a0 msgr2=0x55e620e7f520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:00:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.838+0000 7f59cd09e640 1 --2- 172.21.15.73:0/1786354254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e7d9a0 0x55e620e7f520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.838+0000 7f59cd09e640 1 -- 172.21.15.73:0/1786354254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 msgr2=0x55e620e8f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.838+0000 7f59cd09e640 1 --2- 172.21.15.73:0/1786354254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e8f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.838+0000 7f59cd09e640 1 -- 172.21.15.73:0/1786354254 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e620e85ba0 con 0x55e620e83370 2024-09-05T13:00:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.838+0000 7f59cd09e640 1 --2- 172.21.15.73:0/1786354254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e7fa60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f59c000fb90 tx=0x7f59c001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06815b7a136e5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.839+0000 7f59ae7fc640 1 -- 172.21.15.73:0/1786354254 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c001fc20 con 0x55e620e83370 2024-09-05T13:00:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.839+0000 7f59ae7fc640 1 -- 172.21.15.73:0/1786354254 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59c002f070 con 0x55e620e83370 2024-09-05T13:00:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.839+0000 7f59ae7fc640 1 -- 172.21.15.73:0/1786354254 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c001e6c0 con 0x55e620e83370 2024-09-05T13:00:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.840+0000 7f59d1894740 1 -- 172.21.15.73:0/1786354254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 msgr2=0x55e620e7fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.840+0000 7f59d1894740 1 --2- 172.21.15.73:0/1786354254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e7fa60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f59c000fb90 tx=0x7f59c001e000 comp rx=0 tx=0).stop 2024-09-05T13:00:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.840+0000 7f59d1894740 1 -- 172.21.15.73:0/1786354254 shutdown_connections 2024-09-05T13:00:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.840+0000 7f59d1894740 1 --2- 172.21.15.73:0/1786354254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e7fa60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.840+0000 7f59d1894740 1 --2- 172.21.15.73:0/1786354254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e8f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.840+0000 7f59d1894740 1 --2- 172.21.15.73:0/1786354254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e7d9a0 0x55e620e7f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.840+0000 7f59d1894740 1 -- 172.21.15.73:0/1786354254 >> 172.21.15.73:0/1786354254 conn(0x55e620e79010 msgr2=0x55e620e87c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.843+0000 7f59d1894740 1 -- 172.21.15.73:0/1786354254 shutdown_connections 2024-09-05T13:00:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.843+0000 7f59d1894740 1 -- 172.21.15.73:0/1786354254 wait complete. 2024-09-05T13:00:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.843+0000 7f59d1894740 1 -- start start 2024-09-05T13:00:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.843+0000 7f59d1894740 1 Processor -- start 2024-09-05T13:00:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.844+0000 7f59d1894740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e7d9a0 0x55e620e8f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.844+0000 7f59d1894740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e8bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.844+0000 7f59d1894740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e8c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.844+0000 7f59d1894740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f59c806f520 con 0x55e620e83370 2024-09-05T13:00:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.844+0000 7f59d1894740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59c8070990 con 0x55e620e7e2e0 2024-09-05T13:00:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.844+0000 7f59d1894740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f59c806fbf0 con 0x55e620e7d9a0 2024-09-05T13:00:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.844+0000 7f59d1894740 10 client.0 _ll_register_callbacks cb 0x7f59c0012120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:00:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.845+0000 7f59cd09e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e8c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.845+0000 7f59cd09e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e8c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52970/0 (socket says 172.21.15.73:52970) 2024-09-05T13:00:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.845+0000 7f59cd09e640 1 -- 172.21.15.73:0/2441533390 learned_addr learned my addr 172.21.15.73:0/2441533390 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:00:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.845+0000 7f59cd09e640 1 -- 172.21.15.73:0/2441533390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e7d9a0 msgr2=0x55e620e8f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.845+0000 7f59cd09e640 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e7d9a0 0x55e620e8f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.845+0000 7f59cd09e640 1 -- 172.21.15.73:0/2441533390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 msgr2=0x55e620e8bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:00:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.845+0000 7f59cd09e640 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e8bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.845+0000 7f59cd09e640 1 -- 172.21.15.73:0/2441533390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e620efcaa0 con 0x55e620e83370 2024-09-05T13:00:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.846+0000 7f59cd09e640 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e8c330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f59c002a630 tx=0x7f59c002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d364b6d424aebe9b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:00:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.846+0000 7f59a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:00:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.846+0000 7f59a7fff640 1 -- 172.21.15.73:0/2441533390 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c003d610 con 0x55e620e83370 2024-09-05T13:00:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.846+0000 7f59d1894740 1 -- 172.21.15.73:0/2441533390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59c002f070 con 0x55e620e83370 2024-09-05T13:00:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.846+0000 7f59a7fff640 1 -- 172.21.15.73:0/2441533390 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f59c003d7b0 con 0x55e620e83370 2024-09-05T13:00:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.846+0000 7f59a7fff640 1 -- 172.21.15.73:0/2441533390 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f59c00113c0 con 0x55e620e83370 2024-09-05T13:00:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.846+0000 7f59d1894740 10 client.15813 fetch_fsmap learned FSMap version 33 2024-09-05T13:00:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.846+0000 7f59d1894740 1 -- 172.21.15.73:0/2441533390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e620efdde0 con 0x55e620e83370 2024-09-05T13:00:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.847+0000 7f59a7fff640 1 -- 172.21.15.73:0/2441533390 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59c002f070 con 0x55e620e83370 2024-09-05T13:00:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.847+0000 7f59a7fff640 1 -- 172.21.15.73:0/2441533390 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f59c00338e0 con 0x55e620e83370 2024-09-05T13:00:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.847+0000 7f59d1894740 10 client.15813 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:00:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.847+0000 7f59d1894740 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:00:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.847+0000 7f59d1894740 20 client.15813 populate_metadata read hostname 'smithi073' 2024-09-05T13:00:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.847+0000 7f59d1894740 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e620efe7f0 0x55e620f00cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:00:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.847+0000 7f59d1894740 4 client.15813 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:00:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.847+0000 7f59d1894740 1 -- 172.21.15.73:0/2441533390 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e620de8d70 con 0x55e620efe7f0 2024-09-05T13:00:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.848+0000 7f59cc89d640 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e620efe7f0 0x55e620f00cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:00:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.849+0000 7f59cc89d640 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e620efe7f0 0x55e620f00cb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e39639ca2902cdf9 server_cookie=8eb0bd51aff9cbf7 in_seq=0 out_seq=0 2024-09-05T13:00:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.849+0000 7f59a7fff640 10 client.15813 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.875+0000 7f59a7fff640 1 -- 172.21.15.73:0/2441533390 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e620de8d70 con 0x55e620efe7f0 2024-09-05T13:00:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.875+0000 7f59a7fff640 10 client.15813 handle_command_reply: tid=0 2024-09-05T13:00:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.875+0000 7f59d1894740 1 client.15813 shutdown 2024-09-05T13:00:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.878+0000 7f59d1894740 1 -- 172.21.15.73:0/2441533390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 msgr2=0x55e620e8c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.878+0000 7f59d1894740 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e8c330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f59c002a630 tx=0x7f59c002a660 comp rx=0 tx=0).stop 2024-09-05T13:00:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.880+0000 7f59d1894740 1 -- 172.21.15.73:0/2441533390 shutdown_connections 2024-09-05T13:00:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.880+0000 7f59d1894740 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e620efe7f0 0x55e620f00cb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.880+0000 7f59d1894740 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e620e83370 0x55e620e8c330 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.880+0000 7f59d1894740 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e620e7e2e0 0x55e620e8bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.880+0000 7f59d1894740 1 --2- 172.21.15.73:0/2441533390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e620e7d9a0 0x55e620e8f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.880+0000 7f59d1894740 1 -- 172.21.15.73:0/2441533390 >> 172.21.15.73:0/2441533390 conn(0x55e620e79010 msgr2=0x55e620e779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.880+0000 7f59a7fff640 0 client.15813 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:00:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.880+0000 7f59d1894740 1 -- 172.21.15.73:0/2441533390 shutdown_connections 2024-09-05T13:00:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.880+0000 7f59d1894740 1 -- 172.21.15.73:0/2441533390 wait complete. 2024-09-05T13:00:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.881+0000 7f59d1894740 20 client.15813 trim_cache size 0 max 16384 2024-09-05T13:00:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:00:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:00:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:00:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:00:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.884+0000 7f59ceb01640 1 -- 172.21.15.73:0/1631072647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59b00a2e70 msgr2=0x7f59b00a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.884+0000 7f59ceb01640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59b00a2e70 0x7f59b00a5330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f59c0014770 tx=0x7f59c0016040 comp rx=0 tx=0).stop 2024-09-05T13:00:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.884+0000 7f59ceb01640 1 -- 172.21.15.73:0/1631072647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c81001d0 msgr2=0x7f59c819a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:00:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.884+0000 7f59ceb01640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c81001d0 0x7f59c819a160 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0305f0 tx=0x7f59bc030ea0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.885+0000 7f59ceb01640 1 -- 172.21.15.73:0/1631072647 shutdown_connections 2024-09-05T13:00:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.885+0000 7f59ceb01640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59b00a2e70 0x7f59b00a5330 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.885+0000 7f59ceb01640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59c8101d80 0x7f59c81a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.886+0000 7f59ceb01640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c81013c0 0x7f59c819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.886+0000 7f59ceb01640 1 --2- 172.21.15.73:0/1631072647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c81001d0 0x7f59c819a160 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:00:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.886+0000 7f59ceb01640 1 -- 172.21.15.73:0/1631072647 >> 172.21.15.73:0/1631072647 conn(0x7f59c80fb930 msgr2=0x7f59c81046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:00:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.886+0000 7f59ceb01640 1 -- 172.21.15.73:0/1631072647 shutdown_connections 2024-09-05T13:00:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:00:59.887+0000 7f59ceb01640 1 -- 172.21.15.73:0/1631072647 wait complete. 2024-09-05T13:01:00.004 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:01:00.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.661+0000 7fd76e9a1640 1 -- 172.21.15.73:0/2970811965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd768109450 msgr2=0x7fd768109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.661+0000 7fd76e9a1640 1 --2- 172.21.15.73:0/2970811965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd768109450 0x7fd768109830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd760005fd0 tx=0x7fd76002b430 comp rx=0 tx=0).stop 2024-09-05T13:01:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.662+0000 7fd76e9a1640 1 -- 172.21.15.73:0/2970811965 shutdown_connections 2024-09-05T13:01:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.662+0000 7fd76e9a1640 1 --2- 172.21.15.73:0/2970811965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd76810ea80 0x7fd7681154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.662+0000 7fd76e9a1640 1 --2- 172.21.15.73:0/2970811965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd768109e00 0x7fd76810e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.662+0000 7fd76e9a1640 1 --2- 172.21.15.73:0/2970811965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd768109450 0x7fd768109830 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.662+0000 7fd76e9a1640 1 -- 172.21.15.73:0/2970811965 >> 172.21.15.73:0/2970811965 conn(0x7fd76806e2d0 msgr2=0x7fd76806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.665+0000 7fd76e9a1640 1 -- 172.21.15.73:0/2970811965 shutdown_connections 2024-09-05T13:01:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.665+0000 7fd76e9a1640 1 -- 172.21.15.73:0/2970811965 wait complete. 2024-09-05T13:01:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.666+0000 7fd76e9a1640 1 Processor -- start 2024-09-05T13:01:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.666+0000 7fd76e9a1640 1 -- start start 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.666+0000 7fd76e9a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd768109450 0x7fd76811e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.666+0000 7fd76e9a1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd768109e00 0x7fd7681188b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.666+0000 7fd76e9a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd76810ea80 0x7fd768118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.667+0000 7fd76e9a1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd768117300 con 0x7fd768109e00 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.667+0000 7fd76e9a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd768117180 con 0x7fd76810ea80 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.667+0000 7fd76e9a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd768117480 con 0x7fd768109450 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.667+0000 7fd767fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd768109450 0x7fd76811e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.667+0000 7fd767fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd768109450 0x7fd76811e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39194/0 (socket says 172.21.15.73:39194) 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.667+0000 7fd76cf3e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd76810ea80 0x7fd768118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.667+0000 7fd767fff640 1 -- 172.21.15.73:0/1514937014 learned_addr learned my addr 172.21.15.73:0/1514937014 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.667+0000 7fd7677fe640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd768109e00 0x7fd7681188b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.668+0000 7fd7677fe640 1 -- 172.21.15.73:0/1514937014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd768109450 msgr2=0x7fd76811e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.668+0000 7fd7677fe640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd768109450 0x7fd76811e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.668+0000 7fd7677fe640 1 -- 172.21.15.73:0/1514937014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd76810ea80 msgr2=0x7fd768118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.668+0000 7fd7677fe640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd76810ea80 0x7fd768118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.668+0000 7fd7677fe640 1 -- 172.21.15.73:0/1514937014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd768119540 con 0x7fd768109e00 2024-09-05T13:01:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.671+0000 7fd7677fe640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd768109e00 0x7fd7681188b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009fd0 tx=0x7fd75c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.672+0000 7fd7657fa640 1 -- 172.21.15.73:0/1514937014 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c015020 con 0x7fd768109e00 2024-09-05T13:01:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.672+0000 7fd7657fa640 1 -- 172.21.15.73:0/1514937014 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd75c011d10 con 0x7fd768109e00 2024-09-05T13:01:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.673+0000 7fd7657fa640 1 -- 172.21.15.73:0/1514937014 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00f2e0 con 0x7fd768109e00 2024-09-05T13:01:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.674+0000 7fd76e9a1640 1 -- 172.21.15.73:0/1514937014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7681bc1c0 con 0x7fd768109e00 2024-09-05T13:01:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.674+0000 7fd76e9a1640 1 -- 172.21.15.73:0/1514937014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7681bc620 con 0x7fd768109e00 2024-09-05T13:01:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.679+0000 7fd770d77740 1 Processor -- start 2024-09-05T13:01:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.679+0000 7fd770d77740 1 -- start start 2024-09-05T13:01:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.679+0000 7fd770d77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea0ab80 0x561d7ea09090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.679+0000 7fd770d77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea095d0 0x561d7ea09a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.679+0000 7fd770d77740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea14370 0x561d7ea16760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.679+0000 7fd770d77740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561d7e96f2f0 con 0x561d7ea14370 2024-09-05T13:01:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.679+0000 7fd770d77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561d7e916cf0 con 0x561d7ea095d0 2024-09-05T13:01:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.679+0000 7fd770d77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561d7e96b2b0 con 0x561d7ea0ab80 2024-09-05T13:01:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.680+0000 7fd76cf3e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea0ab80 0x561d7ea09090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.680+0000 7fd76cf3e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea0ab80 0x561d7ea09090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39204/0 (socket says 172.21.15.73:39204) 2024-09-05T13:01:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.680+0000 7fd76cf3e640 1 -- 172.21.15.73:0/3617745371 learned_addr learned my addr 172.21.15.73:0/3617745371 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.680+0000 7fd767fff640 1 --2- 172.21.15.73:0/3617745371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea095d0 0x561d7ea09a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.680+0000 7fd76cf3e640 1 -- 172.21.15.73:0/3617745371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea095d0 msgr2=0x561d7ea09a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.680+0000 7fd76cf3e640 1 --2- 172.21.15.73:0/3617745371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea095d0 0x561d7ea09a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.680+0000 7fd76cf3e640 1 -- 172.21.15.73:0/3617745371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea14370 msgr2=0x561d7ea16760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:01:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.680+0000 7fd76cf3e640 1 --2- 172.21.15.73:0/3617745371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea14370 0x561d7ea16760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.680+0000 7fd76cf3e640 1 -- 172.21.15.73:0/3617745371 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d7e8fb3a0 con 0x561d7ea0ab80 2024-09-05T13:01:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.681+0000 7fd7657fa640 1 -- 172.21.15.73:0/1514937014 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd75c018020 con 0x7fd768109e00 2024-09-05T13:01:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.681+0000 7fd76cf3e640 1 --2- 172.21.15.73:0/3617745371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea0ab80 0x561d7ea09090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd75800cb40 tx=0x7fd75800e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beed1141805e5277 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.682+0000 7fd7657fa640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7500a2c00 0x7fd7500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.683+0000 7fd74e7fc640 1 -- 172.21.15.73:0/3617745371 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758004020 con 0x561d7ea0ab80 2024-09-05T13:01:00.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.683+0000 7fd74e7fc640 1 -- 172.21.15.73:0/3617745371 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7580041c0 con 0x561d7ea0ab80 2024-09-05T13:01:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.683+0000 7fd767fff640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7500a2c00 0x7fd7500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.684+0000 7fd74e7fc640 1 -- 172.21.15.73:0/3617745371 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7580107b0 con 0x561d7ea0ab80 2024-09-05T13:01:00.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.684+0000 7fd770d77740 1 -- 172.21.15.73:0/3617745371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea0ab80 msgr2=0x561d7ea09090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:00.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.684+0000 7fd770d77740 1 --2- 172.21.15.73:0/3617745371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea0ab80 0x561d7ea09090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd75800cb40 tx=0x7fd75800e350 comp rx=0 tx=0).stop 2024-09-05T13:01:00.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.684+0000 7fd7657fa640 1 -- 172.21.15.73:0/1514937014 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd75c098fc0 con 0x7fd768109e00 2024-09-05T13:01:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.690+0000 7fd770d77740 1 -- 172.21.15.73:0/3617745371 shutdown_connections 2024-09-05T13:01:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.690+0000 7fd770d77740 1 --2- 172.21.15.73:0/3617745371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea14370 0x561d7ea16760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.690+0000 7fd770d77740 1 --2- 172.21.15.73:0/3617745371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea095d0 0x561d7ea09a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.690+0000 7fd770d77740 1 --2- 172.21.15.73:0/3617745371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea0ab80 0x561d7ea09090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.690+0000 7fd770d77740 1 -- 172.21.15.73:0/3617745371 >> 172.21.15.73:0/3617745371 conn(0x561d7e9d2310 msgr2=0x561d7ea05c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.691+0000 7fd767fff640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7500a2c00 0x7fd7500a50c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd76000d090 tx=0x7fd76000d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.691+0000 7fd770d77740 1 -- 172.21.15.73:0/3617745371 shutdown_connections 2024-09-05T13:01:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.691+0000 7fd770d77740 1 -- 172.21.15.73:0/3617745371 wait complete. 2024-09-05T13:01:00.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.692+0000 7fd770d77740 1 -- start start 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.692+0000 7fd770d77740 1 Processor -- start 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.692+0000 7fd770d77740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea095d0 0x561d7ea13d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.693+0000 7fd770d77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea0ab80 0x561d7ea11030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.693+0000 7fd770d77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea11640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.693+0000 7fd770d77740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561d7ea17120 con 0x561d7ea095d0 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.693+0000 7fd770d77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561d7e92a060 con 0x561d7ea0ab80 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.693+0000 7fd770d77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561d7ea172a0 con 0x561d7ea14370 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.693+0000 7fd770d77740 10 client.0 _ll_register_callbacks cb 0x561d7e67d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.693+0000 7fd76cf3e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea11640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.693+0000 7fd76cf3e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea11640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39206/0 (socket says 172.21.15.73:39206) 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.693+0000 7fd76cf3e640 1 -- 172.21.15.73:0/205236113 learned_addr learned my addr 172.21.15.73:0/205236113 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.694+0000 7fd76cf3e640 1 -- 172.21.15.73:0/205236113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea0ab80 msgr2=0x561d7ea11030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.694+0000 7fd76cf3e640 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea0ab80 0x561d7ea11030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.694+0000 7fd76cf3e640 1 -- 172.21.15.73:0/205236113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea095d0 msgr2=0x561d7ea13d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.694+0000 7fd76cf3e640 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea095d0 0x561d7ea13d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.694+0000 7fd76cf3e640 1 -- 172.21.15.73:0/205236113 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d7e6e03c0 con 0x561d7ea14370 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.694+0000 7fd76cf3e640 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea11640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd758000c00 tx=0x7fd758003af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7559c282da7d037c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.694+0000 7fd7477fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.695+0000 7fd7477fe640 1 -- 172.21.15.73:0/205236113 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75800c650 con 0x561d7ea14370 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.695+0000 7fd770d77740 1 -- 172.21.15.73:0/205236113 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7580041c0 con 0x561d7ea14370 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.695+0000 7fd7477fe640 1 -- 172.21.15.73:0/205236113 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd758004370 con 0x561d7ea14370 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.695+0000 7fd7477fe640 1 -- 172.21.15.73:0/205236113 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd758005040 con 0x561d7ea14370 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.695+0000 7fd770d77740 10 client.25396 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.695+0000 7fd770d77740 1 -- 172.21.15.73:0/205236113 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561d7ea22c40 con 0x561d7ea14370 2024-09-05T13:01:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.696+0000 7fd7477fe640 1 -- 172.21.15.73:0/205236113 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7580041c0 con 0x561d7ea14370 2024-09-05T13:01:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.696+0000 7fd7477fe640 1 -- 172.21.15.73:0/205236113 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fd758004c20 con 0x561d7ea14370 2024-09-05T13:01:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.696+0000 7fd770d77740 10 client.25396 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.696+0000 7fd770d77740 10 client.25396 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T13:01:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.696+0000 7fd770d77740 20 client.25396 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.696+0000 7fd770d77740 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x561d7ea24460 0x561d7ea26920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.696+0000 7fd770d77740 4 client.25396 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.696+0000 7fd770d77740 1 -- 172.21.15.73:0/205236113 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d7e97c860 con 0x561d7ea24460 2024-09-05T13:01:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.698+0000 7fd767fff640 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x561d7ea24460 0x561d7ea26920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.699+0000 7fd767fff640 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x561d7ea24460 0x561d7ea26920 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f2b53120e0a979a server_cookie=63e0a10851575301 in_seq=0 out_seq=0 2024-09-05T13:01:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.699+0000 7fd7477fe640 10 client.25396 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T13:01:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.700+0000 7fd7477fe640 1 -- 172.21.15.73:0/205236113 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d7e97c860 con 0x561d7ea24460 2024-09-05T13:01:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.700+0000 7fd7477fe640 10 client.25396 handle_command_reply: tid=0 2024-09-05T13:01:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.700+0000 7fd770d77740 1 client.25396 shutdown 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.700+0000 7fd770d77740 1 -- 172.21.15.73:0/205236113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 msgr2=0x561d7ea11640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.700+0000 7fd770d77740 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea11640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd758000c00 tx=0x7fd758003af0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.701+0000 7fd770d77740 1 -- 172.21.15.73:0/205236113 shutdown_connections 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.701+0000 7fd770d77740 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x561d7ea24460 0x561d7ea26920 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.701+0000 7fd770d77740 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea11640 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.701+0000 7fd770d77740 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea0ab80 0x561d7ea11030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.701+0000 7fd770d77740 1 --2- 172.21.15.73:0/205236113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea095d0 0x561d7ea13d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.701+0000 7fd770d77740 1 -- 172.21.15.73:0/205236113 >> 172.21.15.73:0/205236113 conn(0x561d7e9d2310 msgr2=0x561d7ea0b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.701+0000 7fd7477fe640 0 client.25396 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.701+0000 7fd770d77740 1 -- 172.21.15.73:0/205236113 shutdown_connections 2024-09-05T13:01:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.701+0000 7fd770d77740 1 -- 172.21.15.73:0/205236113 wait complete. 2024-09-05T13:01:00.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.701+0000 7fd770d77740 20 client.25396 trim_cache size 0 max 16384 2024-09-05T13:01:00.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd770d77740 1 Processor -- start 2024-09-05T13:01:00.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd770d77740 1 -- start start 2024-09-05T13:01:00.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd770d77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea095d0 0x561d7ea108f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd770d77740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea0ab80 0x561d7ea0c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd770d77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea0c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd770d77740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd76807ee40 con 0x561d7ea0ab80 2024-09-05T13:01:00.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd770d77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd76807c650 con 0x561d7ea095d0 2024-09-05T13:01:00.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd770d77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd76807a4c0 con 0x561d7ea14370 2024-09-05T13:01:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd76cf3e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea0c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd76cf3e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea0c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39208/0 (socket says 172.21.15.73:39208) 2024-09-05T13:01:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.726+0000 7fd76cf3e640 1 -- 172.21.15.73:0/3674230154 learned_addr learned my addr 172.21.15.73:0/3674230154 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.727+0000 7fd767fff640 1 --2- 172.21.15.73:0/3674230154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea095d0 0x561d7ea108f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.727+0000 7fd76cf3e640 1 -- 172.21.15.73:0/3674230154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea095d0 msgr2=0x561d7ea108f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.727+0000 7fd76cf3e640 1 --2- 172.21.15.73:0/3674230154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea095d0 0x561d7ea108f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.727+0000 7fd76cf3e640 1 -- 172.21.15.73:0/3674230154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea0ab80 msgr2=0x561d7ea0c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.727+0000 7fd76cf3e640 1 --2- 172.21.15.73:0/3674230154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea0ab80 0x561d7ea0c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.727+0000 7fd76cf3e640 1 -- 172.21.15.73:0/3674230154 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d7ea0ffe0 con 0x561d7ea14370 2024-09-05T13:01:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.727+0000 7fd76cf3e640 1 --2- 172.21.15.73:0/3674230154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea0c6a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c9f0 tx=0x7fd75800ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e098929b7f23abf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.728+0000 7fd74dffb640 1 -- 172.21.15.73:0/3674230154 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758010870 con 0x561d7ea14370 2024-09-05T13:01:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.728+0000 7fd74dffb640 1 -- 172.21.15.73:0/3674230154 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd75800ed90 con 0x561d7ea14370 2024-09-05T13:01:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.728+0000 7fd74dffb640 1 -- 172.21.15.73:0/3674230154 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758010b70 con 0x561d7ea14370 2024-09-05T13:01:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.729+0000 7fd770d77740 1 -- 172.21.15.73:0/3674230154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 msgr2=0x561d7ea0c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.729+0000 7fd770d77740 1 --2- 172.21.15.73:0/3674230154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea0c6a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c9f0 tx=0x7fd75800ca20 comp rx=0 tx=0).stop 2024-09-05T13:01:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.730+0000 7fd770d77740 1 -- 172.21.15.73:0/3674230154 shutdown_connections 2024-09-05T13:01:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.730+0000 7fd770d77740 1 --2- 172.21.15.73:0/3674230154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea14370 0x561d7ea0c6a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.730+0000 7fd770d77740 1 --2- 172.21.15.73:0/3674230154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea0ab80 0x561d7ea0c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.730+0000 7fd770d77740 1 --2- 172.21.15.73:0/3674230154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea095d0 0x561d7ea108f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.730+0000 7fd770d77740 1 -- 172.21.15.73:0/3674230154 >> 172.21.15.73:0/3674230154 conn(0x561d7e9d2310 msgr2=0x561d7ea130b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.730+0000 7fd770d77740 1 -- 172.21.15.73:0/3674230154 shutdown_connections 2024-09-05T13:01:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.730+0000 7fd770d77740 1 -- 172.21.15.73:0/3674230154 wait complete. 2024-09-05T13:01:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.730+0000 7fd770d77740 1 -- start start 2024-09-05T13:01:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.730+0000 7fd770d77740 1 Processor -- start 2024-09-05T13:01:00.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.731+0000 7fd770d77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea095d0 0x561d7ea1ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.731+0000 7fd770d77740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea0ab80 0x561d7ea0da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.731+0000 7fd770d77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea14370 0x561d7ea0dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.731+0000 7fd770d77740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd76807ab10 con 0x561d7ea0ab80 2024-09-05T13:01:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.731+0000 7fd770d77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd76807bf80 con 0x561d7ea14370 2024-09-05T13:01:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.731+0000 7fd770d77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd76807b1e0 con 0x561d7ea095d0 2024-09-05T13:01:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.731+0000 7fd770d77740 10 client.0 _ll_register_callbacks cb 0x7fd758014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.731+0000 7fd767fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea095d0 0x561d7ea1ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.732+0000 7fd767fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea095d0 0x561d7ea1ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39224/0 (socket says 172.21.15.73:39224) 2024-09-05T13:01:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.732+0000 7fd767fff640 1 -- 172.21.15.73:0/2667585718 learned_addr learned my addr 172.21.15.73:0/2667585718 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.732+0000 7fd7677fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea0ab80 0x561d7ea0da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.732+0000 7fd76cf3e640 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea14370 0x561d7ea0dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.732+0000 7fd7677fe640 1 -- 172.21.15.73:0/2667585718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea095d0 msgr2=0x561d7ea1ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.732+0000 7fd7677fe640 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea095d0 0x561d7ea1ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.732+0000 7fd7677fe640 1 -- 172.21.15.73:0/2667585718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea14370 msgr2=0x561d7ea0dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.732+0000 7fd7677fe640 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea14370 0x561d7ea0dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.732+0000 7fd7677fe640 1 -- 172.21.15.73:0/2667585718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d7ea0e4f0 con 0x561d7ea0ab80 2024-09-05T13:01:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.735+0000 7fd7677fe640 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea0ab80 0x561d7ea0da70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0cc190 tx=0x7fd75c09b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5329ebca805c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.736+0000 7fd7477fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.737+0000 7fd7477fe640 1 -- 172.21.15.73:0/2667585718 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0b6030 con 0x561d7ea0ab80 2024-09-05T13:01:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.737+0000 7fd770d77740 1 -- 172.21.15.73:0/2667585718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd75800ed90 con 0x561d7ea0ab80 2024-09-05T13:01:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.737+0000 7fd7477fe640 1 -- 172.21.15.73:0/2667585718 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd75c0b9b60 con 0x561d7ea0ab80 2024-09-05T13:01:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.737+0000 7fd7477fe640 1 -- 172.21.15.73:0/2667585718 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd75c0aa050 con 0x561d7ea0ab80 2024-09-05T13:01:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.737+0000 7fd770d77740 10 client.15819 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.737+0000 7fd770d77740 1 -- 172.21.15.73:0/2667585718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561d7ea8ef10 con 0x561d7ea0ab80 2024-09-05T13:01:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.738+0000 7fd7477fe640 1 -- 172.21.15.73:0/2667585718 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd75800ed90 con 0x561d7ea0ab80 2024-09-05T13:01:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.738+0000 7fd7477fe640 1 -- 172.21.15.73:0/2667585718 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fd75c022060 con 0x561d7ea0ab80 2024-09-05T13:01:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.738+0000 7fd770d77740 10 client.15819 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.738+0000 7fd770d77740 10 client.15819 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T13:01:00.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.738+0000 7fd770d77740 20 client.15819 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:00.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.738+0000 7fd770d77740 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x561d7ea8f6f0 0x561d7ea91b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:00.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.738+0000 7fd770d77740 4 client.15819 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:01:00.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.738+0000 7fd770d77740 1 -- 172.21.15.73:0/2667585718 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561d7e976d70 con 0x561d7ea8f6f0 2024-09-05T13:01:00.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.739+0000 7fd767fff640 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x561d7ea8f6f0 0x561d7ea91b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:00.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.739+0000 7fd7477fe640 10 client.15819 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T13:01:00.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.739+0000 7fd767fff640 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x561d7ea8f6f0 0x561d7ea91b10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb6c0f02f8edad4e server_cookie=5d68e98e2fd8d51b in_seq=0 out_seq=0 2024-09-05T13:01:00.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd7477fe640 1 -- 172.21.15.73:0/2667585718 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561d7e976d70 con 0x561d7ea8f6f0 2024-09-05T13:01:00.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd7477fe640 10 client.15819 handle_command_reply: tid=0 2024-09-05T13:01:00.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 client.15819 shutdown 2024-09-05T13:01:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 -- 172.21.15.73:0/2667585718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea0ab80 msgr2=0x561d7ea0da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea0ab80 0x561d7ea0da70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0cc190 tx=0x7fd75c09b760 comp rx=0 tx=0).stop 2024-09-05T13:01:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 -- 172.21.15.73:0/2667585718 shutdown_connections 2024-09-05T13:01:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x561d7ea8f6f0 0x561d7ea91b10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d7ea14370 0x561d7ea0dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d7ea0ab80 0x561d7ea0da70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 --2- 172.21.15.73:0/2667585718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d7ea095d0 0x561d7ea1ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 -- 172.21.15.73:0/2667585718 >> 172.21.15.73:0/2667585718 conn(0x561d7e9d2310 msgr2=0x561d7ea12890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd7477fe640 0 client.15819 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T13:01:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 -- 172.21.15.73:0/2667585718 shutdown_connections 2024-09-05T13:01:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.740+0000 7fd770d77740 1 -- 172.21.15.73:0/2667585718 wait complete. 2024-09-05T13:01:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.741+0000 7fd770d77740 20 client.15819 trim_cache size 0 max 16384 2024-09-05T13:01:00.744 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.741+0000 7fd76e9a1640 1 -- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7500a2c00 msgr2=0x7fd7500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.741+0000 7fd76e9a1640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7500a2c00 0x7fd7500a50c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd76000d090 tx=0x7fd76000d000 comp rx=0 tx=0).stop 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.742+0000 7fd76e9a1640 1 -- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd768109e00 msgr2=0x7fd7681188b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.742+0000 7fd76e9a1640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd768109e00 0x7fd7681188b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009fd0 tx=0x7fd75c00b870 comp rx=0 tx=0).stop 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.742+0000 7fd76e9a1640 1 -- 172.21.15.73:0/1514937014 shutdown_connections 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.742+0000 7fd76e9a1640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd7500a2c00 0x7fd7500a50c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.742+0000 7fd76e9a1640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd76810ea80 0x7fd768118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.742+0000 7fd76e9a1640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd768109e00 0x7fd7681188b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.742+0000 7fd76e9a1640 1 --2- 172.21.15.73:0/1514937014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd768109450 0x7fd76811e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.742+0000 7fd76e9a1640 1 -- 172.21.15.73:0/1514937014 >> 172.21.15.73:0/1514937014 conn(0x7fd76806e2d0 msgr2=0x7fd76810c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.742+0000 7fd76e9a1640 1 -- 172.21.15.73:0/1514937014 shutdown_connections 2024-09-05T13:01:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:00.742+0000 7fd76e9a1640 1 -- 172.21.15.73:0/1514937014 wait complete. 2024-09-05T13:01:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:01 smithi073 ceph-mon[30883]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 MiB/s wr, 4.43k op/s 2024-09-05T13:01:01.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:01 smithi162 ceph-mon[34220]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 MiB/s wr, 4.43k op/s 2024-09-05T13:01:01.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:01 smithi169 ceph-mon[34823]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 MiB/s wr, 4.43k op/s 2024-09-05T13:01:01.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T13:01:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:01:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.772+0000 7f93e359e640 1 -- 172.21.15.73:0/2107038777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e4101270 msgr2=0x7f93e410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.772+0000 7f93e359e640 1 --2- 172.21.15.73:0/2107038777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e4101270 0x7f93e410d7a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009cd0 tx=0x7f93dc02ea20 comp rx=0 tx=0).stop 2024-09-05T13:01:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.773+0000 7f93e359e640 1 -- 172.21.15.73:0/2107038777 shutdown_connections 2024-09-05T13:01:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.773+0000 7f93e359e640 1 --2- 172.21.15.73:0/2107038777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e4101270 0x7f93e410d7a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.773+0000 7f93e359e640 1 --2- 172.21.15.73:0/2107038777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93e41008d0 0x7f93e4100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.773+0000 7f93e359e640 1 --2- 172.21.15.73:0/2107038777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93e41068d0 0x7f93e4106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.773+0000 7f93e359e640 1 -- 172.21.15.73:0/2107038777 >> 172.21.15.73:0/2107038777 conn(0x7f93e40fc610 msgr2=0x7f93e40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.773+0000 7f93e359e640 1 -- 172.21.15.73:0/2107038777 shutdown_connections 2024-09-05T13:01:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.773+0000 7f93e359e640 1 -- 172.21.15.73:0/2107038777 wait complete. 2024-09-05T13:01:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.774+0000 7f93e359e640 1 Processor -- start 2024-09-05T13:01:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.775+0000 7f93e359e640 1 -- start start 2024-09-05T13:01:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.775+0000 7f93e359e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93e41008d0 0x7f93e41a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.775+0000 7f93e359e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93e4101270 0x7f93e41a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.775+0000 7f93e359e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e41068d0 0x7f93e41abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.775+0000 7f93e359e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4120cb0 con 0x7f93e41068d0 2024-09-05T13:01:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.775+0000 7f93e359e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4120b30 con 0x7f93e4101270 2024-09-05T13:01:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.775+0000 7f93e359e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4120e30 con 0x7f93e41008d0 2024-09-05T13:01:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.776+0000 7f93e2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e41068d0 0x7f93e41abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.776+0000 7f93e2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e41068d0 0x7f93e41abb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53024/0 (socket says 172.21.15.73:53024) 2024-09-05T13:01:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.776+0000 7f93e2d9d640 1 -- 172.21.15.73:0/1371026447 learned_addr learned my addr 172.21.15.73:0/1371026447 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.776+0000 7f93e259c640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93e41008d0 0x7f93e41a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.777+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93e4101270 0x7f93e41a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.779+0000 7f93e2d9d640 1 -- 172.21.15.73:0/1371026447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93e41008d0 msgr2=0x7f93e41a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.779+0000 7f93e2d9d640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93e41008d0 0x7f93e41a7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.779+0000 7f93e2d9d640 1 -- 172.21.15.73:0/1371026447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93e4101270 msgr2=0x7f93e41a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.779+0000 7f93e2d9d640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93e4101270 0x7f93e41a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.779+0000 7f93e2d9d640 1 -- 172.21.15.73:0/1371026447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e41ac200 con 0x7f93e41068d0 2024-09-05T13:01:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.779+0000 7f93e2d9d640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e41068d0 0x7f93e41abb00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0098d0 tx=0x7f93dc033640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.780+0000 7f93d37fe640 1 -- 172.21.15.73:0/1371026447 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc040030 con 0x7f93e41068d0 2024-09-05T13:01:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.780+0000 7f93e359e640 1 -- 172.21.15.73:0/1371026447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e41ac490 con 0x7f93e41068d0 2024-09-05T13:01:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.780+0000 7f93e359e640 1 -- 172.21.15.73:0/1371026447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e406bc10 con 0x7f93e41068d0 2024-09-05T13:01:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.780+0000 7f93d37fe640 1 -- 172.21.15.73:0/1371026447 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93dc012290 con 0x7f93e41068d0 2024-09-05T13:01:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.780+0000 7f93d37fe640 1 -- 172.21.15.73:0/1371026447 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc037050 con 0x7f93e41068d0 2024-09-05T13:01:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.784+0000 7f93eae52740 1 Processor -- start 2024-09-05T13:01:02.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.785+0000 7f93eae52740 1 -- start start 2024-09-05T13:01:02.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.785+0000 7f93eae52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae4312240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.785+0000 7f93eae52740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae4312be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.785+0000 7f93eae52740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae431f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.785+0000 7f93eae52740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557ae42782f0 con 0x557ae431d520 2024-09-05T13:01:02.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.785+0000 7f93eae52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557ae421fcf0 con 0x557ae4313d30 2024-09-05T13:01:02.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.785+0000 7f93eae52740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557ae42742b0 con 0x557ae4312780 2024-09-05T13:01:02.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.786+0000 7f93d37fe640 1 -- 172.21.15.73:0/1371026447 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f93dc03a070 con 0x7f93e41068d0 2024-09-05T13:01:02.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.788+0000 7f93d37fe640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93cc0a2cc0 0x7f93cc0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.788+0000 7f93d37fe640 1 -- 172.21.15.73:0/1371026447 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f93dc0ef2d0 con 0x7f93e41068d0 2024-09-05T13:01:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.788+0000 7f93e259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae4312be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.788+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae431f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.788+0000 7f93e2d9d640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93cc0a2cc0 0x7f93cc0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.789+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae431f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53038/0 (socket says 172.21.15.73:53038) 2024-09-05T13:01:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.789+0000 7f93e1d9b640 1 -- 172.21.15.73:0/866036414 learned_addr learned my addr 172.21.15.73:0/866036414 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.789+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/866036414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae4312240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.790+0000 7f93e1d9b640 1 -- 172.21.15.73:0/866036414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 msgr2=0x557ae4312be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.790+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/866036414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae4312be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.790+0000 7f93e1d9b640 1 -- 172.21.15.73:0/866036414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 msgr2=0x557ae4312240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.790+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/866036414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae4312240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.790+0000 7f93e1d9b640 1 -- 172.21.15.73:0/866036414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ae42043a0 con 0x557ae431d520 2024-09-05T13:01:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.791+0000 7f93e2d9d640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93cc0a2cc0 0x7f93cc0a5180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0b8010 tx=0x7f93dc00f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.791+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/866036414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae431f910 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f93d8017730 tx=0x7f93d80094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cdac30f694980c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.792+0000 7f93d0ff9640 1 -- 172.21.15.73:0/866036414 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8015760 con 0x557ae431d520 2024-09-05T13:01:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.792+0000 7f93d0ff9640 1 -- 172.21.15.73:0/866036414 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d801d070 con 0x557ae431d520 2024-09-05T13:01:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.792+0000 7f93d0ff9640 1 -- 172.21.15.73:0/866036414 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8018bc0 con 0x557ae431d520 2024-09-05T13:01:02.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.793+0000 7f93eae52740 1 -- 172.21.15.73:0/866036414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 msgr2=0x557ae431f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:02.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.793+0000 7f93eae52740 1 --2- 172.21.15.73:0/866036414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae431f910 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f93d8017730 tx=0x7f93d80094e0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.794+0000 7f93eae52740 1 -- 172.21.15.73:0/866036414 shutdown_connections 2024-09-05T13:01:02.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.794+0000 7f93eae52740 1 --2- 172.21.15.73:0/866036414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae431f910 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.794+0000 7f93eae52740 1 --2- 172.21.15.73:0/866036414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae4312be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.794+0000 7f93eae52740 1 --2- 172.21.15.73:0/866036414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae4312240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.794+0000 7f93eae52740 1 -- 172.21.15.73:0/866036414 >> 172.21.15.73:0/866036414 conn(0x557ae42db310 msgr2=0x557ae430ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:02.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.794+0000 7f93eae52740 1 -- 172.21.15.73:0/866036414 shutdown_connections 2024-09-05T13:01:02.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.794+0000 7f93eae52740 1 -- 172.21.15.73:0/866036414 wait complete. 2024-09-05T13:01:02.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.795+0000 7f93eae52740 1 -- start start 2024-09-05T13:01:02.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.795+0000 7f93eae52740 1 Processor -- start 2024-09-05T13:01:02.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.796+0000 7f93eae52740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae431cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.796+0000 7f93eae52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae431a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.796+0000 7f93eae52740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae431a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.796+0000 7f93eae52740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557ae4320220 con 0x557ae431d520 2024-09-05T13:01:02.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.796+0000 7f93eae52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557ae4233060 con 0x557ae4313d30 2024-09-05T13:01:02.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.796+0000 7f93eae52740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557ae43203a0 con 0x557ae4312780 2024-09-05T13:01:02.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.796+0000 7f93eae52740 10 client.0 _ll_register_callbacks cb 0x557ae3f868c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:02.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.797+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae431cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.797+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae431cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39262/0 (socket says 172.21.15.73:39262) 2024-09-05T13:01:02.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.797+0000 7f93e1d9b640 1 -- 172.21.15.73:0/949471516 learned_addr learned my addr 172.21.15.73:0/949471516 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:02.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.797+0000 7f93e259c640 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae431a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.799+0000 7f93e259c640 1 -- 172.21.15.73:0/949471516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 msgr2=0x557ae431cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:02.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.799+0000 7f93e259c640 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae431cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.799+0000 7f93e259c640 1 -- 172.21.15.73:0/949471516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 msgr2=0x557ae431a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:02.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.799+0000 7f93e259c640 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae431a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.799+0000 7f93e259c640 1 -- 172.21.15.73:0/949471516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ae3fe93c0 con 0x557ae4313d30 2024-09-05T13:01:02.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.800+0000 7f93e259c640 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae431a1b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93d4006fd0 tx=0x7f93d4011630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9fba4be680edcb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:02.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.801+0000 7f93c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:01:02.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.802+0000 7f93c9ffb640 1 -- 172.21.15.73:0/949471516 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4019070 con 0x557ae4313d30 2024-09-05T13:01:02.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.802+0000 7f93eae52740 1 -- 172.21.15.73:0/949471516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93d801d070 con 0x557ae4313d30 2024-09-05T13:01:02.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.802+0000 7f93c9ffb640 1 -- 172.21.15.73:0/949471516 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f93d4015660 con 0x557ae4313d30 2024-09-05T13:01:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.806+0000 7f93c9ffb640 1 -- 172.21.15.73:0/949471516 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f93d4025050 con 0x557ae4313d30 2024-09-05T13:01:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.806+0000 7f93eae52740 10 client.25343 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.806+0000 7f93eae52740 1 -- 172.21.15.73:0/949471516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557ae432be10 con 0x557ae4313d30 2024-09-05T13:01:02.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.807+0000 7f93c9ffb640 1 -- 172.21.15.73:0/949471516 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d801d070 con 0x557ae4313d30 2024-09-05T13:01:02.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.807+0000 7f93c9ffb640 1 -- 172.21.15.73:0/949471516 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f93d401ebb0 con 0x557ae4313d30 2024-09-05T13:01:02.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.810+0000 7f93eae52740 10 client.25343 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:02.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.810+0000 7f93eae52740 10 client.25343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:02.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.810+0000 7f93eae52740 20 client.25343 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:02.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.810+0000 7f93eae52740 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557ae432d2c0 0x557ae432f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.810+0000 7f93eae52740 4 client.25343 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:02.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.810+0000 7f93eae52740 1 -- 172.21.15.73:0/949471516 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ae4285860 con 0x557ae432d2c0 2024-09-05T13:01:02.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.813+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557ae432d2c0 0x557ae432f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.819+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557ae432d2c0 0x557ae432f6b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d668b0fd8cfbf36 server_cookie=1699e86aca6c48c4 in_seq=0 out_seq=0 2024-09-05T13:01:02.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.819+0000 7f93c9ffb640 10 client.25343 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:02.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.821+0000 7f93c9ffb640 1 -- 172.21.15.73:0/949471516 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ae4285860 con 0x557ae432d2c0 2024-09-05T13:01:02.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.821+0000 7f93c9ffb640 10 client.25343 handle_command_reply: tid=0 2024-09-05T13:01:02.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.821+0000 7f93eae52740 1 client.25343 shutdown 2024-09-05T13:01:02.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.824+0000 7f93eae52740 1 -- 172.21.15.73:0/949471516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 msgr2=0x557ae431a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:02.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.824+0000 7f93eae52740 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae431a1b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93d4006fd0 tx=0x7f93d4011630 comp rx=0 tx=0).stop 2024-09-05T13:01:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.825+0000 7f93eae52740 1 -- 172.21.15.73:0/949471516 shutdown_connections 2024-09-05T13:01:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.825+0000 7f93eae52740 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557ae432d2c0 0x557ae432f6b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.825+0000 7f93eae52740 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae431a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.825+0000 7f93eae52740 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae431a1b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.825+0000 7f93eae52740 1 --2- 172.21.15.73:0/949471516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae431cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.826+0000 7f93eae52740 1 -- 172.21.15.73:0/949471516 >> 172.21.15.73:0/949471516 conn(0x557ae42db310 msgr2=0x557ae4314b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.826+0000 7f93c9ffb640 0 client.25343 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.827+0000 7f93eae52740 1 -- 172.21.15.73:0/949471516 shutdown_connections 2024-09-05T13:01:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.828+0000 7f93eae52740 1 -- 172.21.15.73:0/949471516 wait complete. 2024-09-05T13:01:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.829+0000 7f93eae52740 20 client.25343 trim_cache size 0 max 16384 2024-09-05T13:01:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.856+0000 7f93eae52740 1 Processor -- start 2024-09-05T13:01:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.857+0000 7f93eae52740 1 -- start start 2024-09-05T13:01:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.858+0000 7f93eae52740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae4312780 0x557ae4329550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.858+0000 7f93eae52740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4313d30 0x557ae4309b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.858+0000 7f93eae52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae431d520 0x557ae4334f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.858+0000 7f93eae52740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4010d50 con 0x557ae4312780 2024-09-05T13:01:02.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.858+0000 7f93eae52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f93c400e560 con 0x557ae431d520 2024-09-05T13:01:02.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.858+0000 7f93eae52740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f93c400c3b0 con 0x557ae4313d30 2024-09-05T13:01:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.861+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae4312780 0x557ae4329550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.861+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae4312780 0x557ae4329550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53054/0 (socket says 172.21.15.73:53054) 2024-09-05T13:01:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.861+0000 7f93e1d9b640 1 -- 172.21.15.73:0/2409740590 learned_addr learned my addr 172.21.15.73:0/2409740590 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.861+0000 7f93e259c640 1 --2- 172.21.15.73:0/2409740590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4313d30 0x557ae4309b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.861+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/2409740590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae431d520 0x557ae4334f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.865+0000 7f93e259c640 1 -- 172.21.15.73:0/2409740590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae431d520 msgr2=0x557ae4334f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.865+0000 7f93e259c640 1 --2- 172.21.15.73:0/2409740590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae431d520 0x557ae4334f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.865+0000 7f93e259c640 1 -- 172.21.15.73:0/2409740590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae4312780 msgr2=0x557ae4329550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.865+0000 7f93e259c640 1 --2- 172.21.15.73:0/2409740590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae4312780 0x557ae4329550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.865+0000 7f93e259c640 1 -- 172.21.15.73:0/2409740590 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ae430fd70 con 0x557ae4313d30 2024-09-05T13:01:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.865+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/2409740590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae431d520 0x557ae4334f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:01:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.865+0000 7f93e259c640 1 --2- 172.21.15.73:0/2409740590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4313d30 0x557ae4309b90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f93d4011b30 tx=0x7f93d4006df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16bb34e45e2e9085 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.868+0000 7f93cbfff640 1 -- 172.21.15.73:0/2409740590 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4019070 con 0x557ae4313d30 2024-09-05T13:01:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.868+0000 7f93cbfff640 1 -- 172.21.15.73:0/2409740590 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d4022070 con 0x557ae4313d30 2024-09-05T13:01:02.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.869+0000 7f93eae52740 1 -- 172.21.15.73:0/2409740590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4313d30 msgr2=0x557ae4309b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:02.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.869+0000 7f93eae52740 1 --2- 172.21.15.73:0/2409740590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4313d30 0x557ae4309b90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f93d4011b30 tx=0x7f93d4006df0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.871+0000 7f93eae52740 1 -- 172.21.15.73:0/2409740590 shutdown_connections 2024-09-05T13:01:02.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.871+0000 7f93eae52740 1 --2- 172.21.15.73:0/2409740590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae431d520 0x557ae4334f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.871+0000 7f93eae52740 1 --2- 172.21.15.73:0/2409740590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4313d30 0x557ae4309b90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.871+0000 7f93eae52740 1 --2- 172.21.15.73:0/2409740590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae4312780 0x557ae4329550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.871+0000 7f93eae52740 1 -- 172.21.15.73:0/2409740590 >> 172.21.15.73:0/2409740590 conn(0x557ae42db310 msgr2=0x557ae4318a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:02.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.873+0000 7f93eae52740 1 -- 172.21.15.73:0/2409740590 shutdown_connections 2024-09-05T13:01:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.875+0000 7f93eae52740 1 -- 172.21.15.73:0/2409740590 wait complete. 2024-09-05T13:01:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.876+0000 7f93eae52740 1 -- start start 2024-09-05T13:01:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.876+0000 7f93eae52740 1 Processor -- start 2024-09-05T13:01:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.876+0000 7f93eae52740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae4325b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.876+0000 7f93eae52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae4316bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.876+0000 7f93eae52740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae4317130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.876+0000 7f93eae52740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f93c400ca20 con 0x557ae431d520 2024-09-05T13:01:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.876+0000 7f93eae52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f93c400de90 con 0x557ae4313d30 2024-09-05T13:01:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.876+0000 7f93eae52740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f93c400d0f0 con 0x557ae4312780 2024-09-05T13:01:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.876+0000 7f93eae52740 10 client.0 _ll_register_callbacks cb 0x7f93d4009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.877+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae4317130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.877+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae4325b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.877+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae4325b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39278/0 (socket says 172.21.15.73:39278) 2024-09-05T13:01:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.877+0000 7f93e1d9b640 1 -- 172.21.15.73:0/815544564 learned_addr learned my addr 172.21.15.73:0/815544564 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.877+0000 7f93e259c640 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae4316bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.880+0000 7f93e1d9b640 1 -- 172.21.15.73:0/815544564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 msgr2=0x557ae4316bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:02.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.880+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae4316bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.880+0000 7f93e1d9b640 1 -- 172.21.15.73:0/815544564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 msgr2=0x557ae4317130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:02.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.880+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae4317130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.880+0000 7f93e1d9b640 1 -- 172.21.15.73:0/815544564 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ae4317670 con 0x557ae4312780 2024-09-05T13:01:02.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.880+0000 7f93e259c640 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae4316bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:01:02.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.881+0000 7f93e1d9b640 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae4325b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f93d80091e0 tx=0x7f93d8008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b407787fdcdd4fa server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:02.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.882+0000 7f93c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:01:02.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.887+0000 7f93c9ffb640 1 -- 172.21.15.73:0/815544564 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8004450 con 0x557ae4312780 2024-09-05T13:01:02.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.887+0000 7f93c9ffb640 1 -- 172.21.15.73:0/815544564 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f93d8018810 con 0x557ae4312780 2024-09-05T13:01:02.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.889+0000 7f93eae52740 1 -- 172.21.15.73:0/815544564 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93d4022070 con 0x557ae4312780 2024-09-05T13:01:02.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.891+0000 7f93c9ffb640 1 -- 172.21.15.73:0/815544564 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f93d80045f0 con 0x557ae4312780 2024-09-05T13:01:02.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.891+0000 7f93eae52740 10 client.25417 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:02.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.891+0000 7f93eae52740 1 -- 172.21.15.73:0/815544564 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557ae4397c50 con 0x557ae4312780 2024-09-05T13:01:02.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.892+0000 7f93c9ffb640 1 -- 172.21.15.73:0/815544564 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d4022070 con 0x557ae4312780 2024-09-05T13:01:02.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.892+0000 7f93c9ffb640 1 -- 172.21.15.73:0/815544564 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f93d8015c70 con 0x557ae4312780 2024-09-05T13:01:02.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.893+0000 7f93eae52740 10 client.25417 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:02.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.893+0000 7f93eae52740 10 client.25417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:02.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.893+0000 7f93eae52740 20 client.25417 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:02.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.893+0000 7f93eae52740 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557ae4397fe0 0x557ae439a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:02.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.893+0000 7f93eae52740 4 client.25417 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:01:02.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.893+0000 7f93eae52740 1 -- 172.21.15.73:0/815544564 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ae427fd70 con 0x557ae4397fe0 2024-09-05T13:01:02.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.893+0000 7f93e259c640 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557ae4397fe0 0x557ae439a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:02.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.895+0000 7f93e259c640 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557ae4397fe0 0x557ae439a3d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bba480156b1ad461 server_cookie=d68a99f8f0de5988 in_seq=0 out_seq=0 2024-09-05T13:01:02.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.895+0000 7f93c9ffb640 10 client.25417 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:02.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.896+0000 7f93c9ffb640 1 -- 172.21.15.73:0/815544564 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ae427fd70 con 0x557ae4397fe0 2024-09-05T13:01:02.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.896+0000 7f93c9ffb640 10 client.25417 handle_command_reply: tid=0 2024-09-05T13:01:02.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.898+0000 7f93eae52740 1 client.25417 shutdown 2024-09-05T13:01:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.900+0000 7f93eae52740 1 -- 172.21.15.73:0/815544564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 msgr2=0x557ae4325b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.900+0000 7f93eae52740 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae4325b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f93d80091e0 tx=0x7f93d8008040 comp rx=0 tx=0).stop 2024-09-05T13:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.901+0000 7f93eae52740 1 -- 172.21.15.73:0/815544564 shutdown_connections 2024-09-05T13:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.901+0000 7f93eae52740 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x557ae4397fe0 0x557ae439a3d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.901+0000 7f93eae52740 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ae431d520 0x557ae4317130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.901+0000 7f93eae52740 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557ae4313d30 0x557ae4316bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.901+0000 7f93eae52740 1 --2- 172.21.15.73:0/815544564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ae4312780 0x557ae4325b40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.901+0000 7f93c9ffb640 0 client.25417 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.901+0000 7f93eae52740 1 -- 172.21.15.73:0/815544564 >> 172.21.15.73:0/815544564 conn(0x557ae42db310 msgr2=0x557ae431c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.902+0000 7f93eae52740 1 -- 172.21.15.73:0/815544564 shutdown_connections 2024-09-05T13:01:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.902+0000 7f93eae52740 1 -- 172.21.15.73:0/815544564 wait complete. 2024-09-05T13:01:02.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.903+0000 7f93eae52740 20 client.25417 trim_cache size 0 max 16384 2024-09-05T13:01:02.907 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:01:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.905+0000 7f93e359e640 1 -- 172.21.15.73:0/1371026447 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93cc0a2cc0 msgr2=0x7f93cc0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.905+0000 7f93e359e640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93cc0a2cc0 0x7f93cc0a5180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0b8010 tx=0x7f93dc00f040 comp rx=0 tx=0).stop 2024-09-05T13:01:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.905+0000 7f93e359e640 1 -- 172.21.15.73:0/1371026447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e41068d0 msgr2=0x7f93e41abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.905+0000 7f93e359e640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e41068d0 0x7f93e41abb00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0098d0 tx=0x7f93dc033640 comp rx=0 tx=0).stop 2024-09-05T13:01:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.905+0000 7f93e359e640 1 -- 172.21.15.73:0/1371026447 shutdown_connections 2024-09-05T13:01:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.905+0000 7f93e359e640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f93cc0a2cc0 0x7f93cc0a5180 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.906+0000 7f93e359e640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e41068d0 0x7f93e41abb00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.906+0000 7f93e359e640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93e4101270 0x7f93e41a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.906+0000 7f93e359e640 1 --2- 172.21.15.73:0/1371026447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93e41008d0 0x7f93e41a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.906+0000 7f93e359e640 1 -- 172.21.15.73:0/1371026447 >> 172.21.15.73:0/1371026447 conn(0x7f93e40fc610 msgr2=0x7f93e40fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.906+0000 7f93e359e640 1 -- 172.21.15.73:0/1371026447 shutdown_connections 2024-09-05T13:01:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:02.906+0000 7f93e359e640 1 -- 172.21.15.73:0/1371026447 wait complete. 2024-09-05T13:01:03.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:03 smithi073 ceph-mon[30883]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 MiB/s wr, 5.20k op/s 2024-09-05T13:01:03.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:03 smithi162 ceph-mon[34220]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 MiB/s wr, 5.20k op/s 2024-09-05T13:01:03.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:03 smithi169 ceph-mon[34823]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 MiB/s wr, 5.20k op/s 2024-09-05T13:01:04.909 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T13:01:04.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T13:01:05.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:05 smithi073 ceph-mon[30883]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 MiB/s wr, 5.28k op/s 2024-09-05T13:01:05.365 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:01:05.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:05 smithi162 ceph-mon[34220]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 MiB/s wr, 5.28k op/s 2024-09-05T13:01:05.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:05 smithi169 ceph-mon[34823]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 MiB/s wr, 5.28k op/s 2024-09-05T13:01:07.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:07 smithi073 ceph-mon[30883]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 5.78k op/s 2024-09-05T13:01:07.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:07 smithi162 ceph-mon[34220]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 5.78k op/s 2024-09-05T13:01:07.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:07 smithi169 ceph-mon[34823]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 5.78k op/s 2024-09-05T13:01:08.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:08 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:01:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:08 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:01:08.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:08 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:01:09.440 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:09 smithi073 ceph-mon[30883]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 5.82k op/s 2024-09-05T13:01:09.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.460+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/1604106314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e410ea80 msgr2=0x7fd6e41154f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:09.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.460+0000 7fd6ea9b7640 1 --2- 172.21.15.73:0/1604106314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e410ea80 0x7fd6e41154f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009900 tx=0x7fd6d402b550 comp rx=0 tx=0).stop 2024-09-05T13:01:09.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.461+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/1604106314 shutdown_connections 2024-09-05T13:01:09.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.461+0000 7fd6ea9b7640 1 --2- 172.21.15.73:0/1604106314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e410ea80 0x7fd6e41154f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.461+0000 7fd6ea9b7640 1 --2- 172.21.15.73:0/1604106314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e4109e00 0x7fd6e410e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.461+0000 7fd6ea9b7640 1 --2- 172.21.15.73:0/1604106314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e4109450 0x7fd6e4109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.461+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/1604106314 >> 172.21.15.73:0/1604106314 conn(0x7fd6e406e2d0 msgr2=0x7fd6e406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:09.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.461+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/1604106314 shutdown_connections 2024-09-05T13:01:09.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.461+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/1604106314 wait complete. 2024-09-05T13:01:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.462+0000 7fd6ea9b7640 1 Processor -- start 2024-09-05T13:01:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.462+0000 7fd6ea9b7640 1 -- start start 2024-09-05T13:01:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.462+0000 7fd6ea9b7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e4109450 0x7fd6e41a7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.462+0000 7fd6ea9b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e4109e00 0x7fd6e41a7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.462+0000 7fd6ea9b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e410ea80 0x7fd6e41abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.462+0000 7fd6ea9b7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e41186b0 con 0x7fd6e4109450 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.462+0000 7fd6ea9b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e4118530 con 0x7fd6e4109e00 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.462+0000 7fd6ea9b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e4118830 con 0x7fd6e410ea80 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.463+0000 7fd6e8f54640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e410ea80 0x7fd6e41abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.463+0000 7fd6e8f54640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e410ea80 0x7fd6e41abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:42916/0 (socket says 172.21.15.73:42916) 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.463+0000 7fd6e8f54640 1 -- 172.21.15.73:0/863692053 learned_addr learned my addr 172.21.15.73:0/863692053 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.463+0000 7fd6e37fe640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e4109e00 0x7fd6e41a7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.463+0000 7fd6e8f54640 1 -- 172.21.15.73:0/863692053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e4109e00 msgr2=0x7fd6e41a7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.463+0000 7fd6e8f54640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e4109e00 0x7fd6e41a7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.463+0000 7fd6e8f54640 1 -- 172.21.15.73:0/863692053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e4109450 msgr2=0x7fd6e41a7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.463+0000 7fd6e8f54640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e4109450 0x7fd6e41a7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.463+0000 7fd6e8f54640 1 -- 172.21.15.73:0/863692053 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e41ac1f0 con 0x7fd6e410ea80 2024-09-05T13:01:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.464+0000 7fd6e8f54640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e410ea80 0x7fd6e41abb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009850 tx=0x7fd6d4033f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.465+0000 7fd6e17fa640 1 -- 172.21.15.73:0/863692053 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4061030 con 0x7fd6e410ea80 2024-09-05T13:01:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.465+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/863692053 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e41ac480 con 0x7fd6e410ea80 2024-09-05T13:01:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.465+0000 7fd6e17fa640 1 -- 172.21.15.73:0/863692053 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6d4031e20 con 0x7fd6e410ea80 2024-09-05T13:01:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.465+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/863692053 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e4074420 con 0x7fd6e410ea80 2024-09-05T13:01:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.467+0000 7fd6e17fa640 1 -- 172.21.15.73:0/863692053 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4036040 con 0x7fd6e410ea80 2024-09-05T13:01:09.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.470+0000 7fd6e17fa640 1 -- 172.21.15.73:0/863692053 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd6d4064030 con 0x7fd6e410ea80 2024-09-05T13:01:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.475+0000 7fd6ecd8d740 1 Processor -- start 2024-09-05T13:01:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.475+0000 7fd6e17fa640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6cc0a2c00 0x7fd6cc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.475+0000 7fd6ecd8d740 1 -- start start 2024-09-05T13:01:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.475+0000 7fd6e17fa640 1 -- 172.21.15.73:0/863692053 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd6d4110c90 con 0x7fd6e410ea80 2024-09-05T13:01:09.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.476+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89db60 0x55582b89df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.476+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8a8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.476+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b8a8d40 0x55582b8ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.476+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55582b803280 con 0x55582b89db60 2024-09-05T13:01:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.476+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55582b7aab10 con 0x55582b89e480 2024-09-05T13:01:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.476+0000 7fd6e3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89db60 0x55582b89df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.476+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55582b7ff240 con 0x55582b8a8d40 2024-09-05T13:01:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.476+0000 7fd6e3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89db60 0x55582b89df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42406/0 (socket says 172.21.15.73:42406) 2024-09-05T13:01:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.476+0000 7fd6e3fff640 1 -- 172.21.15.73:0/1414842557 learned_addr learned my addr 172.21.15.73:0/1414842557 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.476+0000 7fd6e8f54640 1 --2- 172.21.15.73:0/1414842557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b8a8d40 0x55582b8ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.477+0000 7fd6e3fff640 1 -- 172.21.15.73:0/1414842557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b8a8d40 msgr2=0x55582b8ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.477+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/1414842557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b8a8d40 0x55582b8ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.477+0000 7fd6e3fff640 1 -- 172.21.15.73:0/1414842557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 msgr2=0x55582b8a8800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.477+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/1414842557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8a8800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.477+0000 7fd6e3fff640 1 -- 172.21.15.73:0/1414842557 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55582b7b71f0 con 0x55582b89db60 2024-09-05T13:01:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.478+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/1414842557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89db60 0x55582b89df40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80097c0 tx=0x7fd6d8009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef94d3d6e9700909 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.478+0000 7fd6ca7fc640 1 -- 172.21.15.73:0/1414842557 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8015020 con 0x55582b89db60 2024-09-05T13:01:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.478+0000 7fd6ca7fc640 1 -- 172.21.15.73:0/1414842557 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6d8011420 con 0x55582b89db60 2024-09-05T13:01:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.479+0000 7fd6ca7fc640 1 -- 172.21.15.73:0/1414842557 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80105e0 con 0x55582b89db60 2024-09-05T13:01:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.479+0000 7fd6e37fe640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6cc0a2c00 0x7fd6cc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.480+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/1414842557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89db60 msgr2=0x55582b89df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.480+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/1414842557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89db60 0x55582b89df40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80097c0 tx=0x7fd6d8009c80 comp rx=0 tx=0).stop 2024-09-05T13:01:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.481+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/1414842557 shutdown_connections 2024-09-05T13:01:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.481+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/1414842557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b8a8d40 0x55582b8ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.481+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/1414842557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.481+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/1414842557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89db60 0x55582b89df40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.481+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/1414842557 >> 172.21.15.73:0/1414842557 conn(0x55582b89a0f0 msgr2=0x55582b89a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:09.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.482+0000 7fd6e37fe640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6cc0a2c00 0x7fd6cc0a50c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009980 tx=0x7fd6dc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:09.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.486+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/1414842557 shutdown_connections 2024-09-05T13:01:09.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.487+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/1414842557 wait complete. 2024-09-05T13:01:09.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.488+0000 7fd6ecd8d740 1 -- start start 2024-09-05T13:01:09.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.488+0000 7fd6ecd8d740 1 Processor -- start 2024-09-05T13:01:09.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.489+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 0x55582b8a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.489+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.489+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 0x55582b8a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.489+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55582b8ab910 con 0x55582b8a8d40 2024-09-05T13:01:09.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.489+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55582b7bdf10 con 0x55582b89e480 2024-09-05T13:01:09.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.489+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55582b8aba90 con 0x55582b89db60 2024-09-05T13:01:09.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.490+0000 7fd6ecd8d740 10 client.0 _ll_register_callbacks cb 0x55582b786a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:09.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.490+0000 7fd6e37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.491+0000 7fd6e37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8a60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:57238/0 (socket says 172.21.15.73:57238) 2024-09-05T13:01:09.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.491+0000 7fd6e37fe640 1 -- 172.21.15.73:0/15715804 learned_addr learned my addr 172.21.15.73:0/15715804 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:09.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.491+0000 7fd6e8f54640 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 0x55582b8a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.492+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 0x55582b8a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.492+0000 7fd6e8f54640 1 -- 172.21.15.73:0/15715804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 msgr2=0x55582b8a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.492+0000 7fd6e8f54640 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 0x55582b8a5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.492+0000 7fd6e8f54640 1 -- 172.21.15.73:0/15715804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 msgr2=0x55582b8a60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.492+0000 7fd6e8f54640 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8a60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.492+0000 7fd6e8f54640 1 -- 172.21.15.73:0/15715804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55582b5746a0 con 0x55582b8a8d40 2024-09-05T13:01:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.492+0000 7fd6e8f54640 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 0x55582b8a65f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40dd1c0 tx=0x7fd6d40dd0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f274387f91dc57 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.492+0000 7fd6c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.493+0000 7fd6c37fe640 1 -- 172.21.15.73:0/15715804 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40fb060 con 0x55582b8a8d40 2024-09-05T13:01:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.493+0000 7fd6c37fe640 1 -- 172.21.15.73:0/15715804 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd6d40035f0 con 0x55582b8a8d40 2024-09-05T13:01:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.493+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/15715804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6d8011420 con 0x55582b8a8d40 2024-09-05T13:01:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.493+0000 7fd6c37fe640 1 -- 172.21.15.73:0/15715804 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd6d40a7050 con 0x55582b8a8d40 2024-09-05T13:01:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.493+0000 7fd6ecd8d740 10 client.15840 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.494+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/15715804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55582b8b74c0 con 0x55582b8a8d40 2024-09-05T13:01:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.495+0000 7fd6c37fe640 1 -- 172.21.15.73:0/15715804 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6d40e1870 con 0x55582b8a8d40 2024-09-05T13:01:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.495+0000 7fd6c37fe640 1 -- 172.21.15.73:0/15715804 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fd6d405c040 con 0x55582b8a8d40 2024-09-05T13:01:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.495+0000 7fd6ecd8d740 10 client.15840 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.495+0000 7fd6ecd8d740 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.495+0000 7fd6ecd8d740 20 client.15840 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:09.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.495+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55582b8b8950 0x55582b8bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.495+0000 7fd6ecd8d740 4 client.15840 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:09.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.496+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/15715804 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd6d8011420 con 0x55582b8b8950 2024-09-05T13:01:09.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.502+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55582b8b8950 0x55582b8bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.503+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55582b8b8950 0x55582b8bad90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b26a51b3fa93a5d server_cookie=71a0ffa83b5edd02 in_seq=0 out_seq=0 2024-09-05T13:01:09.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.503+0000 7fd6c37fe640 10 client.15840 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:09.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.504+0000 7fd6c37fe640 1 -- 172.21.15.73:0/15715804 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd6d8011420 con 0x55582b8b8950 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.504+0000 7fd6c37fe640 10 client.15840 handle_command_reply: tid=0 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.504+0000 7fd6ecd8d740 1 client.15840 shutdown 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.505+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/15715804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 msgr2=0x55582b8a65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.505+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 0x55582b8a65f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40dd1c0 tx=0x7fd6d40dd0c0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.505+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/15715804 shutdown_connections 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.505+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55582b8b8950 0x55582b8bad90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.505+0000 7fd6c37fe640 0 client.15840 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.505+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 0x55582b8a65f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.505+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.505+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/15715804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 0x55582b8a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.505+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/15715804 >> 172.21.15.73:0/15715804 conn(0x55582b89a0f0 msgr2=0x55582b899270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:09.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.506+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/15715804 shutdown_connections 2024-09-05T13:01:09.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.508+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/15715804 wait complete. 2024-09-05T13:01:09.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.508+0000 7fd6ecd8d740 20 client.15840 trim_cache size 0 max 16384 2024-09-05T13:01:09.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.544+0000 7fd6ecd8d740 1 Processor -- start 2024-09-05T13:01:09.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.544+0000 7fd6ecd8d740 1 -- start start 2024-09-05T13:01:09.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.545+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89db60 0x55582b8a6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.545+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89e480 0x55582b899160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.545+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b8a8d40 0x55582b8c0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.545+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d0010e10 con 0x55582b89e480 2024-09-05T13:01:09.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.545+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d000e620 con 0x55582b89db60 2024-09-05T13:01:09.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.545+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d000c470 con 0x55582b8a8d40 2024-09-05T13:01:09.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.546+0000 7fd6e37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89e480 0x55582b899160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.546+0000 7fd6e37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89e480 0x55582b899160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42426/0 (socket says 172.21.15.73:42426) 2024-09-05T13:01:09.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.546+0000 7fd6e37fe640 1 -- 172.21.15.73:0/1754397366 learned_addr learned my addr 172.21.15.73:0/1754397366 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:09.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.546+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/1754397366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89db60 0x55582b8a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.546+0000 7fd6e8f54640 1 --2- 172.21.15.73:0/1754397366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b8a8d40 0x55582b8c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.546+0000 7fd6e37fe640 1 -- 172.21.15.73:0/1754397366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b8a8d40 msgr2=0x55582b8c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:09.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.546+0000 7fd6e37fe640 1 --2- 172.21.15.73:0/1754397366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b8a8d40 0x55582b8c0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.546+0000 7fd6e37fe640 1 -- 172.21.15.73:0/1754397366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89db60 msgr2=0x55582b8a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:09.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.546+0000 7fd6e37fe640 1 --2- 172.21.15.73:0/1754397366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89db60 0x55582b8a6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.546+0000 7fd6e37fe640 1 -- 172.21.15.73:0/1754397366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55582b899f20 con 0x55582b89e480 2024-09-05T13:01:09.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.547+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/1754397366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89db60 0x55582b8a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:01:09.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.547+0000 7fd6e37fe640 1 --2- 172.21.15.73:0/1754397366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89e480 0x55582b899160 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc016790 tx=0x7fd6dc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ecb924212d9b7c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:09.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.547+0000 7fd6c9ffb640 1 -- 172.21.15.73:0/1754397366 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc015a70 con 0x55582b89e480 2024-09-05T13:01:09.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.547+0000 7fd6c9ffb640 1 -- 172.21.15.73:0/1754397366 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6dc027070 con 0x55582b89e480 2024-09-05T13:01:09.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.548+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/1754397366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89e480 msgr2=0x55582b899160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:09.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.548+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/1754397366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89e480 0x55582b899160 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc016790 tx=0x7fd6dc011000 comp rx=0 tx=0).stop 2024-09-05T13:01:09.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.551+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/1754397366 shutdown_connections 2024-09-05T13:01:09.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.551+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/1754397366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b8a8d40 0x55582b8c0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.551+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/1754397366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b89e480 0x55582b899160 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.551+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/1754397366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89db60 0x55582b8a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.551+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/1754397366 >> 172.21.15.73:0/1754397366 conn(0x55582b89a0f0 msgr2=0x55582b898a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:09.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.551+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/1754397366 shutdown_connections 2024-09-05T13:01:09.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.551+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/1754397366 wait complete. 2024-09-05T13:01:09.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.551+0000 7fd6ecd8d740 1 -- start start 2024-09-05T13:01:09.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.551+0000 7fd6ecd8d740 1 Processor -- start 2024-09-05T13:01:09.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.552+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 0x55582b8ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.552+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.552+0000 7fd6ecd8d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 0x55582b91b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.552+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d000cae0 con 0x55582b8a8d40 2024-09-05T13:01:09.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.552+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d000df50 con 0x55582b89e480 2024-09-05T13:01:09.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.552+0000 7fd6ecd8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d000d1b0 con 0x55582b89db60 2024-09-05T13:01:09.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.552+0000 7fd6ecd8d740 10 client.0 _ll_register_callbacks cb 0x7fd6d40d9760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:09.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.552+0000 7fd6e3fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 0x55582b8ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.553+0000 7fd6e3fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 0x55582b8ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:42952/0 (socket says 172.21.15.73:42952) 2024-09-05T13:01:09.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.553+0000 7fd6e3fff640 1 -- 172.21.15.73:0/941659585 learned_addr learned my addr 172.21.15.73:0/941659585 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:09.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.553+0000 7fd6e8f54640 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 0x55582b91b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.553+0000 7fd6e3fff640 1 -- 172.21.15.73:0/941659585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 msgr2=0x55582b8adbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:09.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.553+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8adbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.553+0000 7fd6e3fff640 1 -- 172.21.15.73:0/941659585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 msgr2=0x55582b91b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:09.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.553+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 0x55582b91b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.553+0000 7fd6e3fff640 1 -- 172.21.15.73:0/941659585 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55582b91be00 con 0x55582b89db60 2024-09-05T13:01:09.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.554+0000 7fd6e3fff640 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 0x55582b8ad690 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8011fd0 tx=0x7fd6d8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6e599889bf2a7e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:09.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.554+0000 7fd6c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:01:09.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.555+0000 7fd6c37fe640 1 -- 172.21.15.73:0/941659585 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8015040 con 0x55582b89db60 2024-09-05T13:01:09.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.555+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/941659585 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6dc027070 con 0x55582b89db60 2024-09-05T13:01:09.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.555+0000 7fd6c37fe640 1 -- 172.21.15.73:0/941659585 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd6d800bce0 con 0x55582b89db60 2024-09-05T13:01:09.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.555+0000 7fd6c37fe640 1 -- 172.21.15.73:0/941659585 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd6d8004020 con 0x55582b89db60 2024-09-05T13:01:09.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.556+0000 7fd6ecd8d740 10 client.25429 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:09.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.556+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/941659585 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55582b9242a0 con 0x55582b89db60 2024-09-05T13:01:09.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.557+0000 7fd6c37fe640 1 -- 172.21.15.73:0/941659585 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6dc027070 con 0x55582b89db60 2024-09-05T13:01:09.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.557+0000 7fd6c37fe640 1 -- 172.21.15.73:0/941659585 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fd6d8003690 con 0x55582b89db60 2024-09-05T13:01:09.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.557+0000 7fd6ecd8d740 10 client.25429 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:09.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.557+0000 7fd6ecd8d740 10 client.25429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:09.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.557+0000 7fd6ecd8d740 20 client.25429 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:09.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.557+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55582b8b8950 0x55582b926a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:09.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.557+0000 7fd6ecd8d740 4 client.25429 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T13:01:09.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.557+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/941659585 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55582b8107f0 con 0x55582b8b8950 2024-09-05T13:01:09.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.558+0000 7fd6e37fe640 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55582b8b8950 0x55582b926a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:09.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.561+0000 7fd6c37fe640 10 client.25429 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:09.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.561+0000 7fd6e37fe640 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55582b8b8950 0x55582b926a90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95f63e0ddaf17f6a server_cookie=f658694af3739f81 in_seq=0 out_seq=0 2024-09-05T13:01:09.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.563+0000 7fd6c37fe640 1 -- 172.21.15.73:0/941659585 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55582b8107f0 con 0x55582b8b8950 2024-09-05T13:01:09.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.563+0000 7fd6c37fe640 10 client.25429 handle_command_reply: tid=0 2024-09-05T13:01:09.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.563+0000 7fd6ecd8d740 1 client.25429 shutdown 2024-09-05T13:01:09.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/941659585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 msgr2=0x55582b8ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:09.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 0x55582b8ad690 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8011fd0 tx=0x7fd6d8009250 comp rx=0 tx=0).stop 2024-09-05T13:01:09.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/941659585 shutdown_connections 2024-09-05T13:01:09.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55582b8b8950 0x55582b926a90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55582b8a8d40 0x55582b91b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582b89e480 0x55582b8adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6ecd8d740 1 --2- 172.21.15.73:0/941659585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55582b89db60 0x55582b8ad690 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/941659585 >> 172.21.15.73:0/941659585 conn(0x55582b89a0f0 msgr2=0x55582b899270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:09.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6c37fe640 0 client.25429 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:09.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/941659585 shutdown_connections 2024-09-05T13:01:09.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.566+0000 7fd6ecd8d740 1 -- 172.21.15.73:0/941659585 wait complete. 2024-09-05T13:01:09.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.570+0000 7fd6ecd8d740 20 client.25429 trim_cache size 0 max 16384 2024-09-05T13:01:09.573 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:01:09.573 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2024-09-05T13:01:09.573 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "bff71e06-0f05-4252-8001-6d20d15ef0c9", 2024-09-05T13:01:09.573 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2024-09-05T13:01:09.573 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:01:09.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.571+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/863692053 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6cc0a2c00 msgr2=0x7fd6cc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:09.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.571+0000 7fd6ea9b7640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6cc0a2c00 0x7fd6cc0a50c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009980 tx=0x7fd6dc00d040 comp rx=0 tx=0).stop 2024-09-05T13:01:09.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.571+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/863692053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e410ea80 msgr2=0x7fd6e41abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:09.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.571+0000 7fd6ea9b7640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e410ea80 0x7fd6e41abb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009850 tx=0x7fd6d4033f30 comp rx=0 tx=0).stop 2024-09-05T13:01:09.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.572+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/863692053 shutdown_connections 2024-09-05T13:01:09.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.572+0000 7fd6ea9b7640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd6cc0a2c00 0x7fd6cc0a50c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.572+0000 7fd6ea9b7640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e410ea80 0x7fd6e41abb10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.572+0000 7fd6ea9b7640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e4109e00 0x7fd6e41a7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.572+0000 7fd6ea9b7640 1 --2- 172.21.15.73:0/863692053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e4109450 0x7fd6e41a7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:09.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.572+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/863692053 >> 172.21.15.73:0/863692053 conn(0x7fd6e406e2d0 msgr2=0x7fd6e40725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:09.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.572+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/863692053 shutdown_connections 2024-09-05T13:01:09.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:09.572+0000 7fd6ea9b7640 1 -- 172.21.15.73:0/863692053 wait complete. 2024-09-05T13:01:09.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:09 smithi162 ceph-mon[34220]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 5.82k op/s 2024-09-05T13:01:09.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:09 smithi169 ceph-mon[34823]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 5.82k op/s 2024-09-05T13:01:10.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T13:01:10.391 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:10 smithi073 ceph-mon[30883]: scrub queued for path: / 2024-09-05T13:01:10.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:10 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:10.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:10 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:01:10.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:10 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:01:10.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:10 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:01:10.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:10 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:01:10.392 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:10 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:01:10.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:10 smithi162 ceph-mon[34220]: scrub queued for path: / 2024-09-05T13:01:10.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:10 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:10.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:10 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:01:10.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:10 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:01:10.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:10 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:01:10.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:10 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:01:10.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:10 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:01:10.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:10 smithi169 ceph-mon[34823]: scrub queued for path: / 2024-09-05T13:01:10.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:10 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:10.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:10 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:01:10.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:10 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:01:10.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:10 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:01:10.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:10 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:01:10.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:10 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:01:10.767 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:01:11.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:11 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:01:11.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:11 smithi073 ceph-mon[30883]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 MiB/s wr, 4.98k op/s 2024-09-05T13:01:11.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:11 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:11.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:11 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:11.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.327+0000 7fb024126640 1 -- 172.21.15.73:0/1123006010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb01c108e00 msgr2=0x7fb01c10ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:11.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.327+0000 7fb024126640 1 --2- 172.21.15.73:0/1123006010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb01c108e00 0x7fb01c10ce00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb014009ca0 tx=0x7fb01402a8e0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.328+0000 7fb024126640 1 -- 172.21.15.73:0/1123006010 shutdown_connections 2024-09-05T13:01:11.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.328+0000 7fb024126640 1 --2- 172.21.15.73:0/1123006010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c10d530 0x7fb01c1150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.328+0000 7fb024126640 1 --2- 172.21.15.73:0/1123006010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb01c108e00 0x7fb01c10ce00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.328+0000 7fb024126640 1 --2- 172.21.15.73:0/1123006010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb01c108450 0x7fb01c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.328+0000 7fb024126640 1 -- 172.21.15.73:0/1123006010 >> 172.21.15.73:0/1123006010 conn(0x7fb01c077ba0 msgr2=0x7fb01c079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:11.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.328+0000 7fb024126640 1 -- 172.21.15.73:0/1123006010 shutdown_connections 2024-09-05T13:01:11.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.328+0000 7fb024126640 1 -- 172.21.15.73:0/1123006010 wait complete. 2024-09-05T13:01:11.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.329+0000 7fb024126640 1 Processor -- start 2024-09-05T13:01:11.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.329+0000 7fb024126640 1 -- start start 2024-09-05T13:01:11.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.330+0000 7fb024126640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c108450 0x7fb01c1a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.330+0000 7fb024126640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb01c108e00 0x7fb01c1a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.330+0000 7fb024126640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb01c10d530 0x7fb01c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.330+0000 7fb0216c1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb01c108e00 0x7fb01c1a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.330+0000 7fb0216c1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb01c108e00 0x7fb01c1a4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:42970/0 (socket says 172.21.15.73:42970) 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.330+0000 7fb0216c1640 1 -- 172.21.15.73:0/456470858 learned_addr learned my addr 172.21.15.73:0/456470858 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.330+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c118650 con 0x7fb01c108450 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.330+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c1184d0 con 0x7fb01c10d530 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.330+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c1187d0 con 0x7fb01c108e00 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.330+0000 7fb0226c3640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb01c10d530 0x7fb01c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.331+0000 7fb0216c1640 1 -- 172.21.15.73:0/456470858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb01c10d530 msgr2=0x7fb01c19ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.331+0000 7fb021ec2640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c108450 0x7fb01c1a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.331+0000 7fb0216c1640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb01c10d530 0x7fb01c19ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.331+0000 7fb0216c1640 1 -- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c108450 msgr2=0x7fb01c1a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.331+0000 7fb0216c1640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c108450 0x7fb01c1a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.331+0000 7fb0216c1640 1 -- 172.21.15.73:0/456470858 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01c19f130 con 0x7fb01c108e00 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.331+0000 7fb0226c3640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb01c10d530 0x7fb01c19ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:01:11.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.331+0000 7fb021ec2640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c108450 0x7fb01c1a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:01:11.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.332+0000 7fb0216c1640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb01c108e00 0x7fb01c1a4d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb01402ae00 tx=0x7fb014003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:11.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.332+0000 7fb012ffd640 1 -- 172.21.15.73:0/456470858 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb014004040 con 0x7fb01c108e00 2024-09-05T13:01:11.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.332+0000 7fb012ffd640 1 -- 172.21.15.73:0/456470858 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0140046c0 con 0x7fb01c108e00 2024-09-05T13:01:11.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.332+0000 7fb012ffd640 1 -- 172.21.15.73:0/456470858 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01403b400 con 0x7fb01c108e00 2024-09-05T13:01:11.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.332+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01c19f3c0 con 0x7fb01c108e00 2024-09-05T13:01:11.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.332+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb01c19f840 con 0x7fb01c108e00 2024-09-05T13:01:11.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.336+0000 7fb0264fc740 1 Processor -- start 2024-09-05T13:01:11.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.337+0000 7fb012ffd640 1 -- 172.21.15.73:0/456470858 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb0140305e0 con 0x7fb01c108e00 2024-09-05T13:01:11.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.337+0000 7fb0264fc740 1 -- start start 2024-09-05T13:01:11.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.338+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x563315495720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.338+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.338+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.338+0000 7fb0264fc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5633153fb2e0 con 0x563315495340 2024-09-05T13:01:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.338+0000 7fb0264fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5633153a2ce0 con 0x5633154b1690 2024-09-05T13:01:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.338+0000 7fb0264fc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5633153f72a0 con 0x563315495c60 2024-09-05T13:01:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.338+0000 7fb021ec2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.339+0000 7fb021ec2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:42978/0 (socket says 172.21.15.73:42978) 2024-09-05T13:01:11.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.339+0000 7fb021ec2640 1 -- 172.21.15.73:0/525246235 learned_addr learned my addr 172.21.15.73:0/525246235 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:11.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.339+0000 7fb0226c3640 1 --2- 172.21.15.73:0/525246235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x563315495720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.339+0000 7fb012ffd640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb0080a2cd0 0x7fb0080a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.342+0000 7fb0216c1640 1 --2- 172.21.15.73:0/525246235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.342+0000 7fb0226c3640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb0080a2cd0 0x7fb0080a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.342+0000 7fb0226c3640 1 -- 172.21.15.73:0/525246235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 msgr2=0x5633154b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.342+0000 7fb0226c3640 1 --2- 172.21.15.73:0/525246235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.342+0000 7fb0226c3640 1 -- 172.21.15.73:0/525246235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 msgr2=0x5633154b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.342+0000 7fb0226c3640 1 --2- 172.21.15.73:0/525246235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.342+0000 7fb0226c3640 1 -- 172.21.15.73:0/525246235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563315387440 con 0x563315495340 2024-09-05T13:01:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.342+0000 7fb0226c3640 1 --2- 172.21.15.73:0/525246235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x563315495720 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb018015750 tx=0x7fb018015c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21daccbf4005923c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.343+0000 7fb012ffd640 1 -- 172.21.15.73:0/456470858 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb0140f0490 con 0x7fb01c108e00 2024-09-05T13:01:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.343+0000 7fb0226c3640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb0080a2cd0 0x7fb0080a5190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb018020000 tx=0x7fb01801c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:11.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.343+0000 7fb007fff640 1 -- 172.21.15.73:0/525246235 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01801c070 con 0x563315495340 2024-09-05T13:01:11.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.344+0000 7fb007fff640 1 -- 172.21.15.73:0/525246235 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb018009dc0 con 0x563315495340 2024-09-05T13:01:11.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.344+0000 7fb007fff640 1 -- 172.21.15.73:0/525246235 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0180219d0 con 0x563315495340 2024-09-05T13:01:11.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.344+0000 7fb0264fc740 1 -- 172.21.15.73:0/525246235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 msgr2=0x563315495720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:11.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.345+0000 7fb0264fc740 1 --2- 172.21.15.73:0/525246235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x563315495720 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb018015750 tx=0x7fb018015c10 comp rx=0 tx=0).stop 2024-09-05T13:01:11.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.345+0000 7fb0264fc740 1 -- 172.21.15.73:0/525246235 shutdown_connections 2024-09-05T13:01:11.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.345+0000 7fb0264fc740 1 --2- 172.21.15.73:0/525246235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.345+0000 7fb0264fc740 1 --2- 172.21.15.73:0/525246235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.345+0000 7fb0264fc740 1 --2- 172.21.15.73:0/525246235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x563315495720 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.345+0000 7fb0264fc740 1 -- 172.21.15.73:0/525246235 >> 172.21.15.73:0/525246235 conn(0x563315491a30 msgr2=0x563315491e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:11.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.345+0000 7fb0264fc740 1 -- 172.21.15.73:0/525246235 shutdown_connections 2024-09-05T13:01:11.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.345+0000 7fb0264fc740 1 -- 172.21.15.73:0/525246235 wait complete. 2024-09-05T13:01:11.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.345+0000 7fb0264fc740 1 -- start start 2024-09-05T13:01:11.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.345+0000 7fb0264fc740 1 Processor -- start 2024-09-05T13:01:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495340 0x5633154b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495c60 0x5633154ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154ae840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb0264fc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5633154b4310 con 0x563315495c60 2024-09-05T13:01:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb0264fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5633153b6050 con 0x5633154b1690 2024-09-05T13:01:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb0264fc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5633154b4490 con 0x563315495340 2024-09-05T13:01:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb0264fc740 10 client.0 _ll_register_callbacks cb 0x5633153f6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb021ec2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495340 0x5633154b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb021ec2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495340 0x5633154b1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:42982/0 (socket says 172.21.15.73:42982) 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb021ec2640 1 -- 172.21.15.73:0/1268270487 learned_addr learned my addr 172.21.15.73:0/1268270487 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb0216c1640 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495c60 0x5633154ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.346+0000 7fb0226c3640 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.347+0000 7fb0226c3640 1 -- 172.21.15.73:0/1268270487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495340 msgr2=0x5633154b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.347+0000 7fb0226c3640 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495340 0x5633154b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.347+0000 7fb0226c3640 1 -- 172.21.15.73:0/1268270487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495c60 msgr2=0x5633154ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.347+0000 7fb0226c3640 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495c60 0x5633154ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.347+0000 7fb0226c3640 1 -- 172.21.15.73:0/1268270487 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56331516c3c0 con 0x5633154b1690 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.347+0000 7fb0226c3640 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154ae840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb018012640 tx=0x7fb018018e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=993522e47a396c3f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.348+0000 7fb0057fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.348+0000 7fb0057fa640 1 -- 172.21.15.73:0/1268270487 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018021b60 con 0x5633154b1690 2024-09-05T13:01:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.348+0000 7fb0057fa640 1 -- 172.21.15.73:0/1268270487 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb018021d00 con 0x5633154b1690 2024-09-05T13:01:11.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.349+0000 7fb0264fc740 1 -- 172.21.15.73:0/1268270487 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb018009dc0 con 0x5633154b1690 2024-09-05T13:01:11.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.350+0000 7fb0057fa640 1 -- 172.21.15.73:0/1268270487 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb018033450 con 0x5633154b1690 2024-09-05T13:01:11.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.350+0000 7fb0264fc740 10 client.25370 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.350+0000 7fb0264fc740 1 -- 172.21.15.73:0/1268270487 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5633154bfd40 con 0x5633154b1690 2024-09-05T13:01:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.350+0000 7fb0057fa640 1 -- 172.21.15.73:0/1268270487 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb018009dc0 con 0x5633154b1690 2024-09-05T13:01:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.351+0000 7fb0057fa640 1 -- 172.21.15.73:0/1268270487 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb018015040 con 0x5633154b1690 2024-09-05T13:01:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.351+0000 7fb0264fc740 10 client.25370 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.351+0000 7fb0264fc740 10 client.25370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.351+0000 7fb0264fc740 20 client.25370 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.351+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5633154c11a0 0x5633154c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.351+0000 7fb0264fc740 4 client.25370 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.351+0000 7fb0264fc740 1 -- 172.21.15.73:0/1268270487 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563315408850 con 0x5633154c11a0 2024-09-05T13:01:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.351+0000 7fb021ec2640 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5633154c11a0 0x5633154c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.352+0000 7fb021ec2640 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5633154c11a0 0x5633154c3590 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=476abb18429bc0a server_cookie=aa62a9443d25759e in_seq=0 out_seq=0 2024-09-05T13:01:11.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.352+0000 7fb0057fa640 10 client.25370 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:11.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.353+0000 7fb0057fa640 1 -- 172.21.15.73:0/1268270487 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563315408850 con 0x5633154c11a0 2024-09-05T13:01:11.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.353+0000 7fb0057fa640 10 client.25370 handle_command_reply: tid=0 2024-09-05T13:01:11.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.353+0000 7fb0264fc740 1 client.25370 shutdown 2024-09-05T13:01:11.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.354+0000 7fb0264fc740 1 -- 172.21.15.73:0/1268270487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 msgr2=0x5633154ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:11.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.354+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154ae840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb018012640 tx=0x7fb018018e50 comp rx=0 tx=0).stop 2024-09-05T13:01:11.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.354+0000 7fb0264fc740 1 -- 172.21.15.73:0/1268270487 shutdown_connections 2024-09-05T13:01:11.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.354+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5633154c11a0 0x5633154c3590 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.354+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154ae840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.354+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495c60 0x5633154ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.354+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1268270487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495340 0x5633154b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.354+0000 7fb0264fc740 1 -- 172.21.15.73:0/1268270487 >> 172.21.15.73:0/1268270487 conn(0x563315491a30 msgr2=0x563315497790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:11.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.354+0000 7fb0057fa640 0 client.25370 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:11.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.354+0000 7fb0264fc740 1 -- 172.21.15.73:0/1268270487 shutdown_connections 2024-09-05T13:01:11.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.355+0000 7fb0264fc740 1 -- 172.21.15.73:0/1268270487 wait complete. 2024-09-05T13:01:11.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.355+0000 7fb0264fc740 20 client.25370 trim_cache size 0 max 16384 2024-09-05T13:01:11.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.385+0000 7fb0264fc740 1 Processor -- start 2024-09-05T13:01:11.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb0264fc740 1 -- start start 2024-09-05T13:01:11.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154bd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb0264fc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c1adc70 con 0x563315495340 2024-09-05T13:01:11.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb0264fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c074090 con 0x5633154b1690 2024-09-05T13:01:11.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb0264fc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c071ee0 con 0x563315495c60 2024-09-05T13:01:11.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb021ec2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154bd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb0226c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb021ec2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154bd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42488/0 (socket says 172.21.15.73:42488) 2024-09-05T13:01:11.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.386+0000 7fb021ec2640 1 -- 172.21.15.73:0/915804649 learned_addr learned my addr 172.21.15.73:0/915804649 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.387+0000 7fb0226c3640 1 -- 172.21.15.73:0/915804649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 msgr2=0x5633154c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.387+0000 7fb0226c3640 1 --2- 172.21.15.73:0/915804649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.387+0000 7fb0226c3640 1 -- 172.21.15.73:0/915804649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 msgr2=0x5633154bd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.387+0000 7fb0226c3640 1 --2- 172.21.15.73:0/915804649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154bd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.387+0000 7fb0226c3640 1 -- 172.21.15.73:0/915804649 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633154aeb90 con 0x5633154b1690 2024-09-05T13:01:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.387+0000 7fb0226c3640 1 --2- 172.21.15.73:0/915804649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154c9160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb018006fb0 tx=0x7fb0180155a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c438a93836fbebf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.388+0000 7fb0077fe640 1 -- 172.21.15.73:0/915804649 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01803b070 con 0x5633154b1690 2024-09-05T13:01:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.388+0000 7fb0077fe640 1 -- 172.21.15.73:0/915804649 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb01802e070 con 0x5633154b1690 2024-09-05T13:01:11.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.388+0000 7fb0077fe640 1 -- 172.21.15.73:0/915804649 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018029470 con 0x5633154b1690 2024-09-05T13:01:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.389+0000 7fb0264fc740 1 -- 172.21.15.73:0/915804649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 msgr2=0x5633154c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.389+0000 7fb0264fc740 1 --2- 172.21.15.73:0/915804649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154c9160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb018006fb0 tx=0x7fb0180155a0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.389+0000 7fb0264fc740 1 -- 172.21.15.73:0/915804649 shutdown_connections 2024-09-05T13:01:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.389+0000 7fb0264fc740 1 --2- 172.21.15.73:0/915804649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x5633154c9160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.389+0000 7fb0264fc740 1 --2- 172.21.15.73:0/915804649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.389+0000 7fb0264fc740 1 --2- 172.21.15.73:0/915804649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154bd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.389+0000 7fb0264fc740 1 -- 172.21.15.73:0/915804649 >> 172.21.15.73:0/915804649 conn(0x563315491a30 msgr2=0x5633154ad3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:11.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.390+0000 7fb0264fc740 1 -- 172.21.15.73:0/915804649 shutdown_connections 2024-09-05T13:01:11.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.392+0000 7fb0264fc740 1 -- 172.21.15.73:0/915804649 wait complete. 2024-09-05T13:01:11.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.392+0000 7fb0264fc740 1 -- start start 2024-09-05T13:01:11.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.392+0000 7fb0264fc740 1 Processor -- start 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb0264fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x563315529be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb0264fc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c072550 con 0x563315495340 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb0264fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c0739c0 con 0x5633154b1690 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb0264fc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c072c20 con 0x563315495c60 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb0264fc740 10 client.0 _ll_register_callbacks cb 0x7fb00c00a1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb021ec2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb021ec2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42504/0 (socket says 172.21.15.73:42504) 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb021ec2640 1 -- 172.21.15.73:0/1210527463 learned_addr learned my addr 172.21.15.73:0/1210527463 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.393+0000 7fb0216c1640 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb0216c1640 1 -- 172.21.15.73:0/1210527463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 msgr2=0x563315529be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:11.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb0216c1640 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x563315529be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb0216c1640 1 -- 172.21.15.73:0/1210527463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 msgr2=0x5633154b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:11.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb0216c1640 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb0216c1640 1 -- 172.21.15.73:0/1210527463 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56331552a120 con 0x563315495c60 2024-09-05T13:01:11.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb021ec2640 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:01:11.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb0216c1640 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154b51e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb0140b9690 tx=0x7fb0140095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2df98d46fd6eddfb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb0057fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb0057fa640 1 -- 172.21.15.73:0/1210527463 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0140bc800 con 0x563315495c60 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb0264fc740 1 -- 172.21.15.73:0/1210527463 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb01802e070 con 0x563315495c60 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.394+0000 7fb0057fa640 1 -- 172.21.15.73:0/1210527463 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb0140c54a0 con 0x563315495c60 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0057fa640 1 -- 172.21.15.73:0/1210527463 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb0140bc620 con 0x563315495c60 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0264fc740 10 client.25444 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0264fc740 1 -- 172.21.15.73:0/1210527463 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56331552b4c0 con 0x563315495c60 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0057fa640 1 -- 172.21.15.73:0/1210527463 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb01802e070 con 0x563315495c60 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0057fa640 1 -- 172.21.15.73:0/1210527463 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb014004b40 con 0x563315495c60 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0264fc740 10 client.25444 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0264fc740 10 client.25444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0264fc740 20 client.25444 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56331552bc50 0x56331552e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:11.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0264fc740 4 client.25444 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T13:01:11.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.395+0000 7fb0264fc740 1 -- 172.21.15.73:0/1210527463 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563315402d60 con 0x56331552bc50 2024-09-05T13:01:11.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.396+0000 7fb021ec2640 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56331552bc50 0x56331552e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:11.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.396+0000 7fb021ec2640 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56331552bc50 0x56331552e070 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f169d91a72b51aed server_cookie=ba945c1cda0843f5 in_seq=0 out_seq=0 2024-09-05T13:01:11.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.396+0000 7fb0057fa640 10 client.25444 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:11.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.397+0000 7fb0057fa640 1 -- 172.21.15.73:0/1210527463 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563315402d60 con 0x56331552bc50 2024-09-05T13:01:11.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.397+0000 7fb0057fa640 10 client.25444 handle_command_reply: tid=0 2024-09-05T13:01:11.399 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:01:11.399 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-05T13:01:11.400 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2024-09-05T13:01:11.400 INFO:teuthology.orchestra.run.smithi073.stdout: "bff71e06-0f05-4252-8001-6d20d15ef0c9": { 2024-09-05T13:01:11.400 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-05T13:01:11.400 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "bff71e06-0f05-4252-8001-6d20d15ef0c9", 2024-09-05T13:01:11.400 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2024-09-05T13:01:11.400 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:01:11.400 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:01:11.400 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:01:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.397+0000 7fb0264fc740 1 client.25444 shutdown 2024-09-05T13:01:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.397+0000 7fb0264fc740 1 -- 172.21.15.73:0/1210527463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 msgr2=0x5633154b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.397+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154b51e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb0140b9690 tx=0x7fb0140095c0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.398+0000 7fb0264fc740 1 -- 172.21.15.73:0/1210527463 shutdown_connections 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.398+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56331552bc50 0x56331552e070 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.398+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633154b1690 0x563315529be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.398+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563315495c60 0x5633154b51e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.398+0000 7fb0264fc740 1 --2- 172.21.15.73:0/1210527463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563315495340 0x5633154b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.398+0000 7fb0264fc740 1 -- 172.21.15.73:0/1210527463 >> 172.21.15.73:0/1210527463 conn(0x563315491a30 msgr2=0x563315496e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.398+0000 7fb0057fa640 0 client.25444 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.398+0000 7fb0264fc740 1 -- 172.21.15.73:0/1210527463 shutdown_connections 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.398+0000 7fb0264fc740 1 -- 172.21.15.73:0/1210527463 wait complete. 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.398+0000 7fb0264fc740 20 client.25444 trim_cache size 0 max 16384 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.400+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb0080a2cd0 msgr2=0x7fb0080a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.400+0000 7fb024126640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb0080a2cd0 0x7fb0080a5190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb018020000 tx=0x7fb01801c000 comp rx=0 tx=0).stop 2024-09-05T13:01:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.400+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb01c108e00 msgr2=0x7fb01c1a4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.400+0000 7fb024126640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb01c108e00 0x7fb01c1a4d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb01402ae00 tx=0x7fb014003ba0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.400+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 shutdown_connections 2024-09-05T13:01:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.400+0000 7fb024126640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb0080a2cd0 0x7fb0080a5190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.400+0000 7fb024126640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb01c10d530 0x7fb01c19ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.400+0000 7fb024126640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb01c108e00 0x7fb01c1a4d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.400+0000 7fb024126640 1 --2- 172.21.15.73:0/456470858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c108450 0x7fb01c1a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.400+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 >> 172.21.15.73:0/456470858 conn(0x7fb01c077ba0 msgr2=0x7fb01c078ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.401+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 shutdown_connections 2024-09-05T13:01:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:11.401+0000 7fb024126640 1 -- 172.21.15.73:0/456470858 wait complete. 2024-09-05T13:01:11.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:11 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:01:11.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:11 smithi162 ceph-mon[34220]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 MiB/s wr, 4.98k op/s 2024-09-05T13:01:11.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:11 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:11.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:11 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:11.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:11 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:01:11.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:11 smithi169 ceph-mon[34823]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 MiB/s wr, 4.98k op/s 2024-09-05T13:01:11.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:11 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:11.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:11 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:12.234 INFO:tasks.cephfs.filesystem:scrub status for tag:bff71e06-0f05-4252-8001-6d20d15ef0c9 - {'path': '/', 'tag': 'bff71e06-0f05-4252-8001-6d20d15ef0c9', 'options': 'recursive,force'} 2024-09-05T13:01:12.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:12 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:12.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:12 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:12.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:12 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:01:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.032+0000 7fb24084c640 1 -- 172.21.15.73:0/3546602046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb23c1025f0 msgr2=0x7fb23c108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.032+0000 7fb24084c640 1 --2- 172.21.15.73:0/3546602046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb23c1025f0 0x7fb23c108e80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb234009ca0 tx=0x7fb23402a8c0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.033+0000 7fb24084c640 1 -- 172.21.15.73:0/3546602046 shutdown_connections 2024-09-05T13:01:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.033+0000 7fb24084c640 1 --2- 172.21.15.73:0/3546602046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb23c1025f0 0x7fb23c108e80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.033+0000 7fb24084c640 1 --2- 172.21.15.73:0/3546602046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb23c101c30 0x7fb23c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.033+0000 7fb24084c640 1 --2- 172.21.15.73:0/3546602046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb23c100a40 0x7fb23c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.033+0000 7fb24084c640 1 -- 172.21.15.73:0/3546602046 >> 172.21.15.73:0/3546602046 conn(0x7fb23c0fc1e0 msgr2=0x7fb23c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.033+0000 7fb24084c640 1 -- 172.21.15.73:0/3546602046 shutdown_connections 2024-09-05T13:01:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.033+0000 7fb24084c640 1 -- 172.21.15.73:0/3546602046 wait complete. 2024-09-05T13:01:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.034+0000 7fb24084c640 1 Processor -- start 2024-09-05T13:01:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.034+0000 7fb24084c640 1 -- start start 2024-09-05T13:01:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.034+0000 7fb24084c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb23c100a40 0x7fb23c196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.034+0000 7fb24084c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb23c101c30 0x7fb23c1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.034+0000 7fb24084c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb23c1025f0 0x7fb23c19e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.034+0000 7fb24084c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c10c740 con 0x7fb23c100a40 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.034+0000 7fb24084c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c10c5c0 con 0x7fb23c101c30 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.034+0000 7fb24084c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c10c8c0 con 0x7fb23c1025f0 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.034+0000 7fb23a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb23c100a40 0x7fb23c196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.035+0000 7fb23a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb23c100a40 0x7fb23c196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42522/0 (socket says 172.21.15.73:42522) 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.035+0000 7fb23a59c640 1 -- 172.21.15.73:0/2334141957 learned_addr learned my addr 172.21.15.73:0/2334141957 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.035+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb23c1025f0 0x7fb23c19e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.035+0000 7fb23a59c640 1 -- 172.21.15.73:0/2334141957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb23c1025f0 msgr2=0x7fb23c19e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.035+0000 7fb23a59c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb23c1025f0 0x7fb23c19e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.035+0000 7fb23a59c640 1 -- 172.21.15.73:0/2334141957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb23c101c30 msgr2=0x7fb23c1971f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.035+0000 7fb23a59c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb23c101c30 0x7fb23c1971f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.035+0000 7fb23a59c640 1 -- 172.21.15.73:0/2334141957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c19e8f0 con 0x7fb23c100a40 2024-09-05T13:01:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.035+0000 7fb23a59c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb23c100a40 0x7fb23c196cb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00d920 tx=0x7fb22c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.036+0000 7fb22b7fe640 1 -- 172.21.15.73:0/2334141957 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c01b070 con 0x7fb23c100a40 2024-09-05T13:01:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.036+0000 7fb22b7fe640 1 -- 172.21.15.73:0/2334141957 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb22c00edc0 con 0x7fb23c100a40 2024-09-05T13:01:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.036+0000 7fb22b7fe640 1 -- 172.21.15.73:0/2334141957 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c014800 con 0x7fb23c100a40 2024-09-05T13:01:13.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.036+0000 7fb24084c640 1 -- 172.21.15.73:0/2334141957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23c069900 con 0x7fb23c100a40 2024-09-05T13:01:13.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.036+0000 7fb24084c640 1 -- 172.21.15.73:0/2334141957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23c069e80 con 0x7fb23c100a40 2024-09-05T13:01:13.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.040+0000 7fb2435df740 1 Processor -- start 2024-09-05T13:01:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.041+0000 7fb2435df740 1 -- start start 2024-09-05T13:01:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.041+0000 7fb2435df740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b06d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.041+0000 7fb2435df740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b07260 0x560c64b09d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.041+0000 7fb2435df740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b0a330 0x560c64b172e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.041+0000 7fb2435df740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x560c64a6a2f0 con 0x560c64b07260 2024-09-05T13:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.041+0000 7fb2435df740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560c64a12270 con 0x560c64b0a330 2024-09-05T13:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.041+0000 7fb2435df740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560c64a662b0 con 0x560c64b06920 2024-09-05T13:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.041+0000 7fb23ad9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b06d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.041+0000 7fb23ad9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b06d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:43038/0 (socket says 172.21.15.73:43038) 2024-09-05T13:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.041+0000 7fb23ad9d640 1 -- 172.21.15.73:0/227063788 learned_addr learned my addr 172.21.15.73:0/227063788 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.042+0000 7fb23ad9d640 1 -- 172.21.15.73:0/227063788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b0a330 msgr2=0x560c64b172e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.042+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/227063788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b0a330 0x560c64b172e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.042+0000 7fb23ad9d640 1 -- 172.21.15.73:0/227063788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b07260 msgr2=0x560c64b09d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.042+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/227063788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b07260 0x560c64b09d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.042+0000 7fb23ad9d640 1 -- 172.21.15.73:0/227063788 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c64a11340 con 0x560c64b06920 2024-09-05T13:01:13.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.042+0000 7fb22b7fe640 1 -- 172.21.15.73:0/2334141957 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb22c01e070 con 0x7fb23c100a40 2024-09-05T13:01:13.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.043+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/227063788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b06d20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb234035000 tx=0x7fb234005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=256f291cb42c216f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:13.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.043+0000 7fb228ff9640 1 -- 172.21.15.73:0/227063788 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234031710 con 0x560c64b06920 2024-09-05T13:01:13.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.043+0000 7fb228ff9640 1 -- 172.21.15.73:0/227063788 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb234036030 con 0x560c64b06920 2024-09-05T13:01:13.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.043+0000 7fb22b7fe640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb2240a2d80 0x7fb2240a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.045 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.044+0000 7fb22b7fe640 1 -- 172.21.15.73:0/2334141957 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb22c0ce4e0 con 0x7fb23c100a40 2024-09-05T13:01:13.046 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.044+0000 7fb23a59c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb2240a2d80 0x7fb2240a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.044+0000 7fb2435df740 1 -- 172.21.15.73:0/227063788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 msgr2=0x560c64b06d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:13.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.044+0000 7fb2435df740 1 --2- 172.21.15.73:0/227063788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b06d20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb234035000 tx=0x7fb234005fa0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.045+0000 7fb2435df740 1 -- 172.21.15.73:0/227063788 shutdown_connections 2024-09-05T13:01:13.048 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.045+0000 7fb2435df740 1 --2- 172.21.15.73:0/227063788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b0a330 0x560c64b172e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.045+0000 7fb2435df740 1 --2- 172.21.15.73:0/227063788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b07260 0x560c64b09d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.045+0000 7fb2435df740 1 --2- 172.21.15.73:0/227063788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b06d20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.045+0000 7fb2435df740 1 -- 172.21.15.73:0/227063788 >> 172.21.15.73:0/227063788 conn(0x560c64b02010 msgr2=0x560c64b02410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.047+0000 7fb2435df740 1 -- 172.21.15.73:0/227063788 shutdown_connections 2024-09-05T13:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.047+0000 7fb2435df740 1 -- 172.21.15.73:0/227063788 wait complete. 2024-09-05T13:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.047+0000 7fb23a59c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb2240a2d80 0x7fb2240a5240 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00efd0 tx=0x7fb22c0047d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.047+0000 7fb2435df740 1 -- start start 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb2435df740 1 Processor -- start 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb2435df740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 0x560c64b109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb2435df740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 0x560c64b10ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb2435df740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b15f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb2435df740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x560c64b0ac50 con 0x560c64b0a330 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb2435df740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560c649f3290 con 0x560c64b06920 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb2435df740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560c64b0add0 con 0x560c64b07260 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb2435df740 10 client.0 _ll_register_callbacks cb 0x560c64a24140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb23ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b15f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb23ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b15f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42528/0 (socket says 172.21.15.73:42528) 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb23ad9d640 1 -- 172.21.15.73:0/1863361966 learned_addr learned my addr 172.21.15.73:0/1863361966 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.048+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 0x560c64b109b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.049+0000 7fb239d9b640 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 0x560c64b10ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.049+0000 7fb23ad9d640 1 -- 172.21.15.73:0/1863361966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 msgr2=0x560c64b10ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.049+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 0x560c64b10ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.049+0000 7fb23ad9d640 1 -- 172.21.15.73:0/1863361966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 msgr2=0x560c64b109b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.049+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 0x560c64b109b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.049+0000 7fb23ad9d640 1 -- 172.21.15.73:0/1863361966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c6477d210 con 0x560c64b0a330 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.049+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b15f20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x560c64b0fee0 tx=0x7fb2340099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e127baf66a458cb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.049+0000 7fb221ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.049+0000 7fb221ffb640 1 -- 172.21.15.73:0/1863361966 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23402f9f0 con 0x560c64b0a330 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.049+0000 7fb2435df740 1 -- 172.21.15.73:0/1863361966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb234036030 con 0x560c64b0a330 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.050+0000 7fb221ffb640 1 -- 172.21.15.73:0/1863361966 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb23402fb90 con 0x560c64b0a330 2024-09-05T13:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.050+0000 7fb221ffb640 1 -- 172.21.15.73:0/1863361966 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb234003e40 con 0x560c64b0a330 2024-09-05T13:01:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.050+0000 7fb2435df740 10 client.15867 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.050+0000 7fb2435df740 1 -- 172.21.15.73:0/1863361966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560c64849620 con 0x560c64b0a330 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.051+0000 7fb221ffb640 1 -- 172.21.15.73:0/1863361966 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb234036030 con 0x560c64b0a330 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.051+0000 7fb221ffb640 1 -- 172.21.15.73:0/1863361966 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb234043070 con 0x560c64b0a330 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.051+0000 7fb2435df740 10 client.15867 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.051+0000 7fb2435df740 10 client.15867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.051+0000 7fb2435df740 20 client.15867 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.051+0000 7fb2435df740 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c64b2d390 0x560c64b2f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.051+0000 7fb2435df740 4 client.15867 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.051+0000 7fb2435df740 1 -- 172.21.15.73:0/1863361966 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c64a77a20 con 0x560c64b2d390 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.051+0000 7fb239d9b640 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c64b2d390 0x560c64b2f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.052+0000 7fb239d9b640 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c64b2d390 0x560c64b2f7b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66ace46aa6de37d9 server_cookie=de3a451b0e3880e4 in_seq=0 out_seq=0 2024-09-05T13:01:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.052+0000 7fb221ffb640 10 client.15867 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.053+0000 7fb221ffb640 1 -- 172.21.15.73:0/1863361966 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c64a77a20 con 0x560c64b2d390 2024-09-05T13:01:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.053+0000 7fb221ffb640 10 client.15867 handle_command_reply: tid=0 2024-09-05T13:01:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.053+0000 7fb2435df740 1 client.15867 shutdown 2024-09-05T13:01:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.054+0000 7fb2435df740 1 -- 172.21.15.73:0/1863361966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 msgr2=0x560c64b15f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.054+0000 7fb2435df740 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b15f20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x560c64b0fee0 tx=0x7fb2340099e0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.054+0000 7fb2435df740 1 -- 172.21.15.73:0/1863361966 shutdown_connections 2024-09-05T13:01:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.054+0000 7fb2435df740 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c64b2d390 0x560c64b2f7b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.054+0000 7fb2435df740 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b15f20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.054+0000 7fb2435df740 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 0x560c64b10ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.054+0000 7fb2435df740 1 --2- 172.21.15.73:0/1863361966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 0x560c64b109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.054+0000 7fb2435df740 1 -- 172.21.15.73:0/1863361966 >> 172.21.15.73:0/1863361966 conn(0x560c64b02010 msgr2=0x560c64b03820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.054+0000 7fb221ffb640 0 client.15867 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.054+0000 7fb2435df740 1 -- 172.21.15.73:0/1863361966 shutdown_connections 2024-09-05T13:01:13.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.055+0000 7fb2435df740 1 -- 172.21.15.73:0/1863361966 wait complete. 2024-09-05T13:01:13.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.055+0000 7fb2435df740 20 client.15867 trim_cache size 0 max 16384 2024-09-05T13:01:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb2435df740 1 Processor -- start 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb2435df740 1 -- start start 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb2435df740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 0x560c64b0f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb2435df740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 0x560c64b009a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb2435df740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b00ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb2435df740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c1a96f0 con 0x560c64b0a330 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb2435df740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c1a6f00 con 0x560c64b06920 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb2435df740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c1a4d50 con 0x560c64b07260 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb239d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 0x560c64b009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb23ad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 0x560c64b0f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb239d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 0x560c64b009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:43056/0 (socket says 172.21.15.73:43056) 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb23ad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 0x560c64b0f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:57336/0 (socket says 172.21.15.73:57336) 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb239d9b640 1 -- 172.21.15.73:0/3046387196 learned_addr learned my addr 172.21.15.73:0/3046387196 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.079+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/3046387196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b00ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.080+0000 7fb239d9b640 1 -- 172.21.15.73:0/3046387196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 msgr2=0x560c64b0f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.080+0000 7fb239d9b640 1 --2- 172.21.15.73:0/3046387196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 0x560c64b0f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.080+0000 7fb239d9b640 1 -- 172.21.15.73:0/3046387196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 msgr2=0x560c64b00ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.080+0000 7fb239d9b640 1 --2- 172.21.15.73:0/3046387196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b00ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.080+0000 7fb239d9b640 1 -- 172.21.15.73:0/3046387196 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c64afd2d0 con 0x560c64b07260 2024-09-05T13:01:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.080+0000 7fb239d9b640 1 --2- 172.21.15.73:0/3046387196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 0x560c64b009a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb23c1981b0 tx=0x7fb230005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ea098b4e893212a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.080+0000 7fb223fff640 1 -- 172.21.15.73:0/3046387196 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230013db0 con 0x560c64b07260 2024-09-05T13:01:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.080+0000 7fb223fff640 1 -- 172.21.15.73:0/3046387196 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb230005510 con 0x560c64b07260 2024-09-05T13:01:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.080+0000 7fb223fff640 1 -- 172.21.15.73:0/3046387196 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23001b650 con 0x560c64b07260 2024-09-05T13:01:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.082+0000 7fb2435df740 1 -- 172.21.15.73:0/3046387196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 msgr2=0x560c64b009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.082+0000 7fb2435df740 1 --2- 172.21.15.73:0/3046387196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 0x560c64b009a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb23c1981b0 tx=0x7fb230005f90 comp rx=0 tx=0).stop 2024-09-05T13:01:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.082+0000 7fb2435df740 1 -- 172.21.15.73:0/3046387196 shutdown_connections 2024-09-05T13:01:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.082+0000 7fb2435df740 1 --2- 172.21.15.73:0/3046387196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b00ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.082+0000 7fb2435df740 1 --2- 172.21.15.73:0/3046387196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b07260 0x560c64b009a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.082+0000 7fb2435df740 1 --2- 172.21.15.73:0/3046387196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b06920 0x560c64b0f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.082+0000 7fb2435df740 1 -- 172.21.15.73:0/3046387196 >> 172.21.15.73:0/3046387196 conn(0x560c64b02010 msgr2=0x560c64b0ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.082+0000 7fb2435df740 1 -- 172.21.15.73:0/3046387196 shutdown_connections 2024-09-05T13:01:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.082+0000 7fb2435df740 1 -- 172.21.15.73:0/3046387196 wait complete. 2024-09-05T13:01:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.083+0000 7fb2435df740 1 -- start start 2024-09-05T13:01:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.083+0000 7fb2435df740 1 Processor -- start 2024-09-05T13:01:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.084+0000 7fb2435df740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b3c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.084+0000 7fb2435df740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b07260 0x560c64b3ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.084+0000 7fb2435df740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b3fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.084+0000 7fb2435df740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c1a53c0 con 0x560c64b0a330 2024-09-05T13:01:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.084+0000 7fb2435df740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c1a6830 con 0x560c64b07260 2024-09-05T13:01:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.084+0000 7fb2435df740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c1a5a90 con 0x560c64b06920 2024-09-05T13:01:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.084+0000 7fb2435df740 10 client.0 _ll_register_callbacks cb 0x7fb234009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.085+0000 7fb23ad9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b3c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.085+0000 7fb23ad9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b3c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:43058/0 (socket says 172.21.15.73:43058) 2024-09-05T13:01:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.085+0000 7fb23ad9d640 1 -- 172.21.15.73:0/2691211893 learned_addr learned my addr 172.21.15.73:0/2691211893 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.085+0000 7fb239d9b640 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b07260 0x560c64b3ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.086+0000 7fb239d9b640 1 -- 172.21.15.73:0/2691211893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 msgr2=0x560c64b3c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.086+0000 7fb239d9b640 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b3c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.086+0000 7fb239d9b640 1 -- 172.21.15.73:0/2691211893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 msgr2=0x560c64b3fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.086+0000 7fb239d9b640 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b3fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.086+0000 7fb239d9b640 1 -- 172.21.15.73:0/2691211893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c64b40450 con 0x560c64b07260 2024-09-05T13:01:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.086+0000 7fb239d9b640 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b07260 0x560c64b3ce20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x560c64b00780 tx=0x7fb230004960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=111231db3ec60f1d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.087+0000 7fb221ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:01:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.089+0000 7fb221ffb640 1 -- 172.21.15.73:0/2691211893 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230004f10 con 0x560c64b07260 2024-09-05T13:01:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.089+0000 7fb221ffb640 1 -- 172.21.15.73:0/2691211893 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb2300050b0 con 0x560c64b07260 2024-09-05T13:01:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.089+0000 7fb2435df740 1 -- 172.21.15.73:0/2691211893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb230005510 con 0x560c64b07260 2024-09-05T13:01:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.090+0000 7fb221ffb640 1 -- 172.21.15.73:0/2691211893 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb2300052b0 con 0x560c64b07260 2024-09-05T13:01:13.092 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.090+0000 7fb2435df740 10 client.25385 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:13.092 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.090+0000 7fb2435df740 1 -- 172.21.15.73:0/2691211893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560c64b41790 con 0x560c64b07260 2024-09-05T13:01:13.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.092+0000 7fb221ffb640 1 -- 172.21.15.73:0/2691211893 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb230005510 con 0x560c64b07260 2024-09-05T13:01:13.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.092+0000 7fb221ffb640 1 -- 172.21.15.73:0/2691211893 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb230003c20 con 0x560c64b07260 2024-09-05T13:01:13.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.092+0000 7fb2435df740 10 client.25385 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:13.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.092+0000 7fb2435df740 10 client.25385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:13.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.092+0000 7fb2435df740 20 client.25385 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:13.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.092+0000 7fb2435df740 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c64b983a0 0x560c64b9a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:13.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.092+0000 7fb2435df740 4 client.25385 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:01:13.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.092+0000 7fb2435df740 1 -- 172.21.15.73:0/2691211893 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560c64a71d70 con 0x560c64b983a0 2024-09-05T13:01:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.092+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c64b983a0 0x560c64b9a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.093+0000 7fb221ffb640 10 client.25385 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.093+0000 7fb23ad9d640 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c64b983a0 0x560c64b9a7c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3b237a023ffc70 server_cookie=47fc85c98776192f in_seq=0 out_seq=0 2024-09-05T13:01:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb221ffb640 1 -- 172.21.15.73:0/2691211893 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560c64a71d70 con 0x560c64b983a0 2024-09-05T13:01:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb221ffb640 10 client.25385 handle_command_reply: tid=0 2024-09-05T13:01:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 client.25385 shutdown 2024-09-05T13:01:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 -- 172.21.15.73:0/2691211893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b07260 msgr2=0x560c64b3ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b07260 0x560c64b3ce20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x560c64b00780 tx=0x7fb230004960 comp rx=0 tx=0).stop 2024-09-05T13:01:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 -- 172.21.15.73:0/2691211893 shutdown_connections 2024-09-05T13:01:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x560c64b983a0 0x560c64b9a7c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560c64b0a330 0x560c64b3fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c64b07260 0x560c64b3ce20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 --2- 172.21.15.73:0/2691211893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c64b06920 0x560c64b3c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 -- 172.21.15.73:0/2691211893 >> 172.21.15.73:0/2691211893 conn(0x560c64b02010 msgr2=0x560c64b0f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb221ffb640 0 client.25385 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 -- 172.21.15.73:0/2691211893 shutdown_connections 2024-09-05T13:01:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 1 -- 172.21.15.73:0/2691211893 wait complete. 2024-09-05T13:01:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.119+0000 7fb2435df740 20 client.25385 trim_cache size 0 max 16384 2024-09-05T13:01:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:01:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:01:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:01:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:01:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.120+0000 7fb24084c640 1 -- 172.21.15.73:0/2334141957 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb2240a2d80 msgr2=0x7fb2240a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.120+0000 7fb24084c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb2240a2d80 0x7fb2240a5240 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00efd0 tx=0x7fb22c0047d0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.120+0000 7fb24084c640 1 -- 172.21.15.73:0/2334141957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb23c100a40 msgr2=0x7fb23c196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.120+0000 7fb24084c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb23c100a40 0x7fb23c196cb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00d920 tx=0x7fb22c00dde0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.121+0000 7fb24084c640 1 -- 172.21.15.73:0/2334141957 shutdown_connections 2024-09-05T13:01:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.121+0000 7fb24084c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb2240a2d80 0x7fb2240a5240 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.121+0000 7fb24084c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb23c1025f0 0x7fb23c19e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.121+0000 7fb24084c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb23c101c30 0x7fb23c1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.121+0000 7fb24084c640 1 --2- 172.21.15.73:0/2334141957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb23c100a40 0x7fb23c196cb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.121+0000 7fb24084c640 1 -- 172.21.15.73:0/2334141957 >> 172.21.15.73:0/2334141957 conn(0x7fb23c0fc1e0 msgr2=0x7fb23c104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.121+0000 7fb24084c640 1 -- 172.21.15.73:0/2334141957 shutdown_connections 2024-09-05T13:01:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:13.121+0000 7fb24084c640 1 -- 172.21.15.73:0/2334141957 wait complete. 2024-09-05T13:01:13.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:13 smithi162 ceph-mon[34220]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 6.99k op/s 2024-09-05T13:01:13.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:13 smithi073 ceph-mon[30883]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 6.99k op/s 2024-09-05T13:01:13.518 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:13 smithi169 ceph-mon[34823]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 6.99k op/s 2024-09-05T13:01:14.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:14 smithi073 ceph-mon[30883]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 29 MiB/s wr, 6.87k op/s 2024-09-05T13:01:14.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:14 smithi162 ceph-mon[34220]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 29 MiB/s wr, 6.87k op/s 2024-09-05T13:01:14.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:14 smithi169 ceph-mon[34823]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 29 MiB/s wr, 6.87k op/s 2024-09-05T13:01:16.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:16 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:01:16.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:16 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:01:16.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:16 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:01:17.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:17 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:01:17.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:17 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:01:17.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:17 smithi073 ceph-mon[30883]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 28 MiB/s wr, 6.68k op/s 2024-09-05T13:01:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:17 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:01:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:17 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:01:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:17 smithi162 ceph-mon[34220]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 28 MiB/s wr, 6.68k op/s 2024-09-05T13:01:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:17 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:01:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:17 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:01:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:17 smithi169 ceph-mon[34823]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 28 MiB/s wr, 6.68k op/s 2024-09-05T13:01:19.516 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:19 smithi073 ceph-mon[30883]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 MiB/s wr, 6.11k op/s 2024-09-05T13:01:19.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:19 smithi162 ceph-mon[34220]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 MiB/s wr, 6.11k op/s 2024-09-05T13:01:19.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:19 smithi169 ceph-mon[34823]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 MiB/s wr, 6.11k op/s 2024-09-05T13:01:21.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:21 smithi073 ceph-mon[30883]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 24 MiB/s wr, 5.80k op/s 2024-09-05T13:01:21.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:21 smithi162 ceph-mon[34220]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 24 MiB/s wr, 5.80k op/s 2024-09-05T13:01:21.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:21 smithi169 ceph-mon[34823]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 24 MiB/s wr, 5.80k op/s 2024-09-05T13:01:23.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:23 smithi073 ceph-mon[30883]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 6.58k op/s 2024-09-05T13:01:23.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:23 smithi162 ceph-mon[34220]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 6.58k op/s 2024-09-05T13:01:23.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:23 smithi169 ceph-mon[34823]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 6.58k op/s 2024-09-05T13:01:25.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:25 smithi073 ceph-mon[30883]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-09-05T13:01:25.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:25 smithi162 ceph-mon[34220]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-09-05T13:01:25.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:25 smithi169 ceph-mon[34823]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-09-05T13:01:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.256+0000 7f486224c640 1 -- 172.21.15.73:0/253492639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f485c102d10 msgr2=0x7f485c105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.256+0000 7f486224c640 1 --2- 172.21.15.73:0/253492639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f485c102d10 0x7f485c105180 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4844009860 tx=0x7f484402a340 comp rx=0 tx=0).stop 2024-09-05T13:01:26.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.257+0000 7f486224c640 1 -- 172.21.15.73:0/253492639 shutdown_connections 2024-09-05T13:01:26.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.257+0000 7f486224c640 1 --2- 172.21.15.73:0/253492639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f485c1056c0 0x7f485c105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.257+0000 7f486224c640 1 --2- 172.21.15.73:0/253492639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f485c102d10 0x7f485c105180 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.257+0000 7f486224c640 1 --2- 172.21.15.73:0/253492639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f485c1003c0 0x7f485c1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.257+0000 7f486224c640 1 -- 172.21.15.73:0/253492639 >> 172.21.15.73:0/253492639 conn(0x7f485c0fc1b0 msgr2=0x7f485c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:26.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.258+0000 7f486224c640 1 -- 172.21.15.73:0/253492639 shutdown_connections 2024-09-05T13:01:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.258+0000 7f486224c640 1 -- 172.21.15.73:0/253492639 wait complete. 2024-09-05T13:01:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f486224c640 1 Processor -- start 2024-09-05T13:01:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f486224c640 1 -- start start 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f486224c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f485c1003c0 0x7f485c10b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f486224c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f485c102d10 0x7f485c10be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f486224c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f485c1056c0 0x7f485c1ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f486224c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f485c113e00 con 0x7f485c1056c0 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f486224c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f485c113c80 con 0x7f485c1003c0 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f486224c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f485c113f80 con 0x7f485c102d10 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f485b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f485c1003c0 0x7f485c10b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f4853fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f485c102d10 0x7f485c10be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f485bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f485c1056c0 0x7f485c1ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f4853fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f485c102d10 0x7f485c10be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:57536/0 (socket says 172.21.15.73:57536) 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.259+0000 7f4853fff640 1 -- 172.21.15.73:0/3408464011 learned_addr learned my addr 172.21.15.73:0/3408464011 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.260+0000 7f485bfff640 1 -- 172.21.15.73:0/3408464011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f485c102d10 msgr2=0x7f485c10be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.260+0000 7f485bfff640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f485c102d10 0x7f485c10be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.260+0000 7f485bfff640 1 -- 172.21.15.73:0/3408464011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f485c1003c0 msgr2=0x7f485c10b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.260+0000 7f485bfff640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f485c1003c0 0x7f485c10b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.260+0000 7f485bfff640 1 -- 172.21.15.73:0/3408464011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c1ae9f0 con 0x7f485c1056c0 2024-09-05T13:01:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.261+0000 7f485bfff640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f485c1056c0 0x7f485c1ae4b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f485400e940 tx=0x7f485400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.261+0000 7f4853fff640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f485c102d10 0x7f485c10be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:01:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.262+0000 7f48597fa640 1 -- 172.21.15.73:0/3408464011 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854004d20 con 0x7f485c1056c0 2024-09-05T13:01:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.262+0000 7f486224c640 1 -- 172.21.15.73:0/3408464011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485c1aebc0 con 0x7f485c1056c0 2024-09-05T13:01:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.262+0000 7f486224c640 1 -- 172.21.15.73:0/3408464011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485c1af080 con 0x7f485c1056c0 2024-09-05T13:01:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.263+0000 7f48597fa640 1 -- 172.21.15.73:0/3408464011 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4854005020 con 0x7f485c1056c0 2024-09-05T13:01:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.263+0000 7f48597fa640 1 -- 172.21.15.73:0/3408464011 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540116d0 con 0x7f485c1056c0 2024-09-05T13:01:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.265+0000 7f48597fa640 1 -- 172.21.15.73:0/3408464011 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f485400ca60 con 0x7f485c1056c0 2024-09-05T13:01:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.266+0000 7f48597fa640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48480a2e20 0x7f48480a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.267+0000 7f48597fa640 1 -- 172.21.15.73:0/3408464011 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f48540cf0b0 con 0x7f485c1056c0 2024-09-05T13:01:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.267+0000 7f485b7fe640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48480a2e20 0x7f48480a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.268+0000 7f485b7fe640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48480a2e20 0x7f48480a52e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f484c005fd0 tx=0x7f484c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f4864fe0740 1 Processor -- start 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f4864fe0740 1 -- start start 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeedd9a0 0x561eaeeddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeede2e0 0x561eaeee2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeee3370 0x561eaeee5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f4864fe0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561eaee412f0 con 0x561eaeede2e0 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f4864fe0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561eaede9270 con 0x561eaeee3370 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f4864fe0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561eaee3d2b0 con 0x561eaeedd9a0 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f485b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeedd9a0 0x561eaeeddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f485b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeedd9a0 0x561eaeeddda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:57552/0 (socket says 172.21.15.73:57552) 2024-09-05T13:01:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f485b7fe640 1 -- 172.21.15.73:0/3849068754 learned_addr learned my addr 172.21.15.73:0/3849068754 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f4853fff640 1 --2- 172.21.15.73:0/3849068754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeede2e0 0x561eaeee2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.272+0000 7f485bfff640 1 --2- 172.21.15.73:0/3849068754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeee3370 0x561eaeee5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.273+0000 7f4853fff640 1 -- 172.21.15.73:0/3849068754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeedd9a0 msgr2=0x561eaeeddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.273+0000 7f4853fff640 1 --2- 172.21.15.73:0/3849068754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeedd9a0 0x561eaeeddda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.273+0000 7f4853fff640 1 -- 172.21.15.73:0/3849068754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeee3370 msgr2=0x561eaeee5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.273+0000 7f4853fff640 1 --2- 172.21.15.73:0/3849068754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeee3370 0x561eaeee5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.273+0000 7f4853fff640 1 -- 172.21.15.73:0/3849068754 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eaede8340 con 0x561eaeede2e0 2024-09-05T13:01:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.273+0000 7f4853fff640 1 --2- 172.21.15.73:0/3849068754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeede2e0 0x561eaeee2da0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f484402a930 tx=0x7f4844005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdb76bca53368e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.273+0000 7f4851ffb640 1 -- 172.21.15.73:0/3849068754 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844037040 con 0x561eaeede2e0 2024-09-05T13:01:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4851ffb640 1 -- 172.21.15.73:0/3849068754 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4844004030 con 0x561eaeede2e0 2024-09-05T13:01:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4851ffb640 1 -- 172.21.15.73:0/3849068754 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844005580 con 0x561eaeede2e0 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4864fe0740 1 -- 172.21.15.73:0/3849068754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeede2e0 msgr2=0x561eaeee2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4864fe0740 1 --2- 172.21.15.73:0/3849068754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeede2e0 0x561eaeee2da0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f484402a930 tx=0x7f4844005d90 comp rx=0 tx=0).stop 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4864fe0740 1 -- 172.21.15.73:0/3849068754 shutdown_connections 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4864fe0740 1 --2- 172.21.15.73:0/3849068754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeee3370 0x561eaeee5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4864fe0740 1 --2- 172.21.15.73:0/3849068754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeede2e0 0x561eaeee2da0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4864fe0740 1 --2- 172.21.15.73:0/3849068754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeedd9a0 0x561eaeeddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4864fe0740 1 -- 172.21.15.73:0/3849068754 >> 172.21.15.73:0/3849068754 conn(0x561eaeed9010 msgr2=0x561eaeed9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4864fe0740 1 -- 172.21.15.73:0/3849068754 shutdown_connections 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.274+0000 7f4864fe0740 1 -- 172.21.15.73:0/3849068754 wait complete. 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.275+0000 7f4864fe0740 1 -- start start 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.275+0000 7f4864fe0740 1 Processor -- start 2024-09-05T13:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.276+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeee7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.276+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeee80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.276+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaeeef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.276+0000 7f4864fe0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561eaeee6330 con 0x561eaeedd9a0 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.276+0000 7f4864fe0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561eaedca290 con 0x561eaeede2e0 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.276+0000 7f4864fe0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561eaeee64b0 con 0x561eaeee3370 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.276+0000 7f4864fe0740 10 client.0 _ll_register_callbacks cb 0x561eaedfb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.278+0000 7f485b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeee7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.278+0000 7f485b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeee7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42154/0 (socket says 172.21.15.73:42154) 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.278+0000 7f485b7fe640 1 -- 172.21.15.73:0/1991404408 learned_addr learned my addr 172.21.15.73:0/1991404408 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.278+0000 7f485b7fe640 1 -- 172.21.15.73:0/1991404408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 msgr2=0x561eaeeef0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.278+0000 7f485b7fe640 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaeeef0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.278+0000 7f485b7fe640 1 -- 172.21.15.73:0/1991404408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 msgr2=0x561eaeee80a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.278+0000 7f485b7fe640 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeee80a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.278+0000 7f485b7fe640 1 -- 172.21.15.73:0/1991404408 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eaeb54210 con 0x561eaeedd9a0 2024-09-05T13:01:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.279+0000 7f485b7fe640 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeee7b60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f484c0058c0 tx=0x7f484c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a596163daac69d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.279+0000 7f483affd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.281+0000 7f483affd640 1 -- 172.21.15.73:0/1991404408 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c028440 con 0x561eaeedd9a0 2024-09-05T13:01:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.281+0000 7f483affd640 1 -- 172.21.15.73:0/1991404408 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f484c0273e0 con 0x561eaeedd9a0 2024-09-05T13:01:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.281+0000 7f4864fe0740 1 -- 172.21.15.73:0/1991404408 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4844004030 con 0x561eaeedd9a0 2024-09-05T13:01:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.282+0000 7f483affd640 1 -- 172.21.15.73:0/1991404408 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f484c0285e0 con 0x561eaeedd9a0 2024-09-05T13:01:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.282+0000 7f4864fe0740 10 client.15882 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.282+0000 7f4864fe0740 1 -- 172.21.15.73:0/1991404408 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561eaec20620 con 0x561eaeedd9a0 2024-09-05T13:01:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.283+0000 7f483affd640 1 -- 172.21.15.73:0/1991404408 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4844004030 con 0x561eaeedd9a0 2024-09-05T13:01:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.285+0000 7f483affd640 1 -- 172.21.15.73:0/1991404408 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f484c026070 con 0x561eaeedd9a0 2024-09-05T13:01:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.285+0000 7f4864fe0740 10 client.15882 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.285+0000 7f4864fe0740 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.285+0000 7f4864fe0740 20 client.15882 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.285+0000 7f4864fe0740 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561eaeef3a30 0x561eaeef5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.285+0000 7f4864fe0740 4 client.15882 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.285+0000 7f4864fe0740 1 -- 172.21.15.73:0/1991404408 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561eaee4ea20 con 0x561eaeef3a30 2024-09-05T13:01:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.288+0000 7f4853fff640 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561eaeef3a30 0x561eaeef5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.289+0000 7f4853fff640 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561eaeef3a30 0x561eaeef5ef0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31137a6a27465647 server_cookie=59cf54128df52791 in_seq=0 out_seq=0 2024-09-05T13:01:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.289+0000 7f483affd640 10 client.15882 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.292+0000 7f483affd640 1 -- 172.21.15.73:0/1991404408 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561eaee4ea20 con 0x561eaeef3a30 2024-09-05T13:01:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.292+0000 7f483affd640 10 client.15882 handle_command_reply: tid=0 2024-09-05T13:01:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.292+0000 7f4864fe0740 1 client.15882 shutdown 2024-09-05T13:01:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.293+0000 7f4864fe0740 1 -- 172.21.15.73:0/1991404408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 msgr2=0x561eaeee7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.293+0000 7f4864fe0740 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeee7b60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f484c0058c0 tx=0x7f484c004730 comp rx=0 tx=0).stop 2024-09-05T13:01:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.293+0000 7f4864fe0740 1 -- 172.21.15.73:0/1991404408 shutdown_connections 2024-09-05T13:01:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.293+0000 7f4864fe0740 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561eaeef3a30 0x561eaeef5ef0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.293+0000 7f4864fe0740 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaeeef0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.293+0000 7f4864fe0740 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeee80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.293+0000 7f4864fe0740 1 --2- 172.21.15.73:0/1991404408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeee7b60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.293+0000 7f4864fe0740 1 -- 172.21.15.73:0/1991404408 >> 172.21.15.73:0/1991404408 conn(0x561eaeed9010 msgr2=0x561eaeeda820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.294+0000 7f483affd640 0 client.15882 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.295+0000 7f4864fe0740 1 -- 172.21.15.73:0/1991404408 shutdown_connections 2024-09-05T13:01:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.295+0000 7f4864fe0740 1 -- 172.21.15.73:0/1991404408 wait complete. 2024-09-05T13:01:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.296+0000 7f4864fe0740 20 client.15882 trim_cache size 0 max 16384 2024-09-05T13:01:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.326+0000 7f4864fe0740 1 Processor -- start 2024-09-05T13:01:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f4864fe0740 1 -- start start 2024-09-05T13:01:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeedf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeedf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaeeef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f4864fe0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1ba6f0 con 0x561eaeedd9a0 2024-09-05T13:01:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f4864fe0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1b7f00 con 0x561eaeede2e0 2024-09-05T13:01:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f4864fe0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1b5d50 con 0x561eaeee3370 2024-09-05T13:01:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f485bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaeeef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f485bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaeeef0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:57568/0 (socket says 172.21.15.73:57568) 2024-09-05T13:01:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f485bfff640 1 -- 172.21.15.73:0/4280728568 learned_addr learned my addr 172.21.15.73:0/4280728568 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.327+0000 7f4853fff640 1 --2- 172.21.15.73:0/4280728568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeedf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.328+0000 7f485b7fe640 1 --2- 172.21.15.73:0/4280728568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeedf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.328+0000 7f4853fff640 1 -- 172.21.15.73:0/4280728568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 msgr2=0x561eaeeef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.328+0000 7f4853fff640 1 --2- 172.21.15.73:0/4280728568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaeeef0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.328+0000 7f4853fff640 1 -- 172.21.15.73:0/4280728568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 msgr2=0x561eaeedf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.328+0000 7f4853fff640 1 --2- 172.21.15.73:0/4280728568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeedf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.328+0000 7f4853fff640 1 -- 172.21.15.73:0/4280728568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eaeedef70 con 0x561eaeede2e0 2024-09-05T13:01:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.329+0000 7f4853fff640 1 --2- 172.21.15.73:0/4280728568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeedf9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x561eaeee9040 tx=0x7f4844005d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ab7a528929aca72 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.329+0000 7f48517fa640 1 -- 172.21.15.73:0/4280728568 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844037040 con 0x561eaeede2e0 2024-09-05T13:01:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.329+0000 7f48517fa640 1 -- 172.21.15.73:0/4280728568 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4844004280 con 0x561eaeede2e0 2024-09-05T13:01:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.330+0000 7f4864fe0740 1 -- 172.21.15.73:0/4280728568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 msgr2=0x561eaeedf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.330+0000 7f4864fe0740 1 --2- 172.21.15.73:0/4280728568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeedf9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x561eaeee9040 tx=0x7f4844005d90 comp rx=0 tx=0).stop 2024-09-05T13:01:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.331+0000 7f4864fe0740 1 -- 172.21.15.73:0/4280728568 shutdown_connections 2024-09-05T13:01:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.331+0000 7f4864fe0740 1 --2- 172.21.15.73:0/4280728568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaeeef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.331+0000 7f4864fe0740 1 --2- 172.21.15.73:0/4280728568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeedf9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.331+0000 7f4864fe0740 1 --2- 172.21.15.73:0/4280728568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeedf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.331+0000 7f4864fe0740 1 -- 172.21.15.73:0/4280728568 >> 172.21.15.73:0/4280728568 conn(0x561eaeed9010 msgr2=0x561eaeed93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.331+0000 7f4864fe0740 1 -- 172.21.15.73:0/4280728568 shutdown_connections 2024-09-05T13:01:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.331+0000 7f4864fe0740 1 -- 172.21.15.73:0/4280728568 wait complete. 2024-09-05T13:01:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.332+0000 7f4864fe0740 1 -- start start 2024-09-05T13:01:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.332+0000 7f4864fe0740 1 Processor -- start 2024-09-05T13:01:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.332+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeeebef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.332+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeeec430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.332+0000 7f4864fe0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaef5c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f4864fe0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1b63c0 con 0x561eaeedd9a0 2024-09-05T13:01:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f4864fe0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1b7830 con 0x561eaeede2e0 2024-09-05T13:01:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f4864fe0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1b6a90 con 0x561eaeee3370 2024-09-05T13:01:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f4864fe0740 10 client.0 _ll_register_callbacks cb 0x7f484c009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f4853fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeeec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f485b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeeebef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f485b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeeebef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42162/0 (socket says 172.21.15.73:42162) 2024-09-05T13:01:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f485b7fe640 1 -- 172.21.15.73:0/3310270151 learned_addr learned my addr 172.21.15.73:0/3310270151 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f485bfff640 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaef5c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f4853fff640 1 -- 172.21.15.73:0/3310270151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 msgr2=0x561eaef5c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f4853fff640 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaef5c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f4853fff640 1 -- 172.21.15.73:0/3310270151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 msgr2=0x561eaeeebef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f4853fff640 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeeebef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.333+0000 7f4853fff640 1 -- 172.21.15.73:0/3310270151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eaeef6260 con 0x561eaeede2e0 2024-09-05T13:01:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.334+0000 7f4853fff640 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeeec430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x561eaeeefda0 tx=0x7f4844005a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fc1f401cdefed95 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.334+0000 7f483affd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:01:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.334+0000 7f483affd640 1 -- 172.21.15.73:0/3310270151 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844037030 con 0x561eaeede2e0 2024-09-05T13:01:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.334+0000 7f4864fe0740 1 -- 172.21.15.73:0/3310270151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4844004280 con 0x561eaeede2e0 2024-09-05T13:01:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.334+0000 7f483affd640 1 -- 172.21.15.73:0/3310270151 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f4844004430 con 0x561eaeede2e0 2024-09-05T13:01:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.334+0000 7f483affd640 1 -- 172.21.15.73:0/3310270151 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4844030650 con 0x561eaeede2e0 2024-09-05T13:01:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.335+0000 7f4864fe0740 10 client.25400 fetch_fsmap learned FSMap version 33 2024-09-05T13:01:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.335+0000 7f4864fe0740 1 -- 172.21.15.73:0/3310270151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561eaef5dd40 con 0x561eaeede2e0 2024-09-05T13:01:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.335+0000 7f483affd640 1 -- 172.21.15.73:0/3310270151 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4844004280 con 0x561eaeede2e0 2024-09-05T13:01:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.335+0000 7f483affd640 1 -- 172.21.15.73:0/3310270151 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f4844032440 con 0x561eaeede2e0 2024-09-05T13:01:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.336+0000 7f4864fe0740 10 client.25400 fetch_fsmap finished waiting for FSMap version 33 2024-09-05T13:01:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.336+0000 7f4864fe0740 10 client.25400 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.336+0000 7f4864fe0740 20 client.25400 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.336+0000 7f4864fe0740 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561eaef5e6a0 0x561eaef60ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.336+0000 7f4864fe0740 4 client.25400 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:01:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.336+0000 7f4864fe0740 1 -- 172.21.15.73:0/3310270151 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561eaee48d70 con 0x561eaef5e6a0 2024-09-05T13:01:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.336+0000 7f485b7fe640 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561eaef5e6a0 0x561eaef60ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.338+0000 7f485b7fe640 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561eaef5e6a0 0x561eaef60ac0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f605c8a4135bb9e6 server_cookie=bbbfea1bfa48cdde in_seq=0 out_seq=0 2024-09-05T13:01:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.338+0000 7f483affd640 10 client.25400 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.368+0000 7f483affd640 1 -- 172.21.15.73:0/3310270151 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561eaee48d70 con 0x561eaef5e6a0 2024-09-05T13:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.368+0000 7f483affd640 10 client.25400 handle_command_reply: tid=0 2024-09-05T13:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.368+0000 7f4864fe0740 1 client.25400 shutdown 2024-09-05T13:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.368+0000 7f4864fe0740 1 -- 172.21.15.73:0/3310270151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 msgr2=0x561eaeeec430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.368+0000 7f4864fe0740 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeeec430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x561eaeeefda0 tx=0x7f4844005a90 comp rx=0 tx=0).stop 2024-09-05T13:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.369+0000 7f4864fe0740 1 -- 172.21.15.73:0/3310270151 shutdown_connections 2024-09-05T13:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.369+0000 7f4864fe0740 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561eaef5e6a0 0x561eaef60ac0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.369+0000 7f4864fe0740 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561eaeee3370 0x561eaef5c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.369+0000 7f4864fe0740 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eaeede2e0 0x561eaeeec430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.369+0000 7f4864fe0740 1 --2- 172.21.15.73:0/3310270151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561eaeedd9a0 0x561eaeeebef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.369+0000 7f4864fe0740 1 -- 172.21.15.73:0/3310270151 >> 172.21.15.73:0/3310270151 conn(0x561eaeed9010 msgr2=0x561eaeee7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.369+0000 7f483affd640 0 client.25400 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.369+0000 7f4864fe0740 1 -- 172.21.15.73:0/3310270151 shutdown_connections 2024-09-05T13:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.369+0000 7f4864fe0740 1 -- 172.21.15.73:0/3310270151 wait complete. 2024-09-05T13:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.369+0000 7f4864fe0740 20 client.25400 trim_cache size 0 max 16384 2024-09-05T13:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.370+0000 7f486224c640 1 -- 172.21.15.73:0/3408464011 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48480a2e20 msgr2=0x7f48480a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.370+0000 7f486224c640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48480a2e20 0x7f48480a52e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f484c005fd0 tx=0x7f484c009260 comp rx=0 tx=0).stop 2024-09-05T13:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.370+0000 7f486224c640 1 -- 172.21.15.73:0/3408464011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f485c1056c0 msgr2=0x7f485c1ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.370+0000 7f486224c640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f485c1056c0 0x7f485c1ae4b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f485400e940 tx=0x7f485400ed40 comp rx=0 tx=0).stop 2024-09-05T13:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.371+0000 7f486224c640 1 -- 172.21.15.73:0/3408464011 shutdown_connections 2024-09-05T13:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.371+0000 7f486224c640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f48480a2e20 0x7f48480a52e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.371+0000 7f486224c640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f485c1056c0 0x7f485c1ae4b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.371+0000 7f486224c640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f485c102d10 0x7f485c10be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.371+0000 7f486224c640 1 --2- 172.21.15.73:0/3408464011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f485c1003c0 0x7f485c10b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.371+0000 7f486224c640 1 -- 172.21.15.73:0/3408464011 >> 172.21.15.73:0/3408464011 conn(0x7f485c0fc1b0 msgr2=0x7f485c100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.371+0000 7f486224c640 1 -- 172.21.15.73:0/3408464011 shutdown_connections 2024-09-05T13:01:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:26.371+0000 7f486224c640 1 -- 172.21.15.73:0/3408464011 wait complete. 2024-09-05T13:01:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:27 smithi073 ceph-mon[30883]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 4.15k op/s 2024-09-05T13:01:27.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:27 smithi162 ceph-mon[34220]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 4.15k op/s 2024-09-05T13:01:27.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:27 smithi169 ceph-mon[34823]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 4.15k op/s 2024-09-05T13:01:29.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:29 smithi073 ceph-mon[30883]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.17k op/s 2024-09-05T13:01:29.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:29 smithi162 ceph-mon[34220]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.17k op/s 2024-09-05T13:01:29.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:29 smithi169 ceph-mon[34823]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.17k op/s 2024-09-05T13:01:31.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:31 smithi073 ceph-mon[30883]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-05T13:01:31.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:31 smithi162 ceph-mon[34220]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-05T13:01:31.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:31 smithi169 ceph-mon[34823]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-05T13:01:32.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:32 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:01:32.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:32 smithi073 ceph-mon[30883]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 6.70k op/s 2024-09-05T13:01:32.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:32 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:01:32.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:32 smithi162 ceph-mon[34220]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 6.70k op/s 2024-09-05T13:01:32.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:32 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:01:32.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:32 smithi169 ceph-mon[34823]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 6.70k op/s 2024-09-05T13:01:35.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:35 smithi073 ceph-mon[30883]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 20 MiB/s wr, 4.84k op/s 2024-09-05T13:01:35.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:35 smithi162 ceph-mon[34220]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 20 MiB/s wr, 4.84k op/s 2024-09-05T13:01:35.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:35 smithi169 ceph-mon[34823]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 20 MiB/s wr, 4.84k op/s 2024-09-05T13:01:37.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:37 smithi073 ceph-mon[30883]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.20k op/s 2024-09-05T13:01:37.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:37 smithi162 ceph-mon[34220]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.20k op/s 2024-09-05T13:01:37.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:37 smithi169 ceph-mon[34823]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.20k op/s 2024-09-05T13:01:39.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:39 smithi073 ceph-mon[30883]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 5.82k op/s 2024-09-05T13:01:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.522+0000 7f0e90808640 1 -- 172.21.15.73:0/1816740974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e8c102600 msgr2=0x7f0e8c108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.522+0000 7f0e90808640 1 --2- 172.21.15.73:0/1816740974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e8c102600 0x7f0e8c108e90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009900 tx=0x7f0e8402a440 comp rx=0 tx=0).stop 2024-09-05T13:01:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.530+0000 7f0e90808640 1 -- 172.21.15.73:0/1816740974 shutdown_connections 2024-09-05T13:01:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.530+0000 7f0e90808640 1 --2- 172.21.15.73:0/1816740974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e8c102600 0x7f0e8c108e90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.530+0000 7f0e90808640 1 --2- 172.21.15.73:0/1816740974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e8c101c40 0x7f0e8c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.530+0000 7f0e90808640 1 --2- 172.21.15.73:0/1816740974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e8c100a50 0x7f0e8c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.530+0000 7f0e90808640 1 -- 172.21.15.73:0/1816740974 >> 172.21.15.73:0/1816740974 conn(0x7f0e8c0fc1b0 msgr2=0x7f0e8c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.533+0000 7f0e90808640 1 -- 172.21.15.73:0/1816740974 shutdown_connections 2024-09-05T13:01:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.537+0000 7f0e90808640 1 -- 172.21.15.73:0/1816740974 wait complete. 2024-09-05T13:01:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.538+0000 7f0e90808640 1 Processor -- start 2024-09-05T13:01:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.538+0000 7f0e90808640 1 -- start start 2024-09-05T13:01:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.539+0000 7f0e90808640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e8c100a50 0x7f0e8c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.539+0000 7f0e90808640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e8c101c40 0x7f0e8c070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.539+0000 7f0e90808640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e8c102600 0x7f0e8c072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.539+0000 7f0e90808640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c10c6b0 con 0x7f0e8c102600 2024-09-05T13:01:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.539+0000 7f0e90808640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c10c530 con 0x7f0e8c100a50 2024-09-05T13:01:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.539+0000 7f0e90808640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c10c830 con 0x7f0e8c101c40 2024-09-05T13:01:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.539+0000 7f0e8a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e8c100a50 0x7f0e8c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.539+0000 7f0e8a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e8c100a50 0x7f0e8c06de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:47254/0 (socket says 172.21.15.73:47254) 2024-09-05T13:01:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.539+0000 7f0e8a59c640 1 -- 172.21.15.73:0/1010512498 learned_addr learned my addr 172.21.15.73:0/1010512498 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.539+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e8c101c40 0x7f0e8c070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.540+0000 7f0e8ad9d640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e8c102600 0x7f0e8c072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.540+0000 7f0e8a59c640 1 -- 172.21.15.73:0/1010512498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e8c101c40 msgr2=0x7f0e8c070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.540+0000 7f0e8a59c640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e8c101c40 0x7f0e8c070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.540+0000 7f0e8a59c640 1 -- 172.21.15.73:0/1010512498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e8c102600 msgr2=0x7f0e8c072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.540+0000 7f0e8a59c640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e8c102600 0x7f0e8c072940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.540+0000 7f0e8a59c640 1 -- 172.21.15.73:0/1010512498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8c073200 con 0x7f0e8c100a50 2024-09-05T13:01:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.540+0000 7f0e8a59c640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e8c100a50 0x7f0e8c06de40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00e9c0 tx=0x7f0e7c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.540+0000 7f0e83fff640 1 -- 172.21.15.73:0/1010512498 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c00cd80 con 0x7f0e8c100a50 2024-09-05T13:01:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.540+0000 7f0e90808640 1 -- 172.21.15.73:0/1010512498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8c0734f0 con 0x7f0e8c100a50 2024-09-05T13:01:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.541+0000 7f0e90808640 1 -- 172.21.15.73:0/1010512498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e8c073a90 con 0x7f0e8c100a50 2024-09-05T13:01:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.541+0000 7f0e83fff640 1 -- 172.21.15.73:0/1010512498 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e7c032910 con 0x7f0e8c100a50 2024-09-05T13:01:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.541+0000 7f0e83fff640 1 -- 172.21.15.73:0/1010512498 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0108d0 con 0x7f0e8c100a50 2024-09-05T13:01:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.548+0000 7f0e93679740 1 Processor -- start 2024-09-05T13:01:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.554+0000 7f0e93679740 1 -- start start 2024-09-05T13:01:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.556+0000 7f0e83fff640 1 -- 172.21.15.73:0/1010512498 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0e7c032430 con 0x7f0e8c100a50 2024-09-05T13:01:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.557+0000 7f0e83fff640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e6c0a2c80 0x7f0e6c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.557+0000 7f0e83fff640 1 -- 172.21.15.73:0/1010512498 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0e7c0e04a0 con 0x7f0e8c100a50 2024-09-05T13:01:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.559+0000 7f0e8ad9d640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e6c0a2c80 0x7f0e6c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.559+0000 7f0e93679740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265fe9a0 0x5646265feda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.559+0000 7f0e93679740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265ff2e0 0x564626603da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.559+0000 7f0e93679740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 0x564626606830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.559+0000 7f0e93679740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5646265622f0 con 0x564626604370 2024-09-05T13:01:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.559+0000 7f0e93679740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56462650a270 con 0x5646265ff2e0 2024-09-05T13:01:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.559+0000 7f0e93679740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56462655e2b0 con 0x5646265fe9a0 2024-09-05T13:01:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.560+0000 7f0e8ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 0x564626606830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.560+0000 7f0e8ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 0x564626606830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50714/0 (socket says 172.21.15.73:50714) 2024-09-05T13:01:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.560+0000 7f0e8ad9d640 1 -- 172.21.15.73:0/2119341366 learned_addr learned my addr 172.21.15.73:0/2119341366 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.560+0000 7f0e8ad9d640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e6c0a2c80 0x7f0e6c0a5140 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009850 tx=0x7f0e84004c10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.560+0000 7f0e8ad9d640 1 -- 172.21.15.73:0/2119341366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265fe9a0 msgr2=0x5646265feda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.560+0000 7f0e8ad9d640 1 --2- 172.21.15.73:0/2119341366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265fe9a0 0x5646265feda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.560+0000 7f0e8ad9d640 1 -- 172.21.15.73:0/2119341366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265ff2e0 msgr2=0x564626603da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.560+0000 7f0e8ad9d640 1 --2- 172.21.15.73:0/2119341366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265ff2e0 0x564626603da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.560+0000 7f0e8ad9d640 1 -- 172.21.15.73:0/2119341366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564626509340 con 0x564626604370 2024-09-05T13:01:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.560+0000 7f0e8ad9d640 1 --2- 172.21.15.73:0/2119341366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 0x564626606830 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009900 tx=0x7f0e84046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8aab59abc499a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.561+0000 7f0e80d99640 1 -- 172.21.15.73:0/2119341366 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84005650 con 0x564626604370 2024-09-05T13:01:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.561+0000 7f0e80d99640 1 -- 172.21.15.73:0/2119341366 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e84031920 con 0x564626604370 2024-09-05T13:01:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.561+0000 7f0e80d99640 1 -- 172.21.15.73:0/2119341366 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84049850 con 0x564626604370 2024-09-05T13:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.563+0000 7f0e93679740 1 -- 172.21.15.73:0/2119341366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 msgr2=0x564626606830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.564+0000 7f0e93679740 1 --2- 172.21.15.73:0/2119341366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 0x564626606830 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009900 tx=0x7f0e84046000 comp rx=0 tx=0).stop 2024-09-05T13:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.566+0000 7f0e93679740 1 -- 172.21.15.73:0/2119341366 shutdown_connections 2024-09-05T13:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.566+0000 7f0e93679740 1 --2- 172.21.15.73:0/2119341366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 0x564626606830 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.566+0000 7f0e93679740 1 --2- 172.21.15.73:0/2119341366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265ff2e0 0x564626603da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.566+0000 7f0e93679740 1 --2- 172.21.15.73:0/2119341366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265fe9a0 0x5646265feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.566+0000 7f0e93679740 1 -- 172.21.15.73:0/2119341366 >> 172.21.15.73:0/2119341366 conn(0x5646265fa010 msgr2=0x5646265fa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:39.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.570+0000 7f0e93679740 1 -- 172.21.15.73:0/2119341366 shutdown_connections 2024-09-05T13:01:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.574+0000 7f0e93679740 1 -- 172.21.15.73:0/2119341366 wait complete. 2024-09-05T13:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.574+0000 7f0e93679740 1 -- start start 2024-09-05T13:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.574+0000 7f0e93679740 1 Processor -- start 2024-09-05T13:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.578+0000 7f0e93679740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 0x564626608c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.578+0000 7f0e93679740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265ff2e0 0x5646266091c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.578+0000 7f0e93679740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564626604370 0x564626610200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.578+0000 7f0e93679740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5646266072e0 con 0x5646265ff2e0 2024-09-05T13:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.578+0000 7f0e93679740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5646264eb290 con 0x5646265fe9a0 2024-09-05T13:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.578+0000 7f0e93679740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564626607460 con 0x564626604370 2024-09-05T13:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.578+0000 7f0e93679740 10 client.0 _ll_register_callbacks cb 0x56462651c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.580+0000 7f0e8a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 0x564626608c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.580+0000 7f0e8a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 0x564626608c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:47266/0 (socket says 172.21.15.73:47266) 2024-09-05T13:01:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.580+0000 7f0e8a59c640 1 -- 172.21.15.73:0/400465321 learned_addr learned my addr 172.21.15.73:0/400465321 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.580+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265ff2e0 0x5646266091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.580+0000 7f0e8a59c640 1 -- 172.21.15.73:0/400465321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564626604370 msgr2=0x564626610200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.580+0000 7f0e8a59c640 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564626604370 0x564626610200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.580+0000 7f0e8a59c640 1 -- 172.21.15.73:0/400465321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265ff2e0 msgr2=0x5646266091c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.580+0000 7f0e8a59c640 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265ff2e0 0x5646266091c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.580+0000 7f0e8a59c640 1 -- 172.21.15.73:0/400465321 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564626275210 con 0x5646265fe9a0 2024-09-05T13:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.580+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265ff2e0 0x5646266091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:01:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.582+0000 7f0e8a59c640 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 0x564626608c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0accc0 tx=0x7f0e7c0ac780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0f08efe5eb8a5d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.582+0000 7f0e79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:01:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.583+0000 7f0e79ffb640 1 -- 172.21.15.73:0/400465321 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0b59a0 con 0x5646265fe9a0 2024-09-05T13:01:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.583+0000 7f0e79ffb640 1 -- 172.21.15.73:0/400465321 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0e7c0e00f0 con 0x5646265fe9a0 2024-09-05T13:01:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.584+0000 7f0e93679740 1 -- 172.21.15.73:0/400465321 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e84031920 con 0x5646265fe9a0 2024-09-05T13:01:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.587+0000 7f0e79ffb640 1 -- 172.21.15.73:0/400465321 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0e7c032720 con 0x5646265fe9a0 2024-09-05T13:01:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.587+0000 7f0e93679740 10 client.25409 fetch_fsmap learned FSMap version 34 2024-09-05T13:01:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.587+0000 7f0e93679740 1 -- 172.21.15.73:0/400465321 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564626341620 con 0x5646265fe9a0 2024-09-05T13:01:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.593+0000 7f0e79ffb640 1 -- 172.21.15.73:0/400465321 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e84031920 con 0x5646265fe9a0 2024-09-05T13:01:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.593+0000 7f0e79ffb640 1 -- 172.21.15.73:0/400465321 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 34) ==== 8366+0+0 (secure 0 0 0) 0x7f0e7c0c3030 con 0x5646265fe9a0 2024-09-05T13:01:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.594+0000 7f0e93679740 10 client.25409 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T13:01:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.594+0000 7f0e93679740 10 client.25409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.594+0000 7f0e93679740 20 client.25409 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.594+0000 7f0e93679740 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5646266148f0 0x564626616d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.594+0000 7f0e93679740 4 client.25409 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.594+0000 7f0e93679740 1 -- 172.21.15.73:0/400465321 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56462656fa20 con 0x5646266148f0 2024-09-05T13:01:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.597+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5646266148f0 0x564626616d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.599+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5646266148f0 0x564626616d40 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0a5b4aa5b5d41c4 server_cookie=1b84ea1cf83a299 in_seq=0 out_seq=0 2024-09-05T13:01:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.599+0000 7f0e79ffb640 10 client.25409 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.600+0000 7f0e79ffb640 1 -- 172.21.15.73:0/400465321 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56462656fa20 con 0x5646266148f0 2024-09-05T13:01:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.600+0000 7f0e79ffb640 10 client.25409 handle_command_reply: tid=0 2024-09-05T13:01:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.600+0000 7f0e93679740 1 client.25409 shutdown 2024-09-05T13:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.604+0000 7f0e93679740 1 -- 172.21.15.73:0/400465321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 msgr2=0x564626608c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.604+0000 7f0e93679740 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 0x564626608c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0accc0 tx=0x7f0e7c0ac780 comp rx=0 tx=0).stop 2024-09-05T13:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.604+0000 7f0e93679740 1 -- 172.21.15.73:0/400465321 shutdown_connections 2024-09-05T13:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.604+0000 7f0e93679740 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5646266148f0 0x564626616d40 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.604+0000 7f0e93679740 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564626604370 0x564626610200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.604+0000 7f0e93679740 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265ff2e0 0x5646266091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.604+0000 7f0e93679740 1 --2- 172.21.15.73:0/400465321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 0x564626608c80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.604+0000 7f0e93679740 1 -- 172.21.15.73:0/400465321 >> 172.21.15.73:0/400465321 conn(0x5646265fa010 msgr2=0x5646265fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.604+0000 7f0e79ffb640 0 client.25409 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.605+0000 7f0e93679740 1 -- 172.21.15.73:0/400465321 shutdown_connections 2024-09-05T13:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.606+0000 7f0e93679740 1 -- 172.21.15.73:0/400465321 wait complete. 2024-09-05T13:01:39.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:39 smithi162 ceph-mon[34220]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 5.82k op/s 2024-09-05T13:01:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.609+0000 7f0e93679740 20 client.25409 trim_cache size 0 max 16384 2024-09-05T13:01:39.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:39 smithi169 ceph-mon[34823]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 5.82k op/s 2024-09-05T13:01:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.639+0000 7f0e93679740 1 Processor -- start 2024-09-05T13:01:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e93679740 1 -- start start 2024-09-05T13:01:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e93679740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265fe9a0 0x564626609140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e93679740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x564626610190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e93679740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564626604370 0x5646265faec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e93679740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70010d40 con 0x5646265fe9a0 2024-09-05T13:01:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e93679740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7000e580 con 0x564626604370 2024-09-05T13:01:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e93679740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7000c3d0 con 0x5646265ff2e0 2024-09-05T13:01:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e81d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x564626610190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e81d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x564626610190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:60930/0 (socket says 172.21.15.73:60930) 2024-09-05T13:01:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e81d9b640 1 -- 172.21.15.73:0/3463687441 learned_addr learned my addr 172.21.15.73:0/3463687441 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.640+0000 7f0e8ad9d640 1 --2- 172.21.15.73:0/3463687441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564626604370 0x5646265faec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.641+0000 7f0e8a59c640 1 --2- 172.21.15.73:0/3463687441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265fe9a0 0x564626609140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.641+0000 7f0e81d9b640 1 -- 172.21.15.73:0/3463687441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564626604370 msgr2=0x5646265faec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.641+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/3463687441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564626604370 0x5646265faec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.641+0000 7f0e81d9b640 1 -- 172.21.15.73:0/3463687441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265fe9a0 msgr2=0x564626609140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.641+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/3463687441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265fe9a0 0x564626609140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.641+0000 7f0e81d9b640 1 -- 172.21.15.73:0/3463687441 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646266087c0 con 0x5646265ff2e0 2024-09-05T13:01:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.641+0000 7f0e8ad9d640 1 --2- 172.21.15.73:0/3463687441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564626604370 0x5646265faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:01:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.641+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/3463687441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x564626610190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009950 tx=0x7f0e74009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc91673e69e0a8c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.641+0000 7f0e7bfff640 1 -- 172.21.15.73:0/3463687441 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e74004d20 con 0x5646265ff2e0 2024-09-05T13:01:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.642+0000 7f0e7bfff640 1 -- 172.21.15.73:0/3463687441 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e7401f030 con 0x5646265ff2e0 2024-09-05T13:01:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.642+0000 7f0e7bfff640 1 -- 172.21.15.73:0/3463687441 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e740053f0 con 0x5646265ff2e0 2024-09-05T13:01:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.643+0000 7f0e93679740 1 -- 172.21.15.73:0/3463687441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 msgr2=0x564626610190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.643+0000 7f0e93679740 1 --2- 172.21.15.73:0/3463687441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x564626610190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009950 tx=0x7f0e74009680 comp rx=0 tx=0).stop 2024-09-05T13:01:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.643+0000 7f0e93679740 1 -- 172.21.15.73:0/3463687441 shutdown_connections 2024-09-05T13:01:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.643+0000 7f0e93679740 1 --2- 172.21.15.73:0/3463687441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564626604370 0x5646265faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.643+0000 7f0e93679740 1 --2- 172.21.15.73:0/3463687441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x564626610190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.643+0000 7f0e93679740 1 --2- 172.21.15.73:0/3463687441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5646265fe9a0 0x564626609140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.643+0000 7f0e93679740 1 -- 172.21.15.73:0/3463687441 >> 172.21.15.73:0/3463687441 conn(0x5646265fa010 msgr2=0x564626608a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.643+0000 7f0e93679740 1 -- 172.21.15.73:0/3463687441 shutdown_connections 2024-09-05T13:01:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.644+0000 7f0e93679740 1 -- 172.21.15.73:0/3463687441 wait complete. 2024-09-05T13:01:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.644+0000 7f0e93679740 1 -- start start 2024-09-05T13:01:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.644+0000 7f0e93679740 1 Processor -- start 2024-09-05T13:01:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.644+0000 7f0e93679740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 0x56462660d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.644+0000 7f0e93679740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x56462660d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.644+0000 7f0e93679740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 0x56462660e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.644+0000 7f0e93679740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7000ca40 con 0x564626604370 2024-09-05T13:01:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.644+0000 7f0e93679740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7000deb0 con 0x5646265fe9a0 2024-09-05T13:01:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.644+0000 7f0e93679740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7000d110 con 0x5646265ff2e0 2024-09-05T13:01:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.644+0000 7f0e93679740 10 client.0 _ll_register_callbacks cb 0x7f0e7c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.645+0000 7f0e81d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x56462660d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.645+0000 7f0e81d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x56462660d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:60940/0 (socket says 172.21.15.73:60940) 2024-09-05T13:01:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.645+0000 7f0e81d9b640 1 -- 172.21.15.73:0/2156486862 learned_addr learned my addr 172.21.15.73:0/2156486862 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.645+0000 7f0e8a59c640 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 0x56462660d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.646+0000 7f0e8ad9d640 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 0x56462660e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.646+0000 7f0e81d9b640 1 -- 172.21.15.73:0/2156486862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 msgr2=0x56462660d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.646+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 0x56462660d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.646+0000 7f0e81d9b640 1 -- 172.21.15.73:0/2156486862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 msgr2=0x56462660e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.646+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 0x56462660e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.646+0000 7f0e81d9b640 1 -- 172.21.15.73:0/2156486862 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56462660ed20 con 0x5646265ff2e0 2024-09-05T13:01:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.647+0000 7f0e81d9b640 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x56462660d770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e74013f70 tx=0x7f0e74004de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=766dea36faa19a9f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.647+0000 7f0e79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:01:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.647+0000 7f0e79ffb640 1 -- 172.21.15.73:0/2156486862 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e74005370 con 0x5646265ff2e0 2024-09-05T13:01:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.648+0000 7f0e93679740 1 -- 172.21.15.73:0/2156486862 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e7401f030 con 0x5646265ff2e0 2024-09-05T13:01:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.648+0000 7f0e79ffb640 1 -- 172.21.15.73:0/2156486862 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0e74005510 con 0x5646265ff2e0 2024-09-05T13:01:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.648+0000 7f0e79ffb640 1 -- 172.21.15.73:0/2156486862 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0e74034070 con 0x5646265ff2e0 2024-09-05T13:01:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.649+0000 7f0e93679740 10 client.25483 fetch_fsmap learned FSMap version 34 2024-09-05T13:01:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.649+0000 7f0e93679740 1 -- 172.21.15.73:0/2156486862 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56462660fff0 con 0x5646265ff2e0 2024-09-05T13:01:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.650+0000 7f0e79ffb640 1 -- 172.21.15.73:0/2156486862 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e7401f030 con 0x5646265ff2e0 2024-09-05T13:01:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.650+0000 7f0e79ffb640 1 -- 172.21.15.73:0/2156486862 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 34) ==== 8366+0+0 (secure 0 0 0) 0x7f0e7400f040 con 0x5646265ff2e0 2024-09-05T13:01:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.650+0000 7f0e93679740 10 client.25483 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T13:01:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.650+0000 7f0e93679740 10 client.25483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.650+0000 7f0e93679740 20 client.25483 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.650+0000 7f0e93679740 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56462667f8a0 0x564626681cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.650+0000 7f0e93679740 4 client.25483 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:01:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.650+0000 7f0e93679740 1 -- 172.21.15.73:0/2156486862 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564626569d70 con 0x56462667f8a0 2024-09-05T13:01:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.651+0000 7f0e8a59c640 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56462667f8a0 0x564626681cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.654+0000 7f0e8a59c640 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56462667f8a0 0x564626681cc0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42c18130d10c7497 server_cookie=845eeb79d5f190f1 in_seq=0 out_seq=0 2024-09-05T13:01:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:39.654+0000 7f0e79ffb640 10 client.25483 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.147+0000 7f0e79ffb640 1 -- 172.21.15.73:0/2156486862 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564626569d70 con 0x56462667f8a0 2024-09-05T13:01:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.147+0000 7f0e79ffb640 10 client.25483 handle_command_reply: tid=0 2024-09-05T13:01:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 client.25483 shutdown 2024-09-05T13:01:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 -- 172.21.15.73:0/2156486862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 msgr2=0x56462660d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x56462660d770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e74013f70 tx=0x7f0e74004de0 comp rx=0 tx=0).stop 2024-09-05T13:01:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 -- 172.21.15.73:0/2156486862 shutdown_connections 2024-09-05T13:01:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56462667f8a0 0x564626681cc0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564626604370 0x56462660e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646265ff2e0 0x56462660d770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 --2- 172.21.15.73:0/2156486862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646265fe9a0 0x56462660d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 -- 172.21.15.73:0/2156486862 >> 172.21.15.73:0/2156486862 conn(0x5646265fa010 msgr2=0x5646265f89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e79ffb640 0 client.25483 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 -- 172.21.15.73:0/2156486862 shutdown_connections 2024-09-05T13:01:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 1 -- 172.21.15.73:0/2156486862 wait complete. 2024-09-05T13:01:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.148+0000 7f0e93679740 20 client.25483 trim_cache size 0 max 16384 2024-09-05T13:01:40.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:01:40.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:01:40.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:01:40.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:01:40.154 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.149+0000 7f0e90808640 1 -- 172.21.15.73:0/1010512498 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e6c0a2c80 msgr2=0x7f0e6c0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.149+0000 7f0e90808640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e6c0a2c80 0x7f0e6c0a5140 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009850 tx=0x7f0e84004c10 comp rx=0 tx=0).stop 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.150+0000 7f0e90808640 1 -- 172.21.15.73:0/1010512498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e8c100a50 msgr2=0x7f0e8c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.150+0000 7f0e90808640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e8c100a50 0x7f0e8c06de40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00e9c0 tx=0x7f0e7c00ee80 comp rx=0 tx=0).stop 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.150+0000 7f0e90808640 1 -- 172.21.15.73:0/1010512498 shutdown_connections 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.150+0000 7f0e90808640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0e6c0a2c80 0x7f0e6c0a5140 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.150+0000 7f0e90808640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e8c102600 0x7f0e8c072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.150+0000 7f0e90808640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e8c101c40 0x7f0e8c070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.150+0000 7f0e90808640 1 --2- 172.21.15.73:0/1010512498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e8c100a50 0x7f0e8c06de40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.150+0000 7f0e90808640 1 -- 172.21.15.73:0/1010512498 >> 172.21.15.73:0/1010512498 conn(0x7f0e8c0fc1b0 msgr2=0x7f0e8c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.150+0000 7f0e90808640 1 -- 172.21.15.73:0/1010512498 shutdown_connections 2024-09-05T13:01:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:40.150+0000 7f0e90808640 1 -- 172.21.15.73:0/1010512498 wait complete. 2024-09-05T13:01:40.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:40 smithi073 ceph-mon[30883]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 5.84k op/s 2024-09-05T13:01:40.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:40 smithi162 ceph-mon[34220]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 5.84k op/s 2024-09-05T13:01:40.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:40 smithi169 ceph-mon[34823]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 5.84k op/s 2024-09-05T13:01:42.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T13:01:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:42 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:01:42.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:42 smithi073 ceph-mon[30883]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 35 MiB/s wr, 8.51k op/s 2024-09-05T13:01:42.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:42 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:01:42.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:42 smithi162 ceph-mon[34220]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 35 MiB/s wr, 8.51k op/s 2024-09-05T13:01:42.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:42 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:01:42.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:42 smithi169 ceph-mon[34823]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 35 MiB/s wr, 8.51k op/s 2024-09-05T13:01:42.792 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:01:45.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:45 smithi073 ceph-mon[30883]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 MiB/s wr, 5.16k op/s 2024-09-05T13:01:45.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:45 smithi162 ceph-mon[34220]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 MiB/s wr, 5.16k op/s 2024-09-05T13:01:45.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:45 smithi169 ceph-mon[34823]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 MiB/s wr, 5.16k op/s 2024-09-05T13:01:46.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.270+0000 7f1b01bac640 1 -- 172.21.15.73:0/450505769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc105580 msgr2=0x7f1afc10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:46.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.270+0000 7f1b01bac640 1 --2- 172.21.15.73:0/450505769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc105580 0x7f1afc10d100 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009be0 tx=0x7f1af402a6d0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.271+0000 7f1b01bac640 1 -- 172.21.15.73:0/450505769 shutdown_connections 2024-09-05T13:01:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.271+0000 7f1b01bac640 1 --2- 172.21.15.73:0/450505769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc105580 0x7f1afc10d100 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.271+0000 7f1b01bac640 1 --2- 172.21.15.73:0/450505769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1afc100e00 0x7f1afc104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.271+0000 7f1b01bac640 1 --2- 172.21.15.73:0/450505769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1afc100450 0x7f1afc100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.271+0000 7f1b01bac640 1 -- 172.21.15.73:0/450505769 >> 172.21.15.73:0/450505769 conn(0x7f1afc077230 msgr2=0x7f1afc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.271+0000 7f1b01bac640 1 -- 172.21.15.73:0/450505769 shutdown_connections 2024-09-05T13:01:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.271+0000 7f1b01bac640 1 -- 172.21.15.73:0/450505769 wait complete. 2024-09-05T13:01:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.272+0000 7f1b01bac640 1 Processor -- start 2024-09-05T13:01:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.272+0000 7f1b01bac640 1 -- start start 2024-09-05T13:01:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1b01bac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1afc100450 0x7f1afc108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1b01bac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1afc100e00 0x7f1afc108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1b01bac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc105580 0x7f1afc109030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1b01bac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc06dd20 con 0x7f1afc105580 2024-09-05T13:01:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1b01bac640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc06dba0 con 0x7f1afc100e00 2024-09-05T13:01:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1b01bac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc06dea0 con 0x7f1afc100450 2024-09-05T13:01:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1afaffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1afc100e00 0x7f1afc108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1afaffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1afc100e00 0x7f1afc108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:58310/0 (socket says 172.21.15.73:58310) 2024-09-05T13:01:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1afaffd640 1 -- 172.21.15.73:0/482658917 learned_addr learned my addr 172.21.15.73:0/482658917 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1afbfff640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc105580 0x7f1afc109030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.273+0000 7f1afb7fe640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1afc100450 0x7f1afc108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.274+0000 7f1afaffd640 1 -- 172.21.15.73:0/482658917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1afc100450 msgr2=0x7f1afc108590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.274+0000 7f1afaffd640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1afc100450 0x7f1afc108590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.274+0000 7f1afaffd640 1 -- 172.21.15.73:0/482658917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc105580 msgr2=0x7f1afc109030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.274+0000 7f1afaffd640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc105580 0x7f1afc109030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.274+0000 7f1afaffd640 1 -- 172.21.15.73:0/482658917 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1afc199d00 con 0x7f1afc100e00 2024-09-05T13:01:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.274+0000 7f1afaffd640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1afc100e00 0x7f1afc108ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1af000d950 tx=0x7f1af000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.274+0000 7f1af8ff9640 1 -- 172.21.15.73:0/482658917 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0017070 con 0x7f1afc100e00 2024-09-05T13:01:46.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.275+0000 7f1b01bac640 1 -- 172.21.15.73:0/482658917 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1afc199ff0 con 0x7f1afc100e00 2024-09-05T13:01:46.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.275+0000 7f1af8ff9640 1 -- 172.21.15.73:0/482658917 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1af0009c30 con 0x7f1afc100e00 2024-09-05T13:01:46.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.275+0000 7f1af8ff9640 1 -- 172.21.15.73:0/482658917 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0017070 con 0x7f1afc100e00 2024-09-05T13:01:46.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.276+0000 7f1b01bac640 1 -- 172.21.15.73:0/482658917 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1afc19a4f0 con 0x7f1afc100e00 2024-09-05T13:01:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.279+0000 7f1af8ff9640 1 -- 172.21.15.73:0/482658917 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1af0010460 con 0x7f1afc100e00 2024-09-05T13:01:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.280+0000 7f1af8ff9640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1ae40a73e0 0x7f1ae40a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.280+0000 7f1af8ff9640 1 -- 172.21.15.73:0/482658917 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f1af0009a30 con 0x7f1afc100e00 2024-09-05T13:01:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.281+0000 7f1afb7fe640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1ae40a73e0 0x7f1ae40a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.283+0000 7f1b03f82740 1 Processor -- start 2024-09-05T13:01:46.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.283+0000 7f1afb7fe640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1ae40a73e0 0x7f1ae40a98a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1aec005fd0 tx=0x7f1aec01a270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:46.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.283+0000 7f1b03f82740 1 -- start start 2024-09-05T13:01:46.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.283+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da0943c0 0x5630da0947a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.283+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da094ce0 0x5630da0a7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.283+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0a7e90 0x5630da0aa280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.283+0000 7f1b03f82740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5630d9ffa2e0 con 0x5630da0a7e90 2024-09-05T13:01:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.283+0000 7f1b03f82740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5630d9fa1ce0 con 0x5630da094ce0 2024-09-05T13:01:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.283+0000 7f1b03f82740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5630d9ff62a0 con 0x5630da0943c0 2024-09-05T13:01:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.284+0000 7f1afbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0a7e90 0x5630da0aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.284+0000 7f1afbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0a7e90 0x5630da0aa280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52580/0 (socket says 172.21.15.73:52580) 2024-09-05T13:01:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.284+0000 7f1afbfff640 1 -- 172.21.15.73:0/561129424 learned_addr learned my addr 172.21.15.73:0/561129424 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.284+0000 7f1afaffd640 1 --2- 172.21.15.73:0/561129424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da094ce0 0x5630da0a7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.284+0000 7f1afbfff640 1 -- 172.21.15.73:0/561129424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da0943c0 msgr2=0x5630da0947a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:01:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.284+0000 7f1afbfff640 1 --2- 172.21.15.73:0/561129424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da0943c0 0x5630da0947a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.284+0000 7f1afbfff640 1 -- 172.21.15.73:0/561129424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da094ce0 msgr2=0x5630da0a7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.284+0000 7f1afbfff640 1 --2- 172.21.15.73:0/561129424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da094ce0 0x5630da0a7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.284+0000 7f1afbfff640 1 -- 172.21.15.73:0/561129424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d9f86440 con 0x5630da0a7e90 2024-09-05T13:01:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.284+0000 7f1afbfff640 1 --2- 172.21.15.73:0/561129424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0a7e90 0x5630da0aa280 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1af402acc0 tx=0x7f1af4032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e668a62c276110c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.285+0000 7f1ae1ffb640 1 -- 172.21.15.73:0/561129424 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4041030 con 0x5630da0a7e90 2024-09-05T13:01:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.285+0000 7f1ae1ffb640 1 -- 172.21.15.73:0/561129424 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1af40303a0 con 0x5630da0a7e90 2024-09-05T13:01:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.286+0000 7f1ae1ffb640 1 -- 172.21.15.73:0/561129424 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4036040 con 0x5630da0a7e90 2024-09-05T13:01:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.286+0000 7f1b03f82740 1 -- 172.21.15.73:0/561129424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0a7e90 msgr2=0x5630da0aa280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.286+0000 7f1b03f82740 1 --2- 172.21.15.73:0/561129424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0a7e90 0x5630da0aa280 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1af402acc0 tx=0x7f1af4032e20 comp rx=0 tx=0).stop 2024-09-05T13:01:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.287+0000 7f1b03f82740 1 -- 172.21.15.73:0/561129424 shutdown_connections 2024-09-05T13:01:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.287+0000 7f1b03f82740 1 --2- 172.21.15.73:0/561129424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0a7e90 0x5630da0aa280 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.287+0000 7f1b03f82740 1 --2- 172.21.15.73:0/561129424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da094ce0 0x5630da0a7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.287+0000 7f1b03f82740 1 --2- 172.21.15.73:0/561129424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da0943c0 0x5630da0947a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.287+0000 7f1b03f82740 1 -- 172.21.15.73:0/561129424 >> 172.21.15.73:0/561129424 conn(0x5630da090a30 msgr2=0x5630da090e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.288+0000 7f1b03f82740 1 -- 172.21.15.73:0/561129424 shutdown_connections 2024-09-05T13:01:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.288+0000 7f1b03f82740 1 -- 172.21.15.73:0/561129424 wait complete. 2024-09-05T13:01:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.288+0000 7f1b03f82740 1 -- start start 2024-09-05T13:01:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.288+0000 7f1b03f82740 1 Processor -- start 2024-09-05T13:01:46.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.289+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0943c0 0x5630da0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.289+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 0x5630da0a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.289+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0a7e90 0x5630da0a7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.289+0000 7f1afb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0943c0 0x5630da0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.289+0000 7f1afb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0943c0 0x5630da0a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52586/0 (socket says 172.21.15.73:52586) 2024-09-05T13:01:46.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.289+0000 7f1b03f82740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5630da097380 con 0x5630da0943c0 2024-09-05T13:01:46.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.289+0000 7f1b03f82740 1 -- 172.21.15.73:0/1510588901 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5630d9fb5050 con 0x5630da0a7e90 2024-09-05T13:01:46.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1b03f82740 1 -- 172.21.15.73:0/1510588901 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5630da097500 con 0x5630da094ce0 2024-09-05T13:01:46.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1b03f82740 10 client.0 _ll_register_callbacks cb 0x5630d9ff5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1afbfff640 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0a7e90 0x5630da0a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.289+0000 7f1afb7fe640 1 -- 172.21.15.73:0/1510588901 learned_addr learned my addr 172.21.15.73:0/1510588901 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.289+0000 7f1afaffd640 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 0x5630da0a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1afbfff640 1 -- 172.21.15.73:0/1510588901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 msgr2=0x5630da0a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1afbfff640 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 0x5630da0a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1afbfff640 1 -- 172.21.15.73:0/1510588901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0943c0 msgr2=0x5630da0a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1afbfff640 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0943c0 0x5630da0a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1afbfff640 1 -- 172.21.15.73:0/1510588901 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d9d6b3c0 con 0x5630da0a7e90 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1b03f82740 1 -- 172.21.15.73:0/1510588901 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1af40303a0 con 0x5630da0a7e90 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1afbfff640 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0a7e90 0x5630da0a7300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1af4004af0 tx=0x7f1af4003a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30ff9d557766f0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.290+0000 7f1adaffd640 10 client.25424 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:01:46.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.292+0000 7f1adaffd640 1 -- 172.21.15.73:0/1510588901 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4036050 con 0x5630da0a7e90 2024-09-05T13:01:46.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.292+0000 7f1adaffd640 1 -- 172.21.15.73:0/1510588901 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f1af4030a30 con 0x5630da0a7e90 2024-09-05T13:01:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.292+0000 7f1adaffd640 1 -- 172.21.15.73:0/1510588901 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1af4041040 con 0x5630da0a7e90 2024-09-05T13:01:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.292+0000 7f1b03f82740 10 client.25424 fetch_fsmap learned FSMap version 35 2024-09-05T13:01:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.292+0000 7f1b03f82740 1 -- 172.21.15.73:0/1510588901 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=35}) -- 0x5630da09d5a0 con 0x5630da0a7e90 2024-09-05T13:01:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.292+0000 7f1adaffd640 1 -- 172.21.15.73:0/1510588901 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1af4030c70 con 0x5630da0a7e90 2024-09-05T13:01:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.293+0000 7f1b03f82740 10 client.25424 fetch_fsmap finished waiting for FSMap version 35 2024-09-05T13:01:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.293+0000 7f1b03f82740 10 client.25424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.293+0000 7f1b03f82740 20 client.25424 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.293+0000 7f1b03f82740 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5630da0bffb0 0x5630da0c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.293+0000 7f1b03f82740 4 client.25424 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.293+0000 7f1b03f82740 1 -- 172.21.15.73:0/1510588901 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630da007850 con 0x5630da0bffb0 2024-09-05T13:01:46.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.293+0000 7f1afb7fe640 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5630da0bffb0 0x5630da0c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.295+0000 7f1adaffd640 10 client.25424 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:46.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.295+0000 7f1afb7fe640 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5630da0bffb0 0x5630da0c23a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c95cfac94938b823 server_cookie=950dbc039d3087f2 in_seq=0 out_seq=0 2024-09-05T13:01:46.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1adaffd640 1 -- 172.21.15.73:0/1510588901 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630da007850 con 0x5630da0bffb0 2024-09-05T13:01:46.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1adaffd640 10 client.25424 handle_command_reply: tid=0 2024-09-05T13:01:46.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1b03f82740 1 client.25424 shutdown 2024-09-05T13:01:46.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1b03f82740 1 -- 172.21.15.73:0/1510588901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0a7e90 msgr2=0x5630da0a7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:46.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1b03f82740 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0a7e90 0x5630da0a7300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1af4004af0 tx=0x7f1af4003a10 comp rx=0 tx=0).stop 2024-09-05T13:01:46.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1b03f82740 1 -- 172.21.15.73:0/1510588901 shutdown_connections 2024-09-05T13:01:46.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1b03f82740 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5630da0bffb0 0x5630da0c23a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1adaffd640 0 client.25424 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:46.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1b03f82740 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0a7e90 0x5630da0a7300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1b03f82740 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 0x5630da0a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1b03f82740 1 --2- 172.21.15.73:0/1510588901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0943c0 0x5630da0a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.296+0000 7f1b03f82740 1 -- 172.21.15.73:0/1510588901 >> 172.21.15.73:0/1510588901 conn(0x5630da090a30 msgr2=0x5630da08fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:46.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.297+0000 7f1b03f82740 1 -- 172.21.15.73:0/1510588901 shutdown_connections 2024-09-05T13:01:46.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.297+0000 7f1b03f82740 1 -- 172.21.15.73:0/1510588901 wait complete. 2024-09-05T13:01:46.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.297+0000 7f1b03f82740 20 client.25424 trim_cache size 0 max 16384 2024-09-05T13:01:46.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1b03f82740 1 Processor -- start 2024-09-05T13:01:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1b03f82740 1 -- start start 2024-09-05T13:01:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0943c0 0x5630da095e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 0x5630da09c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0a7e90 0x5630da099b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1b03f82740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc1a53d0 con 0x5630da0943c0 2024-09-05T13:01:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1b03f82740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc1a2c40 con 0x5630da0a7e90 2024-09-05T13:01:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1b03f82740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc1a0a90 con 0x5630da094ce0 2024-09-05T13:01:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1afaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 0x5630da09c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1afaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 0x5630da09c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:59030/0 (socket says 172.21.15.73:59030) 2024-09-05T13:01:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.325+0000 7f1afaffd640 1 -- 172.21.15.73:0/1429948463 learned_addr learned my addr 172.21.15.73:0/1429948463 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:46.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.326+0000 7f1afaffd640 1 -- 172.21.15.73:0/1429948463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0a7e90 msgr2=0x5630da099b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:46.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.326+0000 7f1afaffd640 1 --2- 172.21.15.73:0/1429948463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0a7e90 0x5630da099b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.326+0000 7f1afaffd640 1 -- 172.21.15.73:0/1429948463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0943c0 msgr2=0x5630da095e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.326+0000 7f1afaffd640 1 --2- 172.21.15.73:0/1429948463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0943c0 0x5630da095e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.326+0000 7f1afaffd640 1 -- 172.21.15.73:0/1429948463 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630da090860 con 0x5630da094ce0 2024-09-05T13:01:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.326+0000 7f1afaffd640 1 --2- 172.21.15.73:0/1429948463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 0x5630da09c1f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1af009a770 tx=0x7f1af000bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e48d1e02474041e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.327+0000 7f1ae17fa640 1 -- 172.21.15.73:0/1429948463 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0017050 con 0x5630da094ce0 2024-09-05T13:01:46.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.327+0000 7f1ae17fa640 1 -- 172.21.15.73:0/1429948463 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1af00a3450 con 0x5630da094ce0 2024-09-05T13:01:46.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.328+0000 7f1ae17fa640 1 -- 172.21.15.73:0/1429948463 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0020070 con 0x5630da094ce0 2024-09-05T13:01:46.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.329+0000 7f1b03f82740 1 -- 172.21.15.73:0/1429948463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 msgr2=0x5630da09c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:46.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.329+0000 7f1b03f82740 1 --2- 172.21.15.73:0/1429948463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 0x5630da09c1f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1af009a770 tx=0x7f1af000bf60 comp rx=0 tx=0).stop 2024-09-05T13:01:46.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.329+0000 7f1b03f82740 1 -- 172.21.15.73:0/1429948463 shutdown_connections 2024-09-05T13:01:46.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.329+0000 7f1b03f82740 1 --2- 172.21.15.73:0/1429948463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0a7e90 0x5630da099b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.329+0000 7f1b03f82740 1 --2- 172.21.15.73:0/1429948463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da094ce0 0x5630da09c1f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.329+0000 7f1b03f82740 1 --2- 172.21.15.73:0/1429948463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da0943c0 0x5630da095e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.329+0000 7f1b03f82740 1 -- 172.21.15.73:0/1429948463 >> 172.21.15.73:0/1429948463 conn(0x5630da090a30 msgr2=0x5630da08fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:46.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.330+0000 7f1b03f82740 1 -- 172.21.15.73:0/1429948463 shutdown_connections 2024-09-05T13:01:46.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.330+0000 7f1b03f82740 1 -- 172.21.15.73:0/1429948463 wait complete. 2024-09-05T13:01:46.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.331+0000 7f1b03f82740 1 -- start start 2024-09-05T13:01:46.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.331+0000 7f1b03f82740 1 Processor -- start 2024-09-05T13:01:46.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.332+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0943c0 0x5630da0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.332+0000 7f1b03f82740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da094ce0 0x5630da0c5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.332+0000 7f1afb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0943c0 0x5630da0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.332+0000 7f1afb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0943c0 0x5630da0c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:58334/0 (socket says 172.21.15.73:58334) 2024-09-05T13:01:46.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.332+0000 7f1afb7fe640 1 -- 172.21.15.73:0/3379657415 learned_addr learned my addr 172.21.15.73:0/3379657415 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.332+0000 7f1b03f82740 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da0a7e90 0x5630da0c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.332+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc1a1100 con 0x5630da094ce0 2024-09-05T13:01:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.332+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc1a2570 con 0x5630da0943c0 2024-09-05T13:01:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.333+0000 7f1afbfff640 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da0a7e90 0x5630da0c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.333+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc1a17d0 con 0x5630da0a7e90 2024-09-05T13:01:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.333+0000 7f1afaffd640 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da094ce0 0x5630da0c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.333+0000 7f1b03f82740 10 client.0 _ll_register_callbacks cb 0x7f1af4009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.333+0000 7f1afb7fe640 1 -- 172.21.15.73:0/3379657415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da0a7e90 msgr2=0x5630da0c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.333+0000 7f1afb7fe640 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da0a7e90 0x5630da0c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.333+0000 7f1afb7fe640 1 -- 172.21.15.73:0/3379657415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da094ce0 msgr2=0x5630da0c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.333+0000 7f1afb7fe640 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da094ce0 0x5630da0c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.333+0000 7f1afb7fe640 1 -- 172.21.15.73:0/3379657415 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630da0974f0 con 0x5630da0943c0 2024-09-05T13:01:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.334+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1af00a3450 con 0x5630da0943c0 2024-09-05T13:01:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.334+0000 7f1afb7fe640 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0943c0 0x5630da0c5400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1aec01a980 tx=0x7f1aec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93227c51ad980686 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.334+0000 7f1adaffd640 10 client.25427 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:01:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.334+0000 7f1adaffd640 1 -- 172.21.15.73:0/3379657415 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec03d070 con 0x5630da0943c0 2024-09-05T13:01:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.334+0000 7f1adaffd640 1 -- 172.21.15.73:0/3379657415 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f1aec02aab0 con 0x5630da0943c0 2024-09-05T13:01:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.334+0000 7f1adaffd640 1 -- 172.21.15.73:0/3379657415 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1aec049070 con 0x5630da0943c0 2024-09-05T13:01:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.335+0000 7f1b03f82740 10 client.25427 fetch_fsmap learned FSMap version 35 2024-09-05T13:01:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.335+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=35}) -- 0x5630da0a1ea0 con 0x5630da0943c0 2024-09-05T13:01:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.336+0000 7f1adaffd640 1 -- 172.21.15.73:0/3379657415 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1aec029040 con 0x5630da0943c0 2024-09-05T13:01:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.336+0000 7f1b03f82740 10 client.25427 fetch_fsmap finished waiting for FSMap version 35 2024-09-05T13:01:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.336+0000 7f1b03f82740 10 client.25427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.336+0000 7f1b03f82740 20 client.25427 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.336+0000 7f1b03f82740 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5630da0bffb0 0x5630da12d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.336+0000 7f1b03f82740 4 client.25427 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T13:01:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.336+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1af00a3450 con 0x5630da0bffb0 2024-09-05T13:01:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.336+0000 7f1afaffd640 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5630da0bffb0 0x5630da12d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:46.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.340+0000 7f1afaffd640 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5630da0bffb0 0x5630da12d470 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e01f83fb69a94f95 server_cookie=8c9a45da96595c6d in_seq=0 out_seq=0 2024-09-05T13:01:46.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.340+0000 7f1adaffd640 10 client.25427 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:46.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.340+0000 7f1adaffd640 1 -- 172.21.15.73:0/3379657415 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f1af00a3450 con 0x5630da0bffb0 2024-09-05T13:01:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.340+0000 7f1adaffd640 10 client.25427 handle_command_reply: tid=0 2024-09-05T13:01:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.341+0000 7f1b03f82740 1 client.25427 shutdown 2024-09-05T13:01:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.341+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0943c0 msgr2=0x5630da0c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.341+0000 7f1b03f82740 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0943c0 0x5630da0c5400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1aec01a980 tx=0x7f1aec0046c0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.342+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 shutdown_connections 2024-09-05T13:01:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.342+0000 7f1b03f82740 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5630da0bffb0 0x5630da12d470 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.342+0000 7f1b03f82740 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630da0a7e90 0x5630da0c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.342+0000 7f1b03f82740 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5630da094ce0 0x5630da0c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.342+0000 7f1b03f82740 1 --2- 172.21.15.73:0/3379657415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630da0943c0 0x5630da0c5400 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.342+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 >> 172.21.15.73:0/3379657415 conn(0x5630da090a30 msgr2=0x5630da0a0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.342+0000 7f1adaffd640 0 client.25427 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.342+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 shutdown_connections 2024-09-05T13:01:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.342+0000 7f1b03f82740 1 -- 172.21.15.73:0/3379657415 wait complete. 2024-09-05T13:01:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.342+0000 7f1b03f82740 20 client.25427 trim_cache size 0 max 16384 2024-09-05T13:01:46.346 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:01:46.346 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2024-09-05T13:01:46.346 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2024-09-05T13:01:46.346 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:01:46.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 -- 172.21.15.73:0/482658917 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1ae40a73e0 msgr2=0x7f1ae40a98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:46.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1ae40a73e0 0x7f1ae40a98a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1aec005fd0 tx=0x7f1aec01a270 comp rx=0 tx=0).stop 2024-09-05T13:01:46.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 -- 172.21.15.73:0/482658917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1afc100e00 msgr2=0x7f1afc108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1afc100e00 0x7f1afc108ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1af000d950 tx=0x7f1af000de10 comp rx=0 tx=0).stop 2024-09-05T13:01:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 -- 172.21.15.73:0/482658917 shutdown_connections 2024-09-05T13:01:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f1ae40a73e0 0x7f1ae40a98a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc105580 0x7f1afc109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1afc100e00 0x7f1afc108ad0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 --2- 172.21.15.73:0/482658917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1afc100450 0x7f1afc108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 -- 172.21.15.73:0/482658917 >> 172.21.15.73:0/482658917 conn(0x7f1afc077230 msgr2=0x7f1afc1037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.343+0000 7f1b01bac640 1 -- 172.21.15.73:0/482658917 shutdown_connections 2024-09-05T13:01:46.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:46.345+0000 7f1b01bac640 1 -- 172.21.15.73:0/482658917 wait complete. 2024-09-05T13:01:47.262 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:47 smithi073 ceph-mon[30883]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 6.11k op/s 2024-09-05T13:01:47.263 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T13:01:47.264 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T13:01:47.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:47 smithi162 ceph-mon[34220]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 6.11k op/s 2024-09-05T13:01:47.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:47 smithi169 ceph-mon[34823]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 6.11k op/s 2024-09-05T13:01:47.678 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:01:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.262+0000 7f4cd2f99640 1 -- 172.21.15.73:0/2682168483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ccc102790 msgr2=0x7f4ccc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.262+0000 7f4cd2f99640 1 --2- 172.21.15.73:0/2682168483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ccc102790 0x7f4ccc1067e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009ca0 tx=0x7f4cb402a8e0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.262+0000 7f4cd2f99640 1 -- 172.21.15.73:0/2682168483 shutdown_connections 2024-09-05T13:01:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.262+0000 7f4cd2f99640 1 --2- 172.21.15.73:0/2682168483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ccc106f10 0x7f4ccc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.262+0000 7f4cd2f99640 1 --2- 172.21.15.73:0/2682168483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ccc102790 0x7f4ccc1067e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.262+0000 7f4cd2f99640 1 --2- 172.21.15.73:0/2682168483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ccc101de0 0x7f4ccc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.262+0000 7f4cd2f99640 1 -- 172.21.15.73:0/2682168483 >> 172.21.15.73:0/2682168483 conn(0x7f4ccc0fd880 msgr2=0x7f4ccc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.262+0000 7f4cd2f99640 1 -- 172.21.15.73:0/2682168483 shutdown_connections 2024-09-05T13:01:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.262+0000 7f4cd2f99640 1 -- 172.21.15.73:0/2682168483 wait complete. 2024-09-05T13:01:48.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.263+0000 7f4cd2f99640 1 Processor -- start 2024-09-05T13:01:48.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.270+0000 7f4cd2f99640 1 -- start start 2024-09-05T13:01:48.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.271+0000 7f4cd2f99640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ccc101de0 0x7f4ccc075b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.271+0000 7f4cd2f99640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ccc102790 0x7f4ccc0760b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.271+0000 7f4cd2f99640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ccc106f10 0x7f4ccc06cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.271+0000 7f4cd2f99640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc112030 con 0x7f4ccc102790 2024-09-05T13:01:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.271+0000 7f4cd2f99640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc111eb0 con 0x7f4ccc106f10 2024-09-05T13:01:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.271+0000 7f4cd2f99640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc1121b0 con 0x7f4ccc101de0 2024-09-05T13:01:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.271+0000 7f4ccbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ccc102790 0x7f4ccc0760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.271+0000 7f4ccbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ccc102790 0x7f4ccc0760b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52626/0 (socket says 172.21.15.73:52626) 2024-09-05T13:01:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.271+0000 7f4ccbfff640 1 -- 172.21.15.73:0/3198335977 learned_addr learned my addr 172.21.15.73:0/3198335977 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.271+0000 7f4cd0d35640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ccc101de0 0x7f4ccc075b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:48.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.272+0000 7f4cd0d35640 1 -- 172.21.15.73:0/3198335977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ccc106f10 msgr2=0x7f4ccc06cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:48.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.272+0000 7f4cd0d35640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ccc106f10 0x7f4ccc06cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.272+0000 7f4cd0d35640 1 -- 172.21.15.73:0/3198335977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ccc102790 msgr2=0x7f4ccc0760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:48.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.272+0000 7f4cd0d35640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ccc102790 0x7f4ccc0760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.272+0000 7f4cd0d35640 1 -- 172.21.15.73:0/3198335977 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc06d620 con 0x7f4ccc101de0 2024-09-05T13:01:48.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.272+0000 7f4cd0d35640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ccc101de0 0x7f4ccc075b70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009fd0 tx=0x7f4cbc00b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:48.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.272+0000 7f4cc9ffb640 1 -- 172.21.15.73:0/3198335977 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc015020 con 0x7f4ccc101de0 2024-09-05T13:01:48.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.272+0000 7f4cc9ffb640 1 -- 172.21.15.73:0/3198335977 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cbc011d10 con 0x7f4ccc101de0 2024-09-05T13:01:48.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.273+0000 7f4cc9ffb640 1 -- 172.21.15.73:0/3198335977 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc015020 con 0x7f4ccc101de0 2024-09-05T13:01:48.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.273+0000 7f4cd2f99640 1 -- 172.21.15.73:0/3198335977 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc06d910 con 0x7f4ccc101de0 2024-09-05T13:01:48.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.273+0000 7f4cd2f99640 1 -- 172.21.15.73:0/3198335977 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc0717f0 con 0x7f4ccc101de0 2024-09-05T13:01:48.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.275+0000 7f4cd2f99640 1 -- 172.21.15.73:0/3198335977 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ccc1032c0 con 0x7f4ccc101de0 2024-09-05T13:01:48.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.277+0000 7f4cc9ffb640 1 -- 172.21.15.73:0/3198335977 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4cbc018020 con 0x7f4ccc101de0 2024-09-05T13:01:48.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.279+0000 7f4cc9ffb640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4cb80a3010 0x7f4cb80a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:48.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.279+0000 7f4cc9ffb640 1 -- 172.21.15.73:0/3198335977 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f4cbc011630 con 0x7f4ccc101de0 2024-09-05T13:01:48.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.279+0000 7f4ccbfff640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4cb80a3010 0x7f4cb80a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:48.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.280+0000 7f4ccbfff640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4cb80a3010 0x7f4cb80a54d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009a60 tx=0x7f4cb4005eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:48.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.283+0000 7f4cc9ffb640 1 -- 172.21.15.73:0/3198335977 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4cbc01f020 con 0x7f4ccc101de0 2024-09-05T13:01:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.675+0000 7f4cd2f99640 1 -- 172.21.15.73:0/3198335977 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ccc102240 con 0x7f4ccc101de0 2024-09-05T13:01:48.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.677+0000 7f4cc9ffb640 1 -- 172.21.15.73:0/3198335977 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11932 (secure 0 0 0) 0x7f4cbc01f020 con 0x7f4ccc101de0 2024-09-05T13:01:48.679 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T13:01:48.680 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"btime":"2024-09-05T13:01:41:199917+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T13:01:40.957611+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25159":{"gid":25159,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/4110365542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":4110365542},{"type":"v1","addr":"172.21.15.169:6837","nonce":4110365542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T13:01:48.680 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 35 2024-09-05T13:01:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 -- 172.21.15.73:0/3198335977 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4cb80a3010 msgr2=0x7f4cb80a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4cb80a3010 0x7f4cb80a54d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009a60 tx=0x7f4cb4005eb0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 -- 172.21.15.73:0/3198335977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ccc101de0 msgr2=0x7f4ccc075b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ccc101de0 0x7f4ccc075b70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009fd0 tx=0x7f4cbc00b870 comp rx=0 tx=0).stop 2024-09-05T13:01:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 -- 172.21.15.73:0/3198335977 shutdown_connections 2024-09-05T13:01:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4cb80a3010 0x7f4cb80a54d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ccc106f10 0x7f4ccc06cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ccc102790 0x7f4ccc0760b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 --2- 172.21.15.73:0/3198335977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ccc101de0 0x7f4ccc075b70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 -- 172.21.15.73:0/3198335977 >> 172.21.15.73:0/3198335977 conn(0x7f4ccc0fd880 msgr2=0x7f4ccc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 -- 172.21.15.73:0/3198335977 shutdown_connections 2024-09-05T13:01:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:48.681+0000 7f4cd2f99640 1 -- 172.21.15.73:0/3198335977 wait complete. 2024-09-05T13:01:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:49 smithi073 ceph-mon[30883]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 21 MiB/s wr, 5.05k op/s 2024-09-05T13:01:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:49 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3198335977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:01:49.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:49 smithi162 ceph-mon[34220]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 21 MiB/s wr, 5.05k op/s 2024-09-05T13:01:49.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:49 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3198335977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:01:49.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:49 smithi169 ceph-mon[34823]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 21 MiB/s wr, 5.05k op/s 2024-09-05T13:01:49.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:49 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3198335977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:01:49.635 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T13:01:50.035 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:01:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.595+0000 7f4bf46f8640 1 -- 172.21.15.73:0/427181297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bec11b140 msgr2=0x7f4bec11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.595+0000 7f4bf46f8640 1 --2- 172.21.15.73:0/427181297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bec11b140 0x7f4bec11d530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009be0 tx=0x7f4be402a6c0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.599+0000 7f4bf46f8640 1 -- 172.21.15.73:0/427181297 shutdown_connections 2024-09-05T13:01:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.599+0000 7f4bf46f8640 1 --2- 172.21.15.73:0/427181297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bec11b140 0x7f4bec11d530 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.599+0000 7f4bf46f8640 1 --2- 172.21.15.73:0/427181297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bec109830 0x7f4bec109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.599+0000 7f4bf46f8640 1 --2- 172.21.15.73:0/427181297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bec109450 0x7f4bec110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.599+0000 7f4bf46f8640 1 -- 172.21.15.73:0/427181297 >> 172.21.15.73:0/427181297 conn(0x7f4bec06e140 msgr2=0x7f4bec06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.599+0000 7f4bf46f8640 1 -- 172.21.15.73:0/427181297 shutdown_connections 2024-09-05T13:01:50.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.600+0000 7f4bf46f8640 1 -- 172.21.15.73:0/427181297 wait complete. 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf46f8640 1 Processor -- start 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf46f8640 1 -- start start 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf46f8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bec109450 0x7f4bec11a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf46f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bec109830 0x7f4bec113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf46f8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bec11b140 0x7f4bec113ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf46f8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4bec120da0 con 0x7f4bec11b140 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf46f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4bec120c20 con 0x7f4bec109830 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf46f8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4bec120f20 con 0x7f4bec109450 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf2c95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bec11b140 0x7f4bec113ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf2c95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bec11b140 0x7f4bec113ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52642/0 (socket says 172.21.15.73:52642) 2024-09-05T13:01:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.601+0000 7f4bf2c95640 1 -- 172.21.15.73:0/4245366167 learned_addr learned my addr 172.21.15.73:0/4245366167 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:50.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.602+0000 7f4bf1c93640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bec109830 0x7f4bec113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.602+0000 7f4bf2c95640 1 -- 172.21.15.73:0/4245366167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bec109450 msgr2=0x7f4bec11a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:50.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.602+0000 7f4bf2494640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bec109450 0x7f4bec11a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.602+0000 7f4bf2c95640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bec109450 0x7f4bec11a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.602+0000 7f4bf2c95640 1 -- 172.21.15.73:0/4245366167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bec109830 msgr2=0x7f4bec113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:50.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.602+0000 7f4bf2c95640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bec109830 0x7f4bec113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.602+0000 7f4bf2c95640 1 -- 172.21.15.73:0/4245366167 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bec114230 con 0x7f4bec11b140 2024-09-05T13:01:50.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.602+0000 7f4bf2494640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bec109450 0x7f4bec11a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:01:50.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.602+0000 7f4bf1c93640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bec109830 0x7f4bec113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:01:50.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.602+0000 7f4bf2c95640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bec11b140 0x7f4bec113ca0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4be4031610 tx=0x7f4be4030c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:50.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.603+0000 7f4be37fe640 1 -- 172.21.15.73:0/4245366167 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4063020 con 0x7f4bec11b140 2024-09-05T13:01:50.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.603+0000 7f4bf46f8640 1 -- 172.21.15.73:0/4245366167 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bec1144c0 con 0x7f4bec11b140 2024-09-05T13:01:50.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.603+0000 7f4bf46f8640 1 -- 172.21.15.73:0/4245366167 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bec1184a0 con 0x7f4bec11b140 2024-09-05T13:01:50.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.603+0000 7f4be37fe640 1 -- 172.21.15.73:0/4245366167 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4be4058040 con 0x7f4bec11b140 2024-09-05T13:01:50.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.603+0000 7f4be37fe640 1 -- 172.21.15.73:0/4245366167 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4004640 con 0x7f4bec11b140 2024-09-05T13:01:50.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.607+0000 7f4be37fe640 1 -- 172.21.15.73:0/4245366167 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4be4066020 con 0x7f4bec11b140 2024-09-05T13:01:50.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.608+0000 7f4be37fe640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bd80a2cc0 0x7f4bd80a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.609+0000 7f4be37fe640 1 -- 172.21.15.73:0/4245366167 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f4be4111b80 con 0x7f4bec11b140 2024-09-05T13:01:50.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.609+0000 7f4bf2494640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bd80a2cc0 0x7f4bd80a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.609+0000 7f4bf2494640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bd80a2cc0 0x7f4bd80a5180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4be8005fd0 tx=0x7f4be8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:50.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.609+0000 7f4bf6ace740 1 Processor -- start 2024-09-05T13:01:50.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.610+0000 7f4bf6ace740 1 -- start start 2024-09-05T13:01:50.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.610+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3cab80 0x55b5cc3c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.610+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.610+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.611+0000 7f4bf2494640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3cab80 0x55b5cc3c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.611+0000 7f4bf2494640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3cab80 0x55b5cc3c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:59102/0 (socket says 172.21.15.73:59102) 2024-09-05T13:01:50.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.611+0000 7f4bf2494640 1 -- 172.21.15.73:0/213666892 learned_addr learned my addr 172.21.15.73:0/213666892 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:50.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.611+0000 7f4bf1c93640 1 --2- 172.21.15.73:0/213666892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.611+0000 7f4bf6ace740 1 -- 172.21.15.73:0/213666892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b5cc32f2f0 con 0x55b5cc3d4370 2024-09-05T13:01:50.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.611+0000 7f4bf6ace740 1 -- 172.21.15.73:0/213666892 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b5cc2d6cf0 con 0x55b5cc3c95d0 2024-09-05T13:01:50.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.611+0000 7f4bf6ace740 1 -- 172.21.15.73:0/213666892 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b5cc32b2b0 con 0x55b5cc3cab80 2024-09-05T13:01:50.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.611+0000 7f4bf2c95640 1 --2- 172.21.15.73:0/213666892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.612+0000 7f4bf2494640 1 -- 172.21.15.73:0/213666892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3c95d0 msgr2=0x55b5cc3c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.612+0000 7f4bf2494640 1 --2- 172.21.15.73:0/213666892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.612+0000 7f4bf2494640 1 -- 172.21.15.73:0/213666892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 msgr2=0x55b5cc3d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.612+0000 7f4bf2494640 1 --2- 172.21.15.73:0/213666892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.612+0000 7f4bf2494640 1 -- 172.21.15.73:0/213666892 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5cc2bb3a0 con 0x55b5cc3cab80 2024-09-05T13:01:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.612+0000 7f4bf2494640 1 --2- 172.21.15.73:0/213666892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3cab80 0x55b5cc3c9090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4be8010e90 tx=0x7f4be8013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d877f2c4f3ea6a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.612+0000 7f4be0ff9640 1 -- 172.21.15.73:0/213666892 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8023070 con 0x55b5cc3cab80 2024-09-05T13:01:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.612+0000 7f4be0ff9640 1 -- 172.21.15.73:0/213666892 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4be801fb30 con 0x55b5cc3cab80 2024-09-05T13:01:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.612+0000 7f4be0ff9640 1 -- 172.21.15.73:0/213666892 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8011a00 con 0x55b5cc3cab80 2024-09-05T13:01:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.613+0000 7f4bf6ace740 1 -- 172.21.15.73:0/213666892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3cab80 msgr2=0x55b5cc3c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.613+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/213666892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3cab80 0x55b5cc3c9090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4be8010e90 tx=0x7f4be8013000 comp rx=0 tx=0).stop 2024-09-05T13:01:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.613+0000 7f4bf6ace740 1 -- 172.21.15.73:0/213666892 shutdown_connections 2024-09-05T13:01:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.613+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/213666892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.613+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/213666892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.614+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/213666892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3cab80 0x55b5cc3c9090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.614+0000 7f4bf6ace740 1 -- 172.21.15.73:0/213666892 >> 172.21.15.73:0/213666892 conn(0x55b5cc392310 msgr2=0x55b5cc3c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:50.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.614+0000 7f4bf6ace740 1 -- 172.21.15.73:0/213666892 shutdown_connections 2024-09-05T13:01:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.614+0000 7f4bf6ace740 1 -- 172.21.15.73:0/213666892 wait complete. 2024-09-05T13:01:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.614+0000 7f4bf6ace740 1 -- start start 2024-09-05T13:01:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.615+0000 7f4bf6ace740 1 Processor -- start 2024-09-05T13:01:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.615+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.615+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 0x55b5cc3d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.615+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.615+0000 7f4bf2494640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.615+0000 7f4bf6ace740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b5cc3d70d0 con 0x55b5cc3c95d0 2024-09-05T13:01:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.616+0000 7f4bf6ace740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b5cc2ea060 con 0x55b5cc3cab80 2024-09-05T13:01:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.615+0000 7f4bf2494640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3d3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52666/0 (socket says 172.21.15.73:52666) 2024-09-05T13:01:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.616+0000 7f4bf2494640 1 -- 172.21.15.73:0/243628024 learned_addr learned my addr 172.21.15.73:0/243628024 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.616+0000 7f4bf6ace740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b5cc3d7250 con 0x55b5cc3d4370 2024-09-05T13:01:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.616+0000 7f4bf6ace740 10 client.0 _ll_register_callbacks cb 0x55b5cc03d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.616+0000 7f4bf1c93640 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 0x55b5cc3d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.616+0000 7f4bf2c95640 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.616+0000 7f4bf1c93640 1 -- 172.21.15.73:0/243628024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3d4370 msgr2=0x55b5cc3d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.616+0000 7f4bf1c93640 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.617+0000 7f4bf1c93640 1 -- 172.21.15.73:0/243628024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3c95d0 msgr2=0x55b5cc3d3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.617+0000 7f4bf1c93640 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3d3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.617+0000 7f4bf1c93640 1 -- 172.21.15.73:0/243628024 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5cc0a03c0 con 0x55b5cc3cab80 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.617+0000 7f4bf2494640 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3d3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.617+0000 7f4bd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.617+0000 7f4bf1c93640 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 0x55b5cc3d0f40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4bec114f40 tx=0x7f4bdc012810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e959f2d3fb466ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.617+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/243628024 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc004460 con 0x55b5cc3cab80 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.617+0000 7f4bf6ace740 1 -- 172.21.15.73:0/243628024 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4be801fb30 con 0x55b5cc3cab80 2024-09-05T13:01:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.617+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/243628024 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f4bdc004260 con 0x55b5cc3cab80 2024-09-05T13:01:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.618+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/243628024 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4bdc004460 con 0x55b5cc3cab80 2024-09-05T13:01:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.618+0000 7f4bf6ace740 10 client.25436 fetch_fsmap learned FSMap version 35 2024-09-05T13:01:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.618+0000 7f4bf6ace740 1 -- 172.21.15.73:0/243628024 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b5cc3e2b30 con 0x55b5cc3cab80 2024-09-05T13:01:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.618+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/243628024 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4be801fb30 con 0x55b5cc3cab80 2024-09-05T13:01:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.618+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/243628024 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f4bdc019070 con 0x55b5cc3cab80 2024-09-05T13:01:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.619+0000 7f4bf6ace740 10 client.25436 fetch_fsmap finished waiting for FSMap version 35 2024-09-05T13:01:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.619+0000 7f4bf6ace740 10 client.25436 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T13:01:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.619+0000 7f4bf6ace740 20 client.25436 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.619+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55b5cc3e4040 0x55b5cc3e6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.619+0000 7f4bf6ace740 4 client.25436 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.619+0000 7f4bf2494640 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55b5cc3e4040 0x55b5cc3e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.619+0000 7f4bf6ace740 1 -- 172.21.15.73:0/243628024 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5cc33c860 con 0x55b5cc3e4040 2024-09-05T13:01:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.620+0000 7f4bf2494640 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55b5cc3e4040 0x55b5cc3e6500 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc31ed0432bb4328 server_cookie=6d663ab06f9700fb in_seq=0 out_seq=0 2024-09-05T13:01:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.620+0000 7f4bd5ffb640 10 client.25436 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T13:01:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.621+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/243628024 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5cc33c860 con 0x55b5cc3e4040 2024-09-05T13:01:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.621+0000 7f4bd5ffb640 10 client.25436 handle_command_reply: tid=0 2024-09-05T13:01:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.621+0000 7f4bf6ace740 1 client.25436 shutdown 2024-09-05T13:01:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.622+0000 7f4bf6ace740 1 -- 172.21.15.73:0/243628024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 msgr2=0x55b5cc3d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.622+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 0x55b5cc3d0f40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4bec114f40 tx=0x7f4bdc012810 comp rx=0 tx=0).stop 2024-09-05T13:01:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.622+0000 7f4bf6ace740 1 -- 172.21.15.73:0/243628024 shutdown_connections 2024-09-05T13:01:50.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.622+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55b5cc3e4040 0x55b5cc3e6500 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.622+0000 7f4bd5ffb640 0 client.25436 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T13:01:50.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.623+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.623+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 0x55b5cc3d0f40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.623+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/243628024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3d3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.623+0000 7f4bf6ace740 1 -- 172.21.15.73:0/243628024 >> 172.21.15.73:0/243628024 conn(0x55b5cc392310 msgr2=0x55b5cc3cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:50.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.623+0000 7f4bf6ace740 1 -- 172.21.15.73:0/243628024 shutdown_connections 2024-09-05T13:01:50.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.623+0000 7f4bf6ace740 1 -- 172.21.15.73:0/243628024 wait complete. 2024-09-05T13:01:50.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.623+0000 7f4bf6ace740 20 client.25436 trim_cache size 0 max 16384 2024-09-05T13:01:50.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.649+0000 7f4bf6ace740 1 Processor -- start 2024-09-05T13:01:50.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.649+0000 7f4bf6ace740 1 -- start start 2024-09-05T13:01:50.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.649+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3e03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.649+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 0x55b5cc3ebdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.649+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 0x55b5cc3ec310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf2c95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 0x55b5cc3ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf2c95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 0x55b5cc3ec310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52668/0 (socket says 172.21.15.73:52668) 2024-09-05T13:01:50.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf2c95640 1 -- 172.21.15.73:0/3752491667 learned_addr learned my addr 172.21.15.73:0/3752491667 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:50.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf6ace740 1 -- 172.21.15.73:0/3752491667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd0010fa0 con 0x55b5cc3d4370 2024-09-05T13:01:50.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf2494640 1 --2- 172.21.15.73:0/3752491667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3e03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf6ace740 1 -- 172.21.15.73:0/3752491667 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd000e810 con 0x55b5cc3cab80 2024-09-05T13:01:50.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf6ace740 1 -- 172.21.15.73:0/3752491667 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd000c600 con 0x55b5cc3c95d0 2024-09-05T13:01:50.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf1c93640 1 --2- 172.21.15.73:0/3752491667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 0x55b5cc3ebdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf2494640 1 -- 172.21.15.73:0/3752491667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 msgr2=0x55b5cc3ebdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:50.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf2494640 1 --2- 172.21.15.73:0/3752491667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 0x55b5cc3ebdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf2494640 1 -- 172.21.15.73:0/3752491667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 msgr2=0x55b5cc3ec310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf2494640 1 --2- 172.21.15.73:0/3752491667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 0x55b5cc3ec310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.650+0000 7f4bf2494640 1 -- 172.21.15.73:0/3752491667 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5cc3e2960 con 0x55b5cc3c95d0 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.651+0000 7f4bf2494640 1 --2- 172.21.15.73:0/3752491667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3e03a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55b5cc3e6d70 tx=0x7f4be80116a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ad992ae78f60be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.653+0000 7f4bd7fff640 1 -- 172.21.15.73:0/3752491667 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8023030 con 0x55b5cc3c95d0 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.653+0000 7f4bd7fff640 1 -- 172.21.15.73:0/3752491667 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4be80113e0 con 0x55b5cc3c95d0 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.653+0000 7f4bd7fff640 1 -- 172.21.15.73:0/3752491667 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8011710 con 0x55b5cc3c95d0 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.654+0000 7f4bf6ace740 1 -- 172.21.15.73:0/3752491667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3c95d0 msgr2=0x55b5cc3e03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.654+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/3752491667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3e03a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55b5cc3e6d70 tx=0x7f4be80116a0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.654+0000 7f4bf6ace740 1 -- 172.21.15.73:0/3752491667 shutdown_connections 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.654+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/3752491667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3d4370 0x55b5cc3ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.654+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/3752491667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3cab80 0x55b5cc3ebdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.654+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/3752491667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3e03a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.654+0000 7f4bf6ace740 1 -- 172.21.15.73:0/3752491667 >> 172.21.15.73:0/3752491667 conn(0x55b5cc392310 msgr2=0x55b5cc3d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:50.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.655+0000 7f4bf6ace740 1 -- 172.21.15.73:0/3752491667 shutdown_connections 2024-09-05T13:01:50.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.656+0000 7f4bf6ace740 1 -- 172.21.15.73:0/3752491667 wait complete. 2024-09-05T13:01:50.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.656+0000 7f4bf6ace740 1 -- start start 2024-09-05T13:01:50.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.657+0000 7f4bf6ace740 1 Processor -- start 2024-09-05T13:01:50.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.657+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3dcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.657+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.657+0000 7f4bf6ace740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3e4040 0x55b5cc3d8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf6ace740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd000ccd0 con 0x55b5cc3e4040 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf2c95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3e4040 0x55b5cc3d8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf2c95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3e4040 0x55b5cc3d8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52680/0 (socket says 172.21.15.73:52680) 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf2c95640 1 -- 172.21.15.73:0/1521936053 learned_addr learned my addr 172.21.15.73:0/1521936053 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf6ace740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd000e140 con 0x55b5cc3d4370 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf6ace740 1 -- 172.21.15.73:0/1521936053 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd000d3a0 con 0x55b5cc3c95d0 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf6ace740 10 client.0 _ll_register_callbacks cb 0x7f4bdc009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf1c93640 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf2c95640 1 -- 172.21.15.73:0/1521936053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3c95d0 msgr2=0x55b5cc3dcb70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf2c95640 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3dcb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf2c95640 1 -- 172.21.15.73:0/1521936053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3d4370 msgr2=0x55b5cc3d7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf2c95640 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.658+0000 7f4bf2c95640 1 -- 172.21.15.73:0/1521936053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5cc3d8b70 con 0x55b5cc3e4040 2024-09-05T13:01:50.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.659+0000 7f4bf2c95640 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3e4040 0x55b5cc3d8340 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4be40de340 tx=0x7f4be40098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fff9ec96e39557 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:50.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.659+0000 7f4bd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:50.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.660+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/1521936053 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be40fc060 con 0x55b5cc3e4040 2024-09-05T13:01:50.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.660+0000 7f4bf6ace740 1 -- 172.21.15.73:0/1521936053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5cc336d70 con 0x55b5cc3e4040 2024-09-05T13:01:50.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.660+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/1521936053 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f4be40305a0 con 0x55b5cc3e4040 2024-09-05T13:01:50.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.660+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/1521936053 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4be40f6030 con 0x55b5cc3e4040 2024-09-05T13:01:50.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.660+0000 7f4bf6ace740 10 client.15942 fetch_fsmap learned FSMap version 35 2024-09-05T13:01:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.660+0000 7f4bf6ace740 1 -- 172.21.15.73:0/1521936053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b5cc44ed00 con 0x55b5cc3e4040 2024-09-05T13:01:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.661+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/1521936053 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b5cc336d70 con 0x55b5cc3e4040 2024-09-05T13:01:50.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.661+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/1521936053 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f4be40e6b90 con 0x55b5cc3e4040 2024-09-05T13:01:50.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.661+0000 7f4bf6ace740 10 client.15942 fetch_fsmap finished waiting for FSMap version 35 2024-09-05T13:01:50.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.661+0000 7f4bf6ace740 10 client.15942 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T13:01:50.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.661+0000 7f4bf6ace740 20 client.15942 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:50.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.661+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55b5cc44f400 0x55b5cc451820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:50.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.661+0000 7f4bf6ace740 4 client.15942 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:01:50.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.661+0000 7f4bf6ace740 1 -- 172.21.15.73:0/1521936053 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b5cc2b3170 con 0x55b5cc44f400 2024-09-05T13:01:50.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.662+0000 7f4bf2494640 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55b5cc44f400 0x55b5cc451820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:50.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.663+0000 7f4bf2494640 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55b5cc44f400 0x55b5cc451820 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67255d746fa15339 server_cookie=5f755bd9a5ee8388 in_seq=0 out_seq=0 2024-09-05T13:01:50.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.663+0000 7f4bd5ffb640 10 client.15942 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T13:01:50.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.663+0000 7f4bd5ffb640 1 -- 172.21.15.73:0/1521936053 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b5cc2b3170 con 0x55b5cc44f400 2024-09-05T13:01:50.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.663+0000 7f4bd5ffb640 10 client.15942 handle_command_reply: tid=0 2024-09-05T13:01:50.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.663+0000 7f4bf6ace740 1 client.15942 shutdown 2024-09-05T13:01:50.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.664+0000 7f4bf6ace740 1 -- 172.21.15.73:0/1521936053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3e4040 msgr2=0x55b5cc3d8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:50.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.664+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3e4040 0x55b5cc3d8340 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4be40de340 tx=0x7f4be40098c0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.664+0000 7f4bf6ace740 1 -- 172.21.15.73:0/1521936053 shutdown_connections 2024-09-05T13:01:50.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.664+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5cc3e4040 0x55b5cc3d8340 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.664+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5cc3d4370 0x55b5cc3d7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.664+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55b5cc44f400 0x55b5cc451820 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.664+0000 7f4bf6ace740 1 --2- 172.21.15.73:0/1521936053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5cc3c95d0 0x55b5cc3dcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.664+0000 7f4bf6ace740 1 -- 172.21.15.73:0/1521936053 >> 172.21.15.73:0/1521936053 conn(0x55b5cc392310 msgr2=0x55b5cc3cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:50.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.665+0000 7f4bd5ffb640 0 client.15942 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T13:01:50.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.665+0000 7f4bf6ace740 1 -- 172.21.15.73:0/1521936053 shutdown_connections 2024-09-05T13:01:50.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.665+0000 7f4bf6ace740 1 -- 172.21.15.73:0/1521936053 wait complete. 2024-09-05T13:01:50.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.668+0000 7f4bf6ace740 20 client.15942 trim_cache size 0 max 16384 2024-09-05T13:01:50.671 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:01:50.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.672+0000 7f4bf46f8640 1 -- 172.21.15.73:0/4245366167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bd80a2cc0 msgr2=0x7f4bd80a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:50.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.672+0000 7f4bf46f8640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bd80a2cc0 0x7f4bd80a5180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4be8005fd0 tx=0x7f4be8009260 comp rx=0 tx=0).stop 2024-09-05T13:01:50.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.672+0000 7f4bf46f8640 1 -- 172.21.15.73:0/4245366167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bec11b140 msgr2=0x7f4bec113ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:50.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.672+0000 7f4bf46f8640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bec11b140 0x7f4bec113ca0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4be4031610 tx=0x7f4be4030c60 comp rx=0 tx=0).stop 2024-09-05T13:01:50.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.673+0000 7f4bf46f8640 1 -- 172.21.15.73:0/4245366167 shutdown_connections 2024-09-05T13:01:50.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.673+0000 7f4bf46f8640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4bd80a2cc0 0x7f4bd80a5180 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4be8005fd0 tx=0x7f4be8009260 comp rx=0 tx=0).stop 2024-09-05T13:01:50.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.673+0000 7f4bf46f8640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bec11b140 0x7f4bec113ca0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.673+0000 7f4bf46f8640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bec109830 0x7f4bec113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.673+0000 7f4bf46f8640 1 --2- 172.21.15.73:0/4245366167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bec109450 0x7f4bec11a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:50.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.673+0000 7f4bf46f8640 1 -- 172.21.15.73:0/4245366167 >> 172.21.15.73:0/4245366167 conn(0x7f4bec06e140 msgr2=0x7f4bec070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:50.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.674+0000 7f4bf46f8640 1 -- 172.21.15.73:0/4245366167 shutdown_connections 2024-09-05T13:01:50.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:50.674+0000 7f4bf46f8640 1 -- 172.21.15.73:0/4245366167 wait complete. 2024-09-05T13:01:51.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:51 smithi073 ceph-mon[30883]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 4.68k op/s 2024-09-05T13:01:51.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:51 smithi162 ceph-mon[34220]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 4.68k op/s 2024-09-05T13:01:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:51 smithi169 ceph-mon[34823]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 4.68k op/s 2024-09-05T13:01:51.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T13:01:52.139 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:01:52.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.751+0000 7f8a51271640 1 -- 172.21.15.73:0/2793744385 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44040c30 con 0x7f8a4c06ea30 2024-09-05T13:01:52.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.751+0000 7f8a544d7640 1 -- 172.21.15.73:0/2793744385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c06ea30 msgr2=0x7f8a4c06ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.751+0000 7f8a544d7640 1 --2- 172.21.15.73:0/2793744385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c06ea30 0x7f8a4c06ee90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8a4401acb0 tx=0x7f8a4403b920 comp rx=0 tx=0).stop 2024-09-05T13:01:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.752+0000 7f8a544d7640 1 -- 172.21.15.73:0/2793744385 shutdown_connections 2024-09-05T13:01:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.752+0000 7f8a544d7640 1 --2- 172.21.15.73:0/2793744385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c11b140 0x7f8a4c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.752+0000 7f8a544d7640 1 --2- 172.21.15.73:0/2793744385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c06ea30 0x7f8a4c06ee90 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.752+0000 7f8a544d7640 1 --2- 172.21.15.73:0/2793744385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a4c110220 0x7f8a4c06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.752+0000 7f8a544d7640 1 -- 172.21.15.73:0/2793744385 >> 172.21.15.73:0/2793744385 conn(0x7f8a4c073210 msgr2=0x7f8a4c073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.753+0000 7f8a544d7640 1 -- 172.21.15.73:0/2793744385 shutdown_connections 2024-09-05T13:01:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.753+0000 7f8a544d7640 1 -- 172.21.15.73:0/2793744385 wait complete. 2024-09-05T13:01:52.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.754+0000 7f8a544d7640 1 Processor -- start 2024-09-05T13:01:52.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.754+0000 7f8a544d7640 1 -- start start 2024-09-05T13:01:52.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.754+0000 7f8a544d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c06ea30 0x7f8a4c11a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.754+0000 7f8a544d7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a4c110220 0x7f8a4c1168f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.755+0000 7f8a544d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c11b140 0x7f8a4c116e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.755+0000 7f8a51a72640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a4c110220 0x7f8a4c1168f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.755+0000 7f8a51a72640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a4c110220 0x7f8a4c1168f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:59162/0 (socket says 172.21.15.73:59162) 2024-09-05T13:01:52.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.755+0000 7f8a51a72640 1 -- 172.21.15.73:0/1293723040 learned_addr learned my addr 172.21.15.73:0/1293723040 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:52.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.755+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c113320 con 0x7f8a4c11b140 2024-09-05T13:01:52.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.755+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1131a0 con 0x7f8a4c06ea30 2024-09-05T13:01:52.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.755+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1134a0 con 0x7f8a4c110220 2024-09-05T13:01:52.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.755+0000 7f8a52273640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c06ea30 0x7f8a4c11a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.756+0000 7f8a52a74640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c11b140 0x7f8a4c116e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.757+0000 7f8a51a72640 1 -- 172.21.15.73:0/1293723040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c06ea30 msgr2=0x7f8a4c11a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.757+0000 7f8a51a72640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c06ea30 0x7f8a4c11a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.757+0000 7f8a51a72640 1 -- 172.21.15.73:0/1293723040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c11b140 msgr2=0x7f8a4c116e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.757+0000 7f8a51a72640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c11b140 0x7f8a4c116e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.757+0000 7f8a51a72640 1 -- 172.21.15.73:0/1293723040 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c117560 con 0x7f8a4c110220 2024-09-05T13:01:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.758+0000 7f8a51a72640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a4c110220 0x7f8a4c1168f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8a4401add0 tx=0x7f8a44040a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.759+0000 7f8a437fe640 1 -- 172.21.15.73:0/1293723040 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44045070 con 0x7f8a4c110220 2024-09-05T13:01:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.760+0000 7f8a437fe640 1 -- 172.21.15.73:0/1293723040 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a44040bd0 con 0x7f8a4c110220 2024-09-05T13:01:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.760+0000 7f8a437fe640 1 -- 172.21.15.73:0/1293723040 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4404a690 con 0x7f8a4c110220 2024-09-05T13:01:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.761+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c1ab0a0 con 0x7f8a4c110220 2024-09-05T13:01:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.761+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c1ab440 con 0x7f8a4c110220 2024-09-05T13:01:52.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.764+0000 7f8a568ad740 1 Processor -- start 2024-09-05T13:01:52.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.765+0000 7f8a437fe640 1 -- 172.21.15.73:0/1293723040 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8a44048020 con 0x7f8a4c110220 2024-09-05T13:01:52.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.766+0000 7f8a437fe640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8a380a2d90 0x7f8a380a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.767+0000 7f8a52a74640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8a380a2d90 0x7f8a380a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.767+0000 7f8a437fe640 1 -- 172.21.15.73:0/1293723040 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f8a44100e70 con 0x7f8a4c110220 2024-09-05T13:01:52.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.768+0000 7f8a568ad740 1 -- start start 2024-09-05T13:01:52.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.768+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d61d30 0x562ef1d60240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.768+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d60be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.768+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d6b520 0x562ef1d6d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.768+0000 7f8a568ad740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x562ef1cc62f0 con 0x562ef1d61d30 2024-09-05T13:01:52.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.768+0000 7f8a568ad740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562ef1c6dcf0 con 0x562ef1d60780 2024-09-05T13:01:52.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.768+0000 7f8a568ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ef1cc22b0 con 0x562ef1d6b520 2024-09-05T13:01:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.769+0000 7f8a52273640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d61d30 0x562ef1d60240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.769+0000 7f8a52273640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d61d30 0x562ef1d60240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52716/0 (socket says 172.21.15.73:52716) 2024-09-05T13:01:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.769+0000 7f8a52273640 1 -- 172.21.15.73:0/4145264816 learned_addr learned my addr 172.21.15.73:0/4145264816 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.769+0000 7f8a52a74640 1 --2- 172.21.15.73:0/4145264816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d6b520 0x562ef1d6d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.769+0000 7f8a51a72640 1 --2- 172.21.15.73:0/4145264816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d60be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.769+0000 7f8a52273640 1 -- 172.21.15.73:0/4145264816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d6b520 msgr2=0x562ef1d6d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.769+0000 7f8a52273640 1 --2- 172.21.15.73:0/4145264816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d6b520 0x562ef1d6d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.769+0000 7f8a52273640 1 -- 172.21.15.73:0/4145264816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 msgr2=0x562ef1d60be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.769+0000 7f8a52273640 1 --2- 172.21.15.73:0/4145264816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d60be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.769+0000 7f8a52273640 1 -- 172.21.15.73:0/4145264816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef1c523a0 con 0x562ef1d61d30 2024-09-05T13:01:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.770+0000 7f8a52273640 1 --2- 172.21.15.73:0/4145264816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d61d30 0x562ef1d60240 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009a70 tx=0x7f8a3c009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29abe9dd048b811 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.770+0000 7f8a40ff9640 1 -- 172.21.15.73:0/4145264816 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c017070 con 0x562ef1d61d30 2024-09-05T13:01:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.770+0000 7f8a40ff9640 1 -- 172.21.15.73:0/4145264816 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a3c013470 con 0x562ef1d61d30 2024-09-05T13:01:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.770+0000 7f8a40ff9640 1 -- 172.21.15.73:0/4145264816 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c012610 con 0x562ef1d61d30 2024-09-05T13:01:52.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.771+0000 7f8a568ad740 1 -- 172.21.15.73:0/4145264816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d61d30 msgr2=0x562ef1d60240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:52.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.771+0000 7f8a568ad740 1 --2- 172.21.15.73:0/4145264816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d61d30 0x562ef1d60240 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009a70 tx=0x7f8a3c009f30 comp rx=0 tx=0).stop 2024-09-05T13:01:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.772+0000 7f8a568ad740 1 -- 172.21.15.73:0/4145264816 shutdown_connections 2024-09-05T13:01:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.772+0000 7f8a568ad740 1 --2- 172.21.15.73:0/4145264816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d6b520 0x562ef1d6d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.772+0000 7f8a568ad740 1 --2- 172.21.15.73:0/4145264816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d60be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.772+0000 7f8a568ad740 1 --2- 172.21.15.73:0/4145264816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d61d30 0x562ef1d60240 secure :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009a70 tx=0x7f8a3c009f30 comp rx=0 tx=0).stop 2024-09-05T13:01:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.772+0000 7f8a568ad740 1 -- 172.21.15.73:0/4145264816 >> 172.21.15.73:0/4145264816 conn(0x562ef1d29310 msgr2=0x562ef1d5ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.773+0000 7f8a52a74640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8a380a2d90 0x7f8a380a5250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009ce0 tx=0x7f8a48015850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:52.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.773+0000 7f8a568ad740 1 -- 172.21.15.73:0/4145264816 shutdown_connections 2024-09-05T13:01:52.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.774+0000 7f8a568ad740 1 -- 172.21.15.73:0/4145264816 wait complete. 2024-09-05T13:01:52.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.774+0000 7f8a568ad740 1 -- start start 2024-09-05T13:01:52.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.774+0000 7f8a568ad740 1 Processor -- start 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.774+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d60780 0x562ef1d682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d6b520 0x562ef1d68820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d77730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a568ad740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x562ef1d6e280 con 0x562ef1d68d60 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a568ad740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562ef1c81060 con 0x562ef1d6b520 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a568ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ef1d6e400 con 0x562ef1d60780 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a568ad740 10 client.0 _ll_register_callbacks cb 0x562ef19d48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a52a74640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d77730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a52a74640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d77730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52724/0 (socket says 172.21.15.73:52724) 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a52a74640 1 -- 172.21.15.73:0/3410586023 learned_addr learned my addr 172.21.15.73:0/3410586023 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a52a74640 1 -- 172.21.15.73:0/3410586023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d60780 msgr2=0x562ef1d682e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a52a74640 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d60780 0x562ef1d682e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.775+0000 7f8a52a74640 1 -- 172.21.15.73:0/3410586023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d6b520 msgr2=0x562ef1d68820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:52.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.776+0000 7f8a52a74640 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d6b520 0x562ef1d68820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.776+0000 7f8a52a74640 1 -- 172.21.15.73:0/3410586023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef1a373c0 con 0x562ef1d68d60 2024-09-05T13:01:52.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.776+0000 7f8a52a74640 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d77730 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8a48012680 tx=0x7f8a48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c476c7d992bf036 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:52.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.777+0000 7f8a35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:52.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.779+0000 7f8a35ffb640 1 -- 172.21.15.73:0/3410586023 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4800f9e0 con 0x562ef1d68d60 2024-09-05T13:01:52.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.779+0000 7f8a35ffb640 1 -- 172.21.15.73:0/3410586023 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f8a4800fb80 con 0x562ef1d68d60 2024-09-05T13:01:52.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.779+0000 7f8a568ad740 1 -- 172.21.15.73:0/3410586023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a3c013470 con 0x562ef1d68d60 2024-09-05T13:01:52.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.780+0000 7f8a35ffb640 1 -- 172.21.15.73:0/3410586023 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8a4800fd80 con 0x562ef1d68d60 2024-09-05T13:01:52.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.781+0000 7f8a568ad740 10 client.15954 fetch_fsmap learned FSMap version 35 2024-09-05T13:01:52.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.781+0000 7f8a568ad740 1 -- 172.21.15.73:0/3410586023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562ef1d7a210 con 0x562ef1d68d60 2024-09-05T13:01:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.785+0000 7f8a35ffb640 1 -- 172.21.15.73:0/3410586023 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a48024070 con 0x562ef1d68d60 2024-09-05T13:01:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.786+0000 7f8a35ffb640 1 -- 172.21.15.73:0/3410586023 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f8a480205d0 con 0x562ef1d68d60 2024-09-05T13:01:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.786+0000 7f8a568ad740 10 client.15954 fetch_fsmap finished waiting for FSMap version 35 2024-09-05T13:01:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.786+0000 7f8a568ad740 10 client.15954 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T13:01:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.786+0000 7f8a568ad740 20 client.15954 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.786+0000 7f8a568ad740 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x562ef1d7bb30 0x562ef1d7dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.786+0000 7f8a568ad740 4 client.15954 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.786+0000 7f8a568ad740 1 -- 172.21.15.73:0/3410586023 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a3c013470 con 0x562ef1d7bb30 2024-09-05T13:01:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.789+0000 7f8a52273640 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x562ef1d7bb30 0x562ef1d7dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.792+0000 7f8a52273640 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x562ef1d7bb30 0x562ef1d7dff0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2a02c8b6918416a5 server_cookie=17bb4ac9b3695663 in_seq=0 out_seq=0 2024-09-05T13:01:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.792+0000 7f8a35ffb640 10 client.15954 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T13:01:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.793+0000 7f8a35ffb640 1 -- 172.21.15.73:0/3410586023 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8a3c013470 con 0x562ef1d7bb30 2024-09-05T13:01:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.793+0000 7f8a35ffb640 10 client.15954 handle_command_reply: tid=0 2024-09-05T13:01:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.793+0000 7f8a568ad740 1 client.15954 shutdown 2024-09-05T13:01:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.795+0000 7f8a568ad740 1 -- 172.21.15.73:0/3410586023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 msgr2=0x562ef1d77730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.795+0000 7f8a568ad740 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d77730 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8a48012680 tx=0x7f8a48004730 comp rx=0 tx=0).stop 2024-09-05T13:01:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.795+0000 7f8a568ad740 1 -- 172.21.15.73:0/3410586023 shutdown_connections 2024-09-05T13:01:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.795+0000 7f8a568ad740 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x562ef1d7bb30 0x562ef1d7dff0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.795+0000 7f8a568ad740 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d77730 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.795+0000 7f8a568ad740 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d6b520 0x562ef1d68820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.795+0000 7f8a568ad740 1 --2- 172.21.15.73:0/3410586023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d60780 0x562ef1d682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.795+0000 7f8a568ad740 1 -- 172.21.15.73:0/3410586023 >> 172.21.15.73:0/3410586023 conn(0x562ef1d29310 msgr2=0x562ef1d62b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.797+0000 7f8a35ffb640 0 client.15954 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T13:01:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.799+0000 7f8a568ad740 1 -- 172.21.15.73:0/3410586023 shutdown_connections 2024-09-05T13:01:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.800+0000 7f8a568ad740 1 -- 172.21.15.73:0/3410586023 wait complete. 2024-09-05T13:01:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.801+0000 7f8a568ad740 20 client.15954 trim_cache size 0 max 16384 2024-09-05T13:01:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.828+0000 7f8a568ad740 1 Processor -- start 2024-09-05T13:01:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.829+0000 7f8a568ad740 1 -- start start 2024-09-05T13:01:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.829+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d77520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.829+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d68d60 0x562ef1d77a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.829+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d6b520 0x562ef1d66bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.829+0000 7f8a568ad740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1b6140 con 0x562ef1d6b520 2024-09-05T13:01:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.829+0000 7f8a568ad740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1b39b0 con 0x562ef1d60780 2024-09-05T13:01:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.829+0000 7f8a568ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1b18b0 con 0x562ef1d68d60 2024-09-05T13:01:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.830+0000 7f8a51a72640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d68d60 0x562ef1d77a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.830+0000 7f8a51a72640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d68d60 0x562ef1d77a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:59194/0 (socket says 172.21.15.73:59194) 2024-09-05T13:01:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.830+0000 7f8a51a72640 1 -- 172.21.15.73:0/1488435639 learned_addr learned my addr 172.21.15.73:0/1488435639 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.830+0000 7f8a52273640 1 --2- 172.21.15.73:0/1488435639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d77520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.830+0000 7f8a52a74640 1 --2- 172.21.15.73:0/1488435639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d6b520 0x562ef1d66bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.830+0000 7f8a52273640 1 -- 172.21.15.73:0/1488435639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d68d60 msgr2=0x562ef1d77a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.830+0000 7f8a52273640 1 --2- 172.21.15.73:0/1488435639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d68d60 0x562ef1d77a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.830+0000 7f8a52273640 1 -- 172.21.15.73:0/1488435639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d6b520 msgr2=0x562ef1d66bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.830+0000 7f8a52273640 1 --2- 172.21.15.73:0/1488435639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d6b520 0x562ef1d66bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.830+0000 7f8a52273640 1 -- 172.21.15.73:0/1488435639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef1d6ac50 con 0x562ef1d60780 2024-09-05T13:01:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.831+0000 7f8a52273640 1 --2- 172.21.15.73:0/1488435639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d77520 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c008000 tx=0x7f8a3c013e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=374ba8c5333c959c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.832+0000 7f8a37fff640 1 -- 172.21.15.73:0/1488435639 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c017040 con 0x562ef1d60780 2024-09-05T13:01:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.832+0000 7f8a37fff640 1 -- 172.21.15.73:0/1488435639 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a3c013950 con 0x562ef1d60780 2024-09-05T13:01:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.832+0000 7f8a37fff640 1 -- 172.21.15.73:0/1488435639 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c0266d0 con 0x562ef1d60780 2024-09-05T13:01:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.833+0000 7f8a568ad740 1 -- 172.21.15.73:0/1488435639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 msgr2=0x562ef1d77520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.833+0000 7f8a568ad740 1 --2- 172.21.15.73:0/1488435639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d77520 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c008000 tx=0x7f8a3c013e40 comp rx=0 tx=0).stop 2024-09-05T13:01:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.833+0000 7f8a568ad740 1 -- 172.21.15.73:0/1488435639 shutdown_connections 2024-09-05T13:01:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.833+0000 7f8a568ad740 1 --2- 172.21.15.73:0/1488435639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d6b520 0x562ef1d66bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.833+0000 7f8a568ad740 1 --2- 172.21.15.73:0/1488435639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d68d60 0x562ef1d77a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.833+0000 7f8a568ad740 1 --2- 172.21.15.73:0/1488435639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d77520 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.833+0000 7f8a568ad740 1 -- 172.21.15.73:0/1488435639 >> 172.21.15.73:0/1488435639 conn(0x562ef1d29310 msgr2=0x562ef1d5c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:52.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.834+0000 7f8a568ad740 1 -- 172.21.15.73:0/1488435639 shutdown_connections 2024-09-05T13:01:52.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.837+0000 7f8a568ad740 1 -- 172.21.15.73:0/1488435639 wait complete. 2024-09-05T13:01:52.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.837+0000 7f8a568ad740 1 -- start start 2024-09-05T13:01:52.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.837+0000 7f8a568ad740 1 Processor -- start 2024-09-05T13:01:52.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.840+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d6e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.840+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d6eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.840+0000 7f8a568ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d6b520 0x562ef1d6f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.840+0000 7f8a568ad740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1b1e70 con 0x562ef1d68d60 2024-09-05T13:01:52.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.840+0000 7f8a568ad740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1b32e0 con 0x562ef1d60780 2024-09-05T13:01:52.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.840+0000 7f8a568ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1b2540 con 0x562ef1d6b520 2024-09-05T13:01:52.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.840+0000 7f8a568ad740 10 client.0 _ll_register_callbacks cb 0x7f8a4c06f5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:52.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.841+0000 7f8a51a72640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d6eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.841+0000 7f8a51a72640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d6eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52742/0 (socket says 172.21.15.73:52742) 2024-09-05T13:01:52.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.841+0000 7f8a51a72640 1 -- 172.21.15.73:0/4283565562 learned_addr learned my addr 172.21.15.73:0/4283565562 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:52.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.842+0000 7f8a52a74640 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d6b520 0x562ef1d6f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.842+0000 7f8a51a72640 1 -- 172.21.15.73:0/4283565562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d6b520 msgr2=0x562ef1d6f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:52.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.842+0000 7f8a51a72640 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d6b520 0x562ef1d6f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.842+0000 7f8a51a72640 1 -- 172.21.15.73:0/4283565562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 msgr2=0x562ef1d6e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:52.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.842+0000 7f8a51a72640 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d6e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.842+0000 7f8a51a72640 1 -- 172.21.15.73:0/4283565562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef1de4ac0 con 0x562ef1d68d60 2024-09-05T13:01:52.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.842+0000 7f8a51a72640 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d6eb90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8a4403bf10 tx=0x7f8a4401a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18d80231b7ba605 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.843+0000 7f8a35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.843+0000 7f8a35ffb640 1 -- 172.21.15.73:0/4283565562 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a440eb060 con 0x562ef1d68d60 2024-09-05T13:01:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.843+0000 7f8a35ffb640 1 -- 172.21.15.73:0/4283565562 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f8a44040d80 con 0x562ef1d68d60 2024-09-05T13:01:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.844+0000 7f8a568ad740 1 -- 172.21.15.73:0/4283565562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a3c013950 con 0x562ef1d68d60 2024-09-05T13:01:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.844+0000 7f8a35ffb640 1 -- 172.21.15.73:0/4283565562 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8a44041ad0 con 0x562ef1d68d60 2024-09-05T13:01:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.844+0000 7f8a568ad740 10 client.15960 fetch_fsmap learned FSMap version 35 2024-09-05T13:01:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.844+0000 7f8a568ad740 1 -- 172.21.15.73:0/4283565562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562ef1de5e00 con 0x562ef1d68d60 2024-09-05T13:01:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.845+0000 7f8a35ffb640 1 -- 172.21.15.73:0/4283565562 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a3c013950 con 0x562ef1d68d60 2024-09-05T13:01:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.846+0000 7f8a35ffb640 1 -- 172.21.15.73:0/4283565562 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f8a440c9d10 con 0x562ef1d68d60 2024-09-05T13:01:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.846+0000 7f8a568ad740 10 client.15960 fetch_fsmap finished waiting for FSMap version 35 2024-09-05T13:01:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.846+0000 7f8a568ad740 10 client.15960 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T13:01:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.846+0000 7f8a568ad740 20 client.15960 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.846+0000 7f8a568ad740 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x562ef1de6570 0x562ef1de8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.846+0000 7f8a568ad740 4 client.15960 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:01:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.846+0000 7f8a568ad740 1 -- 172.21.15.73:0/4283565562 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ef1cd3860 con 0x562ef1de6570 2024-09-05T13:01:52.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.849+0000 7f8a52273640 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x562ef1de6570 0x562ef1de8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:52.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.855+0000 7f8a52273640 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x562ef1de6570 0x562ef1de8990 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f85c632f117b551 server_cookie=ae162d0dab79ae29 in_seq=0 out_seq=0 2024-09-05T13:01:52.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.855+0000 7f8a35ffb640 10 client.15960 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T13:01:52.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.857+0000 7f8a35ffb640 1 -- 172.21.15.73:0/4283565562 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ef1cd3860 con 0x562ef1de6570 2024-09-05T13:01:52.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.857+0000 7f8a35ffb640 10 client.15960 handle_command_reply: tid=0 2024-09-05T13:01:52.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.858+0000 7f8a568ad740 1 client.15960 shutdown 2024-09-05T13:01:52.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.860+0000 7f8a568ad740 1 -- 172.21.15.73:0/4283565562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 msgr2=0x562ef1d6eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:52.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.860+0000 7f8a568ad740 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d6eb90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8a4403bf10 tx=0x7f8a4401a5d0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.862+0000 7f8a568ad740 1 -- 172.21.15.73:0/4283565562 shutdown_connections 2024-09-05T13:01:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.862+0000 7f8a568ad740 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x562ef1de6570 0x562ef1de8990 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.862+0000 7f8a568ad740 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef1d6b520 0x562ef1d6f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.862+0000 7f8a568ad740 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562ef1d68d60 0x562ef1d6eb90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.862+0000 7f8a568ad740 1 --2- 172.21.15.73:0/4283565562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef1d60780 0x562ef1d6e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.862+0000 7f8a568ad740 1 -- 172.21.15.73:0/4283565562 >> 172.21.15.73:0/4283565562 conn(0x562ef1d29310 msgr2=0x562ef1d66ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:52.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.862+0000 7f8a35ffb640 0 client.15960 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T13:01:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.864+0000 7f8a568ad740 1 -- 172.21.15.73:0/4283565562 shutdown_connections 2024-09-05T13:01:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.864+0000 7f8a568ad740 1 -- 172.21.15.73:0/4283565562 wait complete. 2024-09-05T13:01:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.864+0000 7f8a568ad740 20 client.15960 trim_cache size 0 max 16384 2024-09-05T13:01:52.866 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:01:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.866+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8a380a2d90 msgr2=0x7f8a380a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.866+0000 7f8a544d7640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8a380a2d90 0x7f8a380a5250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009ce0 tx=0x7f8a48015850 comp rx=0 tx=0).stop 2024-09-05T13:01:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.866+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a4c110220 msgr2=0x7f8a4c1168f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.866+0000 7f8a544d7640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a4c110220 0x7f8a4c1168f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8a4401add0 tx=0x7f8a44040a60 comp rx=0 tx=0).stop 2024-09-05T13:01:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.868+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 shutdown_connections 2024-09-05T13:01:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.868+0000 7f8a544d7640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8a380a2d90 0x7f8a380a5250 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.868+0000 7f8a544d7640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c11b140 0x7f8a4c116e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.868+0000 7f8a544d7640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a4c110220 0x7f8a4c1168f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.868+0000 7f8a544d7640 1 --2- 172.21.15.73:0/1293723040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c06ea30 0x7f8a4c11a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.868+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 >> 172.21.15.73:0/1293723040 conn(0x7f8a4c073210 msgr2=0x7f8a4c11b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.868+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 shutdown_connections 2024-09-05T13:01:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:52.868+0000 7f8a544d7640 1 -- 172.21.15.73:0/1293723040 wait complete. 2024-09-05T13:01:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.270+0000 7f39aaba6640 1 -- 172.21.15.73:0/3792373664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a41013c0 msgr2=0x7f39a4101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.270+0000 7f39aaba6640 1 --2- 172.21.15.73:0/3792373664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a41013c0 0x7f39a4101850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f399c00bc00 tx=0x7f399c009260 comp rx=0 tx=0).stop 2024-09-05T13:01:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.270+0000 7f39aaba6640 1 -- 172.21.15.73:0/3792373664 shutdown_connections 2024-09-05T13:01:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.270+0000 7f39aaba6640 1 --2- 172.21.15.73:0/3792373664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a41013c0 0x7f39a4101850 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.270+0000 7f39aaba6640 1 --2- 172.21.15.73:0/3792373664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a40694a0 0x7f39a4100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.270+0000 7f39aaba6640 1 --2- 172.21.15.73:0/3792373664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39a4069010 0x7f39a41001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.270+0000 7f39aaba6640 1 -- 172.21.15.73:0/3792373664 >> 172.21.15.73:0/3792373664 conn(0x7f39a40fb930 msgr2=0x7f39a40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.270+0000 7f39aaba6640 1 -- 172.21.15.73:0/3792373664 shutdown_connections 2024-09-05T13:01:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.270+0000 7f39aaba6640 1 -- 172.21.15.73:0/3792373664 wait complete. 2024-09-05T13:01:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39aaba6640 1 Processor -- start 2024-09-05T13:01:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39aaba6640 1 -- start start 2024-09-05T13:01:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39aaba6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4069010 0x7f39a4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39aaba6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a40694a0 0x7f39a4071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39aaba6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39a41013c0 0x7f39a41a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39aaba6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f39a410b680 con 0x7f39a4069010 2024-09-05T13:01:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39aaba6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39a410b500 con 0x7f39a40694a0 2024-09-05T13:01:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39aaba6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39a410b800 con 0x7f39a41013c0 2024-09-05T13:01:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39a3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a40694a0 0x7f39a4071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39a3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a40694a0 0x7f39a4071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:58518/0 (socket says 172.21.15.73:58518) 2024-09-05T13:01:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39a3fff640 1 -- 172.21.15.73:0/436829997 learned_addr learned my addr 172.21.15.73:0/436829997 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39a9143640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39a41013c0 0x7f39a41a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.272+0000 7f39a8942640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4069010 0x7f39a4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.273+0000 7f39a3fff640 1 -- 172.21.15.73:0/436829997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39a41013c0 msgr2=0x7f39a41a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.273+0000 7f39a3fff640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39a41013c0 0x7f39a41a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.273+0000 7f39a3fff640 1 -- 172.21.15.73:0/436829997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4069010 msgr2=0x7f39a4070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.273+0000 7f39a3fff640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4069010 0x7f39a4070b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.273+0000 7f39a3fff640 1 -- 172.21.15.73:0/436829997 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a4074190 con 0x7f39a40694a0 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.273+0000 7f39a3fff640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a40694a0 0x7f39a4071080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f39900058c0 tx=0x7f3990009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.273+0000 7f39a1ffb640 1 -- 172.21.15.73:0/436829997 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399000f260 con 0x7f39a40694a0 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.273+0000 7f39aaba6640 1 -- 172.21.15.73:0/436829997 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a41a6330 con 0x7f39a40694a0 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.274+0000 7f39a1ffb640 1 -- 172.21.15.73:0/436829997 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f399000be40 con 0x7f39a40694a0 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.274+0000 7f39a1ffb640 1 -- 172.21.15.73:0/436829997 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399000ee20 con 0x7f39a40694a0 2024-09-05T13:01:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.274+0000 7f39aaba6640 1 -- 172.21.15.73:0/436829997 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a41a6950 con 0x7f39a40694a0 2024-09-05T13:01:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.277+0000 7f39ada1f740 1 Processor -- start 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.277+0000 7f39a1ffb640 1 -- 172.21.15.73:0/436829997 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3990033440 con 0x7f39a40694a0 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.277+0000 7f39ada1f740 1 -- start start 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39ada1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca8d9a0 0x55bb1ca8dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39ada1f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca92da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39ada1f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca93370 0x55bb1ca95830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39ada1f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bb1c9f12f0 con 0x55bb1ca93370 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39ada1f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bb1c999270 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39ada1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bb1c9ed2b0 con 0x55bb1ca8d9a0 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a8942640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca92da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a8942640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca92da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:58534/0 (socket says 172.21.15.73:58534) 2024-09-05T13:01:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a8942640 1 -- 172.21.15.73:0/380721574 learned_addr learned my addr 172.21.15.73:0/380721574 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a9143640 1 --2- 172.21.15.73:0/380721574 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca8d9a0 0x55bb1ca8dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a3fff640 1 --2- 172.21.15.73:0/380721574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca93370 0x55bb1ca95830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a1ffb640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39940a2cb0 0x7f39940a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a8942640 1 -- 172.21.15.73:0/380721574 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca8d9a0 msgr2=0x55bb1ca8dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a8942640 1 --2- 172.21.15.73:0/380721574 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca8d9a0 0x55bb1ca8dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a8942640 1 -- 172.21.15.73:0/380721574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca93370 msgr2=0x55bb1ca95830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a8942640 1 --2- 172.21.15.73:0/380721574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca93370 0x55bb1ca95830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.279+0000 7f39a1ffb640 1 -- 172.21.15.73:0/436829997 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f39900dfc30 con 0x7f39a40694a0 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.278+0000 7f39a8942640 1 -- 172.21.15.73:0/380721574 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb1c998340 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.279+0000 7f39a9143640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39940a2cb0 0x7f39940a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.279+0000 7f39a8942640 1 --2- 172.21.15.73:0/380721574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca92da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f399800b3a0 tx=0x7f39980118f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a0870a8b8192356 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.279+0000 7f398effd640 1 -- 172.21.15.73:0/380721574 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998010380 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.279+0000 7f398effd640 1 -- 172.21.15.73:0/380721574 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3998010a00 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.279+0000 7f398effd640 1 -- 172.21.15.73:0/380721574 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998019980 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.280+0000 7f39ada1f740 1 -- 172.21.15.73:0/380721574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 msgr2=0x55bb1ca92da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.280+0000 7f39ada1f740 1 --2- 172.21.15.73:0/380721574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca92da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f399800b3a0 tx=0x7f39980118f0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.280+0000 7f39a9143640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39940a2cb0 0x7f39940a5170 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f399c006010 tx=0x7f399c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.280+0000 7f39ada1f740 1 -- 172.21.15.73:0/380721574 shutdown_connections 2024-09-05T13:01:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.280+0000 7f39ada1f740 1 --2- 172.21.15.73:0/380721574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca93370 0x55bb1ca95830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.280+0000 7f39ada1f740 1 --2- 172.21.15.73:0/380721574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca92da0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.280+0000 7f39ada1f740 1 --2- 172.21.15.73:0/380721574 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca8d9a0 0x55bb1ca8dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.280+0000 7f39ada1f740 1 -- 172.21.15.73:0/380721574 >> 172.21.15.73:0/380721574 conn(0x55bb1ca89010 msgr2=0x55bb1ca89410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.280+0000 7f39ada1f740 1 -- 172.21.15.73:0/380721574 shutdown_connections 2024-09-05T13:01:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.280+0000 7f39ada1f740 1 -- 172.21.15.73:0/380721574 wait complete. 2024-09-05T13:01:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.281+0000 7f39ada1f740 1 -- start start 2024-09-05T13:01:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.281+0000 7f39ada1f740 1 Processor -- start 2024-09-05T13:01:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.281+0000 7f39ada1f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8d9a0 0x55bb1ca97c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.281+0000 7f39a8942640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8d9a0 0x55bb1ca97c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.281+0000 7f39a8942640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8d9a0 0x55bb1ca97c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52788/0 (socket says 172.21.15.73:52788) 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.281+0000 7f39a8942640 1 -- 172.21.15.73:0/3792458264 learned_addr learned my addr 172.21.15.73:0/3792458264 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39ada1f740 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca981a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39ada1f740 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 0x55bb1ca9f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bb1ca96340 con 0x55bb1ca8d9a0 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bb1c97a290 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bb1ca964c0 con 0x55bb1ca93370 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39ada1f740 10 client.0 _ll_register_callbacks cb 0x55bb1c9ab140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39a3fff640 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39a8942640 1 -- 172.21.15.73:0/3792458264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 msgr2=0x55bb1ca9f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39a8942640 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 0x55bb1ca9f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39a8942640 1 -- 172.21.15.73:0/3792458264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 msgr2=0x55bb1ca981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39a8942640 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39a8942640 1 -- 172.21.15.73:0/3792458264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb1c704210 con 0x55bb1ca8d9a0 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39a8942640 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8d9a0 0x55bb1ca97c60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3998011000 tx=0x7f39980105b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cbbb526bc2cc37 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f3983fff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f3983fff640 1 -- 172.21.15.73:0/3792458264 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998029060 con 0x55bb1ca8d9a0 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f3983fff640 1 -- 172.21.15.73:0/3792458264 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f39980115f0 con 0x55bb1ca8d9a0 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3998010a00 con 0x55bb1ca8d9a0 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f3983fff640 1 -- 172.21.15.73:0/3792458264 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3998019310 con 0x55bb1ca8d9a0 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.282+0000 7f39ada1f740 10 client.15972 fetch_fsmap learned FSMap version 35 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.283+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bb1c7d0620 con 0x55bb1ca8d9a0 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.283+0000 7f3983fff640 1 -- 172.21.15.73:0/3792458264 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3998010a00 con 0x55bb1ca8d9a0 2024-09-05T13:01:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.283+0000 7f3983fff640 1 -- 172.21.15.73:0/3792458264 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f399801b6a0 con 0x55bb1ca8d9a0 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.283+0000 7f39ada1f740 10 client.15972 fetch_fsmap finished waiting for FSMap version 35 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.283+0000 7f39ada1f740 10 client.15972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.283+0000 7f39ada1f740 20 client.15972 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.283+0000 7f39ada1f740 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55bb1caa3650 0x55bb1caa5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.283+0000 7f39ada1f740 4 client.15972 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.283+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb1c9fea20 con 0x55bb1caa3650 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.283+0000 7f39a3fff640 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55bb1caa3650 0x55bb1caa5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.284+0000 7f3983fff640 10 client.15972 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.284+0000 7f39a3fff640 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55bb1caa3650 0x55bb1caa5af0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a12cdc850bd27ff6 server_cookie=f1a5d7fbb779eb34 in_seq=0 out_seq=0 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f3983fff640 1 -- 172.21.15.73:0/3792458264 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb1c9fea20 con 0x55bb1caa3650 2024-09-05T13:01:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f3983fff640 10 client.15972 handle_command_reply: tid=0 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f39ada1f740 1 client.15972 shutdown 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8d9a0 msgr2=0x55bb1ca97c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f39ada1f740 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8d9a0 0x55bb1ca97c60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3998011000 tx=0x7f39980105b0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 shutdown_connections 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f39ada1f740 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55bb1caa3650 0x55bb1caa5af0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f3983fff640 0 client.15972 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f39ada1f740 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 0x55bb1ca9f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f39ada1f740 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f39ada1f740 1 --2- 172.21.15.73:0/3792458264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8d9a0 0x55bb1ca97c60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.285+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 >> 172.21.15.73:0/3792458264 conn(0x55bb1ca89010 msgr2=0x55bb1ca8a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.286+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 shutdown_connections 2024-09-05T13:01:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.286+0000 7f39ada1f740 1 -- 172.21.15.73:0/3792458264 wait complete. 2024-09-05T13:01:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.286+0000 7f39ada1f740 20 client.15972 trim_cache size 0 max 16384 2024-09-05T13:01:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39ada1f740 1 Processor -- start 2024-09-05T13:01:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39ada1f740 1 -- start start 2024-09-05T13:01:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39ada1f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca880b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39ada1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 0x55bb1ca9f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39ada1f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1caa3650 0x55bb1ca8a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39ada1f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3988010c80 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39ada1f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f398800e4f0 con 0x55bb1caa3650 2024-09-05T13:01:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39ada1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f398800c340 con 0x55bb1ca93370 2024-09-05T13:01:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39a8942640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca880b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39a8942640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca880b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39090/0 (socket says 172.21.15.73:39090) 2024-09-05T13:01:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.315+0000 7f39a8942640 1 -- 172.21.15.73:0/2607303746 learned_addr learned my addr 172.21.15.73:0/2607303746 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.316+0000 7f39a8942640 1 -- 172.21.15.73:0/2607303746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 msgr2=0x55bb1ca9f130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.316+0000 7f39a8942640 1 --2- 172.21.15.73:0/2607303746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 0x55bb1ca9f130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.316+0000 7f39a8942640 1 -- 172.21.15.73:0/2607303746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1caa3650 msgr2=0x55bb1ca8a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.316+0000 7f39a8942640 1 --2- 172.21.15.73:0/2607303746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1caa3650 0x55bb1ca8a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.316+0000 7f39a8942640 1 -- 172.21.15.73:0/2607303746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb1ca88e30 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.316+0000 7f39a8942640 1 --2- 172.21.15.73:0/2607303746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca880b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f399801baf0 tx=0x7f3998010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2380c71d291f13c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.316+0000 7f398e7fc640 1 -- 172.21.15.73:0/2607303746 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998034070 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.316+0000 7f398e7fc640 1 -- 172.21.15.73:0/2607303746 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f399800a040 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.317+0000 7f398e7fc640 1 -- 172.21.15.73:0/2607303746 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998029040 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.317+0000 7f39ada1f740 1 -- 172.21.15.73:0/2607303746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 msgr2=0x55bb1ca880b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.317+0000 7f39ada1f740 1 --2- 172.21.15.73:0/2607303746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca880b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f399801baf0 tx=0x7f3998010e40 comp rx=0 tx=0).stop 2024-09-05T13:01:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.317+0000 7f39ada1f740 1 -- 172.21.15.73:0/2607303746 shutdown_connections 2024-09-05T13:01:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.317+0000 7f39ada1f740 1 --2- 172.21.15.73:0/2607303746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1caa3650 0x55bb1ca8a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.317+0000 7f39ada1f740 1 --2- 172.21.15.73:0/2607303746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 0x55bb1ca9f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.317+0000 7f39ada1f740 1 --2- 172.21.15.73:0/2607303746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca880b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.317+0000 7f39ada1f740 1 -- 172.21.15.73:0/2607303746 >> 172.21.15.73:0/2607303746 conn(0x55bb1ca89010 msgr2=0x55bb1ca879a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.317+0000 7f39ada1f740 1 -- 172.21.15.73:0/2607303746 shutdown_connections 2024-09-05T13:01:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.318+0000 7f39ada1f740 1 -- 172.21.15.73:0/2607303746 wait complete. 2024-09-05T13:01:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.318+0000 7f39ada1f740 1 -- start start 2024-09-05T13:01:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.318+0000 7f39ada1f740 1 Processor -- start 2024-09-05T13:01:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39ada1f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca9c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39ada1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 0x55bb1ca9cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39ada1f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1caa3650 0x55bb1ca9dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39ada1f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f398800c9b0 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39ada1f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f398800de20 con 0x55bb1caa3650 2024-09-05T13:01:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39ada1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f398800d080 con 0x55bb1ca93370 2024-09-05T13:01:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39ada1f740 10 client.0 _ll_register_callbacks cb 0x7f399c00ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a8942640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca9c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a8942640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca9c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39092/0 (socket says 172.21.15.73:39092) 2024-09-05T13:01:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a8942640 1 -- 172.21.15.73:0/25349969 learned_addr learned my addr 172.21.15.73:0/25349969 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a3fff640 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 0x55bb1ca9cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a9143640 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1caa3650 0x55bb1ca9dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a8942640 1 -- 172.21.15.73:0/25349969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 msgr2=0x55bb1ca9cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a8942640 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 0x55bb1ca9cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a8942640 1 -- 172.21.15.73:0/25349969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1caa3650 msgr2=0x55bb1ca9dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a8942640 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1caa3650 0x55bb1ca9dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a8942640 1 -- 172.21.15.73:0/25349969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb1ca9e1c0 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f39a8942640 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca9c660 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3998012fd0 tx=0x7f399800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98b2e2edae03219 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.319+0000 7f3983fff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.320+0000 7f3983fff640 1 -- 172.21.15.73:0/25349969 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399803e020 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.320+0000 7f3983fff640 1 -- 172.21.15.73:0/25349969 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f3998004250 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.320+0000 7f39ada1f740 1 -- 172.21.15.73:0/25349969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f399800a040 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.320+0000 7f3983fff640 1 -- 172.21.15.73:0/25349969 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3998034040 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.320+0000 7f39ada1f740 10 client.15978 fetch_fsmap learned FSMap version 35 2024-09-05T13:01:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.320+0000 7f39ada1f740 1 -- 172.21.15.73:0/25349969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bb1ca9f4d0 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.321+0000 7f3983fff640 1 -- 172.21.15.73:0/25349969 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f399800a040 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.321+0000 7f3983fff640 1 -- 172.21.15.73:0/25349969 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f399801bce0 con 0x55bb1ca8e2e0 2024-09-05T13:01:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.321+0000 7f39ada1f740 10 client.15978 fetch_fsmap finished waiting for FSMap version 35 2024-09-05T13:01:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.321+0000 7f39ada1f740 10 client.15978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.321+0000 7f39ada1f740 20 client.15978 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.321+0000 7f39ada1f740 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55bb1cb0eba0 0x55bb1cb10fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.321+0000 7f39ada1f740 4 client.15978 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:01:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.321+0000 7f39ada1f740 1 -- 172.21.15.73:0/25349969 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb1c9f8d70 con 0x55bb1cb0eba0 2024-09-05T13:01:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.322+0000 7f39a3fff640 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55bb1cb0eba0 0x55bb1cb10fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.323+0000 7f3983fff640 10 client.15978 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:53.323+0000 7f39a3fff640 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55bb1cb0eba0 0x55bb1cb10fc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82eae94d0d4c2917 server_cookie=4202e84411b339f7 in_seq=0 out_seq=0 2024-09-05T13:01:53.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:53 smithi073 ceph-mon[30883]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 MiB/s wr, 4.99k op/s 2024-09-05T13:01:53.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:53 smithi162 ceph-mon[34220]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 MiB/s wr, 4.99k op/s 2024-09-05T13:01:53.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:53 smithi169 ceph-mon[34823]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 MiB/s wr, 4.99k op/s 2024-09-05T13:01:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.071+0000 7f3983fff640 1 -- 172.21.15.73:0/25349969 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bb1c9f8d70 con 0x55bb1cb0eba0 2024-09-05T13:01:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.071+0000 7f3983fff640 10 client.15978 handle_command_reply: tid=0 2024-09-05T13:01:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.071+0000 7f39ada1f740 1 client.15978 shutdown 2024-09-05T13:01:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.072+0000 7f39ada1f740 1 -- 172.21.15.73:0/25349969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 msgr2=0x55bb1ca9c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.072+0000 7f39ada1f740 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca9c660 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3998012fd0 tx=0x7f399800bd50 comp rx=0 tx=0).stop 2024-09-05T13:01:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.072+0000 7f39ada1f740 1 -- 172.21.15.73:0/25349969 shutdown_connections 2024-09-05T13:01:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.072+0000 7f39ada1f740 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55bb1cb0eba0 0x55bb1cb10fc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.072+0000 7f3983fff640 0 client.15978 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.072+0000 7f39ada1f740 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb1caa3650 0x55bb1ca9dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.072+0000 7f39ada1f740 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb1ca93370 0x55bb1ca9cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.072+0000 7f39ada1f740 1 --2- 172.21.15.73:0/25349969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bb1ca8e2e0 0x55bb1ca9c660 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.072+0000 7f39ada1f740 1 -- 172.21.15.73:0/25349969 >> 172.21.15.73:0/25349969 conn(0x55bb1ca89010 msgr2=0x55bb1ca881c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.072+0000 7f39ada1f740 1 -- 172.21.15.73:0/25349969 shutdown_connections 2024-09-05T13:01:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.073+0000 7f39ada1f740 1 -- 172.21.15.73:0/25349969 wait complete. 2024-09-05T13:01:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.073+0000 7f39ada1f740 20 client.15978 trim_cache size 0 max 16384 2024-09-05T13:01:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:01:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:01:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:01:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:01:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 -- 172.21.15.73:0/436829997 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39940a2cb0 msgr2=0x7f39940a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39940a2cb0 0x7f39940a5170 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f399c006010 tx=0x7f399c009260 comp rx=0 tx=0).stop 2024-09-05T13:01:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 -- 172.21.15.73:0/436829997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a40694a0 msgr2=0x7f39a4071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a40694a0 0x7f39a4071080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f39900058c0 tx=0x7f3990009f70 comp rx=0 tx=0).stop 2024-09-05T13:01:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 -- 172.21.15.73:0/436829997 shutdown_connections 2024-09-05T13:01:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f39940a2cb0 0x7f39940a5170 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39a41013c0 0x7f39a41a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a40694a0 0x7f39a4071080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 --2- 172.21.15.73:0/436829997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4069010 0x7f39a4070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 -- 172.21.15.73:0/436829997 >> 172.21.15.73:0/436829997 conn(0x7f39a40fb930 msgr2=0x7f39a40fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 -- 172.21.15.73:0/436829997 shutdown_connections 2024-09-05T13:01:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:01:55.074+0000 7f39aaba6640 1 -- 172.21.15.73:0/436829997 wait complete. 2024-09-05T13:01:55.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:55 smithi073 ceph-mon[30883]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.4 MiB/s wr, 2.11k op/s 2024-09-05T13:01:55.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:55 smithi162 ceph-mon[34220]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.4 MiB/s wr, 2.11k op/s 2024-09-05T13:01:55.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:55 smithi169 ceph-mon[34823]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.4 MiB/s wr, 2.11k op/s 2024-09-05T13:01:56.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:56 smithi073 ceph-mon[30883]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.51k op/s 2024-09-05T13:01:56.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:56 smithi162 ceph-mon[34220]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.51k op/s 2024-09-05T13:01:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:56 smithi169 ceph-mon[34823]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.51k op/s 2024-09-05T13:01:56.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T13:01:57.081 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:01:57.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.645+0000 7f49f8f32640 1 -- 172.21.15.73:0/2663384810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49f41068d0 msgr2=0x7f49f4106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:57.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.645+0000 7f49f8f32640 1 --2- 172.21.15.73:0/2663384810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49f41068d0 0x7f49f4106cb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009930 tx=0x7f49e402a440 comp rx=0 tx=0).stop 2024-09-05T13:01:57.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.645+0000 7f49f8f32640 1 -- 172.21.15.73:0/2663384810 shutdown_connections 2024-09-05T13:01:57.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.645+0000 7f49f8f32640 1 --2- 172.21.15.73:0/2663384810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49f4101270 0x7f49f410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.645+0000 7f49f8f32640 1 --2- 172.21.15.73:0/2663384810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f41008d0 0x7f49f4100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.645+0000 7f49f8f32640 1 --2- 172.21.15.73:0/2663384810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49f41068d0 0x7f49f4106cb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.645+0000 7f49f8f32640 1 -- 172.21.15.73:0/2663384810 >> 172.21.15.73:0/2663384810 conn(0x7f49f40fc610 msgr2=0x7f49f40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:57.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.648+0000 7f49f8f32640 1 -- 172.21.15.73:0/2663384810 shutdown_connections 2024-09-05T13:01:57.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.648+0000 7f49f8f32640 1 -- 172.21.15.73:0/2663384810 wait complete. 2024-09-05T13:01:57.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.649+0000 7f49f8f32640 1 Processor -- start 2024-09-05T13:01:57.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.650+0000 7f49f8f32640 1 -- start start 2024-09-05T13:01:57.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.651+0000 7f49f8f32640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49f41008d0 0x7f49f410a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.651+0000 7f49f8f32640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49f4101270 0x7f49f410adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.651+0000 7f49f8f32640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f41068d0 0x7f49f410b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.651+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49f41008d0 0x7f49f410a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.651+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49f41008d0 0x7f49f410a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:44818/0 (socket says 172.21.15.73:44818) 2024-09-05T13:01:57.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.651+0000 7f49f37fe640 1 -- 172.21.15.73:0/81074747 learned_addr learned my addr 172.21.15.73:0/81074747 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:57.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.651+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f49f406c660 con 0x7f49f4101270 2024-09-05T13:01:57.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.651+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f49f406c4e0 con 0x7f49f41068d0 2024-09-05T13:01:57.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.652+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f49f406c7e0 con 0x7f49f41008d0 2024-09-05T13:01:57.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.654+0000 7f49f3fff640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f41068d0 0x7f49f410b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.654+0000 7f49f37fe640 1 -- 172.21.15.73:0/81074747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f41068d0 msgr2=0x7f49f410b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:57.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.654+0000 7f49f37fe640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f41068d0 0x7f49f410b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.654+0000 7f49f37fe640 1 -- 172.21.15.73:0/81074747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49f4101270 msgr2=0x7f49f410adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:57.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.654+0000 7f49f37fe640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49f4101270 0x7f49f410adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.654+0000 7f49f37fe640 1 -- 172.21.15.73:0/81074747 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f41af0a0 con 0x7f49f41008d0 2024-09-05T13:01:57.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.655+0000 7f49f37fe640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49f41008d0 0x7f49f410a8b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009230 tx=0x7f49e4004b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:57.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.655+0000 7f49f0ff9640 1 -- 172.21.15.73:0/81074747 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4040070 con 0x7f49f41008d0 2024-09-05T13:01:57.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.656+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f41af330 con 0x7f49f41008d0 2024-09-05T13:01:57.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.656+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f41af7e0 con 0x7f49f41008d0 2024-09-05T13:01:57.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.656+0000 7f49f0ff9640 1 -- 172.21.15.73:0/81074747 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49e4031c80 con 0x7f49f41008d0 2024-09-05T13:01:57.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.656+0000 7f49f0ff9640 1 -- 172.21.15.73:0/81074747 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4035020 con 0x7f49f41008d0 2024-09-05T13:01:57.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.660+0000 7f49f0ff9640 1 -- 172.21.15.73:0/81074747 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f49e4043070 con 0x7f49f41008d0 2024-09-05T13:01:57.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.661+0000 7f49f0ff9640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49dc0a2d50 0x7f49dc0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.662+0000 7f49f0ff9640 1 -- 172.21.15.73:0/81074747 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f49e40f0d40 con 0x7f49f41008d0 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.662+0000 7f49fc56a740 1 Processor -- start 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.662+0000 7f49fc56a740 1 -- start start 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.662+0000 7f49f2ffd640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49dc0a2d50 0x7f49dc0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.662+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe2b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.662+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe2bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.662+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe41150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.662+0000 7f49fc56a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b5fbd912f0 con 0x55b5fbe3ed60 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.662+0000 7f49fc56a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b5fbd38cf0 con 0x55b5fbe2cd60 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.662+0000 7f49fc56a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b5fbd8d2b0 con 0x55b5fbe2b7b0 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe2b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe2b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:37862/0 (socket says 172.21.15.73:37862) 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f37fe640 1 -- 172.21.15.73:0/2136531539 learned_addr learned my addr 172.21.15.73:0/2136531539 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f2ffd640 1 --2- 172.21.15.73:0/2136531539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe2bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f3fff640 1 --2- 172.21.15.73:0/2136531539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe41150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f2ffd640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49dc0a2d50 0x7f49dc0a5210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49f410c070 tx=0x7f49e8009b70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f37fe640 1 -- 172.21.15.73:0/2136531539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe2b7b0 msgr2=0x55b5fbe2bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f37fe640 1 --2- 172.21.15.73:0/2136531539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe2bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f37fe640 1 -- 172.21.15.73:0/2136531539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 msgr2=0x55b5fbe41150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f37fe640 1 --2- 172.21.15.73:0/2136531539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe41150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f37fe640 1 -- 172.21.15.73:0/2136531539 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5fbd1d3a0 con 0x55b5fbe2cd60 2024-09-05T13:01:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.663+0000 7f49f37fe640 1 --2- 172.21.15.73:0/2136531539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe2b270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f49e4005880 tx=0x7f49e402a440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cce2b89c3e0493be server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.664+0000 7f49d9ffb640 1 -- 172.21.15.73:0/2136531539 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e404a040 con 0x55b5fbe2cd60 2024-09-05T13:01:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.664+0000 7f49d9ffb640 1 -- 172.21.15.73:0/2136531539 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49e40bdc70 con 0x55b5fbe2cd60 2024-09-05T13:01:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.664+0000 7f49d9ffb640 1 -- 172.21.15.73:0/2136531539 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4003cc0 con 0x55b5fbe2cd60 2024-09-05T13:01:57.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.665+0000 7f49fc56a740 1 -- 172.21.15.73:0/2136531539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2cd60 msgr2=0x55b5fbe2b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.665+0000 7f49fc56a740 1 --2- 172.21.15.73:0/2136531539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe2b270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f49e4005880 tx=0x7f49e402a440 comp rx=0 tx=0).stop 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.665+0000 7f49fc56a740 1 -- 172.21.15.73:0/2136531539 shutdown_connections 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.665+0000 7f49fc56a740 1 --2- 172.21.15.73:0/2136531539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe41150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.665+0000 7f49fc56a740 1 --2- 172.21.15.73:0/2136531539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe2bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.665+0000 7f49fc56a740 1 --2- 172.21.15.73:0/2136531539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe2b270 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.665+0000 7f49fc56a740 1 -- 172.21.15.73:0/2136531539 >> 172.21.15.73:0/2136531539 conn(0x55b5fbdf4310 msgr2=0x55b5fbe27e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.665+0000 7f49fc56a740 1 -- 172.21.15.73:0/2136531539 shutdown_connections 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.665+0000 7f49fc56a740 1 -- 172.21.15.73:0/2136531539 wait complete. 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.666+0000 7f49fc56a740 1 -- start start 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.666+0000 7f49fc56a740 1 Processor -- start 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.667+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe383e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.667+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe38920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.667+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe3e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.667+0000 7f49fc56a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b5fbe2e6e0 con 0x55b5fbe3ed60 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.667+0000 7f49fc56a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b5fbd4c060 con 0x55b5fbe2b7b0 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.667+0000 7f49fc56a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b5fbe2e860 con 0x55b5fbe2cd60 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.667+0000 7f49fc56a740 10 client.0 _ll_register_callbacks cb 0x55b5fba9f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.667+0000 7f49f3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe3e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.667+0000 7f49f3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe3e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39132/0 (socket says 172.21.15.73:39132) 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.667+0000 7f49f3fff640 1 -- 172.21.15.73:0/799536664 learned_addr learned my addr 172.21.15.73:0/799536664 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.668+0000 7f49f3fff640 1 -- 172.21.15.73:0/799536664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe2cd60 msgr2=0x55b5fbe38920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.668+0000 7f49f3fff640 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe38920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.668+0000 7f49f3fff640 1 -- 172.21.15.73:0/799536664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 msgr2=0x55b5fbe383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.668+0000 7f49f3fff640 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.668+0000 7f49f3fff640 1 -- 172.21.15.73:0/799536664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5fbb023c0 con 0x55b5fbe3ed60 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.668+0000 7f49f3fff640 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe3e0f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00abc0 tx=0x7f49ec0072b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c93e0984eae4abb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:57.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.668+0000 7f49d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:57.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.669+0000 7f49d2ffd640 1 -- 172.21.15.73:0/799536664 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec01b060 con 0x55b5fbe3ed60 2024-09-05T13:01:57.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.669+0000 7f49d2ffd640 1 -- 172.21.15.73:0/799536664 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f49ec016440 con 0x55b5fbe3ed60 2024-09-05T13:01:57.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.669+0000 7f49fc56a740 1 -- 172.21.15.73:0/799536664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49e40bdc70 con 0x55b5fbe3ed60 2024-09-05T13:01:57.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.670+0000 7f49d2ffd640 1 -- 172.21.15.73:0/799536664 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f49ec016640 con 0x55b5fbe3ed60 2024-09-05T13:01:57.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.670+0000 7f49fc56a740 10 client.15984 fetch_fsmap learned FSMap version 36 2024-09-05T13:01:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.670+0000 7f49fc56a740 1 -- 172.21.15.73:0/799536664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b5fbe34480 con 0x55b5fbe3ed60 2024-09-05T13:01:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.671+0000 7f49d2ffd640 1 -- 172.21.15.73:0/799536664 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49ec016cc0 con 0x55b5fbe3ed60 2024-09-05T13:01:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.671+0000 7f49d2ffd640 1 -- 172.21.15.73:0/799536664 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 36) ==== 8358+0+0 (secure 0 0 0) 0x7f49ec015b80 con 0x55b5fbe3ed60 2024-09-05T13:01:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.671+0000 7f49fc56a740 10 client.15984 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T13:01:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.671+0000 7f49fc56a740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.671+0000 7f49fc56a740 20 client.15984 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.671+0000 7f49fc56a740 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b5fbe56e80 0x55b5fbe592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.671+0000 7f49fc56a740 4 client.15984 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:01:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.671+0000 7f49fc56a740 1 -- 172.21.15.73:0/799536664 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f49e40bdc70 con 0x55b5fbe56e80 2024-09-05T13:01:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.672+0000 7f49f37fe640 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b5fbe56e80 0x55b5fbe592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.678+0000 7f49f37fe640 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b5fbe56e80 0x55b5fbe592f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3621b7c166c7dd42 server_cookie=a470d2d1c480daec in_seq=0 out_seq=0 2024-09-05T13:01:57.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.679+0000 7f49d2ffd640 10 client.15984 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.680+0000 7f49d2ffd640 1 -- 172.21.15.73:0/799536664 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f49e40bdc70 con 0x55b5fbe56e80 2024-09-05T13:01:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.680+0000 7f49d2ffd640 10 client.15984 handle_command_reply: tid=0 2024-09-05T13:01:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.680+0000 7f49fc56a740 1 client.15984 shutdown 2024-09-05T13:01:57.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.684+0000 7f49fc56a740 1 -- 172.21.15.73:0/799536664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 msgr2=0x55b5fbe3e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.684+0000 7f49fc56a740 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe3e0f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00abc0 tx=0x7f49ec0072b0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.684+0000 7f49fc56a740 1 -- 172.21.15.73:0/799536664 shutdown_connections 2024-09-05T13:01:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.684+0000 7f49fc56a740 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b5fbe56e80 0x55b5fbe592f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.684+0000 7f49d2ffd640 0 client.15984 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.684+0000 7f49fc56a740 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe3e0f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.684+0000 7f49fc56a740 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe38920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.684+0000 7f49fc56a740 1 --2- 172.21.15.73:0/799536664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.684+0000 7f49fc56a740 1 -- 172.21.15.73:0/799536664 >> 172.21.15.73:0/799536664 conn(0x55b5fbdf4310 msgr2=0x55b5fbe2db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.685+0000 7f49fc56a740 1 -- 172.21.15.73:0/799536664 shutdown_connections 2024-09-05T13:01:57.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.686+0000 7f49fc56a740 1 -- 172.21.15.73:0/799536664 wait complete. 2024-09-05T13:01:57.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.687+0000 7f49fc56a740 20 client.15984 trim_cache size 0 max 16384 2024-09-05T13:01:57.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.709+0000 7f49fc56a740 1 Processor -- start 2024-09-05T13:01:57.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49fc56a740 1 -- start start 2024-09-05T13:01:57.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe3e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe5ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe5f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49fc56a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f49e0010d80 con 0x55b5fbe2cd60 2024-09-05T13:01:57.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49fc56a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f49e000e620 con 0x55b5fbe2b7b0 2024-09-05T13:01:57.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49fc56a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f49e000c470 con 0x55b5fbe3ed60 2024-09-05T13:01:57.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe3e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe3e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:37882/0 (socket says 172.21.15.73:37882) 2024-09-05T13:01:57.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49f37fe640 1 -- 172.21.15.73:0/2211881356 learned_addr learned my addr 172.21.15.73:0/2211881356 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:57.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49f3fff640 1 --2- 172.21.15.73:0/2211881356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe5f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49f37fe640 1 -- 172.21.15.73:0/2211881356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe3ed60 msgr2=0x55b5fbe5f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:57.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49f37fe640 1 --2- 172.21.15.73:0/2211881356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe5f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49f37fe640 1 -- 172.21.15.73:0/2211881356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe2cd60 msgr2=0x55b5fbe5ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:57.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49f37fe640 1 --2- 172.21.15.73:0/2211881356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe5ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.710+0000 7f49f37fe640 1 -- 172.21.15.73:0/2211881356 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5fbe34950 con 0x55b5fbe2b7b0 2024-09-05T13:01:57.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.711+0000 7f49f37fe640 1 --2- 172.21.15.73:0/2211881356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe3e060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49e40b99d0 tx=0x7f49e403c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=213c77400c80dde4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:57.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.713+0000 7f49d97fa640 1 -- 172.21.15.73:0/2211881356 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e404a040 con 0x55b5fbe2b7b0 2024-09-05T13:01:57.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.713+0000 7f49d97fa640 1 -- 172.21.15.73:0/2211881356 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49e40bdc70 con 0x55b5fbe2b7b0 2024-09-05T13:01:57.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.713+0000 7f49d97fa640 1 -- 172.21.15.73:0/2211881356 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4003cc0 con 0x55b5fbe2b7b0 2024-09-05T13:01:57.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.714+0000 7f49fc56a740 1 -- 172.21.15.73:0/2211881356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 msgr2=0x55b5fbe3e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:57.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.714+0000 7f49fc56a740 1 --2- 172.21.15.73:0/2211881356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe3e060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49e40b99d0 tx=0x7f49e403c000 comp rx=0 tx=0).stop 2024-09-05T13:01:57.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.714+0000 7f49fc56a740 1 -- 172.21.15.73:0/2211881356 shutdown_connections 2024-09-05T13:01:57.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.714+0000 7f49fc56a740 1 --2- 172.21.15.73:0/2211881356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe5f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.714+0000 7f49fc56a740 1 --2- 172.21.15.73:0/2211881356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe5ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.714+0000 7f49fc56a740 1 --2- 172.21.15.73:0/2211881356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe3e060 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.714+0000 7f49fc56a740 1 -- 172.21.15.73:0/2211881356 >> 172.21.15.73:0/2211881356 conn(0x55b5fbdf4310 msgr2=0x55b5fbe383e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:57.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.715+0000 7f49fc56a740 1 -- 172.21.15.73:0/2211881356 shutdown_connections 2024-09-05T13:01:57.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.715+0000 7f49fc56a740 1 -- 172.21.15.73:0/2211881356 wait complete. 2024-09-05T13:01:57.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.715+0000 7f49fc56a740 1 -- start start 2024-09-05T13:01:57.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49fc56a740 1 Processor -- start 2024-09-05T13:01:57.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe67060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49fc56a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe6a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49fc56a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f49e000cae0 con 0x55b5fbe2cd60 2024-09-05T13:01:57.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49fc56a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f49e000df50 con 0x55b5fbe2b7b0 2024-09-05T13:01:57.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe67060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe67060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:37886/0 (socket says 172.21.15.73:37886) 2024-09-05T13:01:57.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49f37fe640 1 -- 172.21.15.73:0/3281557364 learned_addr learned my addr 172.21.15.73:0/3281557364 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:01:57.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49fc56a740 1 -- 172.21.15.73:0/3281557364 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f49e000d1b0 con 0x55b5fbe3ed60 2024-09-05T13:01:57.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.716+0000 7f49fc56a740 10 client.0 _ll_register_callbacks cb 0x7f49ec009770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:01:57.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.717+0000 7f49f2ffd640 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.717+0000 7f49f3fff640 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe6a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.717+0000 7f49f2ffd640 1 -- 172.21.15.73:0/3281557364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe3ed60 msgr2=0x55b5fbe6a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:57.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.717+0000 7f49f2ffd640 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe6a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.717+0000 7f49f2ffd640 1 -- 172.21.15.73:0/3281557364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 msgr2=0x55b5fbe67060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:01:57.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.717+0000 7f49f2ffd640 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe67060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.717+0000 7f49f2ffd640 1 -- 172.21.15.73:0/3281557364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5fbe6adc0 con 0x55b5fbe2cd60 2024-09-05T13:01:57.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.718+0000 7f49f2ffd640 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe675a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55b5fbe34d40 tx=0x7f49e80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f23e97980efe13 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:01:57.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.718+0000 7f49d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:01:57.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.718+0000 7f49d2ffd640 1 -- 172.21.15.73:0/3281557364 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e800f040 con 0x55b5fbe2cd60 2024-09-05T13:01:57.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.718+0000 7f49d2ffd640 1 -- 172.21.15.73:0/3281557364 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f49e8016c20 con 0x55b5fbe2cd60 2024-09-05T13:01:57.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.719+0000 7f49fc56a740 1 -- 172.21.15.73:0/3281557364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49e40bdc70 con 0x55b5fbe2cd60 2024-09-05T13:01:57.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.719+0000 7f49d2ffd640 1 -- 172.21.15.73:0/3281557364 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f49e8016e40 con 0x55b5fbe2cd60 2024-09-05T13:01:57.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.719+0000 7f49fc56a740 10 client.15987 fetch_fsmap learned FSMap version 36 2024-09-05T13:01:57.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.719+0000 7f49fc56a740 1 -- 172.21.15.73:0/3281557364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b5fbec25d0 con 0x55b5fbe2cd60 2024-09-05T13:01:57.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.720+0000 7f49d2ffd640 1 -- 172.21.15.73:0/3281557364 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49e801f8f0 con 0x55b5fbe2cd60 2024-09-05T13:01:57.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.720+0000 7f49d2ffd640 1 -- 172.21.15.73:0/3281557364 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 36) ==== 8358+0+0 (secure 0 0 0) 0x7f49e8027030 con 0x55b5fbe2cd60 2024-09-05T13:01:57.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.721+0000 7f49fc56a740 10 client.15987 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T13:01:57.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.721+0000 7f49fc56a740 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:01:57.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.721+0000 7f49fc56a740 20 client.15987 populate_metadata read hostname 'smithi073' 2024-09-05T13:01:57.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.721+0000 7f49fc56a740 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b5fbe56e80 0x55b5fbec4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:01:57.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.721+0000 7f49fc56a740 4 client.15987 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:01:57.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.721+0000 7f49fc56a740 1 -- 172.21.15.73:0/3281557364 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f49e40bdc70 con 0x55b5fbe56e80 2024-09-05T13:01:57.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.722+0000 7f49f37fe640 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b5fbe56e80 0x55b5fbec4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:01:57.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.725+0000 7f49f37fe640 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b5fbe56e80 0x55b5fbec4d90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23978681d3a1cdbd server_cookie=34293e752ee2a59f in_seq=0 out_seq=0 2024-09-05T13:01:57.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.725+0000 7f49d2ffd640 10 client.15987 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:57.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.725+0000 7f49d2ffd640 1 -- 172.21.15.73:0/3281557364 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f49e40bdc70 con 0x55b5fbe56e80 2024-09-05T13:01:57.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.725+0000 7f49d2ffd640 10 client.15987 handle_command_reply: tid=0 2024-09-05T13:01:57.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.725+0000 7f49fc56a740 1 client.15987 shutdown 2024-09-05T13:01:57.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.725+0000 7f49fc56a740 1 -- 172.21.15.73:0/3281557364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe2cd60 msgr2=0x55b5fbe675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:57.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.725+0000 7f49fc56a740 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe675a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55b5fbe34d40 tx=0x7f49e80047d0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.726+0000 7f49fc56a740 1 -- 172.21.15.73:0/3281557364 shutdown_connections 2024-09-05T13:01:57.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.726+0000 7f49fc56a740 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b5fbe56e80 0x55b5fbec4d90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.726+0000 7f49d2ffd640 0 client.15987 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:01:57.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.726+0000 7f49fc56a740 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5fbe3ed60 0x55b5fbe6a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.726+0000 7f49fc56a740 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b5fbe2cd60 0x55b5fbe675a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.726+0000 7f49fc56a740 1 --2- 172.21.15.73:0/3281557364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5fbe2b7b0 0x55b5fbe67060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.726+0000 7f49fc56a740 1 -- 172.21.15.73:0/3281557364 >> 172.21.15.73:0/3281557364 conn(0x55b5fbdf4310 msgr2=0x55b5fbe26780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:57.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.729+0000 7f49fc56a740 1 -- 172.21.15.73:0/3281557364 shutdown_connections 2024-09-05T13:01:57.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.730+0000 7f49fc56a740 1 -- 172.21.15.73:0/3281557364 wait complete. 2024-09-05T13:01:57.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.730+0000 7f49fc56a740 20 client.15987 trim_cache size 0 max 16384 2024-09-05T13:01:57.732 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:01:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.734+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49dc0a2d50 msgr2=0x7f49dc0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.734+0000 7f49f8f32640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49dc0a2d50 0x7f49dc0a5210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49f410c070 tx=0x7f49e8009b70 comp rx=0 tx=0).stop 2024-09-05T13:01:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.734+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49f41008d0 msgr2=0x7f49f410a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:01:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.734+0000 7f49f8f32640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49f41008d0 0x7f49f410a8b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009230 tx=0x7f49e4004b80 comp rx=0 tx=0).stop 2024-09-05T13:01:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.734+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 shutdown_connections 2024-09-05T13:01:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.734+0000 7f49f8f32640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f49dc0a2d50 0x7f49dc0a5210 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49f410c070 tx=0x7f49e8009b70 comp rx=0 tx=0).stop 2024-09-05T13:01:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.734+0000 7f49f8f32640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f41068d0 0x7f49f410b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.734+0000 7f49f8f32640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49f4101270 0x7f49f410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.734+0000 7f49f8f32640 1 --2- 172.21.15.73:0/81074747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49f41008d0 0x7f49f410a8b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:01:57.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.735+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 >> 172.21.15.73:0/81074747 conn(0x7f49f40fc610 msgr2=0x7f49f4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:01:57.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.737+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 shutdown_connections 2024-09-05T13:01:57.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:01:57.737+0000 7f49f8f32640 1 -- 172.21.15.73:0/81074747 wait complete. 2024-09-05T13:01:58.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:58 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:01:58.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:01:58 smithi073 ceph-mon[30883]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 5.22k op/s 2024-09-05T13:01:58.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:58 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:01:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:01:58 smithi162 ceph-mon[34220]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 5.22k op/s 2024-09-05T13:01:58.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:58 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:01:58.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:01:58 smithi169 ceph-mon[34823]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 5.22k op/s 2024-09-05T13:01:59.595 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T13:01:59.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T13:02:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:02:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:01 smithi073 ceph-mon[30883]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 5.05k op/s 2024-09-05T13:02:01.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:01 smithi162 ceph-mon[34220]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 5.05k op/s 2024-09-05T13:02:01.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:01 smithi169 ceph-mon[34823]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 5.05k op/s 2024-09-05T13:02:02.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:02 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:02.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:02 smithi073 ceph-mon[30883]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 MiB/s wr, 7.92k op/s 2024-09-05T13:02:02.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:02 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:02.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:02 smithi162 ceph-mon[34220]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 MiB/s wr, 7.92k op/s 2024-09-05T13:02:02.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:02 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:02.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:02 smithi169 ceph-mon[34823]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 MiB/s wr, 7.92k op/s 2024-09-05T13:02:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:05 smithi073 ceph-mon[30883]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 7.64k op/s 2024-09-05T13:02:05.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:05 smithi162 ceph-mon[34220]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 7.64k op/s 2024-09-05T13:02:05.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:05 smithi169 ceph-mon[34823]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 7.64k op/s 2024-09-05T13:02:07.170 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:07 smithi073 ceph-mon[30883]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 8.69k op/s 2024-09-05T13:02:07.363 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:02:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2024-09-05T13:02:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "cc91a846-52ed-44f4-ac41-016c1563727c", 2024-09-05T13:02:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2024-09-05T13:02:07.364 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:02:07.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.899+0000 7fae15ffb640 1 -- 172.21.15.73:0/1088792670 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c02f300 con 0x7fae181091f0 2024-09-05T13:02:07.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.899+0000 7fae1d493640 1 -- 172.21.15.73:0/1088792670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae181091f0 msgr2=0x7fae181095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:07.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.899+0000 7fae1d493640 1 --2- 172.21.15.73:0/1088792670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae181091f0 0x7fae181095d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009860 tx=0x7fae0c02a3d0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.899+0000 7fae1d493640 1 -- 172.21.15.73:0/1088792670 shutdown_connections 2024-09-05T13:02:07.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.899+0000 7fae1d493640 1 --2- 172.21.15.73:0/1088792670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18114ab0 0x7fae18116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.899+0000 7fae1d493640 1 --2- 172.21.15.73:0/1088792670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18109b10 0x7fae18114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.899+0000 7fae1d493640 1 --2- 172.21.15.73:0/1088792670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae181091f0 0x7fae181095d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.899+0000 7fae1d493640 1 -- 172.21.15.73:0/1088792670 >> 172.21.15.73:0/1088792670 conn(0x7fae1806e140 msgr2=0x7fae1806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:07.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.899+0000 7fae1d493640 1 -- 172.21.15.73:0/1088792670 shutdown_connections 2024-09-05T13:02:07.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.900+0000 7fae1d493640 1 -- 172.21.15.73:0/1088792670 wait complete. 2024-09-05T13:02:07.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.901+0000 7fae1d493640 1 Processor -- start 2024-09-05T13:02:07.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.901+0000 7fae1d493640 1 -- start start 2024-09-05T13:02:07.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.901+0000 7fae1d493640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae181091f0 0x7fae18113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.901+0000 7fae1d493640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18109b10 0x7fae18114400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.901+0000 7fae1d493640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18114ab0 0x7fae1810af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.901+0000 7fae1d493640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae1811a7f0 con 0x7fae181091f0 2024-09-05T13:02:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.901+0000 7fae1d493640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae1811a670 con 0x7fae18109b10 2024-09-05T13:02:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.901+0000 7fae1d493640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae1811a970 con 0x7fae18114ab0 2024-09-05T13:02:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fae16ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae181091f0 0x7fae18113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fae16ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae181091f0 0x7fae18113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44628/0 (socket says 172.21.15.73:44628) 2024-09-05T13:02:07.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fae16ffd640 1 -- 172.21.15.73:0/4095856801 learned_addr learned my addr 172.21.15.73:0/4095856801 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:07.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fae167fc640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18109b10 0x7fae18114400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fae16ffd640 1 -- 172.21.15.73:0/4095856801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18114ab0 msgr2=0x7fae1810af30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T13:02:07.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fae16ffd640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18114ab0 0x7fae1810af30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fae16ffd640 1 -- 172.21.15.73:0/4095856801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18109b10 msgr2=0x7fae18114400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fae16ffd640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18109b10 0x7fae18114400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fae16ffd640 1 -- 172.21.15.73:0/4095856801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1810b840 con 0x7fae181091f0 2024-09-05T13:02:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fae16ffd640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae181091f0 0x7fae18113ec0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fae0c000c00 tx=0x7fae0c030920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.902+0000 7fadfffff640 1 -- 172.21.15.73:0/4095856801 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c004440 con 0x7fae181091f0 2024-09-05T13:02:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.903+0000 7fae1d493640 1 -- 172.21.15.73:0/4095856801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1810ba70 con 0x7fae181091f0 2024-09-05T13:02:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.903+0000 7fae1d493640 1 -- 172.21.15.73:0/4095856801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1810fae0 con 0x7fae181091f0 2024-09-05T13:02:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.903+0000 7fadfffff640 1 -- 172.21.15.73:0/4095856801 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae0c005620 con 0x7fae181091f0 2024-09-05T13:02:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.903+0000 7fadfffff640 1 -- 172.21.15.73:0/4095856801 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0035f0 con 0x7fae181091f0 2024-09-05T13:02:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.908+0000 7fae1f869740 1 Processor -- start 2024-09-05T13:02:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.909+0000 7fadfffff640 1 -- 172.21.15.73:0/4095856801 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fae0c039040 con 0x7fae181091f0 2024-09-05T13:02:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.910+0000 7fadfffff640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2bc0 0x7fae000a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.910+0000 7fadfffff640 1 -- 172.21.15.73:0/4095856801 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fae0c0f0210 con 0x7fae181091f0 2024-09-05T13:02:07.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.911+0000 7fae1f869740 1 -- start start 2024-09-05T13:02:07.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.911+0000 7fae1f869740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7eb60 0x559723c7ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.911+0000 7fae1f869740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7f480 0x559723c89800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.911+0000 7fae1f869740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c89d40 0x559723c8c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.911+0000 7fae1f869740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559723be4280 con 0x559723c7f480 2024-09-05T13:02:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.911+0000 7fae1f869740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559723b8bb10 con 0x559723c89d40 2024-09-05T13:02:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.911+0000 7fae1f869740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559723be0240 con 0x559723c7eb60 2024-09-05T13:02:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.912+0000 7fae167fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7f480 0x559723c89800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.912+0000 7fae167fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7f480 0x559723c89800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44644/0 (socket says 172.21.15.73:44644) 2024-09-05T13:02:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.912+0000 7fae167fc640 1 -- 172.21.15.73:0/3951332949 learned_addr learned my addr 172.21.15.73:0/3951332949 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.912+0000 7fae167fc640 1 -- 172.21.15.73:0/3951332949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7eb60 msgr2=0x559723c7ef40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:07.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.912+0000 7fae167fc640 1 --2- 172.21.15.73:0/3951332949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7eb60 0x559723c7ef40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.912+0000 7fae167fc640 1 -- 172.21.15.73:0/3951332949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c89d40 msgr2=0x559723c8c130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:07.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.912+0000 7fae167fc640 1 --2- 172.21.15.73:0/3951332949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c89d40 0x559723c8c130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.912+0000 7fae167fc640 1 -- 172.21.15.73:0/3951332949 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559723b981f0 con 0x559723c7f480 2024-09-05T13:02:07.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.912+0000 7fae167fc640 1 --2- 172.21.15.73:0/3951332949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7f480 0x559723c89800 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fae10009fd0 tx=0x7fae100118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f198aa82f5661cd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:07.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.912+0000 7fae177fe640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2bc0 0x7fae000a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.922+0000 7fadfd7fa640 1 -- 172.21.15.73:0/3951332949 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10004d20 con 0x559723c7f480 2024-09-05T13:02:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.922+0000 7fadfd7fa640 1 -- 172.21.15.73:0/3951332949 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae10004050 con 0x559723c7f480 2024-09-05T13:02:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.922+0000 7fadfd7fa640 1 -- 172.21.15.73:0/3951332949 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10005280 con 0x559723c7f480 2024-09-05T13:02:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.924+0000 7fae1f869740 1 -- 172.21.15.73:0/3951332949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7f480 msgr2=0x559723c89800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.924+0000 7fae1f869740 1 --2- 172.21.15.73:0/3951332949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7f480 0x559723c89800 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fae10009fd0 tx=0x7fae100118d0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.924+0000 7fae177fe640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2bc0 0x7fae000a5080 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x559723c7c470 tx=0x7fae08009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.925+0000 7fae1f869740 1 -- 172.21.15.73:0/3951332949 shutdown_connections 2024-09-05T13:02:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.925+0000 7fae1f869740 1 --2- 172.21.15.73:0/3951332949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c89d40 0x559723c8c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.925+0000 7fae1f869740 1 --2- 172.21.15.73:0/3951332949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7f480 0x559723c89800 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.925+0000 7fae1f869740 1 --2- 172.21.15.73:0/3951332949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7eb60 0x559723c7ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.925+0000 7fae1f869740 1 -- 172.21.15.73:0/3951332949 >> 172.21.15.73:0/3951332949 conn(0x559723c7b0f0 msgr2=0x559723c7b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:07.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.926+0000 7fae1f869740 1 -- 172.21.15.73:0/3951332949 shutdown_connections 2024-09-05T13:02:07.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.928+0000 7fae1f869740 1 -- 172.21.15.73:0/3951332949 wait complete. 2024-09-05T13:02:07.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.929+0000 7fae1f869740 1 -- start start 2024-09-05T13:02:07.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.929+0000 7fae1f869740 1 Processor -- start 2024-09-05T13:02:07.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.929+0000 7fae1f869740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7eb60 0x559723c86c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae1f869740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c7f480 0x559723c871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae1f869740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c87700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae1f869740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559723c8c910 con 0x559723c89d40 2024-09-05T13:02:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae167fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c7f480 0x559723c871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae167fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c7f480 0x559723c871c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:59784/0 (socket says 172.21.15.73:59784) 2024-09-05T13:02:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae167fc640 1 -- 172.21.15.73:0/2017154241 learned_addr learned my addr 172.21.15.73:0/2017154241 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae1f869740 1 -- 172.21.15.73:0/2017154241 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559723b9ef10 con 0x559723c7f480 2024-09-05T13:02:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae177fe640 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c87700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae1f869740 1 -- 172.21.15.73:0/2017154241 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559723c8ca90 con 0x559723c7eb60 2024-09-05T13:02:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae16ffd640 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7eb60 0x559723c86c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.930+0000 7fae1f869740 10 client.0 _ll_register_callbacks cb 0x559723b67a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.931+0000 7fae177fe640 1 -- 172.21.15.73:0/2017154241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7eb60 msgr2=0x559723c86c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.931+0000 7fae177fe640 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7eb60 0x559723c86c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.931+0000 7fae177fe640 1 -- 172.21.15.73:0/2017154241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c7f480 msgr2=0x559723c871c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.931+0000 7fae177fe640 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c7f480 0x559723c871c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.931+0000 7fae177fe640 1 -- 172.21.15.73:0/2017154241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597239556a0 con 0x559723c89d40 2024-09-05T13:02:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.932+0000 7fae177fe640 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c87700 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fae08005fd0 tx=0x7fae08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5380d25f104b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.932+0000 7fadfaff5640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:02:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.932+0000 7fadfaff5640 1 -- 172.21.15.73:0/2017154241 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08020070 con 0x559723c89d40 2024-09-05T13:02:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.932+0000 7fadfaff5640 1 -- 172.21.15.73:0/2017154241 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fae08005220 con 0x559723c89d40 2024-09-05T13:02:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.932+0000 7fae1f869740 1 -- 172.21.15.73:0/2017154241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae10004050 con 0x559723c89d40 2024-09-05T13:02:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.933+0000 7fadfaff5640 1 -- 172.21.15.73:0/2017154241 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fae0802b070 con 0x559723c89d40 2024-09-05T13:02:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.938+0000 7fae1f869740 10 client.15999 fetch_fsmap learned FSMap version 38 2024-09-05T13:02:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.938+0000 7fae1f869740 1 -- 172.21.15.73:0/2017154241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559723c98660 con 0x559723c89d40 2024-09-05T13:02:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.940+0000 7fadfaff5640 1 -- 172.21.15.73:0/2017154241 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae10004050 con 0x559723c89d40 2024-09-05T13:02:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.940+0000 7fadfaff5640 1 -- 172.21.15.73:0/2017154241 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7fae0801c7b0 con 0x559723c89d40 2024-09-05T13:02:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.941+0000 7fae1f869740 10 client.15999 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T13:02:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.941+0000 7fae1f869740 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.941+0000 7fae1f869740 20 client.15999 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.941+0000 7fae1f869740 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559723c99fa0 0x559723c9c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.941+0000 7fae1f869740 4 client.15999 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:02:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.941+0000 7fae1f869740 1 -- 172.21.15.73:0/2017154241 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559723bf17f0 con 0x559723c99fa0 2024-09-05T13:02:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.942+0000 7fae16ffd640 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559723c99fa0 0x559723c9c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.947+0000 7fae16ffd640 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559723c99fa0 0x559723c9c420 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=137b17971ea76c48 server_cookie=7ab102428b5474d1 in_seq=0 out_seq=0 2024-09-05T13:02:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.947+0000 7fadfaff5640 10 client.15999 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.948+0000 7fadfaff5640 1 -- 172.21.15.73:0/2017154241 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559723bf17f0 con 0x559723c99fa0 2024-09-05T13:02:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.948+0000 7fadfaff5640 10 client.15999 handle_command_reply: tid=0 2024-09-05T13:02:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.948+0000 7fae1f869740 1 client.15999 shutdown 2024-09-05T13:02:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.954+0000 7fae1f869740 1 -- 172.21.15.73:0/2017154241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 msgr2=0x559723c87700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.954+0000 7fae1f869740 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c87700 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fae08005fd0 tx=0x7fae08004730 comp rx=0 tx=0).stop 2024-09-05T13:02:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.954+0000 7fae1f869740 1 -- 172.21.15.73:0/2017154241 shutdown_connections 2024-09-05T13:02:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.954+0000 7fae1f869740 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559723c99fa0 0x559723c9c420 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.954+0000 7fae1f869740 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c87700 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.954+0000 7fae1f869740 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c7f480 0x559723c871c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.954+0000 7fae1f869740 1 --2- 172.21.15.73:0/2017154241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7eb60 0x559723c86c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.954+0000 7fadfaff5640 0 client.15999 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.954+0000 7fae1f869740 1 -- 172.21.15.73:0/2017154241 >> 172.21.15.73:0/2017154241 conn(0x559723c7b0f0 msgr2=0x559723c80e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.955+0000 7fae1f869740 1 -- 172.21.15.73:0/2017154241 shutdown_connections 2024-09-05T13:02:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.955+0000 7fae1f869740 1 -- 172.21.15.73:0/2017154241 wait complete. 2024-09-05T13:02:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.955+0000 7fae1f869740 20 client.15999 trim_cache size 0 max 16384 2024-09-05T13:02:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.987+0000 7fae1f869740 1 Processor -- start 2024-09-05T13:02:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae1f869740 1 -- start start 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae1f869740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c7eb60 0x559723ca1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae1f869740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 0x559723ca2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae1f869740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c83ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae1f869740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae04010de0 con 0x559723c89d40 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae1f869740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae0400e620 con 0x559723c7eb60 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae1f869740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae0400c470 con 0x559723c7f480 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae177fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c83ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae177fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c83ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44664/0 (socket says 172.21.15.73:44664) 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae177fe640 1 -- 172.21.15.73:0/4125459405 learned_addr learned my addr 172.21.15.73:0/4125459405 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.988+0000 7fae167fc640 1 --2- 172.21.15.73:0/4125459405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 0x559723ca2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.989+0000 7fae177fe640 1 -- 172.21.15.73:0/4125459405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 msgr2=0x559723ca2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.989+0000 7fae177fe640 1 --2- 172.21.15.73:0/4125459405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 0x559723ca2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.989+0000 7fae177fe640 1 -- 172.21.15.73:0/4125459405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c7eb60 msgr2=0x559723ca1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.989+0000 7fae177fe640 1 --2- 172.21.15.73:0/4125459405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c7eb60 0x559723ca1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.989+0000 7fae177fe640 1 -- 172.21.15.73:0/4125459405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559723c7ab90 con 0x559723c89d40 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.989+0000 7fae177fe640 1 --2- 172.21.15.73:0/4125459405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c83ee0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fae0801cb80 tx=0x7fae08004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca40d607a4814ad server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.989+0000 7fadfcff9640 1 -- 172.21.15.73:0/4125459405 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0803d070 con 0x559723c89d40 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.989+0000 7fadfcff9640 1 -- 172.21.15.73:0/4125459405 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae0801c830 con 0x559723c89d40 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.989+0000 7fadfcff9640 1 -- 172.21.15.73:0/4125459405 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08020040 con 0x559723c89d40 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.990+0000 7fae1f869740 1 -- 172.21.15.73:0/4125459405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 msgr2=0x559723c83ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.990+0000 7fae1f869740 1 --2- 172.21.15.73:0/4125459405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c83ee0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fae0801cb80 tx=0x7fae08004660 comp rx=0 tx=0).stop 2024-09-05T13:02:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.995+0000 7fae1f869740 1 -- 172.21.15.73:0/4125459405 shutdown_connections 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.995+0000 7fae1f869740 1 --2- 172.21.15.73:0/4125459405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c89d40 0x559723c83ee0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.995+0000 7fae1f869740 1 --2- 172.21.15.73:0/4125459405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 0x559723ca2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.995+0000 7fae1f869740 1 --2- 172.21.15.73:0/4125459405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c7eb60 0x559723ca1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.995+0000 7fae1f869740 1 -- 172.21.15.73:0/4125459405 >> 172.21.15.73:0/4125459405 conn(0x559723c7b0f0 msgr2=0x559723c88bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.995+0000 7fae1f869740 1 -- 172.21.15.73:0/4125459405 shutdown_connections 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.995+0000 7fae1f869740 1 -- 172.21.15.73:0/4125459405 wait complete. 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.995+0000 7fae1f869740 1 -- start start 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.995+0000 7fae1f869740 1 Processor -- start 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.996+0000 7fae1f869740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7eb60 0x559723c8e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.996+0000 7fae1f869740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 0x559723c8e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.996+0000 7fae1f869740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c89d40 0x559723d03cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.996+0000 7fae1f869740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae0400cae0 con 0x559723c7eb60 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.996+0000 7fae167fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 0x559723c8e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.996+0000 7fae167fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 0x559723c8e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:52864/0 (socket says 172.21.15.73:52864) 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.996+0000 7fae167fc640 1 -- 172.21.15.73:0/1397451597 learned_addr learned my addr 172.21.15.73:0/1397451597 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.996+0000 7fae1f869740 1 -- 172.21.15.73:0/1397451597 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae0400df50 con 0x559723c89d40 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.996+0000 7fae1f869740 1 -- 172.21.15.73:0/1397451597 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae0400d1b0 con 0x559723c7f480 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.996+0000 7fae177fe640 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c89d40 0x559723d03cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.997+0000 7fae1f869740 10 client.0 _ll_register_callbacks cb 0x7fae08014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.997+0000 7fae167fc640 1 -- 172.21.15.73:0/1397451597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c89d40 msgr2=0x559723d03cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.997+0000 7fae167fc640 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c89d40 0x559723d03cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.997+0000 7fae167fc640 1 -- 172.21.15.73:0/1397451597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7eb60 msgr2=0x559723c8e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.997+0000 7fae167fc640 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7eb60 0x559723c8e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.997+0000 7fae167fc640 1 -- 172.21.15.73:0/1397451597 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559723d04200 con 0x559723c7f480 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:06.999+0000 7fae167fc640 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 0x559723c8e6d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae10009ef0 tx=0x7fae1000f8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cd374cd89e54b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.000+0000 7fadfaff5640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:02:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.001+0000 7fadfaff5640 1 -- 172.21.15.73:0/1397451597 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1000fdc0 con 0x559723c7f480 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.001+0000 7fae1f869740 1 -- 172.21.15.73:0/1397451597 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae0801c830 con 0x559723c7f480 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.001+0000 7fadfaff5640 1 -- 172.21.15.73:0/1397451597 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fae10005000 con 0x559723c7f480 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.003+0000 7fadfaff5640 1 -- 172.21.15.73:0/1397451597 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fae10005200 con 0x559723c7f480 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.004+0000 7fae1f869740 10 client.25561 fetch_fsmap learned FSMap version 38 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.004+0000 7fae1f869740 1 -- 172.21.15.73:0/1397451597 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559723d05480 con 0x559723c7f480 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.008+0000 7fadfaff5640 1 -- 172.21.15.73:0/1397451597 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae0801c830 con 0x559723c7f480 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.008+0000 7fadfaff5640 1 -- 172.21.15.73:0/1397451597 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7fae10019ab0 con 0x559723c7f480 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.008+0000 7fae1f869740 10 client.25561 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.008+0000 7fae1f869740 10 client.25561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.008+0000 7fae1f869740 20 client.25561 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.008+0000 7fae1f869740 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559723d05c10 0x559723d08030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.008+0000 7fae1f869740 4 client.25561 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T13:02:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.008+0000 7fae1f869740 1 -- 172.21.15.73:0/1397451597 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559723bebd00 con 0x559723d05c10 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.008+0000 7fae16ffd640 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559723d05c10 0x559723d08030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.010+0000 7fae16ffd640 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559723d05c10 0x559723d08030 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3358f5fb5dd5d5c server_cookie=899918ec1e0450e7 in_seq=0 out_seq=0 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.011+0000 7fadfaff5640 10 client.25561 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.013+0000 7fadfaff5640 1 -- 172.21.15.73:0/1397451597 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559723bebd00 con 0x559723d05c10 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.013+0000 7fadfaff5640 10 client.25561 handle_command_reply: tid=0 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.015+0000 7fae1f869740 1 client.25561 shutdown 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 1 -- 172.21.15.73:0/1397451597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 msgr2=0x559723c8e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 0x559723c8e6d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae10009ef0 tx=0x7fae1000f8c0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 1 -- 172.21.15.73:0/1397451597 shutdown_connections 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x559723d05c10 0x559723d08030 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559723c89d40 0x559723d03cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559723c7f480 0x559723c8e6d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 1 --2- 172.21.15.73:0/1397451597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559723c7eb60 0x559723c8e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 1 -- 172.21.15.73:0/1397451597 >> 172.21.15.73:0/1397451597 conn(0x559723c7b0f0 msgr2=0x559723c79a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fadfaff5640 0 client.25561 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 1 -- 172.21.15.73:0/1397451597 shutdown_connections 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 1 -- 172.21.15.73:0/1397451597 wait complete. 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.017+0000 7fae1f869740 20 client.25561 trim_cache size 0 max 16384 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.021+0000 7fae1d493640 1 -- 172.21.15.73:0/4095856801 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2bc0 msgr2=0x7fae000a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.021+0000 7fae1d493640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2bc0 0x7fae000a5080 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x559723c7c470 tx=0x7fae08009260 comp rx=0 tx=0).stop 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.021+0000 7fae1d493640 1 -- 172.21.15.73:0/4095856801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae181091f0 msgr2=0x7fae18113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.021+0000 7fae1d493640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae181091f0 0x7fae18113ec0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fae0c000c00 tx=0x7fae0c030920 comp rx=0 tx=0).stop 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.021+0000 7fae1d493640 1 -- 172.21.15.73:0/4095856801 shutdown_connections 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.021+0000 7fae1d493640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2bc0 0x7fae000a5080 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.021+0000 7fae1d493640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18114ab0 0x7fae1810af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.021+0000 7fae1d493640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18109b10 0x7fae18114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.021+0000 7fae1d493640 1 --2- 172.21.15.73:0/4095856801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae181091f0 0x7fae18113ec0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.021+0000 7fae1d493640 1 -- 172.21.15.73:0/4095856801 >> 172.21.15.73:0/4095856801 conn(0x7fae1806e140 msgr2=0x7fae180708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.023+0000 7fae1d493640 1 -- 172.21.15.73:0/4095856801 shutdown_connections 2024-09-05T13:02:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:07.023+0000 7fae1d493640 1 -- 172.21.15.73:0/4095856801 wait complete. 2024-09-05T13:02:07.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:07 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:07.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:07 smithi162 ceph-mon[34220]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 8.69k op/s 2024-09-05T13:02:07.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:07 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:07.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:07 smithi169 ceph-mon[34823]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 8.69k op/s 2024-09-05T13:02:07.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:07 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.238+0000 7f0fbe95f640 1 -- 172.21.15.73:0/3096574824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb8109700 msgr2=0x7f0fb8109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.238+0000 7f0fbe95f640 1 --2- 172.21.15.73:0/3096574824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb8109700 0x7f0fb8109b00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009be0 tx=0x7f0fb002a6c0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.240+0000 7f0fbe95f640 1 -- 172.21.15.73:0/3096574824 shutdown_connections 2024-09-05T13:02:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.240+0000 7f0fbe95f640 1 --2- 172.21.15.73:0/3096574824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fb80736a0 0x7f0fb8119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.240+0000 7f0fbe95f640 1 --2- 172.21.15.73:0/3096574824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb8072ce0 0x7f0fb8073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.240+0000 7f0fbe95f640 1 --2- 172.21.15.73:0/3096574824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb8109700 0x7f0fb8109b00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.240+0000 7f0fbe95f640 1 -- 172.21.15.73:0/3096574824 >> 172.21.15.73:0/3096574824 conn(0x7f0fb806ece0 msgr2=0x7f0fb8071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.242+0000 7f0fbe95f640 1 -- 172.21.15.73:0/3096574824 shutdown_connections 2024-09-05T13:02:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.243+0000 7f0fbe95f640 1 -- 172.21.15.73:0/3096574824 wait complete. 2024-09-05T13:02:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.244+0000 7f0fbe95f640 1 Processor -- start 2024-09-05T13:02:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.244+0000 7f0fbe95f640 1 -- start start 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.244+0000 7f0fbe95f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb8072ce0 0x7f0fb81a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbe95f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fb80736a0 0x7f0fb81a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbe95f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb8109700 0x7f0fb81ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbe95f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb811c640 con 0x7f0fb8109700 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbe95f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb811c4c0 con 0x7f0fb8072ce0 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbe95f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb811c7c0 con 0x7f0fb80736a0 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbcefc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb8109700 0x7f0fb81ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbcefc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb8109700 0x7f0fb81ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44690/0 (socket says 172.21.15.73:44690) 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbcefc640 1 -- 172.21.15.73:0/2069772228 learned_addr learned my addr 172.21.15.73:0/2069772228 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fb80736a0 0x7f0fb81a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbcefc640 1 -- 172.21.15.73:0/2069772228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fb80736a0 msgr2=0x7f0fb81a6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbcefc640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fb80736a0 0x7f0fb81a6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbcefc640 1 -- 172.21.15.73:0/2069772228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb8072ce0 msgr2=0x7f0fb81a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbcefc640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb8072ce0 0x7f0fb81a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.245+0000 7f0fbcefc640 1 -- 172.21.15.73:0/2069772228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb81ae670 con 0x7f0fb8109700 2024-09-05T13:02:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.246+0000 7f0fbcefc640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb8109700 0x7f0fb81ae000 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800d750 tx=0x7f0fa800db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.247+0000 7f0fb57fa640 1 -- 172.21.15.73:0/2069772228 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8017070 con 0x7f0fb8109700 2024-09-05T13:02:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.248+0000 7f0fb57fa640 1 -- 172.21.15.73:0/2069772228 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fa80097c0 con 0x7f0fb8109700 2024-09-05T13:02:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.248+0000 7f0fb57fa640 1 -- 172.21.15.73:0/2069772228 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8004ce0 con 0x7f0fb8109700 2024-09-05T13:02:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.248+0000 7f0fbe95f640 1 -- 172.21.15.73:0/2069772228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb81ae960 con 0x7f0fb8109700 2024-09-05T13:02:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.249+0000 7f0fbe95f640 1 -- 172.21.15.73:0/2069772228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb81aeee0 con 0x7f0fb8109700 2024-09-05T13:02:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.252+0000 7f0fb57fa640 1 -- 172.21.15.73:0/2069772228 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0fa8009ce0 con 0x7f0fb8109700 2024-09-05T13:02:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.253+0000 7f0fb57fa640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0fa00a2cb0 0x7f0fa00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.253+0000 7f0fb57fa640 1 -- 172.21.15.73:0/2069772228 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0fa8098fd0 con 0x7f0fb8109700 2024-09-05T13:02:08.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.256+0000 7f0fb7fff640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0fa00a2cb0 0x7f0fa00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.258 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.257+0000 7f0fb7fff640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0fa00a2cb0 0x7f0fa00a5170 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00099a0 tx=0x7f0fb0009330 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.259+0000 7f0fc17d7740 1 Processor -- start 2024-09-05T13:02:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.259+0000 7f0fc17d7740 1 -- start start 2024-09-05T13:02:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.259+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89b9e0 0x563e4e89bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.259+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89c320 0x563e4e8a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.259+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8a3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.259+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563e4e7ff2f0 con 0x563e4e89c320 2024-09-05T13:02:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.259+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563e4e7a7270 con 0x563e4e8a13b0 2024-09-05T13:02:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.259+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563e4e7fb2b0 con 0x563e4e89b9e0 2024-09-05T13:02:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.260+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89b9e0 0x563e4e89bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.260+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89b9e0 0x563e4e89bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:52896/0 (socket says 172.21.15.73:52896) 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.260+0000 7f0fb7fff640 1 -- 172.21.15.73:0/156298095 learned_addr learned my addr 172.21.15.73:0/156298095 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.260+0000 7f0fbcefc640 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.260+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89c320 0x563e4e8a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.260+0000 7f0fb77fe640 1 -- 172.21.15.73:0/156298095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89b9e0 msgr2=0x563e4e89bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.261+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89b9e0 0x563e4e89bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.261+0000 7f0fb77fe640 1 -- 172.21.15.73:0/156298095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 msgr2=0x563e4e8a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.261+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.261+0000 7f0fb77fe640 1 -- 172.21.15.73:0/156298095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e4e7a6340 con 0x563e4e89c320 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.261+0000 7f0fbcefc640 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.261+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89c320 0x563e4e8a0de0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009970 tx=0x7f0fac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265b07a02b37bee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.261+0000 7f0fb7fff640 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89b9e0 0x563e4e89bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:02:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.262+0000 7f0f9e7fc640 1 -- 172.21.15.73:0/156298095 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac017070 con 0x563e4e89c320 2024-09-05T13:02:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.262+0000 7f0f9e7fc640 1 -- 172.21.15.73:0/156298095 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fac013470 con 0x563e4e89c320 2024-09-05T13:02:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.262+0000 7f0f9e7fc640 1 -- 172.21.15.73:0/156298095 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac012630 con 0x563e4e89c320 2024-09-05T13:02:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.265+0000 7f0fc17d7740 1 -- 172.21.15.73:0/156298095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89c320 msgr2=0x563e4e8a0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.265+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89c320 0x563e4e8a0de0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009970 tx=0x7f0fac009e30 comp rx=0 tx=0).stop 2024-09-05T13:02:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.265+0000 7f0fc17d7740 1 -- 172.21.15.73:0/156298095 shutdown_connections 2024-09-05T13:02:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.265+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.265+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89c320 0x563e4e8a0de0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.265+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/156298095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89b9e0 0x563e4e89bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.266+0000 7f0fc17d7740 1 -- 172.21.15.73:0/156298095 >> 172.21.15.73:0/156298095 conn(0x563e4e897050 msgr2=0x563e4e897450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:08.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.269+0000 7f0fc17d7740 1 -- 172.21.15.73:0/156298095 shutdown_connections 2024-09-05T13:02:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.272+0000 7f0fc17d7740 1 -- 172.21.15.73:0/156298095 wait complete. 2024-09-05T13:02:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.272+0000 7f0fc17d7740 1 -- start start 2024-09-05T13:02:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.273+0000 7f0fc17d7740 1 Processor -- start 2024-09-05T13:02:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.273+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89b9e0 0x563e4e8a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.273+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e89c320 0x563e4e8a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.273+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e8a13b0 0x563e4e8ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.273+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563e4e8a4380 con 0x563e4e89b9e0 2024-09-05T13:02:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.273+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563e4e788290 con 0x563e4e89c320 2024-09-05T13:02:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.273+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563e4e8a4500 con 0x563e4e8a13b0 2024-09-05T13:02:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.273+0000 7f0fc17d7740 10 client.0 _ll_register_callbacks cb 0x563e4e7b9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.275+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89b9e0 0x563e4e8a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.275+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89b9e0 0x563e4e8a5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44702/0 (socket says 172.21.15.73:44702) 2024-09-05T13:02:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.275+0000 7f0fb7fff640 1 -- 172.21.15.73:0/3453316334 learned_addr learned my addr 172.21.15.73:0/3453316334 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:08.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.276+0000 7f0fb7fff640 1 -- 172.21.15.73:0/3453316334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e8a13b0 msgr2=0x563e4e8ad210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:08.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.276+0000 7f0fb7fff640 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e8a13b0 0x563e4e8ad210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.276+0000 7f0fb7fff640 1 -- 172.21.15.73:0/3453316334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e89c320 msgr2=0x563e4e8a61d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:08.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.276+0000 7f0fb7fff640 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e89c320 0x563e4e8a61d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.276+0000 7f0fb7fff640 1 -- 172.21.15.73:0/3453316334 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e4e512210 con 0x563e4e89b9e0 2024-09-05T13:02:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.277+0000 7f0fb7fff640 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89b9e0 0x563e4e8a5c90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0030950 tx=0x7f0fb0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9404d9214486d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.277+0000 7f0f977fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:02:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.277+0000 7f0f977fe640 1 -- 172.21.15.73:0/3453316334 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb004d020 con 0x563e4e89b9e0 2024-09-05T13:02:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.277+0000 7f0f977fe640 1 -- 172.21.15.73:0/3453316334 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0fb0004450 con 0x563e4e89b9e0 2024-09-05T13:02:08.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.278+0000 7f0fc17d7740 1 -- 172.21.15.73:0/3453316334 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fac013470 con 0x563e4e89b9e0 2024-09-05T13:02:08.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.280+0000 7f0f977fe640 1 -- 172.21.15.73:0/3453316334 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0fb0036040 con 0x563e4e89b9e0 2024-09-05T13:02:08.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.281+0000 7f0fc17d7740 10 client.16011 fetch_fsmap learned FSMap version 38 2024-09-05T13:02:08.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.281+0000 7f0fc17d7740 1 -- 172.21.15.73:0/3453316334 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563e4e5de620 con 0x563e4e89b9e0 2024-09-05T13:02:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.282+0000 7f0f977fe640 1 -- 172.21.15.73:0/3453316334 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fac013470 con 0x563e4e89b9e0 2024-09-05T13:02:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.283+0000 7f0f977fe640 1 -- 172.21.15.73:0/3453316334 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7f0fb005a020 con 0x563e4e89b9e0 2024-09-05T13:02:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.284+0000 7f0fc17d7740 10 client.16011 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T13:02:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.284+0000 7f0fc17d7740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.284+0000 7f0fc17d7740 20 client.16011 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.284+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563e4e8c2a20 0x563e4e8c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.284+0000 7f0fc17d7740 4 client.16011 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:02:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.284+0000 7f0fc17d7740 1 -- 172.21.15.73:0/3453316334 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e4e80ca20 con 0x563e4e8c2a20 2024-09-05T13:02:08.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.286+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563e4e8c2a20 0x563e4e8c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.287+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563e4e8c2a20 0x563e4e8c4ee0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd5bf31b89fecbff server_cookie=8ab3d2641ca656b9 in_seq=0 out_seq=0 2024-09-05T13:02:08.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.287+0000 7f0f977fe640 10 client.16011 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:08.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.288+0000 7f0f977fe640 1 -- 172.21.15.73:0/3453316334 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e4e80ca20 con 0x563e4e8c2a20 2024-09-05T13:02:08.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.288+0000 7f0f977fe640 10 client.16011 handle_command_reply: tid=0 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0fc17d7740 1 client.16011 shutdown 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0fc17d7740 1 -- 172.21.15.73:0/3453316334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89b9e0 msgr2=0x563e4e8a5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89b9e0 0x563e4e8a5c90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0030950 tx=0x7f0fb0005fd0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0fc17d7740 1 -- 172.21.15.73:0/3453316334 shutdown_connections 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563e4e8c2a20 0x563e4e8c4ee0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e8a13b0 0x563e4e8ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e89c320 0x563e4e8a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/3453316334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e89b9e0 0x563e4e8a5c90 secure :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0030950 tx=0x7f0fb0005fd0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0fc17d7740 1 -- 172.21.15.73:0/3453316334 >> 172.21.15.73:0/3453316334 conn(0x563e4e897050 msgr2=0x563e4e898860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0f977fe640 0 client.16011 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.289+0000 7f0fc17d7740 1 -- 172.21.15.73:0/3453316334 shutdown_connections 2024-09-05T13:02:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.290+0000 7f0fc17d7740 1 -- 172.21.15.73:0/3453316334 wait complete. 2024-09-05T13:02:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.290+0000 7f0fc17d7740 20 client.16011 trim_cache size 0 max 16384 2024-09-05T13:02:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.305+0000 7f0fc17d7740 1 Processor -- start 2024-09-05T13:02:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.305+0000 7f0fc17d7740 1 -- start start 2024-09-05T13:02:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.305+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89c320 0x563e4e8a6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.305+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e895d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb81b1ff0 con 0x563e4e895900 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb81af830 con 0x563e4e8a13b0 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8117690 con 0x563e4e89c320 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fbcefc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e895d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fbcefc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e895d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44706/0 (socket says 172.21.15.73:44706) 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fbcefc640 1 -- 172.21.15.73:0/2542601962 learned_addr learned my addr 172.21.15.73:0/2542601962 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/2542601962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fb7fff640 1 --2- 172.21.15.73:0/2542601962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89c320 0x563e4e8a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fbcefc640 1 -- 172.21.15.73:0/2542601962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89c320 msgr2=0x563e4e8a6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fbcefc640 1 --2- 172.21.15.73:0/2542601962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89c320 0x563e4e8a6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fbcefc640 1 -- 172.21.15.73:0/2542601962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 msgr2=0x563e4e8ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fbcefc640 1 --2- 172.21.15.73:0/2542601962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8ad1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fbcefc640 1 -- 172.21.15.73:0/2542601962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e4e896e70 con 0x563e4e895900 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0fbcefc640 1 --2- 172.21.15.73:0/2542601962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e895d90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8097e40 tx=0x7f0fa80a0400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb33da4da5cf76a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0f9dffb640 1 -- 172.21.15.73:0/2542601962 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8097960 con 0x563e4e895900 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0f9dffb640 1 -- 172.21.15.73:0/2542601962 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fa800fec0 con 0x563e4e895900 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.306+0000 7f0f9dffb640 1 -- 172.21.15.73:0/2542601962 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8097b00 con 0x563e4e895900 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.307+0000 7f0fc17d7740 1 -- 172.21.15.73:0/2542601962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 msgr2=0x563e4e895d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.307+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/2542601962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e895d90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8097e40 tx=0x7f0fa80a0400 comp rx=0 tx=0).stop 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.307+0000 7f0fc17d7740 1 -- 172.21.15.73:0/2542601962 shutdown_connections 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.307+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/2542601962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e895d90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.307+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/2542601962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.307+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/2542601962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89c320 0x563e4e8a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.307+0000 7f0fc17d7740 1 -- 172.21.15.73:0/2542601962 >> 172.21.15.73:0/2542601962 conn(0x563e4e897050 msgr2=0x563e4e8a5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.307+0000 7f0fc17d7740 1 -- 172.21.15.73:0/2542601962 shutdown_connections 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.307+0000 7f0fc17d7740 1 -- 172.21.15.73:0/2542601962 wait complete. 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.307+0000 7f0fc17d7740 1 -- start start 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fc17d7740 1 Processor -- start 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e8aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89c320 0x563e4e8aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fc17d7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8117d00 con 0x563e4e895900 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb81af160 con 0x563e4e8a13b0 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fc17d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb81183d0 con 0x563e4e89c320 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fc17d7740 10 client.0 _ll_register_callbacks cb 0x7f0fb0034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e8aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e8aaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44714/0 (socket says 172.21.15.73:44714) 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fb7fff640 1 -- 172.21.15.73:0/332173652 learned_addr learned my addr 172.21.15.73:0/332173652 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89c320 0x563e4e8aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fbcefc640 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fb7fff640 1 -- 172.21.15.73:0/332173652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89c320 msgr2=0x563e4e8aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fb7fff640 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89c320 0x563e4e8aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fb7fff640 1 -- 172.21.15.73:0/332173652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 msgr2=0x563e4e8abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fb7fff640 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fb7fff640 1 -- 172.21.15.73:0/332173652 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e4e8ac570 con 0x563e4e895900 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fbcefc640 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0fb7fff640 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e8aaa10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0003fd0 tx=0x7f0fb0031ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596a7a70d57099fb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.308+0000 7f0f977fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0f977fe640 1 -- 172.21.15.73:0/332173652 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb004d040 con 0x563e4e895900 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0f977fe640 1 -- 172.21.15.73:0/332173652 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0fb0004250 con 0x563e4e895900 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0fc17d7740 1 -- 172.21.15.73:0/332173652 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fa800fec0 con 0x563e4e895900 2024-09-05T13:02:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0f977fe640 1 -- 172.21.15.73:0/332173652 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0fb0004450 con 0x563e4e895900 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0fc17d7740 10 client.16017 fetch_fsmap learned FSMap version 38 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0fc17d7740 1 -- 172.21.15.73:0/332173652 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563e4e92d940 con 0x563e4e895900 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0f977fe640 1 -- 172.21.15.73:0/332173652 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fa800fec0 con 0x563e4e895900 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0f977fe640 1 -- 172.21.15.73:0/332173652 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7f0fb005a040 con 0x563e4e895900 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0fc17d7740 10 client.16017 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0fc17d7740 10 client.16017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0fc17d7740 20 client.16017 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563e4e92e3a0 0x563e4e9307c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0fc17d7740 4 client.16017 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0fc17d7740 1 -- 172.21.15.73:0/332173652 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563e4e8a1100 con 0x563e4e92e3a0 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.309+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563e4e92e3a0 0x563e4e9307c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.310+0000 7f0f977fe640 10 client.16017 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.310+0000 7f0fb77fe640 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563e4e92e3a0 0x563e4e9307c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99eb6ea2f7adcd8b server_cookie=886dbc8297319cb5 in_seq=0 out_seq=0 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.356+0000 7f0f977fe640 1 -- 172.21.15.73:0/332173652 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563e4e8a1100 con 0x563e4e92e3a0 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.356+0000 7f0f977fe640 10 client.16017 handle_command_reply: tid=0 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.356+0000 7f0fc17d7740 1 client.16017 shutdown 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.357+0000 7f0fc17d7740 1 -- 172.21.15.73:0/332173652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 msgr2=0x563e4e8aaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.357+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e8aaa10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0003fd0 tx=0x7f0fb0031ce0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.357+0000 7f0fc17d7740 1 -- 172.21.15.73:0/332173652 shutdown_connections 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.357+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x563e4e92e3a0 0x563e4e9307c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.357+0000 7f0f977fe640 0 client.16017 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.357+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e4e8a13b0 0x563e4e8abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.357+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4e89c320 0x563e4e8aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.357+0000 7f0fc17d7740 1 --2- 172.21.15.73:0/332173652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563e4e895900 0x563e4e8aaa10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.357+0000 7f0fc17d7740 1 -- 172.21.15.73:0/332173652 >> 172.21.15.73:0/332173652 conn(0x563e4e897050 msgr2=0x563e4e895d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.360+0000 7f0fc17d7740 1 -- 172.21.15.73:0/332173652 shutdown_connections 2024-09-05T13:02:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.361+0000 7f0fc17d7740 1 -- 172.21.15.73:0/332173652 wait complete. 2024-09-05T13:02:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.363+0000 7f0fc17d7740 20 client.16017 trim_cache size 0 max 16384 2024-09-05T13:02:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:02:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:02:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:02:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:02:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.364+0000 7f0fbe95f640 1 -- 172.21.15.73:0/2069772228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0fa00a2cb0 msgr2=0x7f0fa00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.364+0000 7f0fbe95f640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0fa00a2cb0 0x7f0fa00a5170 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00099a0 tx=0x7f0fb0009330 comp rx=0 tx=0).stop 2024-09-05T13:02:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.364+0000 7f0fbe95f640 1 -- 172.21.15.73:0/2069772228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb8109700 msgr2=0x7f0fb81ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.364+0000 7f0fbe95f640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb8109700 0x7f0fb81ae000 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800d750 tx=0x7f0fa800db50 comp rx=0 tx=0).stop 2024-09-05T13:02:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.365+0000 7f0fbe95f640 1 -- 172.21.15.73:0/2069772228 shutdown_connections 2024-09-05T13:02:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.365+0000 7f0fbe95f640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0fa00a2cb0 0x7f0fa00a5170 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.365+0000 7f0fbe95f640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb8109700 0x7f0fb81ae000 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.365+0000 7f0fbe95f640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fb80736a0 0x7f0fb81a6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.365+0000 7f0fbe95f640 1 --2- 172.21.15.73:0/2069772228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb8072ce0 0x7f0fb81a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.365+0000 7f0fbe95f640 1 -- 172.21.15.73:0/2069772228 >> 172.21.15.73:0/2069772228 conn(0x7f0fb806ece0 msgr2=0x7f0fb8071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.366+0000 7f0fbe95f640 1 -- 172.21.15.73:0/2069772228 shutdown_connections 2024-09-05T13:02:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:08.367+0000 7f0fbe95f640 1 -- 172.21.15.73:0/2069772228 wait complete. 2024-09-05T13:02:08.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:08 smithi073 ceph-mon[30883]: scrub queued for path: / 2024-09-05T13:02:08.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:08 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:08 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:02:08.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:08 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:02:08.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:08 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:02:08.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:08 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:08 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:08 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:08 smithi162 ceph-mon[34220]: scrub queued for path: / 2024-09-05T13:02:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:08 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:08 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:02:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:08 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:02:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:08 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:02:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:08 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:08 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:08 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:08 smithi169 ceph-mon[34823]: scrub queued for path: / 2024-09-05T13:02:08.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:08 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:08 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:02:08.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:08 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:02:08.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:08 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:02:08.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:08 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:08 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:08.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:08 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:02:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:09 smithi073 ceph-mon[30883]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 8.07k op/s 2024-09-05T13:02:09.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:09 smithi162 ceph-mon[34220]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 8.07k op/s 2024-09-05T13:02:09.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:09 smithi169 ceph-mon[34823]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 8.07k op/s 2024-09-05T13:02:10.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:10 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:02:10.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:10 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:02:10.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:10 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:02:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:11 smithi073 ceph-mon[30883]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 6.45k op/s 2024-09-05T13:02:11.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:11 smithi162 ceph-mon[34220]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 6.45k op/s 2024-09-05T13:02:11.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:11 smithi169 ceph-mon[34823]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 6.45k op/s 2024-09-05T13:02:12.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:12 smithi073 ceph-mon[30883]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 28 MiB/s wr, 6.72k op/s 2024-09-05T13:02:12.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:12 smithi162 ceph-mon[34220]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 28 MiB/s wr, 6.72k op/s 2024-09-05T13:02:12.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:12 smithi169 ceph-mon[34823]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 28 MiB/s wr, 6.72k op/s 2024-09-05T13:02:13.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T13:02:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:02:14.016 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:02:14.016 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:02:14.016 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:13 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:02:14.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:02:14.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:02:14.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:13 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:02:14.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:02:14.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:02:14.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:13 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:02:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.329+0000 7f02fa7fc640 1 -- 172.21.15.73:0/630146146 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0319b0 con 0x7f02fc109450 2024-09-05T13:02:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.329+0000 7f0302262640 1 -- 172.21.15.73:0/630146146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc109450 msgr2=0x7f02fc110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.329+0000 7f0302262640 1 --2- 172.21.15.73:0/630146146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc109450 0x7f02fc110250 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009900 tx=0x7f02ec02a420 comp rx=0 tx=0).stop 2024-09-05T13:02:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.330+0000 7f0302262640 1 -- 172.21.15.73:0/630146146 shutdown_connections 2024-09-05T13:02:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.330+0000 7f0302262640 1 --2- 172.21.15.73:0/630146146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02fc11b140 0x7f02fc11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.330+0000 7f0302262640 1 --2- 172.21.15.73:0/630146146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02fc109830 0x7f02fc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.330+0000 7f0302262640 1 --2- 172.21.15.73:0/630146146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc109450 0x7f02fc110250 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.330+0000 7f0302262640 1 -- 172.21.15.73:0/630146146 >> 172.21.15.73:0/630146146 conn(0x7f02fc06e140 msgr2=0x7f02fc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.330+0000 7f0302262640 1 -- 172.21.15.73:0/630146146 shutdown_connections 2024-09-05T13:02:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.330+0000 7f0302262640 1 -- 172.21.15.73:0/630146146 wait complete. 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.331+0000 7f0302262640 1 Processor -- start 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.331+0000 7f0302262640 1 -- start start 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.331+0000 7f0302262640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc109450 0x7f02fc1a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.331+0000 7f0302262640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02fc109830 0x7f02fc1a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.331+0000 7f0302262640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02fc11b140 0x7f02fc1abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.331+0000 7f0302262640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc120e30 con 0x7f02fc109450 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.331+0000 7f0302262640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc120cb0 con 0x7f02fc11b140 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.331+0000 7f0302262640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc120fb0 con 0x7f02fc109830 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.332+0000 7f02fbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02fc11b140 0x7f02fc1abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.332+0000 7f02fbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02fc11b140 0x7f02fc1abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:38810/0 (socket says 172.21.15.73:38810) 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.332+0000 7f02fbfff640 1 -- 172.21.15.73:0/4080781235 learned_addr learned my addr 172.21.15.73:0/4080781235 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.332+0000 7f02faffd640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02fc109830 0x7f02fc1a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.333+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc109450 0x7f02fc1a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.334+0000 7f02faffd640 1 -- 172.21.15.73:0/4080781235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02fc11b140 msgr2=0x7f02fc1abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.334+0000 7f02faffd640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02fc11b140 0x7f02fc1abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.334+0000 7f02faffd640 1 -- 172.21.15.73:0/4080781235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc109450 msgr2=0x7f02fc1a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.334+0000 7f02faffd640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc109450 0x7f02fc1a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.334+0000 7f02faffd640 1 -- 172.21.15.73:0/4080781235 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc1ac320 con 0x7f02fc109830 2024-09-05T13:02:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.336+0000 7f02faffd640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02fc109830 0x7f02fc1a78b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009fd0 tx=0x7f02f000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:14.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.337+0000 7f02f8ff9640 1 -- 172.21.15.73:0/4080781235 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f0015020 con 0x7f02fc109830 2024-09-05T13:02:14.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.338+0000 7f02f8ff9640 1 -- 172.21.15.73:0/4080781235 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02f0011d10 con 0x7f02fc109830 2024-09-05T13:02:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.338+0000 7f0302262640 1 -- 172.21.15.73:0/4080781235 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02fc1ac610 con 0x7f02fc109830 2024-09-05T13:02:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.339+0000 7f02f8ff9640 1 -- 172.21.15.73:0/4080781235 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f000f2e0 con 0x7f02fc109830 2024-09-05T13:02:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.339+0000 7f0302262640 1 -- 172.21.15.73:0/4080781235 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02fc1b3ef0 con 0x7f02fc109830 2024-09-05T13:02:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.343+0000 7f02f8ff9640 1 -- 172.21.15.73:0/4080781235 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f02f0018020 con 0x7f02fc109830 2024-09-05T13:02:14.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.344+0000 7f0304638740 1 Processor -- start 2024-09-05T13:02:14.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.345+0000 7f0304638740 1 -- start start 2024-09-05T13:02:14.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.345+0000 7f0304638740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f94a0 0x55e5841f9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.345+0000 7f0304638740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 0x55e584204140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.345+0000 7f0304638740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 0x55e584206a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.345+0000 7f0304638740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e58415f2e0 con 0x55e584204680 2024-09-05T13:02:14.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.345+0000 7f0304638740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e584106ce0 con 0x55e5841f9dc0 2024-09-05T13:02:14.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.345+0000 7f0304638740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e58415b2a0 con 0x55e5841f94a0 2024-09-05T13:02:14.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.346+0000 7f02f8ff9640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f02e40a2c20 0x7f02e40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.346+0000 7f02f8ff9640 1 -- 172.21.15.73:0/4080781235 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f02f00cde80 con 0x7f02fc109830 2024-09-05T13:02:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.346+0000 7f02fb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 0x55e584204140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.346+0000 7f02fb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 0x55e584204140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:38816/0 (socket says 172.21.15.73:38816) 2024-09-05T13:02:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.346+0000 7f02fb7fe640 1 -- 172.21.15.73:0/1007217987 learned_addr learned my addr 172.21.15.73:0/1007217987 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.347+0000 7f02fb7fe640 1 -- 172.21.15.73:0/1007217987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f94a0 msgr2=0x55e5841f9880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.347+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/1007217987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f94a0 0x55e5841f9880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.347+0000 7f02fb7fe640 1 -- 172.21.15.73:0/1007217987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 msgr2=0x55e584206a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.347+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/1007217987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 0x55e584206a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.347+0000 7f02fb7fe640 1 -- 172.21.15.73:0/1007217987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5840eb440 con 0x55e5841f9dc0 2024-09-05T13:02:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.347+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/1007217987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 0x55e584204140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009900 tx=0x7f02ec005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5137534dc9a05874 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.348+0000 7f02e1ffb640 1 -- 172.21.15.73:0/1007217987 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec040070 con 0x55e5841f9dc0 2024-09-05T13:02:14.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.348+0000 7f02e1ffb640 1 -- 172.21.15.73:0/1007217987 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02ec005020 con 0x55e5841f9dc0 2024-09-05T13:02:14.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.348+0000 7f02e1ffb640 1 -- 172.21.15.73:0/1007217987 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec035040 con 0x55e5841f9dc0 2024-09-05T13:02:14.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.349+0000 7f0304638740 1 -- 172.21.15.73:0/1007217987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 msgr2=0x55e584204140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:14.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.349+0000 7f0304638740 1 --2- 172.21.15.73:0/1007217987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 0x55e584204140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009900 tx=0x7f02ec005e80 comp rx=0 tx=0).stop 2024-09-05T13:02:14.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.349+0000 7f0304638740 1 -- 172.21.15.73:0/1007217987 shutdown_connections 2024-09-05T13:02:14.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.349+0000 7f0304638740 1 --2- 172.21.15.73:0/1007217987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 0x55e584206a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.349+0000 7f0304638740 1 --2- 172.21.15.73:0/1007217987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 0x55e584204140 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.350+0000 7f0304638740 1 --2- 172.21.15.73:0/1007217987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f94a0 0x55e5841f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.350+0000 7f0304638740 1 -- 172.21.15.73:0/1007217987 >> 172.21.15.73:0/1007217987 conn(0x55e5841f5a30 msgr2=0x55e5841f5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:14.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.352+0000 7f0304638740 1 -- 172.21.15.73:0/1007217987 shutdown_connections 2024-09-05T13:02:14.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.352+0000 7f0304638740 1 -- 172.21.15.73:0/1007217987 wait complete. 2024-09-05T13:02:14.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.353+0000 7f0304638740 1 -- start start 2024-09-05T13:02:14.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.353+0000 7f02fbfff640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f02e40a2c20 0x7f02e40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:14.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.353+0000 7f0304638740 1 Processor -- start 2024-09-05T13:02:14.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.353+0000 7f02fbfff640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f02e40a2c20 0x7f02e40a50e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f02f4007dc0 tx=0x7f02f4007550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:14.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.354+0000 7f0304638740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e584203f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.354+0000 7f0304638740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 0x55e584201230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.354+0000 7f0304638740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e584204680 0x55e584201770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.354+0000 7f0304638740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e584207240 con 0x55e5841f94a0 2024-09-05T13:02:14.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.354+0000 7f02fb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e584203f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:14.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.354+0000 7f02fb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e584203f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36756/0 (socket says 172.21.15.73:36756) 2024-09-05T13:02:14.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.354+0000 7f02fb7fe640 1 -- 172.21.15.73:0/689238802 learned_addr learned my addr 172.21.15.73:0/689238802 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:14.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.354+0000 7f0304638740 1 -- 172.21.15.73:0/689238802 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e58411a050 con 0x55e5841f9dc0 2024-09-05T13:02:14.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.354+0000 7f0304638740 1 -- 172.21.15.73:0/689238802 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e5842073c0 con 0x55e584204680 2024-09-05T13:02:14.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.354+0000 7f0304638740 10 client.0 _ll_register_callbacks cb 0x55e58415a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:14.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.355+0000 7f02fb7fe640 1 -- 172.21.15.73:0/689238802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e584204680 msgr2=0x55e584201770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:14.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.355+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e584204680 0x55e584201770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.355+0000 7f02fb7fe640 1 -- 172.21.15.73:0/689238802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 msgr2=0x55e584201230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:14.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.355+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 0x55e584201230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.355+0000 7f02fb7fe640 1 -- 172.21.15.73:0/689238802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e583ed03c0 con 0x55e5841f94a0 2024-09-05T13:02:14.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.356+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e584203f80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f02ec006010 tx=0x7f02ec0047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d3aa1c1f3eebea server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:14.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.356+0000 7f02daffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:02:14.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.357+0000 7f02daffd640 1 -- 172.21.15.73:0/689238802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec040070 con 0x55e5841f94a0 2024-09-05T13:02:14.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.357+0000 7f02daffd640 1 -- 172.21.15.73:0/689238802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f02ec0054a0 con 0x55e5841f94a0 2024-09-05T13:02:14.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.359+0000 7f0304638740 1 -- 172.21.15.73:0/689238802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02ec005020 con 0x55e5841f94a0 2024-09-05T13:02:14.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.361+0000 7f02daffd640 1 -- 172.21.15.73:0/689238802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f02ec054050 con 0x55e5841f94a0 2024-09-05T13:02:14.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.362+0000 7f0304638740 10 client.16026 fetch_fsmap learned FSMap version 38 2024-09-05T13:02:14.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.362+0000 7f0304638740 1 -- 172.21.15.73:0/689238802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e584212c00 con 0x55e5841f94a0 2024-09-05T13:02:14.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.363+0000 7f02daffd640 1 -- 172.21.15.73:0/689238802 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02ec03c440 con 0x55e5841f94a0 2024-09-05T13:02:14.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.363+0000 7f02daffd640 1 -- 172.21.15.73:0/689238802 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7f02ec044400 con 0x55e5841f94a0 2024-09-05T13:02:14.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.363+0000 7f0304638740 10 client.16026 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T13:02:14.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.363+0000 7f0304638740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:14.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.363+0000 7f0304638740 20 client.16026 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:14.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.363+0000 7f0304638740 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e584213f50 0x55e584216340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.363+0000 7f0304638740 4 client.16026 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:02:14.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.363+0000 7f0304638740 1 -- 172.21.15.73:0/689238802 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f02ec005020 con 0x55e584213f50 2024-09-05T13:02:14.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.363+0000 7f02faffd640 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e584213f50 0x55e584216340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:14.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.364+0000 7f02daffd640 10 client.16026 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:14.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.364+0000 7f02faffd640 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e584213f50 0x55e584216340 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fcbef09cc470239 server_cookie=4a8ee8172e142eb9 in_seq=0 out_seq=0 2024-09-05T13:02:14.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.366+0000 7f02daffd640 1 -- 172.21.15.73:0/689238802 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f02ec005020 con 0x55e584213f50 2024-09-05T13:02:14.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.366+0000 7f02daffd640 10 client.16026 handle_command_reply: tid=0 2024-09-05T13:02:14.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.366+0000 7f0304638740 1 client.16026 shutdown 2024-09-05T13:02:14.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.367+0000 7f0304638740 1 -- 172.21.15.73:0/689238802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 msgr2=0x55e584203f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:14.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.367+0000 7f0304638740 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e584203f80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f02ec006010 tx=0x7f02ec0047a0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.368+0000 7f0304638740 1 -- 172.21.15.73:0/689238802 shutdown_connections 2024-09-05T13:02:14.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.368+0000 7f0304638740 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e584213f50 0x55e584216340 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.368+0000 7f0304638740 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e584204680 0x55e584201770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.368+0000 7f0304638740 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f9dc0 0x55e584201230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.368+0000 7f02daffd640 0 client.16026 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:14.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.368+0000 7f0304638740 1 --2- 172.21.15.73:0/689238802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e584203f80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.368+0000 7f0304638740 1 -- 172.21.15.73:0/689238802 >> 172.21.15.73:0/689238802 conn(0x55e5841f5a30 msgr2=0x55e5841fb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:14.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.368+0000 7f0304638740 1 -- 172.21.15.73:0/689238802 shutdown_connections 2024-09-05T13:02:14.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.368+0000 7f0304638740 1 -- 172.21.15.73:0/689238802 wait complete. 2024-09-05T13:02:14.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.369+0000 7f0304638740 20 client.16026 trim_cache size 0 max 16384 2024-09-05T13:02:14.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.401+0000 7f0304638740 1 Processor -- start 2024-09-05T13:02:14.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.401+0000 7f0304638740 1 -- start start 2024-09-05T13:02:14.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.402+0000 7f0304638740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f94a0 0x55e5842104f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.402+0000 7f0304638740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f9dc0 0x55e5841fb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.402+0000 7f0304638740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 0x55e58421ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.402+0000 7f0304638740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc1be900 con 0x55e584204680 2024-09-05T13:02:14.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.402+0000 7f0304638740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc1bc140 con 0x55e5841f94a0 2024-09-05T13:02:14.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.402+0000 7f0304638740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc1b9fb0 con 0x55e5841f9dc0 2024-09-05T13:02:14.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.402+0000 7f02fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 0x55e58421ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:14.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.402+0000 7f02fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 0x55e58421ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36768/0 (socket says 172.21.15.73:36768) 2024-09-05T13:02:14.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.402+0000 7f02fbfff640 1 -- 172.21.15.73:0/2644968699 learned_addr learned my addr 172.21.15.73:0/2644968699 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:14.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.403+0000 7f02fbfff640 1 -- 172.21.15.73:0/2644968699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f9dc0 msgr2=0x55e5841fb600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:14.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.403+0000 7f02fbfff640 1 --2- 172.21.15.73:0/2644968699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f9dc0 0x55e5841fb600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.403+0000 7f02fbfff640 1 -- 172.21.15.73:0/2644968699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f94a0 msgr2=0x55e5842104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:14.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.403+0000 7f02fbfff640 1 --2- 172.21.15.73:0/2644968699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f94a0 0x55e5842104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.403+0000 7f02fbfff640 1 -- 172.21.15.73:0/2644968699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e584206e10 con 0x55e584204680 2024-09-05T13:02:14.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.403+0000 7f02fbfff640 1 --2- 172.21.15.73:0/2644968699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 0x55e58421ba60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f02f4005c40 tx=0x7f02f4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f81983e4c8c37 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:14.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.404+0000 7f02e17fa640 1 -- 172.21.15.73:0/2644968699 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f401ba40 con 0x55e584204680 2024-09-05T13:02:14.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.404+0000 7f02e17fa640 1 -- 172.21.15.73:0/2644968699 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02f401bbe0 con 0x55e584204680 2024-09-05T13:02:14.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.404+0000 7f02e17fa640 1 -- 172.21.15.73:0/2644968699 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f401d680 con 0x55e584204680 2024-09-05T13:02:14.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.405+0000 7f0304638740 1 -- 172.21.15.73:0/2644968699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 msgr2=0x55e58421ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:14.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.405+0000 7f0304638740 1 --2- 172.21.15.73:0/2644968699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 0x55e58421ba60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f02f4005c40 tx=0x7f02f4012000 comp rx=0 tx=0).stop 2024-09-05T13:02:14.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.406+0000 7f0304638740 1 -- 172.21.15.73:0/2644968699 shutdown_connections 2024-09-05T13:02:14.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.406+0000 7f0304638740 1 --2- 172.21.15.73:0/2644968699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e584204680 0x55e58421ba60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.406+0000 7f0304638740 1 --2- 172.21.15.73:0/2644968699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f9dc0 0x55e5841fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.406+0000 7f0304638740 1 --2- 172.21.15.73:0/2644968699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5841f94a0 0x55e5842104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.406+0000 7f0304638740 1 -- 172.21.15.73:0/2644968699 >> 172.21.15.73:0/2644968699 conn(0x55e5841f5a30 msgr2=0x55e5841faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:14.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.407+0000 7f0304638740 1 -- 172.21.15.73:0/2644968699 shutdown_connections 2024-09-05T13:02:14.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.407+0000 7f0304638740 1 -- 172.21.15.73:0/2644968699 wait complete. 2024-09-05T13:02:14.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.408+0000 7f0304638740 1 -- start start 2024-09-05T13:02:14.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.408+0000 7f0304638740 1 Processor -- start 2024-09-05T13:02:14.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.409+0000 7f0304638740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e5842083c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.409+0000 7f0304638740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f9dc0 0x55e584208900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.409+0000 7f0304638740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e584204680 0x55e584208e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.409+0000 7f0304638740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc1ba600 con 0x55e5841f94a0 2024-09-05T13:02:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.409+0000 7f0304638740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc1bba70 con 0x55e584204680 2024-09-05T13:02:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.409+0000 7f0304638740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc1bacd0 con 0x55e5841f9dc0 2024-09-05T13:02:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.409+0000 7f0304638740 10 client.0 _ll_register_callbacks cb 0x7f02ec0315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.409+0000 7f02fb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e5842083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.409+0000 7f02fb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e5842083c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36778/0 (socket says 172.21.15.73:36778) 2024-09-05T13:02:14.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.409+0000 7f02fb7fe640 1 -- 172.21.15.73:0/3060590150 learned_addr learned my addr 172.21.15.73:0/3060590150 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:14.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.410+0000 7f02fb7fe640 1 -- 172.21.15.73:0/3060590150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f9dc0 msgr2=0x55e584208900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:14.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.410+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f9dc0 0x55e584208900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.410+0000 7f02fb7fe640 1 -- 172.21.15.73:0/3060590150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e584204680 msgr2=0x55e584208e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:14.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.410+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e584204680 0x55e584208e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.410+0000 7f02fb7fe640 1 -- 172.21.15.73:0/3060590150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e58427da30 con 0x55e5841f94a0 2024-09-05T13:02:14.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.410+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e5842083c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0092a0 tx=0x7f02ec044630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d4c45f9c010be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:14.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.411+0000 7f02daffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:02:14.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.411+0000 7f02daffd640 1 -- 172.21.15.73:0/3060590150 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec040040 con 0x55e5841f94a0 2024-09-05T13:02:14.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.411+0000 7f02daffd640 1 -- 172.21.15.73:0/3060590150 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f02ec004250 con 0x55e5841f94a0 2024-09-05T13:02:14.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.412+0000 7f0304638740 1 -- 172.21.15.73:0/3060590150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02f401bbe0 con 0x55e5841f94a0 2024-09-05T13:02:14.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.413+0000 7f02daffd640 1 -- 172.21.15.73:0/3060590150 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f02ec035030 con 0x55e5841f94a0 2024-09-05T13:02:14.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.414+0000 7f0304638740 10 client.16032 fetch_fsmap learned FSMap version 38 2024-09-05T13:02:14.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.414+0000 7f0304638740 1 -- 172.21.15.73:0/3060590150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e58427ec80 con 0x55e5841f94a0 2024-09-05T13:02:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.421+0000 7f02daffd640 1 -- 172.21.15.73:0/3060590150 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02f401bbe0 con 0x55e5841f94a0 2024-09-05T13:02:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.421+0000 7f02daffd640 1 -- 172.21.15.73:0/3060590150 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7f02ec003700 con 0x55e5841f94a0 2024-09-05T13:02:14.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.421+0000 7f0304638740 10 client.16032 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T13:02:14.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.421+0000 7f0304638740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:14.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.421+0000 7f0304638740 20 client.16032 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:14.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.421+0000 7f0304638740 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e584213f50 0x55e584281380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:14.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.421+0000 7f0304638740 4 client.16032 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T13:02:14.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.421+0000 7f0304638740 1 -- 172.21.15.73:0/3060590150 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e58416c850 con 0x55e584213f50 2024-09-05T13:02:14.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.423+0000 7f02faffd640 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e584213f50 0x55e584281380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:14.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.427+0000 7f02faffd640 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e584213f50 0x55e584281380 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caf9dcfe88537dc2 server_cookie=f948b43ac3421be5 in_seq=0 out_seq=0 2024-09-05T13:02:14.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.428+0000 7f02daffd640 10 client.16032 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:14.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.428+0000 7f02daffd640 1 -- 172.21.15.73:0/3060590150 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e58416c850 con 0x55e584213f50 2024-09-05T13:02:14.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.428+0000 7f02daffd640 10 client.16032 handle_command_reply: tid=0 2024-09-05T13:02:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.428+0000 7f0304638740 1 client.16032 shutdown 2024-09-05T13:02:14.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.434+0000 7f0304638740 1 -- 172.21.15.73:0/3060590150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 msgr2=0x55e5842083c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:14.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.434+0000 7f0304638740 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e5842083c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0092a0 tx=0x7f02ec044630 comp rx=0 tx=0).stop 2024-09-05T13:02:14.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.435+0000 7f0304638740 1 -- 172.21.15.73:0/3060590150 shutdown_connections 2024-09-05T13:02:14.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.435+0000 7f0304638740 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55e584213f50 0x55e584281380 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.435+0000 7f0304638740 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e584204680 0x55e584208e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.435+0000 7f0304638740 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e5841f9dc0 0x55e584208900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.435+0000 7f0304638740 1 --2- 172.21.15.73:0/3060590150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5841f94a0 0x55e5842083c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.435+0000 7f0304638740 1 -- 172.21.15.73:0/3060590150 >> 172.21.15.73:0/3060590150 conn(0x55e5841f5a30 msgr2=0x55e5841f4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:14.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.435+0000 7f02daffd640 0 client.16032 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:14.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.436+0000 7f0304638740 1 -- 172.21.15.73:0/3060590150 shutdown_connections 2024-09-05T13:02:14.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.436+0000 7f0304638740 1 -- 172.21.15.73:0/3060590150 wait complete. 2024-09-05T13:02:14.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.436+0000 7f0304638740 20 client.16032 trim_cache size 0 max 16384 2024-09-05T13:02:14.438 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:02:14.438 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-05T13:02:14.438 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2024-09-05T13:02:14.438 INFO:teuthology.orchestra.run.smithi073.stdout: "cc91a846-52ed-44f4-ac41-016c1563727c": { 2024-09-05T13:02:14.438 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-05T13:02:14.438 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "cc91a846-52ed-44f4-ac41-016c1563727c", 2024-09-05T13:02:14.439 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2024-09-05T13:02:14.439 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:02:14.439 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:02:14.439 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 -- 172.21.15.73:0/4080781235 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f02e40a2c20 msgr2=0x7f02e40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f02e40a2c20 0x7f02e40a50e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f02f4007dc0 tx=0x7f02f4007550 comp rx=0 tx=0).stop 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 -- 172.21.15.73:0/4080781235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02fc109830 msgr2=0x7f02fc1a78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02fc109830 0x7f02fc1a78b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009fd0 tx=0x7f02f000b870 comp rx=0 tx=0).stop 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 -- 172.21.15.73:0/4080781235 shutdown_connections 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f02e40a2c20 0x7f02e40a50e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02fc11b140 0x7f02fc1abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02fc109830 0x7f02fc1a78b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 --2- 172.21.15.73:0/4080781235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc109450 0x7f02fc1a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 -- 172.21.15.73:0/4080781235 >> 172.21.15.73:0/4080781235 conn(0x7f02fc06e140 msgr2=0x7f02fc11be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 -- 172.21.15.73:0/4080781235 shutdown_connections 2024-09-05T13:02:14.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:14.438+0000 7f0302262640 1 -- 172.21.15.73:0/4080781235 wait complete. 2024-09-05T13:02:15.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:14 smithi162 ceph-mon[34220]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 16 MiB/s wr, 3.81k op/s 2024-09-05T13:02:15.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:14 smithi073 ceph-mon[30883]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 16 MiB/s wr, 3.81k op/s 2024-09-05T13:02:15.019 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:14 smithi169 ceph-mon[34823]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 16 MiB/s wr, 3.81k op/s 2024-09-05T13:02:15.472 INFO:tasks.cephfs.filesystem:scrub status for tag:cc91a846-52ed-44f4-ac41-016c1563727c - {'path': '/', 'tag': 'cc91a846-52ed-44f4-ac41-016c1563727c', 'options': 'recursive,force'} 2024-09-05T13:02:16.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:16 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:02:16.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:16 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:02:16.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:16 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:02:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:17 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:02:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:17 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:02:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:17 smithi162 ceph-mon[34220]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 15 MiB/s wr, 3.66k op/s 2024-09-05T13:02:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:17 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:02:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:17 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:02:17.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:17 smithi169 ceph-mon[34823]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 15 MiB/s wr, 3.66k op/s 2024-09-05T13:02:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:17 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:02:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:17 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:02:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:17 smithi073 ceph-mon[30883]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 15 MiB/s wr, 3.66k op/s 2024-09-05T13:02:19.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:19 smithi073 ceph-mon[30883]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-09-05T13:02:19.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:19 smithi162 ceph-mon[34220]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-09-05T13:02:19.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:19 smithi169 ceph-mon[34823]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-09-05T13:02:21.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:21 smithi073 ceph-mon[30883]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.3 MiB/s wr, 1.15k op/s 2024-09-05T13:02:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.603+0000 7fe4ecedd640 1 -- 172.21.15.73:0/1384028426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4e810ddc0 msgr2=0x7fe4e8110280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.603+0000 7fe4ecedd640 1 --2- 172.21.15.73:0/1384028426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4e810ddc0 0x7fe4e8110280 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009c10 tx=0x7fe4e002a700 comp rx=0 tx=0).stop 2024-09-05T13:02:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.604+0000 7fe4ecedd640 1 -- 172.21.15.73:0/1384028426 shutdown_connections 2024-09-05T13:02:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.604+0000 7fe4ecedd640 1 --2- 172.21.15.73:0/1384028426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4e810ddc0 0x7fe4e8110280 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.604+0000 7fe4ecedd640 1 --2- 172.21.15.73:0/1384028426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8074000 0x7fe4e810d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.604+0000 7fe4ecedd640 1 --2- 172.21.15.73:0/1384028426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4e8073b50 0x7fe4e810b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.604+0000 7fe4ecedd640 1 -- 172.21.15.73:0/1384028426 >> 172.21.15.73:0/1384028426 conn(0x7fe4e806f640 msgr2=0x7fe4e8071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.605+0000 7fe4ecedd640 1 -- 172.21.15.73:0/1384028426 shutdown_connections 2024-09-05T13:02:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.605+0000 7fe4ecedd640 1 -- 172.21.15.73:0/1384028426 wait complete. 2024-09-05T13:02:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.606+0000 7fe4ecedd640 1 Processor -- start 2024-09-05T13:02:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.606+0000 7fe4ecedd640 1 -- start start 2024-09-05T13:02:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.606+0000 7fe4ecedd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8073b50 0x7fe4e819e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.606+0000 7fe4ecedd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4e8074000 0x7fe4e819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.606+0000 7fe4ecedd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4e810ddc0 0x7fe4e81c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.606+0000 7fe4ecedd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8113600 con 0x7fe4e8073b50 2024-09-05T13:02:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.606+0000 7fe4ecedd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8113480 con 0x7fe4e810ddc0 2024-09-05T13:02:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.606+0000 7fe4ecedd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8113780 con 0x7fe4e8074000 2024-09-05T13:02:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.608+0000 7fe4e659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8073b50 0x7fe4e819e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.608+0000 7fe4e659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8073b50 0x7fe4e819e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36808/0 (socket says 172.21.15.73:36808) 2024-09-05T13:02:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.608+0000 7fe4e659c640 1 -- 172.21.15.73:0/2001337758 learned_addr learned my addr 172.21.15.73:0/2001337758 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.608+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4e8074000 0x7fe4e819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.608+0000 7fe4e6d9d640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4e810ddc0 0x7fe4e81c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.609+0000 7fe4e5d9b640 1 -- 172.21.15.73:0/2001337758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4e810ddc0 msgr2=0x7fe4e81c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.609+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4e810ddc0 0x7fe4e81c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.609+0000 7fe4e5d9b640 1 -- 172.21.15.73:0/2001337758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8073b50 msgr2=0x7fe4e819e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.609+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8073b50 0x7fe4e819e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.609+0000 7fe4e5d9b640 1 -- 172.21.15.73:0/2001337758 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e81c8040 con 0x7fe4e8074000 2024-09-05T13:02:21.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:21 smithi162 ceph-mon[34220]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.3 MiB/s wr, 1.15k op/s 2024-09-05T13:02:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.613+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4e8074000 0x7fe4e819ee40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00b3c0 tx=0x7fe4dc00b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.614+0000 7fe4d77fe640 1 -- 172.21.15.73:0/2001337758 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc011830 con 0x7fe4e8074000 2024-09-05T13:02:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.614+0000 7fe4d77fe640 1 -- 172.21.15.73:0/2001337758 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4dc016070 con 0x7fe4e8074000 2024-09-05T13:02:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.614+0000 7fe4d77fe640 1 -- 172.21.15.73:0/2001337758 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc011830 con 0x7fe4e8074000 2024-09-05T13:02:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.615+0000 7fe4ecedd640 1 -- 172.21.15.73:0/2001337758 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e81c8330 con 0x7fe4e8074000 2024-09-05T13:02:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.615+0000 7fe4ecedd640 1 -- 172.21.15.73:0/2001337758 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e81c8830 con 0x7fe4e8074000 2024-09-05T13:02:21.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:21 smithi169 ceph-mon[34823]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.3 MiB/s wr, 1.15k op/s 2024-09-05T13:02:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.619+0000 7fe4efc71740 1 Processor -- start 2024-09-05T13:02:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.619+0000 7fe4efc71740 1 -- start start 2024-09-05T13:02:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.619+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55b79a0 0x561fa55b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.619+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55b82e0 0x561fa55bcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.619+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55bd370 0x561fa55bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.619+0000 7fe4efc71740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561fa551b2f0 con 0x561fa55b79a0 2024-09-05T13:02:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.619+0000 7fe4efc71740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561fa54c3270 con 0x561fa55bd370 2024-09-05T13:02:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.619+0000 7fe4efc71740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561fa55172b0 con 0x561fa55b82e0 2024-09-05T13:02:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.621+0000 7fe4e6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55b79a0 0x561fa55b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.621+0000 7fe4e6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55b79a0 0x561fa55b7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36814/0 (socket says 172.21.15.73:36814) 2024-09-05T13:02:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.621+0000 7fe4e6d9d640 1 -- 172.21.15.73:0/3400174931 learned_addr learned my addr 172.21.15.73:0/3400174931 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:21.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.621+0000 7fe4e659c640 1 --2- 172.21.15.73:0/3400174931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55b82e0 0x561fa55bcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.622+0000 7fe4e6d9d640 1 -- 172.21.15.73:0/3400174931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55b82e0 msgr2=0x561fa55bcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.622+0000 7fe4e6d9d640 1 --2- 172.21.15.73:0/3400174931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55b82e0 0x561fa55bcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.622+0000 7fe4e6d9d640 1 -- 172.21.15.73:0/3400174931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55bd370 msgr2=0x561fa55bf830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:02:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.622+0000 7fe4e6d9d640 1 --2- 172.21.15.73:0/3400174931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55bd370 0x561fa55bf830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.622+0000 7fe4e6d9d640 1 -- 172.21.15.73:0/3400174931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa54c2340 con 0x561fa55b79a0 2024-09-05T13:02:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.623+0000 7fe4e6d9d640 1 --2- 172.21.15.73:0/3400174931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55b79a0 0x561fa55b7da0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009c10 tx=0x7fe4e0030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c0dc05ba5a79f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.625+0000 7fe4d4ff9640 1 -- 172.21.15.73:0/3400174931 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0040030 con 0x561fa55b79a0 2024-09-05T13:02:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.625+0000 7fe4d4ff9640 1 -- 172.21.15.73:0/3400174931 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4e0030d20 con 0x561fa55b79a0 2024-09-05T13:02:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.626+0000 7fe4efc71740 1 -- 172.21.15.73:0/3400174931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55b79a0 msgr2=0x561fa55b7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.626+0000 7fe4efc71740 1 --2- 172.21.15.73:0/3400174931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55b79a0 0x561fa55b7da0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009c10 tx=0x7fe4e0030b70 comp rx=0 tx=0).stop 2024-09-05T13:02:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.626+0000 7fe4efc71740 1 -- 172.21.15.73:0/3400174931 shutdown_connections 2024-09-05T13:02:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.626+0000 7fe4efc71740 1 --2- 172.21.15.73:0/3400174931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55bd370 0x561fa55bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.626+0000 7fe4efc71740 1 --2- 172.21.15.73:0/3400174931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55b82e0 0x561fa55bcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.626+0000 7fe4efc71740 1 --2- 172.21.15.73:0/3400174931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55b79a0 0x561fa55b7da0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.626+0000 7fe4efc71740 1 -- 172.21.15.73:0/3400174931 >> 172.21.15.73:0/3400174931 conn(0x561fa55b3010 msgr2=0x561fa55b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.629+0000 7fe4d77fe640 1 -- 172.21.15.73:0/2001337758 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe4dc010c30 con 0x7fe4e8074000 2024-09-05T13:02:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.630+0000 7fe4d77fe640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4d00a3110 0x7fe4d00a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.630+0000 7fe4d77fe640 1 -- 172.21.15.73:0/2001337758 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fe4dc011630 con 0x7fe4e8074000 2024-09-05T13:02:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.631+0000 7fe4e659c640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4d00a3110 0x7fe4d00a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.632+0000 7fe4efc71740 1 -- 172.21.15.73:0/3400174931 shutdown_connections 2024-09-05T13:02:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.635+0000 7fe4efc71740 1 -- 172.21.15.73:0/3400174931 wait complete. 2024-09-05T13:02:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.635+0000 7fe4efc71740 1 -- start start 2024-09-05T13:02:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.636+0000 7fe4efc71740 1 Processor -- start 2024-09-05T13:02:21.639 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.638+0000 7fe4e659c640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4d00a3110 0x7fe4d00a55d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x561fa55b3e90 tx=0x7fe4d801a270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.638+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55bd370 0x561fa55c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.639+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55c21e0 0x561fa55c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.639+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.639+0000 7fe4efc71740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561fa55c0330 con 0x561fa55bd370 2024-09-05T13:02:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.639+0000 7fe4efc71740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561fa54a4290 con 0x561fa55c21e0 2024-09-05T13:02:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.639+0000 7fe4efc71740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561fa55c04b0 con 0x561fa55c2660 2024-09-05T13:02:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.639+0000 7fe4efc71740 10 client.0 _ll_register_callbacks cb 0x561fa54d5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.639+0000 7fe4e6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.639+0000 7fe4e6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:48794/0 (socket says 172.21.15.73:48794) 2024-09-05T13:02:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.639+0000 7fe4e6d9d640 1 -- 172.21.15.73:0/3606173437 learned_addr learned my addr 172.21.15.73:0/3606173437 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.639+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55c21e0 0x561fa55c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.641+0000 7fe4e6d9d640 1 -- 172.21.15.73:0/3606173437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55c21e0 msgr2=0x561fa55c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.641+0000 7fe4e6d9d640 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55c21e0 0x561fa55c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.641+0000 7fe4e6d9d640 1 -- 172.21.15.73:0/3606173437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55bd370 msgr2=0x561fa55c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.641+0000 7fe4e6d9d640 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55bd370 0x561fa55c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.641+0000 7fe4e6d9d640 1 -- 172.21.15.73:0/3606173437 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa522e210 con 0x561fa55c2660 2024-09-05T13:02:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.641+0000 7fe4e6d9d640 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c9750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe4e002acf0 tx=0x7fe4e0030e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a220d32fa9a4ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.641+0000 7fe4cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:02:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.642+0000 7fe4cdffb640 1 -- 172.21.15.73:0/3606173437 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0049070 con 0x561fa55c2660 2024-09-05T13:02:21.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.642+0000 7fe4efc71740 1 -- 172.21.15.73:0/3606173437 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561fa5528a20 con 0x561fa55c2660 2024-09-05T13:02:21.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.645+0000 7fe4cdffb640 1 -- 172.21.15.73:0/3606173437 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fe4e00306e0 con 0x561fa55c2660 2024-09-05T13:02:21.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.645+0000 7fe4cdffb640 1 -- 172.21.15.73:0/3606173437 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe4e0053050 con 0x561fa55c2660 2024-09-05T13:02:21.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.645+0000 7fe4efc71740 10 client.25591 fetch_fsmap learned FSMap version 38 2024-09-05T13:02:21.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.645+0000 7fe4efc71740 1 -- 172.21.15.73:0/3606173437 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561fa52fa620 con 0x561fa55c2660 2024-09-05T13:02:21.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.646+0000 7fe4cdffb640 1 -- 172.21.15.73:0/3606173437 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561fa5528a20 con 0x561fa55c2660 2024-09-05T13:02:21.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.647+0000 7fe4cdffb640 1 -- 172.21.15.73:0/3606173437 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7fe4e0056020 con 0x561fa55c2660 2024-09-05T13:02:21.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.647+0000 7fe4efc71740 10 client.25591 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T13:02:21.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.647+0000 7fe4efc71740 10 client.25591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:21.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.647+0000 7fe4efc71740 20 client.25591 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:21.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.647+0000 7fe4efc71740 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561fa55ce210 0x561fa55d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.647+0000 7fe4efc71740 4 client.25591 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:02:21.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.647+0000 7fe4efc71740 1 -- 172.21.15.73:0/3606173437 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fa5522d70 con 0x561fa55ce210 2024-09-05T13:02:21.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.648+0000 7fe4e659c640 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561fa55ce210 0x561fa55d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.648+0000 7fe4e659c640 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561fa55ce210 0x561fa55d0650 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c53a2de3c850090e server_cookie=76ed9738f511a3b6 in_seq=0 out_seq=0 2024-09-05T13:02:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.649+0000 7fe4cdffb640 10 client.25591 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.649+0000 7fe4cdffb640 1 -- 172.21.15.73:0/3606173437 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fa5522d70 con 0x561fa55ce210 2024-09-05T13:02:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4cdffb640 10 client.25591 handle_command_reply: tid=0 2024-09-05T13:02:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4efc71740 1 client.25591 shutdown 2024-09-05T13:02:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4efc71740 1 -- 172.21.15.73:0/3606173437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 msgr2=0x561fa55c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:21.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4efc71740 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c9750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe4e002acf0 tx=0x7fe4e0030e90 comp rx=0 tx=0).stop 2024-09-05T13:02:21.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4efc71740 1 -- 172.21.15.73:0/3606173437 shutdown_connections 2024-09-05T13:02:21.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4efc71740 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561fa55ce210 0x561fa55d0650 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4efc71740 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c9750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4efc71740 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55c21e0 0x561fa55c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4efc71740 1 --2- 172.21.15.73:0/3606173437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55bd370 0x561fa55c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4efc71740 1 -- 172.21.15.73:0/3606173437 >> 172.21.15.73:0/3606173437 conn(0x561fa55b3010 msgr2=0x561fa55b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:21.652 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.650+0000 7fe4cdffb640 0 client.25591 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.652+0000 7fe4efc71740 1 -- 172.21.15.73:0/3606173437 shutdown_connections 2024-09-05T13:02:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.652+0000 7fe4efc71740 1 -- 172.21.15.73:0/3606173437 wait complete. 2024-09-05T13:02:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.652+0000 7fe4efc71740 20 client.25591 trim_cache size 0 max 16384 2024-09-05T13:02:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.689+0000 7fe4efc71740 1 Processor -- start 2024-09-05T13:02:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.690+0000 7fe4efc71740 1 -- start start 2024-09-05T13:02:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.691+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55bd370 0x561fa55b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.691+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.691+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.691+0000 7fe4efc71740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e81d3ed0 con 0x561fa55c21e0 2024-09-05T13:02:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.691+0000 7fe4efc71740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e81d1710 con 0x561fa55bd370 2024-09-05T13:02:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.691+0000 7fe4efc71740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e81cf560 con 0x561fa55c2660 2024-09-05T13:02:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.691+0000 7fe4e6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.691+0000 7fe4e6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:48796/0 (socket says 172.21.15.73:48796) 2024-09-05T13:02:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.691+0000 7fe4e6d9d640 1 -- 172.21.15.73:0/428427587 learned_addr learned my addr 172.21.15.73:0/428427587 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.692+0000 7fe4e659c640 1 --2- 172.21.15.73:0/428427587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55bd370 0x561fa55b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.692+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/428427587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.693+0000 7fe4e5d9b640 1 -- 172.21.15.73:0/428427587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 msgr2=0x561fa55c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.693+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/428427587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.693+0000 7fe4e5d9b640 1 -- 172.21.15.73:0/428427587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55bd370 msgr2=0x561fa55b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.693+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/428427587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55bd370 0x561fa55b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.693+0000 7fe4e5d9b640 1 -- 172.21.15.73:0/428427587 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa55bc820 con 0x561fa55c21e0 2024-09-05T13:02:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.695+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/428427587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c9170 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc09a3b0 tx=0x7fe4dc094f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c37455ef0b60ad server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.696+0000 7fe4cffff640 1 -- 172.21.15.73:0/428427587 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc09e7d0 con 0x561fa55c21e0 2024-09-05T13:02:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.696+0000 7fe4cffff640 1 -- 172.21.15.73:0/428427587 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4dc0a3090 con 0x561fa55c21e0 2024-09-05T13:02:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.696+0000 7fe4cffff640 1 -- 172.21.15.73:0/428427587 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc099870 con 0x561fa55c21e0 2024-09-05T13:02:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.697+0000 7fe4efc71740 1 -- 172.21.15.73:0/428427587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 msgr2=0x561fa55c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.697+0000 7fe4efc71740 1 --2- 172.21.15.73:0/428427587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c9170 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc09a3b0 tx=0x7fe4dc094f90 comp rx=0 tx=0).stop 2024-09-05T13:02:21.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.704+0000 7fe4efc71740 1 -- 172.21.15.73:0/428427587 shutdown_connections 2024-09-05T13:02:21.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.704+0000 7fe4efc71740 1 --2- 172.21.15.73:0/428427587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55c2660 0x561fa55c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.704+0000 7fe4efc71740 1 --2- 172.21.15.73:0/428427587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c9170 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.704+0000 7fe4efc71740 1 --2- 172.21.15.73:0/428427587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55bd370 0x561fa55b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.704+0000 7fe4efc71740 1 -- 172.21.15.73:0/428427587 >> 172.21.15.73:0/428427587 conn(0x561fa55b3010 msgr2=0x561fa55b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:21.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.707+0000 7fe4efc71740 1 -- 172.21.15.73:0/428427587 shutdown_connections 2024-09-05T13:02:21.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.708+0000 7fe4efc71740 1 -- 172.21.15.73:0/428427587 wait complete. 2024-09-05T13:02:21.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.708+0000 7fe4efc71740 1 -- start start 2024-09-05T13:02:21.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.709+0000 7fe4efc71740 1 Processor -- start 2024-09-05T13:02:21.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.711+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55bd370 0x561fa55c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.711+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.711+0000 7fe4efc71740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55c2660 0x561fa55c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.711+0000 7fe4efc71740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e81cfbd0 con 0x561fa55c21e0 2024-09-05T13:02:21.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.711+0000 7fe4efc71740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e81d1040 con 0x561fa55c2660 2024-09-05T13:02:21.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.711+0000 7fe4efc71740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e81d02a0 con 0x561fa55bd370 2024-09-05T13:02:21.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.711+0000 7fe4efc71740 10 client.0 _ll_register_callbacks cb 0x7fe4d8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.713+0000 7fe4e5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.713+0000 7fe4e659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55bd370 0x561fa55c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.713+0000 7fe4e5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36846/0 (socket says 172.21.15.73:36846) 2024-09-05T13:02:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.713+0000 7fe4e5d9b640 1 -- 172.21.15.73:0/2864530853 learned_addr learned my addr 172.21.15.73:0/2864530853 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.713+0000 7fe4e6d9d640 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55c2660 0x561fa55c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.713+0000 7fe4e5d9b640 1 -- 172.21.15.73:0/2864530853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55bd370 msgr2=0x561fa55c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.713+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55bd370 0x561fa55c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.713+0000 7fe4e5d9b640 1 -- 172.21.15.73:0/2864530853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55c2660 msgr2=0x561fa55c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.713+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55c2660 0x561fa55c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.713+0000 7fe4e5d9b640 1 -- 172.21.15.73:0/2864530853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa55c9770 con 0x561fa55c21e0 2024-09-05T13:02:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.714+0000 7fe4e5d9b640 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c4180 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc096880 tx=0x7fe4dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537b8dd6db4d6161 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.714+0000 7fe4cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:02:21.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.715+0000 7fe4cdffb640 1 -- 172.21.15.73:0/2864530853 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0b2070 con 0x561fa55c21e0 2024-09-05T13:02:21.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.715+0000 7fe4cdffb640 1 -- 172.21.15.73:0/2864530853 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fe4dc0b3290 con 0x561fa55c21e0 2024-09-05T13:02:21.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.715+0000 7fe4efc71740 1 -- 172.21.15.73:0/2864530853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4dc0a3090 con 0x561fa55c21e0 2024-09-05T13:02:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.716+0000 7fe4cdffb640 1 -- 172.21.15.73:0/2864530853 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe4dc099870 con 0x561fa55c21e0 2024-09-05T13:02:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.717+0000 7fe4efc71740 10 client.16044 fetch_fsmap learned FSMap version 38 2024-09-05T13:02:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.717+0000 7fe4efc71740 1 -- 172.21.15.73:0/2864530853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561fa5637d20 con 0x561fa55c21e0 2024-09-05T13:02:21.722 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.721+0000 7fe4cdffb640 1 -- 172.21.15.73:0/2864530853 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4dc0a3090 con 0x561fa55c21e0 2024-09-05T13:02:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.721+0000 7fe4cdffb640 1 -- 172.21.15.73:0/2864530853 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7fe4dc0992e0 con 0x561fa55c21e0 2024-09-05T13:02:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.721+0000 7fe4efc71740 10 client.16044 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T13:02:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.721+0000 7fe4efc71740 10 client.16044 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.721+0000 7fe4efc71740 20 client.16044 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.721+0000 7fe4efc71740 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561fa5638690 0x561fa563aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.721+0000 7fe4efc71740 4 client.16044 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:02:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.721+0000 7fe4efc71740 1 -- 172.21.15.73:0/2864530853 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561fa549f900 con 0x561fa5638690 2024-09-05T13:02:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.721+0000 7fe4e659c640 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561fa5638690 0x561fa563aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:21.725 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.723+0000 7fe4cdffb640 10 client.16044 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:21.725 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:21.724+0000 7fe4e659c640 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561fa5638690 0x561fa563aab0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd2e247dec066960 server_cookie=3b823e81d9a357eb in_seq=0 out_seq=0 2024-09-05T13:02:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4cdffb640 1 -- 172.21.15.73:0/2864530853 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561fa549f900 con 0x561fa5638690 2024-09-05T13:02:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4cdffb640 10 client.16044 handle_command_reply: tid=0 2024-09-05T13:02:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 client.16044 shutdown 2024-09-05T13:02:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 -- 172.21.15.73:0/2864530853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 msgr2=0x561fa55c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c4180 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc096880 tx=0x7fe4dc0046c0 comp rx=0 tx=0).stop 2024-09-05T13:02:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 -- 172.21.15.73:0/2864530853 shutdown_connections 2024-09-05T13:02:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x561fa5638690 0x561fa563aab0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fa55c2660 0x561fa55c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fa55c21e0 0x561fa55c4180 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 --2- 172.21.15.73:0/2864530853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561fa55bd370 0x561fa55c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 -- 172.21.15.73:0/2864530853 >> 172.21.15.73:0/2864530853 conn(0x561fa55b3010 msgr2=0x561fa55b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4cdffb640 0 client.16044 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 -- 172.21.15.73:0/2864530853 shutdown_connections 2024-09-05T13:02:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 1 -- 172.21.15.73:0/2864530853 wait complete. 2024-09-05T13:02:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.109+0000 7fe4efc71740 20 client.16044 trim_cache size 0 max 16384 2024-09-05T13:02:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:02:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:02:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:02:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:02:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 -- 172.21.15.73:0/2001337758 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4d00a3110 msgr2=0x7fe4d00a55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4d00a3110 0x7fe4d00a55d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x561fa55b3e90 tx=0x7fe4d801a270 comp rx=0 tx=0).stop 2024-09-05T13:02:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 -- 172.21.15.73:0/2001337758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4e8074000 msgr2=0x7fe4e819ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4e8074000 0x7fe4e819ee40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00b3c0 tx=0x7fe4dc00b880 comp rx=0 tx=0).stop 2024-09-05T13:02:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 -- 172.21.15.73:0/2001337758 shutdown_connections 2024-09-05T13:02:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe4d00a3110 0x7fe4d00a55d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4e810ddc0 0x7fe4e81c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4e8074000 0x7fe4e819ee40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 --2- 172.21.15.73:0/2001337758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8073b50 0x7fe4e819e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 -- 172.21.15.73:0/2001337758 >> 172.21.15.73:0/2001337758 conn(0x7fe4e806f640 msgr2=0x7fe4e80717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 -- 172.21.15.73:0/2001337758 shutdown_connections 2024-09-05T13:02:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:22.110+0000 7fe4ecedd640 1 -- 172.21.15.73:0/2001337758 wait complete. 2024-09-05T13:02:23.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:23 smithi073 ceph-mon[30883]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 17 MiB/s wr, 4.11k op/s 2024-09-05T13:02:23.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:23 smithi162 ceph-mon[34220]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 17 MiB/s wr, 4.11k op/s 2024-09-05T13:02:23.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:23 smithi169 ceph-mon[34823]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 17 MiB/s wr, 4.11k op/s 2024-09-05T13:02:25.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:25 smithi073 ceph-mon[30883]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.29k op/s 2024-09-05T13:02:25.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:25 smithi162 ceph-mon[34220]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.29k op/s 2024-09-05T13:02:25.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:25 smithi169 ceph-mon[34823]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.29k op/s 2024-09-05T13:02:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:27 smithi073 ceph-mon[30883]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2024-09-05T13:02:27.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:27 smithi162 ceph-mon[34220]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2024-09-05T13:02:27.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:27 smithi169 ceph-mon[34823]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2024-09-05T13:02:29.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:29 smithi073 ceph-mon[30883]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 5.60k op/s 2024-09-05T13:02:29.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:29 smithi162 ceph-mon[34220]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 5.60k op/s 2024-09-05T13:02:29.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:29 smithi169 ceph-mon[34823]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 5.60k op/s 2024-09-05T13:02:31.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:31 smithi073 ceph-mon[30883]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 5.15k op/s 2024-09-05T13:02:31.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:31 smithi162 ceph-mon[34220]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 5.15k op/s 2024-09-05T13:02:31.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:31 smithi169 ceph-mon[34823]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 5.15k op/s 2024-09-05T13:02:33.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:33 smithi073 ceph-mon[30883]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 5.67k op/s 2024-09-05T13:02:33.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:33 smithi162 ceph-mon[34220]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 5.67k op/s 2024-09-05T13:02:33.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:33 smithi169 ceph-mon[34823]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 5.67k op/s 2024-09-05T13:02:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.275+0000 7f8e092c3640 1 -- 172.21.15.73:0/3015998590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e04101d80 msgr2=0x7f8e04108610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.275+0000 7f8e092c3640 1 --2- 172.21.15.73:0/3015998590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e04101d80 0x7f8e04108610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc01acb0 tx=0x7f8dfc03b900 comp rx=0 tx=0).stop 2024-09-05T13:02:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.279+0000 7f8e092c3640 1 -- 172.21.15.73:0/3015998590 shutdown_connections 2024-09-05T13:02:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.279+0000 7f8e092c3640 1 --2- 172.21.15.73:0/3015998590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e04101d80 0x7f8e04108610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.279+0000 7f8e092c3640 1 --2- 172.21.15.73:0/3015998590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e041013c0 0x7f8e04101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.279+0000 7f8e092c3640 1 --2- 172.21.15.73:0/3015998590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e041001d0 0x7f8e041005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.279+0000 7f8e092c3640 1 -- 172.21.15.73:0/3015998590 >> 172.21.15.73:0/3015998590 conn(0x7f8e040fb930 msgr2=0x7f8e040fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.283+0000 7f8e092c3640 1 -- 172.21.15.73:0/3015998590 shutdown_connections 2024-09-05T13:02:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.285+0000 7f8e092c3640 1 -- 172.21.15.73:0/3015998590 wait complete. 2024-09-05T13:02:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.286+0000 7f8e092c3640 1 Processor -- start 2024-09-05T13:02:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.289+0000 7f8e092c3640 1 -- start start 2024-09-05T13:02:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.289+0000 7f8e092c3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e041001d0 0x7f8e04198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.289+0000 7f8e092c3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e041013c0 0x7f8e0419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.289+0000 7f8e092c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e04101d80 0x7f8e0419d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.289+0000 7f8e092c3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0406e0c0 con 0x7f8e041001d0 2024-09-05T13:02:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.289+0000 7f8e092c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0406df40 con 0x7f8e04101d80 2024-09-05T13:02:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.289+0000 7f8e092c3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0406e240 con 0x7f8e041013c0 2024-09-05T13:02:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.290+0000 7f8e027fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e041013c0 0x7f8e0419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.290+0000 7f8e027fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e041013c0 0x7f8e0419ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:50552/0 (socket says 172.21.15.73:50552) 2024-09-05T13:02:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.290+0000 7f8e027fc640 1 -- 172.21.15.73:0/2249443305 learned_addr learned my addr 172.21.15.73:0/2249443305 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.292+0000 7f8e037fe640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e04101d80 0x7f8e0419d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.293+0000 7f8e037fe640 1 -- 172.21.15.73:0/2249443305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e041013c0 msgr2=0x7f8e0419ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.293+0000 7f8e037fe640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e041013c0 0x7f8e0419ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.293+0000 7f8e037fe640 1 -- 172.21.15.73:0/2249443305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e041001d0 msgr2=0x7f8e04198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.293+0000 7f8e037fe640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e041001d0 0x7f8e04198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.293+0000 7f8e037fe640 1 -- 172.21.15.73:0/2249443305 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0419d870 con 0x7f8e04101d80 2024-09-05T13:02:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.297+0000 7f8e037fe640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e04101d80 0x7f8e0419d230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0407e0 tx=0x7f8dfc041950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.297+0000 7f8debfff640 1 -- 172.21.15.73:0/2249443305 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc045070 con 0x7f8e04101d80 2024-09-05T13:02:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.298+0000 7f8debfff640 1 -- 172.21.15.73:0/2249443305 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dfc003e50 con 0x7f8e04101d80 2024-09-05T13:02:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.299+0000 7f8debfff640 1 -- 172.21.15.73:0/2249443305 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc003b70 con 0x7f8e04101d80 2024-09-05T13:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.300+0000 7f8e092c3640 1 -- 172.21.15.73:0/2249443305 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0419db00 con 0x7f8e04101d80 2024-09-05T13:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.300+0000 7f8e092c3640 1 -- 172.21.15.73:0/2249443305 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0419dff0 con 0x7f8e04101d80 2024-09-05T13:02:35.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.306+0000 7f8e0c059740 1 Processor -- start 2024-09-05T13:02:35.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.312+0000 7f8debfff640 1 -- 172.21.15.73:0/2249443305 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8dfc048020 con 0x7f8e04101d80 2024-09-05T13:02:35.315 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.313+0000 7f8e0c059740 1 -- start start 2024-09-05T13:02:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.314+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a23169a0 0x5618a2316da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.314+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a231bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.314+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a231c370 0x5618a231e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.314+0000 7f8e0c059740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5618a227a2f0 con 0x5618a23169a0 2024-09-05T13:02:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.314+0000 7f8e0c059740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5618a2222270 con 0x5618a231c370 2024-09-05T13:02:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.314+0000 7f8e0c059740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618a22762b0 con 0x5618a23172e0 2024-09-05T13:02:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.314+0000 7f8debfff640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8dec0a2b60 0x7f8dec0a5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.315+0000 7f8e02ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a231bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.315+0000 7f8debfff640 1 -- 172.21.15.73:0/2249443305 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f8dfc100e90 con 0x7f8e04101d80 2024-09-05T13:02:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.315+0000 7f8e02ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a231bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:50566/0 (socket says 172.21.15.73:50566) 2024-09-05T13:02:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.315+0000 7f8e02ffd640 1 -- 172.21.15.73:0/1438790513 learned_addr learned my addr 172.21.15.73:0/1438790513 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.316+0000 7f8e02ffd640 1 -- 172.21.15.73:0/1438790513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a231c370 msgr2=0x5618a231e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:02:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.316+0000 7f8e02ffd640 1 --2- 172.21.15.73:0/1438790513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a231c370 0x5618a231e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.316+0000 7f8e02ffd640 1 -- 172.21.15.73:0/1438790513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a23169a0 msgr2=0x5618a2316da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:02:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.316+0000 7f8e02ffd640 1 --2- 172.21.15.73:0/1438790513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a23169a0 0x5618a2316da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.316+0000 7f8e02ffd640 1 -- 172.21.15.73:0/1438790513 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618a2221340 con 0x5618a23172e0 2024-09-05T13:02:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.317+0000 7f8e037fe640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8dec0a2b60 0x7f8dec0a5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.319+0000 7f8e02ffd640 1 --2- 172.21.15.73:0/1438790513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a231bda0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8df40097b0 tx=0x7f8df4009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88ab1b09904e04fa server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.320+0000 7f8de97fa640 1 -- 172.21.15.73:0/1438790513 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4015020 con 0x5618a23172e0 2024-09-05T13:02:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.320+0000 7f8de97fa640 1 -- 172.21.15.73:0/1438790513 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df4011420 con 0x5618a23172e0 2024-09-05T13:02:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.320+0000 7f8de97fa640 1 -- 172.21.15.73:0/1438790513 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df40105e0 con 0x5618a23172e0 2024-09-05T13:02:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.321+0000 7f8e0c059740 1 -- 172.21.15.73:0/1438790513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 msgr2=0x5618a231bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.321+0000 7f8e0c059740 1 --2- 172.21.15.73:0/1438790513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a231bda0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8df40097b0 tx=0x7f8df4009c70 comp rx=0 tx=0).stop 2024-09-05T13:02:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.322+0000 7f8e037fe640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8dec0a2b60 0x7f8dec0a5020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc01a630 tx=0x7f8dfc040810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.325+0000 7f8e0c059740 1 -- 172.21.15.73:0/1438790513 shutdown_connections 2024-09-05T13:02:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.325+0000 7f8e0c059740 1 --2- 172.21.15.73:0/1438790513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a231c370 0x5618a231e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.325+0000 7f8e0c059740 1 --2- 172.21.15.73:0/1438790513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a231bda0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.325+0000 7f8e0c059740 1 --2- 172.21.15.73:0/1438790513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a23169a0 0x5618a2316da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.325+0000 7f8e0c059740 1 -- 172.21.15.73:0/1438790513 >> 172.21.15.73:0/1438790513 conn(0x5618a2312010 msgr2=0x5618a2312410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.329+0000 7f8e0c059740 1 -- 172.21.15.73:0/1438790513 shutdown_connections 2024-09-05T13:02:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.333+0000 7f8e0c059740 1 -- 172.21.15.73:0/1438790513 wait complete. 2024-09-05T13:02:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.333+0000 7f8e0c059740 1 -- start start 2024-09-05T13:02:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.333+0000 7f8e0c059740 1 Processor -- start 2024-09-05T13:02:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.334+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 0x5618a2320c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.334+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a2321170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.334+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a23281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.334+0000 7f8e0c059740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5618a231f340 con 0x5618a231c370 2024-09-05T13:02:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.334+0000 7f8e0c059740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5618a2203290 con 0x5618a23169a0 2024-09-05T13:02:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.334+0000 7f8e0c059740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618a231f4c0 con 0x5618a23172e0 2024-09-05T13:02:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.334+0000 7f8e027fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 0x5618a2320c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.334+0000 7f8e027fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 0x5618a2320c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:56824/0 (socket says 172.21.15.73:56824) 2024-09-05T13:02:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.334+0000 7f8e027fc640 1 -- 172.21.15.73:0/865520485 learned_addr learned my addr 172.21.15.73:0/865520485 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.334+0000 7f8e02ffd640 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a2321170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.335+0000 7f8e027fc640 1 -- 172.21.15.73:0/865520485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 msgr2=0x5618a2321170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.335+0000 7f8e027fc640 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a2321170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.335+0000 7f8e027fc640 1 -- 172.21.15.73:0/865520485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 msgr2=0x5618a23281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.335+0000 7f8e027fc640 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a23281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.335+0000 7f8e027fc640 1 -- 172.21.15.73:0/865520485 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618a1f8d210 con 0x5618a23169a0 2024-09-05T13:02:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.336+0000 7f8e0c059740 10 client.0 _ll_register_callbacks cb 0x5618a2234140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.336+0000 7f8e0c059740 1 -- 172.21.15.73:0/865520485 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8df4011420 con 0x5618a23169a0 2024-09-05T13:02:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.338+0000 7f8e027fc640 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 0x5618a2320c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8df8010540 tx=0x7f8df8010a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=699f7bcb24745e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.339+0000 7f8de6ff5640 10 client.25526 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:02:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.339+0000 7f8de6ff5640 1 -- 172.21.15.73:0/865520485 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8022050 con 0x5618a23169a0 2024-09-05T13:02:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.339+0000 7f8de6ff5640 1 -- 172.21.15.73:0/865520485 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f8df8012600 con 0x5618a23169a0 2024-09-05T13:02:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.339+0000 7f8de6ff5640 1 -- 172.21.15.73:0/865520485 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8df8018070 con 0x5618a23169a0 2024-09-05T13:02:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.340+0000 7f8e0c059740 10 client.25526 fetch_fsmap learned FSMap version 38 2024-09-05T13:02:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.340+0000 7f8e0c059740 1 -- 172.21.15.73:0/865520485 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=38}) -- 0x5618a2059620 con 0x5618a23169a0 2024-09-05T13:02:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.343+0000 7f8de6ff5640 1 -- 172.21.15.73:0/865520485 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7f8df8012840 con 0x5618a23169a0 2024-09-05T13:02:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.344+0000 7f8e0c059740 10 client.25526 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T13:02:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.344+0000 7f8e0c059740 10 client.25526 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.344+0000 7f8e0c059740 20 client.25526 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.344+0000 7f8e0c059740 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5618a232c750 0x5618a232ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.344+0000 7f8e0c059740 4 client.25526 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:02:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.344+0000 7f8e0c059740 1 -- 172.21.15.73:0/865520485 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618a2287a20 con 0x5618a232c750 2024-09-05T13:02:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.347+0000 7f8e02ffd640 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5618a232c750 0x5618a232ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.357+0000 7f8e02ffd640 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5618a232c750 0x5618a232ec10 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecc61b76515558c3 server_cookie=3003147d7460d953 in_seq=0 out_seq=0 2024-09-05T13:02:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.357+0000 7f8de6ff5640 10 client.25526 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.358+0000 7f8de6ff5640 1 -- 172.21.15.73:0/865520485 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618a2287a20 con 0x5618a232c750 2024-09-05T13:02:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.358+0000 7f8de6ff5640 10 client.25526 handle_command_reply: tid=0 2024-09-05T13:02:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.359+0000 7f8e0c059740 1 client.25526 shutdown 2024-09-05T13:02:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.364+0000 7f8e0c059740 1 -- 172.21.15.73:0/865520485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 msgr2=0x5618a2320c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.364+0000 7f8e0c059740 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 0x5618a2320c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8df8010540 tx=0x7f8df8010a00 comp rx=0 tx=0).stop 2024-09-05T13:02:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.365+0000 7f8e0c059740 1 -- 172.21.15.73:0/865520485 shutdown_connections 2024-09-05T13:02:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.365+0000 7f8e0c059740 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5618a232c750 0x5618a232ec10 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.365+0000 7f8e0c059740 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a23281b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.365+0000 7f8e0c059740 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a2321170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.365+0000 7f8e0c059740 1 --2- 172.21.15.73:0/865520485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 0x5618a2320c30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.365+0000 7f8e0c059740 1 -- 172.21.15.73:0/865520485 >> 172.21.15.73:0/865520485 conn(0x5618a2312010 msgr2=0x5618a2313820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.367+0000 7f8de6ff5640 0 client.25526 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.368+0000 7f8e0c059740 1 -- 172.21.15.73:0/865520485 shutdown_connections 2024-09-05T13:02:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.369+0000 7f8e0c059740 1 -- 172.21.15.73:0/865520485 wait complete. 2024-09-05T13:02:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.370+0000 7f8e0c059740 20 client.25526 trim_cache size 0 max 16384 2024-09-05T13:02:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.410+0000 7f8e0c059740 1 Processor -- start 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.410+0000 7f8e0c059740 1 -- start start 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23169a0 0x5618a2321200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23172e0 0x5618a23119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a23280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e0c059740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041a9480 con 0x5618a231c370 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e0c059740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041a6cc0 con 0x5618a23172e0 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e0c059740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041a4b10 con 0x5618a23169a0 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e027fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23169a0 0x5618a2321200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e027fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23169a0 0x5618a2321200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:50582/0 (socket says 172.21.15.73:50582) 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e027fc640 1 -- 172.21.15.73:0/2960892915 learned_addr learned my addr 172.21.15.73:0/2960892915 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e027fc640 1 --2- 172.21.15.73:0/2960892915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a23280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.411+0000 7f8e02ffd640 1 --2- 172.21.15.73:0/2960892915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23172e0 0x5618a23119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.412+0000 7f8e027fc640 1 -- 172.21.15.73:0/2960892915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23172e0 msgr2=0x5618a23119b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.412+0000 7f8e027fc640 1 --2- 172.21.15.73:0/2960892915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23172e0 0x5618a23119b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.412+0000 7f8e027fc640 1 -- 172.21.15.73:0/2960892915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 msgr2=0x5618a23280d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.412+0000 7f8e027fc640 1 --2- 172.21.15.73:0/2960892915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a23280d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.412+0000 7f8e027fc640 1 -- 172.21.15.73:0/2960892915 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618a2328f90 con 0x5618a23169a0 2024-09-05T13:02:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.412+0000 7f8e027fc640 1 --2- 172.21.15.73:0/2960892915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23169a0 0x5618a2321200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8df8006a30 tx=0x7f8df8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2588711bab7b346 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.413+0000 7f8de8ff9640 1 -- 172.21.15.73:0/2960892915 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8000e60 con 0x5618a23169a0 2024-09-05T13:02:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.413+0000 7f8de8ff9640 1 -- 172.21.15.73:0/2960892915 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df4011420 con 0x5618a23169a0 2024-09-05T13:02:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.413+0000 7f8de8ff9640 1 -- 172.21.15.73:0/2960892915 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8022040 con 0x5618a23169a0 2024-09-05T13:02:35.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.414+0000 7f8e0c059740 1 -- 172.21.15.73:0/2960892915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23169a0 msgr2=0x5618a2321200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:35.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.414+0000 7f8e0c059740 1 --2- 172.21.15.73:0/2960892915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23169a0 0x5618a2321200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8df8006a30 tx=0x7f8df8014000 comp rx=0 tx=0).stop 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.414+0000 7f8e0c059740 1 -- 172.21.15.73:0/2960892915 shutdown_connections 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.414+0000 7f8e0c059740 1 --2- 172.21.15.73:0/2960892915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a23280d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.414+0000 7f8e0c059740 1 --2- 172.21.15.73:0/2960892915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23172e0 0x5618a23119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.414+0000 7f8e0c059740 1 --2- 172.21.15.73:0/2960892915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23169a0 0x5618a2321200 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.414+0000 7f8e0c059740 1 -- 172.21.15.73:0/2960892915 >> 172.21.15.73:0/2960892915 conn(0x5618a2312010 msgr2=0x5618a2312ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.414+0000 7f8e0c059740 1 -- 172.21.15.73:0/2960892915 shutdown_connections 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.414+0000 7f8e0c059740 1 -- 172.21.15.73:0/2960892915 wait complete. 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e0c059740 1 -- start start 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e0c059740 1 Processor -- start 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 0x5618a2325810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a2325d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e0c059740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a2326d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e0c059740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041a5180 con 0x5618a231c370 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e0c059740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041a65f0 con 0x5618a23169a0 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e0c059740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041a5850 con 0x5618a23172e0 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e0c059740 10 client.0 _ll_register_callbacks cb 0x7f8df80095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e027fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a2326d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e02ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a2325d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e027fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a2326d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48134/0 (socket says 172.21.15.73:48134) 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e027fc640 1 -- 172.21.15.73:0/4201127132 learned_addr learned my addr 172.21.15.73:0/4201127132 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.415+0000 7f8e027fc640 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 0x5618a2325810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e027fc640 1 -- 172.21.15.73:0/4201127132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 msgr2=0x5618a2325d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e027fc640 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a2325d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e027fc640 1 -- 172.21.15.73:0/4201127132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 msgr2=0x5618a2325810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e027fc640 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 0x5618a2325810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e027fc640 1 -- 172.21.15.73:0/4201127132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618a2327320 con 0x5618a231c370 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e027fc640 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a2326d10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8df80101a0 tx=0x7f8df80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c14beb7dbbdac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8de6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8de6ff5640 1 -- 172.21.15.73:0/4201127132 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8022030 con 0x5618a231c370 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8de6ff5640 1 -- 172.21.15.73:0/4201127132 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f8df8006200 con 0x5618a231c370 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e0c059740 1 -- 172.21.15.73:0/4201127132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8df4011420 con 0x5618a231c370 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8de6ff5640 1 -- 172.21.15.73:0/4201127132 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8df803d050 con 0x5618a231c370 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e0c059740 10 client.16050 fetch_fsmap learned FSMap version 38 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e0c059740 1 -- 172.21.15.73:0/4201127132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5618a23974f0 con 0x5618a231c370 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8de6ff5640 1 -- 172.21.15.73:0/4201127132 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df4011420 con 0x5618a231c370 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8de6ff5640 1 -- 172.21.15.73:0/4201127132 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7f8df80145e0 con 0x5618a231c370 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e0c059740 10 client.16050 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T13:02:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e0c059740 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:35.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e0c059740 20 client.16050 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:35.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.416+0000 7f8e0c059740 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5618a2397e20 0x5618a239a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:35.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.417+0000 7f8e0c059740 4 client.16050 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:02:35.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.417+0000 7f8e0c059740 1 -- 172.21.15.73:0/4201127132 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618a2281d70 con 0x5618a2397e20 2024-09-05T13:02:35.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.417+0000 7f8e02ffd640 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5618a2397e20 0x5618a239a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:35.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.417+0000 7f8de6ff5640 10 client.16050 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:35.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:35.417+0000 7f8e02ffd640 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5618a2397e20 0x5618a239a240 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=366fe76fffc7f183 server_cookie=35019ea226a57a7f in_seq=0 out_seq=0 2024-09-05T13:02:35.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:35 smithi073 ceph-mon[30883]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-09-05T13:02:35.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:35 smithi162 ceph-mon[34220]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-09-05T13:02:35.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:35 smithi169 ceph-mon[34823]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-09-05T13:02:36.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:36 smithi073 ceph-mon[30883]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.6 MiB/s wr, 2.38k op/s 2024-09-05T13:02:36.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:36 smithi162 ceph-mon[34220]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.6 MiB/s wr, 2.38k op/s 2024-09-05T13:02:36.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:36 smithi169 ceph-mon[34823]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.6 MiB/s wr, 2.38k op/s 2024-09-05T13:02:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8de6ff5640 1 -- 172.21.15.73:0/4201127132 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618a2281d70 con 0x5618a2397e20 2024-09-05T13:02:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8de6ff5640 10 client.16050 handle_command_reply: tid=0 2024-09-05T13:02:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8e0c059740 1 client.16050 shutdown 2024-09-05T13:02:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8e0c059740 1 -- 172.21.15.73:0/4201127132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 msgr2=0x5618a2326d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8e0c059740 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a2326d10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8df80101a0 tx=0x7f8df80046c0 comp rx=0 tx=0).stop 2024-09-05T13:02:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8e0c059740 1 -- 172.21.15.73:0/4201127132 shutdown_connections 2024-09-05T13:02:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8e0c059740 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5618a2397e20 0x5618a239a240 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8e0c059740 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618a231c370 0x5618a2326d10 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8e0c059740 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618a23172e0 0x5618a2325d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8de6ff5640 0 client.16050 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8e0c059740 1 --2- 172.21.15.73:0/4201127132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618a23169a0 0x5618a2325810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.300+0000 7f8e0c059740 1 -- 172.21.15.73:0/4201127132 >> 172.21.15.73:0/4201127132 conn(0x5618a2312010 msgr2=0x5618a23136e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.301+0000 7f8e0c059740 1 -- 172.21.15.73:0/4201127132 shutdown_connections 2024-09-05T13:02:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.301+0000 7f8e0c059740 1 -- 172.21.15.73:0/4201127132 wait complete. 2024-09-05T13:02:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.301+0000 7f8e0c059740 20 client.16050 trim_cache size 0 max 16384 2024-09-05T13:02:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:02:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:02:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:02:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:02:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 -- 172.21.15.73:0/2249443305 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8dec0a2b60 msgr2=0x7f8dec0a5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8dec0a2b60 0x7f8dec0a5020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc01a630 tx=0x7f8dfc040810 comp rx=0 tx=0).stop 2024-09-05T13:02:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 -- 172.21.15.73:0/2249443305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e04101d80 msgr2=0x7f8e0419d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e04101d80 0x7f8e0419d230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0407e0 tx=0x7f8dfc041950 comp rx=0 tx=0).stop 2024-09-05T13:02:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 -- 172.21.15.73:0/2249443305 shutdown_connections 2024-09-05T13:02:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f8dec0a2b60 0x7f8dec0a5020 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e04101d80 0x7f8e0419d230 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e041013c0 0x7f8e0419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 --2- 172.21.15.73:0/2249443305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e041001d0 0x7f8e04198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 -- 172.21.15.73:0/2249443305 >> 172.21.15.73:0/2249443305 conn(0x7f8e040fb930 msgr2=0x7f8e04070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 -- 172.21.15.73:0/2249443305 shutdown_connections 2024-09-05T13:02:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:38.302+0000 7f8e092c3640 1 -- 172.21.15.73:0/2249443305 wait complete. 2024-09-05T13:02:39.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:39 smithi073 ceph-mon[30883]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.62k op/s 2024-09-05T13:02:39.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:39 smithi162 ceph-mon[34220]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.62k op/s 2024-09-05T13:02:39.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:39 smithi169 ceph-mon[34823]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.62k op/s 2024-09-05T13:02:41.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:41 smithi073 ceph-mon[30883]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-05T13:02:41.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:41 smithi162 ceph-mon[34220]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-05T13:02:41.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:41 smithi169 ceph-mon[34823]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-05T13:02:43.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:43 smithi073 ceph-mon[30883]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 4.96k op/s 2024-09-05T13:02:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:43 smithi162 ceph-mon[34220]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 4.96k op/s 2024-09-05T13:02:43.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:43 smithi169 ceph-mon[34823]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 4.96k op/s 2024-09-05T13:02:44.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:44 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:44.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:44 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:44.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:44 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:45.473 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T13:02:45.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:45 smithi073 ceph-mon[30883]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.62k op/s 2024-09-05T13:02:45.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:45 smithi162 ceph-mon[34220]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.62k op/s 2024-09-05T13:02:45.518 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:45 smithi169 ceph-mon[34823]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.62k op/s 2024-09-05T13:02:46.445 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:02:46.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:46 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:46.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:46 smithi073 ceph-mon[30883]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 19 MiB/s wr, 4.61k op/s 2024-09-05T13:02:46.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:46 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:46.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:46 smithi162 ceph-mon[34220]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 19 MiB/s wr, 4.61k op/s 2024-09-05T13:02:46.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:46 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:46.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:46 smithi169 ceph-mon[34823]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 19 MiB/s wr, 4.61k op/s 2024-09-05T13:02:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:49 smithi073 ceph-mon[30883]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 5.83k op/s 2024-09-05T13:02:49.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:49 smithi162 ceph-mon[34220]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 5.83k op/s 2024-09-05T13:02:49.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:49 smithi169 ceph-mon[34823]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 5.83k op/s 2024-09-05T13:02:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.421+0000 7f0c398ba640 1 -- 172.21.15.73:0/2498651384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c34100a40 msgr2=0x7f0c34100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.421+0000 7f0c398ba640 1 --2- 172.21.15.73:0/2498651384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c34100a40 0x7f0c34100e40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009900 tx=0x7f0c2402a400 comp rx=0 tx=0).stop 2024-09-05T13:02:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.421+0000 7f0c398ba640 1 -- 172.21.15.73:0/2498651384 shutdown_connections 2024-09-05T13:02:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.421+0000 7f0c398ba640 1 --2- 172.21.15.73:0/2498651384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c341025f0 0x7f0c34108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.421+0000 7f0c398ba640 1 --2- 172.21.15.73:0/2498651384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34101c30 0x7f0c341020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.421+0000 7f0c398ba640 1 --2- 172.21.15.73:0/2498651384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c34100a40 0x7f0c34100e40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.421+0000 7f0c398ba640 1 -- 172.21.15.73:0/2498651384 >> 172.21.15.73:0/2498651384 conn(0x7f0c340fc1e0 msgr2=0x7f0c340fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:51.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.421+0000 7f0c398ba640 1 -- 172.21.15.73:0/2498651384 shutdown_connections 2024-09-05T13:02:51.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.421+0000 7f0c398ba640 1 -- 172.21.15.73:0/2498651384 wait complete. 2024-09-05T13:02:51.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.421+0000 7f0c398ba640 1 Processor -- start 2024-09-05T13:02:51.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c398ba640 1 -- start start 2024-09-05T13:02:51.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c398ba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c34100a40 0x7f0c3419e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c398ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34101c30 0x7f0c3419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c398ba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c341025f0 0x7f0c341a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c398ba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3410a2e0 con 0x7f0c34100a40 2024-09-05T13:02:51.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c398ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3410a160 con 0x7f0c34101c30 2024-09-05T13:02:51.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c398ba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3410a460 con 0x7f0c341025f0 2024-09-05T13:02:51.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c32ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c34100a40 0x7f0c3419e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c32ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c34100a40 0x7f0c3419e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43318/0 (socket says 172.21.15.73:43318) 2024-09-05T13:02:51.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c32ffd640 1 -- 172.21.15.73:0/1607879307 learned_addr learned my addr 172.21.15.73:0/1607879307 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:51.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c327fc640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34101c30 0x7f0c3419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.422+0000 7f0c337fe640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c341025f0 0x7f0c341a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c32ffd640 1 -- 172.21.15.73:0/1607879307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c341025f0 msgr2=0x7f0c341a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:51.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c32ffd640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c341025f0 0x7f0c341a5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c32ffd640 1 -- 172.21.15.73:0/1607879307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34101c30 msgr2=0x7f0c3419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:51.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c32ffd640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34101c30 0x7f0c3419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c32ffd640 1 -- 172.21.15.73:0/1607879307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c341a5fe0 con 0x7f0c34100a40 2024-09-05T13:02:51.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c337fe640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c341025f0 0x7f0c341a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:02:51.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c32ffd640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c34100a40 0x7f0c3419e620 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0c24031440 tx=0x7f0c24032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:51.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c388b8640 1 -- 172.21.15.73:0/1607879307 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2403f030 con 0x7f0c34100a40 2024-09-05T13:02:51.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c388b8640 1 -- 172.21.15.73:0/1607879307 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c24003ce0 con 0x7f0c34100a40 2024-09-05T13:02:51.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c398ba640 1 -- 172.21.15.73:0/1607879307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c341a6270 con 0x7f0c34100a40 2024-09-05T13:02:51.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c388b8640 1 -- 172.21.15.73:0/1607879307 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24035070 con 0x7f0c34100a40 2024-09-05T13:02:51.433 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.423+0000 7f0c398ba640 1 -- 172.21.15.73:0/1607879307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c341a67b0 con 0x7f0c34100a40 2024-09-05T13:02:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.426+0000 7f0c3c657740 1 Processor -- start 2024-09-05T13:02:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.426+0000 7f0c3c657740 1 -- start start 2024-09-05T13:02:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.426+0000 7f0c388b8640 1 -- 172.21.15.73:0/1607879307 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0c24042030 con 0x7f0c34100a40 2024-09-05T13:02:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.426+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce095da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.426+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0962e0 0x55f3ce09ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.426+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce09b370 0x55f3ce09d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.426+0000 7f0c3c657740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f3cdff92f0 con 0x55f3ce09b370 2024-09-05T13:02:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.426+0000 7f0c3c657740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f3cdfa1270 con 0x55f3ce0959a0 2024-09-05T13:02:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.426+0000 7f0c3c657740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f3cdff52b0 con 0x55f3ce0962e0 2024-09-05T13:02:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c32ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0962e0 0x55f3ce09ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c337fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce095da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c337fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce095da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:44502/0 (socket says 172.21.15.73:44502) 2024-09-05T13:02:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c337fe640 1 -- 172.21.15.73:0/1396917013 learned_addr learned my addr 172.21.15.73:0/1396917013 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c327fc640 1 --2- 172.21.15.73:0/1396917013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce09b370 0x55f3ce09d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c337fe640 1 -- 172.21.15.73:0/1396917013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0962e0 msgr2=0x55f3ce09ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c337fe640 1 --2- 172.21.15.73:0/1396917013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0962e0 0x55f3ce09ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c337fe640 1 -- 172.21.15.73:0/1396917013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce09b370 msgr2=0x55f3ce09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c337fe640 1 --2- 172.21.15.73:0/1396917013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce09b370 0x55f3ce09d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c337fe640 1 -- 172.21.15.73:0/1396917013 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cdfa0340 con 0x55f3ce0959a0 2024-09-05T13:02:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.427+0000 7f0c388b8640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c1c0a2d30 0x7f0c1c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.428+0000 7f0c337fe640 1 --2- 172.21.15.73:0/1396917013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce095da0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0117e0 tx=0x7f0c2c011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4563fe65ba16c79d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.428+0000 7f0c32ffd640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c1c0a2d30 0x7f0c1c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.428+0000 7f0c388b8640 1 -- 172.21.15.73:0/1607879307 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0c240ef7b0 con 0x7f0c34100a40 2024-09-05T13:02:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.428+0000 7f0c19ffb640 1 -- 172.21.15.73:0/1396917013 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c011310 con 0x55f3ce0959a0 2024-09-05T13:02:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.428+0000 7f0c19ffb640 1 -- 172.21.15.73:0/1396917013 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c2c003e50 con 0x55f3ce0959a0 2024-09-05T13:02:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c19ffb640 1 -- 172.21.15.73:0/1396917013 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c004620 con 0x55f3ce0959a0 2024-09-05T13:02:51.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c32ffd640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c1c0a2d30 0x7f0c1c0a51f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0c24032fd0 tx=0x7f0c240f5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:51.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c3c657740 1 -- 172.21.15.73:0/1396917013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 msgr2=0x55f3ce095da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:51.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c3c657740 1 --2- 172.21.15.73:0/1396917013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce095da0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0117e0 tx=0x7f0c2c011ca0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c3c657740 1 -- 172.21.15.73:0/1396917013 shutdown_connections 2024-09-05T13:02:51.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c3c657740 1 --2- 172.21.15.73:0/1396917013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce09b370 0x55f3ce09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c3c657740 1 --2- 172.21.15.73:0/1396917013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0962e0 0x55f3ce09ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c3c657740 1 --2- 172.21.15.73:0/1396917013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce095da0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c3c657740 1 -- 172.21.15.73:0/1396917013 >> 172.21.15.73:0/1396917013 conn(0x55f3ce091010 msgr2=0x55f3ce091410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:51.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c3c657740 1 -- 172.21.15.73:0/1396917013 shutdown_connections 2024-09-05T13:02:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c3c657740 1 -- 172.21.15.73:0/1396917013 wait complete. 2024-09-05T13:02:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.429+0000 7f0c3c657740 1 -- start start 2024-09-05T13:02:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.430+0000 7f0c3c657740 1 Processor -- start 2024-09-05T13:02:51.443 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:51 smithi073 ceph-mon[30883]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 3.35k op/s 2024-09-05T13:02:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.430+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0959a0 0x55f3ce09fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.430+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 0x55f3ce0a0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.430+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce09b370 0x55f3ce0a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.430+0000 7f0c337fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0959a0 0x55f3ce09fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.430+0000 7f0c337fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0959a0 0x55f3ce09fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:44224/0 (socket says 172.21.15.73:44224) 2024-09-05T13:02:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.430+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f3ce09e390 con 0x55f3ce0962e0 2024-09-05T13:02:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.430+0000 7f0c337fe640 1 -- 172.21.15.73:0/2535530972 learned_addr learned my addr 172.21.15.73:0/2535530972 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.430+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f3cdf82290 con 0x55f3ce09b370 2024-09-05T13:02:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.430+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f3ce09e510 con 0x55f3ce0959a0 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c327fc640 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 0x55f3ce0a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c337fe640 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce09b370 0x55f3ce0a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c3c657740 10 client.0 _ll_register_callbacks cb 0x55f3cdfb3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c337fe640 1 -- 172.21.15.73:0/2535530972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce09b370 msgr2=0x55f3ce0a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c337fe640 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce09b370 0x55f3ce0a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c337fe640 1 -- 172.21.15.73:0/2535530972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 msgr2=0x55f3ce0a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c337fe640 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 0x55f3ce0a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c337fe640 1 -- 172.21.15.73:0/2535530972 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3cdd0c210 con 0x55f3ce0959a0 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c327fc640 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 0x55f3ce0a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c337fe640 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0959a0 0x55f3ce09fcf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c006010 tx=0x7f0c2c005a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b54219f2b865a05c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c12ffd640 1 -- 172.21.15.73:0/2535530972 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c020020 con 0x55f3ce0959a0 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c2c003e50 con 0x55f3ce0959a0 2024-09-05T13:02:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c12ffd640 1 -- 172.21.15.73:0/2535530972 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0c2c0045a0 con 0x55f3ce0959a0 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.431+0000 7f0c12ffd640 1 -- 172.21.15.73:0/2535530972 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0c2c023070 con 0x55f3ce0959a0 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c3c657740 10 client.25624 fetch_fsmap learned FSMap version 40 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55f3cddd8620 con 0x55f3ce0959a0 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c12ffd640 1 -- 172.21.15.73:0/2535530972 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c2c003e50 con 0x55f3ce0959a0 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c12ffd640 1 -- 172.21.15.73:0/2535530972 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7f0c2c018020 con 0x55f3ce0959a0 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c3c657740 10 client.25624 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c3c657740 10 client.25624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c3c657740 20 client.25624 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c3c657740 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f3ce0ab650 0x55f3ce0ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c3c657740 4 client.25624 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3ce006a20 con 0x55f3ce0ab650 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.432+0000 7f0c327fc640 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f3ce0ab650 0x55f3ce0ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.433+0000 7f0c12ffd640 10 client.25624 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.433+0000 7f0c327fc640 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f3ce0ab650 0x55f3ce0ada60 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c44392635193fb server_cookie=738743071c67b3c5 in_seq=0 out_seq=0 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c12ffd640 1 -- 172.21.15.73:0/2535530972 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3ce006a20 con 0x55f3ce0ab650 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c12ffd640 10 client.25624 handle_command_reply: tid=0 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 client.25624 shutdown 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0959a0 msgr2=0x55f3ce09fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0959a0 0x55f3ce09fcf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c006010 tx=0x7f0c2c005a50 comp rx=0 tx=0).stop 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 shutdown_connections 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f3ce0ab650 0x55f3ce0ada60 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce09b370 0x55f3ce0a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c12ffd640 0 client.25624 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 0x55f3ce0a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 --2- 172.21.15.73:0/2535530972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0959a0 0x55f3ce09fcf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 >> 172.21.15.73:0/2535530972 conn(0x55f3ce091010 msgr2=0x55f3ce092820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 shutdown_connections 2024-09-05T13:02:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 1 -- 172.21.15.73:0/2535530972 wait complete. 2024-09-05T13:02:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.434+0000 7f0c3c657740 20 client.25624 trim_cache size 0 max 16384 2024-09-05T13:02:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.463+0000 7f0c3c657740 1 Processor -- start 2024-09-05T13:02:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.463+0000 7f0c3c657740 1 -- start start 2024-09-05T13:02:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0962e0 0x55f3ce0ada40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce09b370 0x55f3ce0a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c3c657740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c341b1e10 con 0x55f3ce0959a0 2024-09-05T13:02:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c3c657740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c341af680 con 0x55f3ce09b370 2024-09-05T13:02:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c3c657740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c341ad4d0 con 0x55f3ce0962e0 2024-09-05T13:02:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c337fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c337fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43348/0 (socket says 172.21.15.73:43348) 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c337fe640 1 -- 172.21.15.73:0/3794023374 learned_addr learned my addr 172.21.15.73:0/3794023374 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c327fc640 1 --2- 172.21.15.73:0/3794023374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0962e0 0x55f3ce0ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c337fe640 1 -- 172.21.15.73:0/3794023374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0962e0 msgr2=0x55f3ce0ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c337fe640 1 --2- 172.21.15.73:0/3794023374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0962e0 0x55f3ce0ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c337fe640 1 -- 172.21.15.73:0/3794023374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce09b370 msgr2=0x55f3ce0a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c337fe640 1 --2- 172.21.15.73:0/3794023374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce09b370 0x55f3ce0a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c337fe640 1 -- 172.21.15.73:0/3794023374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ce090e30 con 0x55f3ce0959a0 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.464+0000 7f0c337fe640 1 --2- 172.21.15.73:0/3794023374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a02c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c002230 tx=0x7f0c2c004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3ac98e28229ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.465+0000 7f0c197fa640 1 -- 172.21.15.73:0/3794023374 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c020070 con 0x55f3ce0959a0 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.465+0000 7f0c197fa640 1 -- 172.21.15.73:0/3794023374 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c2c02d590 con 0x55f3ce0959a0 2024-09-05T13:02:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.465+0000 7f0c197fa640 1 -- 172.21.15.73:0/3794023374 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c005790 con 0x55f3ce0959a0 2024-09-05T13:02:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.466+0000 7f0c3c657740 1 -- 172.21.15.73:0/3794023374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0959a0 msgr2=0x55f3ce0a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.466+0000 7f0c3c657740 1 --2- 172.21.15.73:0/3794023374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a02c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c002230 tx=0x7f0c2c004130 comp rx=0 tx=0).stop 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.466+0000 7f0c3c657740 1 -- 172.21.15.73:0/3794023374 shutdown_connections 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.466+0000 7f0c3c657740 1 --2- 172.21.15.73:0/3794023374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce09b370 0x55f3ce0a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.466+0000 7f0c3c657740 1 --2- 172.21.15.73:0/3794023374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce0962e0 0x55f3ce0ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.466+0000 7f0c3c657740 1 --2- 172.21.15.73:0/3794023374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a02c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.466+0000 7f0c3c657740 1 -- 172.21.15.73:0/3794023374 >> 172.21.15.73:0/3794023374 conn(0x55f3ce091010 msgr2=0x55f3ce08f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.466+0000 7f0c3c657740 1 -- 172.21.15.73:0/3794023374 shutdown_connections 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.466+0000 7f0c3c657740 1 -- 172.21.15.73:0/3794023374 wait complete. 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.467+0000 7f0c3c657740 1 -- start start 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.467+0000 7f0c3c657740 1 Processor -- start 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.467+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.467+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 0x55f3ce0a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c3c657740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce09b370 0x55f3ce0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c3c657740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c341adb40 con 0x55f3ce0962e0 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c3c657740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c341aefb0 con 0x55f3ce0959a0 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c3c657740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c341ae210 con 0x55f3ce09b370 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c3c657740 10 client.0 _ll_register_callbacks cb 0x7f0c280097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c337fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c337fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:44522/0 (socket says 172.21.15.73:44522) 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c337fe640 1 -- 172.21.15.73:0/818275885 learned_addr learned my addr 172.21.15.73:0/818275885 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c327fc640 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 0x55f3ce0a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c337fe640 1 -- 172.21.15.73:0/818275885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce09b370 msgr2=0x55f3ce0a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c337fe640 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce09b370 0x55f3ce0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c337fe640 1 -- 172.21.15.73:0/818275885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 msgr2=0x55f3ce0a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c337fe640 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 0x55f3ce0a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.468+0000 7f0c337fe640 1 -- 172.21.15.73:0/818275885 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ce0a60d0 con 0x55f3ce0959a0 2024-09-05T13:02:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.469+0000 7f0c337fe640 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a4570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c02d760 tx=0x7f0c2c0115b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccd285d8ef5c1e50 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.469+0000 7f0c12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:02:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.469+0000 7f0c12ffd640 1 -- 172.21.15.73:0/818275885 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c020050 con 0x55f3ce0959a0 2024-09-05T13:02:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.469+0000 7f0c12ffd640 1 -- 172.21.15.73:0/818275885 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0c2c02d2b0 con 0x55f3ce0959a0 2024-09-05T13:02:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.469+0000 7f0c3c657740 1 -- 172.21.15.73:0/818275885 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c2c02d590 con 0x55f3ce0959a0 2024-09-05T13:02:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.470+0000 7f0c12ffd640 1 -- 172.21.15.73:0/818275885 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0c2c005510 con 0x55f3ce0959a0 2024-09-05T13:02:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.470+0000 7f0c3c657740 10 client.25547 fetch_fsmap learned FSMap version 40 2024-09-05T13:02:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.470+0000 7f0c3c657740 1 -- 172.21.15.73:0/818275885 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55f3ce0a73e0 con 0x55f3ce0959a0 2024-09-05T13:02:51.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.478+0000 7f0c12ffd640 1 -- 172.21.15.73:0/818275885 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c2c01a920 con 0x55f3ce0959a0 2024-09-05T13:02:51.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.478+0000 7f0c12ffd640 1 -- 172.21.15.73:0/818275885 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7f0c2c018070 con 0x55f3ce0959a0 2024-09-05T13:02:51.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.478+0000 7f0c3c657740 10 client.25547 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T13:02:51.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.478+0000 7f0c3c657740 10 client.25547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.478+0000 7f0c3c657740 20 client.25547 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.478+0000 7f0c3c657740 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f3ce0ab650 0x55f3ce1188e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.478+0000 7f0c3c657740 4 client.25547 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:02:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.478+0000 7f0c3c657740 1 -- 172.21.15.73:0/818275885 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f0c2c02d590 con 0x55f3ce0ab650 2024-09-05T13:02:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.478+0000 7f0c327fc640 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f3ce0ab650 0x55f3ce1188e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.479+0000 7f0c327fc640 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f3ce0ab650 0x55f3ce1188e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c1d30a3f0555014 server_cookie=61c7eeb592f38d82 in_seq=0 out_seq=0 2024-09-05T13:02:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:51.479+0000 7f0c12ffd640 10 client.25547 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:51.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:51 smithi162 ceph-mon[34220]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 3.35k op/s 2024-09-05T13:02:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:51 smithi169 ceph-mon[34823]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 3.35k op/s 2024-09-05T13:02:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.425+0000 7f0c12ffd640 1 -- 172.21.15.73:0/818275885 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f0c2c02d590 con 0x55f3ce0ab650 2024-09-05T13:02:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.425+0000 7f0c12ffd640 10 client.25547 handle_command_reply: tid=0 2024-09-05T13:02:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.425+0000 7f0c3c657740 1 client.25547 shutdown 2024-09-05T13:02:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.425+0000 7f0c3c657740 1 -- 172.21.15.73:0/818275885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 msgr2=0x55f3ce0a4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.425+0000 7f0c3c657740 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a4570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c02d760 tx=0x7f0c2c0115b0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.426+0000 7f0c3c657740 1 -- 172.21.15.73:0/818275885 shutdown_connections 2024-09-05T13:02:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.426+0000 7f0c3c657740 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55f3ce0ab650 0x55f3ce1188e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.426+0000 7f0c12ffd640 0 client.25547 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.426+0000 7f0c3c657740 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f3ce09b370 0x55f3ce0a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.426+0000 7f0c3c657740 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3ce0962e0 0x55f3ce0a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.426+0000 7f0c3c657740 1 --2- 172.21.15.73:0/818275885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3ce0959a0 0x55f3ce0a4570 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.426+0000 7f0c3c657740 1 -- 172.21.15.73:0/818275885 >> 172.21.15.73:0/818275885 conn(0x55f3ce091010 msgr2=0x55f3ce091ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.426+0000 7f0c3c657740 1 -- 172.21.15.73:0/818275885 shutdown_connections 2024-09-05T13:02:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.426+0000 7f0c3c657740 1 -- 172.21.15.73:0/818275885 wait complete. 2024-09-05T13:02:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.426+0000 7f0c3c657740 20 client.25547 trim_cache size 0 max 16384 2024-09-05T13:02:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:02:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:02:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:02:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:02:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.429+0000 7f0c398ba640 1 -- 172.21.15.73:0/1607879307 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c1c0a2d30 msgr2=0x7f0c1c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.429+0000 7f0c398ba640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c1c0a2d30 0x7f0c1c0a51f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0c24032fd0 tx=0x7f0c240f5530 comp rx=0 tx=0).stop 2024-09-05T13:02:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.429+0000 7f0c398ba640 1 -- 172.21.15.73:0/1607879307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c34100a40 msgr2=0x7f0c3419e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.429+0000 7f0c398ba640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c34100a40 0x7f0c3419e620 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0c24031440 tx=0x7f0c24032ce0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.429+0000 7f0c398ba640 1 -- 172.21.15.73:0/1607879307 shutdown_connections 2024-09-05T13:02:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.429+0000 7f0c398ba640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0c1c0a2d30 0x7f0c1c0a51f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.430+0000 7f0c398ba640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c341025f0 0x7f0c341a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.430+0000 7f0c398ba640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34101c30 0x7f0c3419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.430+0000 7f0c398ba640 1 --2- 172.21.15.73:0/1607879307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c34100a40 0x7f0c3419e620 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.430+0000 7f0c398ba640 1 -- 172.21.15.73:0/1607879307 >> 172.21.15.73:0/1607879307 conn(0x7f0c340fc1e0 msgr2=0x7f0c340fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.430+0000 7f0c398ba640 1 -- 172.21.15.73:0/1607879307 shutdown_connections 2024-09-05T13:02:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:02:52.430+0000 7f0c398ba640 1 -- 172.21.15.73:0/1607879307 wait complete. 2024-09-05T13:02:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.731+0000 7fd49c285640 1 -- 172.21.15.73:0/1488250804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd494109830 msgr2=0x7fd494109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.731+0000 7fd49c285640 1 --2- 172.21.15.73:0/1488250804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd494109830 0x7fd494109c90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd490009900 tx=0x7fd49002a410 comp rx=0 tx=0).stop 2024-09-05T13:02:52.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.733+0000 7fd49c285640 1 -- 172.21.15.73:0/1488250804 shutdown_connections 2024-09-05T13:02:52.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.733+0000 7fd49c285640 1 --2- 172.21.15.73:0/1488250804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd49411b140 0x7fd49411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.733+0000 7fd49c285640 1 --2- 172.21.15.73:0/1488250804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd494109830 0x7fd494109c90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.733+0000 7fd49c285640 1 --2- 172.21.15.73:0/1488250804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd494109450 0x7fd494110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.733+0000 7fd49c285640 1 -- 172.21.15.73:0/1488250804 >> 172.21.15.73:0/1488250804 conn(0x7fd49406e140 msgr2=0x7fd49406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:52.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.736+0000 7fd49c285640 1 -- 172.21.15.73:0/1488250804 shutdown_connections 2024-09-05T13:02:52.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.737+0000 7fd49c285640 1 -- 172.21.15.73:0/1488250804 wait complete. 2024-09-05T13:02:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.737+0000 7fd49c285640 1 Processor -- start 2024-09-05T13:02:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.740+0000 7fd49c285640 1 -- start start 2024-09-05T13:02:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.740+0000 7fd49c285640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd494109450 0x7fd4941a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.740+0000 7fd49c285640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd494109830 0x7fd4941a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.740+0000 7fd49c285640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd49411b140 0x7fd4941abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.740+0000 7fd49c285640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd494120df0 con 0x7fd494109450 2024-09-05T13:02:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.740+0000 7fd49c285640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd494120c70 con 0x7fd49411b140 2024-09-05T13:02:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.740+0000 7fd49c285640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd494120f70 con 0x7fd494109830 2024-09-05T13:02:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.741+0000 7fd49a822640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd49411b140 0x7fd4941abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.741+0000 7fd49a021640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd494109450 0x7fd4941a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.741+0000 7fd49a021640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd494109450 0x7fd4941a71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43386/0 (socket says 172.21.15.73:43386) 2024-09-05T13:02:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.741+0000 7fd499820640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd494109830 0x7fd4941a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.741+0000 7fd49a021640 1 -- 172.21.15.73:0/3666579281 learned_addr learned my addr 172.21.15.73:0/3666579281 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.742+0000 7fd499820640 1 -- 172.21.15.73:0/3666579281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd49411b140 msgr2=0x7fd4941abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.742+0000 7fd499820640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd49411b140 0x7fd4941abaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.742+0000 7fd499820640 1 -- 172.21.15.73:0/3666579281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd494109450 msgr2=0x7fd4941a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.742+0000 7fd499820640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd494109450 0x7fd4941a71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.742+0000 7fd499820640 1 -- 172.21.15.73:0/3666579281 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4941ac180 con 0x7fd494109830 2024-09-05T13:02:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.742+0000 7fd499820640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd494109830 0x7fd4941a7710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd49002aa00 tx=0x7fd490003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.743+0000 7fd48b7fe640 1 -- 172.21.15.73:0/3666579281 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49003f070 con 0x7fd494109830 2024-09-05T13:02:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.743+0000 7fd49c285640 1 -- 172.21.15.73:0/3666579281 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4941ac410 con 0x7fd494109830 2024-09-05T13:02:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.743+0000 7fd49c285640 1 -- 172.21.15.73:0/3666579281 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4941b3d50 con 0x7fd494109830 2024-09-05T13:02:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.743+0000 7fd48b7fe640 1 -- 172.21.15.73:0/3666579281 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd490031c90 con 0x7fd494109830 2024-09-05T13:02:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.744+0000 7fd48b7fe640 1 -- 172.21.15.73:0/3666579281 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490035030 con 0x7fd494109830 2024-09-05T13:02:52.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.747+0000 7fd48b7fe640 1 -- 172.21.15.73:0/3666579281 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd490042070 con 0x7fd494109830 2024-09-05T13:02:52.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.748+0000 7fd48b7fe640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4800a2cc0 0x7fd4800a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.749+0000 7fd48b7fe640 1 -- 172.21.15.73:0/3666579281 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd4900f04e0 con 0x7fd494109830 2024-09-05T13:02:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.751+0000 7fd49a021640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4800a2cc0 0x7fd4800a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.814+0000 7fd49a021640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4800a2cc0 0x7fd4800a5180 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd48400ac00 tx=0x7fd48400a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:52.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.814+0000 7fd49e65b740 1 Processor -- start 2024-09-05T13:02:52.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.814+0000 7fd49e65b740 1 -- start start 2024-09-05T13:02:52.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.815+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcaf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.815+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bcba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.815+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcba680 0x56440bcbca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.815+0000 7fd49e65b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56440bc152e0 con 0x56440bcafdc0 2024-09-05T13:02:52.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.815+0000 7fd49e65b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56440bbbcce0 con 0x56440bcba680 2024-09-05T13:02:52.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.815+0000 7fd49e65b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56440bc112a0 con 0x56440bcaf4a0 2024-09-05T13:02:52.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.815+0000 7fd49a021640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcaf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.817+0000 7fd49a822640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcba680 0x56440bcbca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.817+0000 7fd499820640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bcba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.818+0000 7fd49a822640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcba680 0x56440bcbca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:44560/0 (socket says 172.21.15.73:44560) 2024-09-05T13:02:52.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.818+0000 7fd49a822640 1 -- 172.21.15.73:0/2692463193 learned_addr learned my addr 172.21.15.73:0/2692463193 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:52.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.821+0000 7fd49a021640 1 -- 172.21.15.73:0/2692463193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcba680 msgr2=0x56440bcbca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:52.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.821+0000 7fd49a021640 1 --2- 172.21.15.73:0/2692463193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcba680 0x56440bcbca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.821+0000 7fd49a021640 1 -- 172.21.15.73:0/2692463193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 msgr2=0x56440bcba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:52.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.821+0000 7fd49a021640 1 --2- 172.21.15.73:0/2692463193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bcba140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.821+0000 7fd49a021640 1 -- 172.21.15.73:0/2692463193 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56440bba1440 con 0x56440bcaf4a0 2024-09-05T13:02:52.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.822+0000 7fd49a021640 1 --2- 172.21.15.73:0/2692463193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcaf880 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd48400ee20 tx=0x7fd484011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12aa9871b1527a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:52.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.822+0000 7fd488dec640 1 -- 172.21.15.73:0/2692463193 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484021070 con 0x56440bcaf4a0 2024-09-05T13:02:52.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.822+0000 7fd488dec640 1 -- 172.21.15.73:0/2692463193 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd48400ee50 con 0x56440bcaf4a0 2024-09-05T13:02:52.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.823+0000 7fd49e65b740 1 -- 172.21.15.73:0/2692463193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 msgr2=0x56440bcaf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.823+0000 7fd49e65b740 1 --2- 172.21.15.73:0/2692463193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcaf880 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd48400ee20 tx=0x7fd484011000 comp rx=0 tx=0).stop 2024-09-05T13:02:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.827+0000 7fd49e65b740 1 -- 172.21.15.73:0/2692463193 shutdown_connections 2024-09-05T13:02:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.827+0000 7fd49e65b740 1 --2- 172.21.15.73:0/2692463193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcba680 0x56440bcbca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.827+0000 7fd49e65b740 1 --2- 172.21.15.73:0/2692463193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bcba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.827+0000 7fd49e65b740 1 --2- 172.21.15.73:0/2692463193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcaf880 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.827+0000 7fd49e65b740 1 -- 172.21.15.73:0/2692463193 >> 172.21.15.73:0/2692463193 conn(0x56440bcaba30 msgr2=0x56440bcabe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.831+0000 7fd49e65b740 1 -- 172.21.15.73:0/2692463193 shutdown_connections 2024-09-05T13:02:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.831+0000 7fd49e65b740 1 -- 172.21.15.73:0/2692463193 wait complete. 2024-09-05T13:02:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.831+0000 7fd49e65b740 1 -- start start 2024-09-05T13:02:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.831+0000 7fd49e65b740 1 Processor -- start 2024-09-05T13:02:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.832+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcb9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.832+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bcb71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.832+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcba680 0x56440bcb76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.832+0000 7fd49a021640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcb9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.832+0000 7fd49a021640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcb9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:44290/0 (socket says 172.21.15.73:44290) 2024-09-05T13:02:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.832+0000 7fd49a021640 1 -- 172.21.15.73:0/4234740641 learned_addr learned my addr 172.21.15.73:0/4234740641 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.832+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56440bcce300 con 0x56440bcafdc0 2024-09-05T13:02:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.832+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56440bbd0050 con 0x56440bcba680 2024-09-05T13:02:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.833+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56440bcce480 con 0x56440bcaf4a0 2024-09-05T13:02:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.833+0000 7fd49e65b740 10 client.0 _ll_register_callbacks cb 0x56440bc10160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.833+0000 7fd499820640 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bcb71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.833+0000 7fd49a021640 1 -- 172.21.15.73:0/4234740641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcba680 msgr2=0x56440bcb76e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.833+0000 7fd49a021640 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcba680 0x56440bcb76e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.833+0000 7fd49a021640 1 -- 172.21.15.73:0/4234740641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 msgr2=0x56440bcb71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.833+0000 7fd49a021640 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bcb71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.833+0000 7fd49a021640 1 -- 172.21.15.73:0/4234740641 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56440b9863c0 con 0x56440bcaf4a0 2024-09-05T13:02:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.833+0000 7fd49a021640 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcb9ef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd48401daf0 tx=0x7fd48401db20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9da7e4867cb5c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.833+0000 7fd47dffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:02:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.835+0000 7fd47dffb640 1 -- 172.21.15.73:0/4234740641 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484034060 con 0x56440bcaf4a0 2024-09-05T13:02:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.835+0000 7fd47dffb640 1 -- 172.21.15.73:0/4234740641 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd484005050 con 0x56440bcaf4a0 2024-09-05T13:02:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.835+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd48400ee50 con 0x56440bcaf4a0 2024-09-05T13:02:52.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.836+0000 7fd47dffb640 1 -- 172.21.15.73:0/4234740641 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd484021070 con 0x56440bcaf4a0 2024-09-05T13:02:52.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.836+0000 7fd49e65b740 10 client.25639 fetch_fsmap learned FSMap version 40 2024-09-05T13:02:52.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.836+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x56440bcd9cb0 con 0x56440bcaf4a0 2024-09-05T13:02:52.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.837+0000 7fd47dffb640 1 -- 172.21.15.73:0/4234740641 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd484004680 con 0x56440bcaf4a0 2024-09-05T13:02:52.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.837+0000 7fd47dffb640 1 -- 172.21.15.73:0/4234740641 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7fd484026450 con 0x56440bcaf4a0 2024-09-05T13:02:52.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.837+0000 7fd49e65b740 10 client.25639 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T13:02:52.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.837+0000 7fd49e65b740 10 client.25639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:52.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.837+0000 7fd49e65b740 20 client.25639 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:52.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.837+0000 7fd49e65b740 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56440bcdb0b0 0x56440bcdd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.837+0000 7fd49e65b740 4 client.25639 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:02:52.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.837+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd48400ee50 con 0x56440bcdb0b0 2024-09-05T13:02:52.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.838+0000 7fd499820640 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56440bcdb0b0 0x56440bcdd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.839+0000 7fd499820640 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56440bcdb0b0 0x56440bcdd4a0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a85d33975c59e889 server_cookie=587cf2f80474850d in_seq=0 out_seq=0 2024-09-05T13:02:52.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.839+0000 7fd47dffb640 10 client.25639 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:52.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.840+0000 7fd47dffb640 1 -- 172.21.15.73:0/4234740641 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd48400ee50 con 0x56440bcdb0b0 2024-09-05T13:02:52.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.840+0000 7fd47dffb640 10 client.25639 handle_command_reply: tid=0 2024-09-05T13:02:52.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.842+0000 7fd49e65b740 1 client.25639 shutdown 2024-09-05T13:02:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.844+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 msgr2=0x56440bcb9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.844+0000 7fd49e65b740 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcb9ef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd48401daf0 tx=0x7fd48401db20 comp rx=0 tx=0).stop 2024-09-05T13:02:52.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.846+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 shutdown_connections 2024-09-05T13:02:52.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.846+0000 7fd49e65b740 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56440bcdb0b0 0x56440bcdd4a0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.846+0000 7fd49e65b740 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcba680 0x56440bcb76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.846+0000 7fd49e65b740 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bcb71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.846+0000 7fd49e65b740 1 --2- 172.21.15.73:0/4234740641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcb9ef0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.846+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 >> 172.21.15.73:0/4234740641 conn(0x56440bcaba30 msgr2=0x56440bcb1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.846+0000 7fd47dffb640 0 client.25639 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.846+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 shutdown_connections 2024-09-05T13:02:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.846+0000 7fd49e65b740 1 -- 172.21.15.73:0/4234740641 wait complete. 2024-09-05T13:02:52.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.846+0000 7fd49e65b740 20 client.25639 trim_cache size 0 max 16384 2024-09-05T13:02:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.886+0000 7fd49e65b740 1 Processor -- start 2024-09-05T13:02:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.886+0000 7fd49e65b740 1 -- start start 2024-09-05T13:02:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.886+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcaf4a0 0x56440bce2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.886+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bce3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.886+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcba680 0x56440bcd37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.886+0000 7fd49e65b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd478010e10 con 0x56440bcafdc0 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.886+0000 7fd49e65b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800e680 con 0x56440bcaf4a0 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.886+0000 7fd49e65b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800c4d0 con 0x56440bcba680 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd49a822640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcba680 0x56440bcd37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd499820640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bce3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd49a021640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcaf4a0 0x56440bce2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd49a822640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcba680 0x56440bcd37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:44304/0 (socket says 172.21.15.73:44304) 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd49a822640 1 -- 172.21.15.73:0/2407601270 learned_addr learned my addr 172.21.15.73:0/2407601270 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd49a021640 1 -- 172.21.15.73:0/2407601270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcba680 msgr2=0x56440bcd37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd49a021640 1 --2- 172.21.15.73:0/2407601270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcba680 0x56440bcd37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd49a021640 1 -- 172.21.15.73:0/2407601270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 msgr2=0x56440bce3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:52.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd49a021640 1 --2- 172.21.15.73:0/2407601270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bce3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd49a021640 1 -- 172.21.15.73:0/2407601270 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56440bcacae0 con 0x56440bcaf4a0 2024-09-05T13:02:52.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd499820640 1 --2- 172.21.15.73:0/2407601270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bce3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:02:52.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.887+0000 7fd49a822640 1 --2- 172.21.15.73:0/2407601270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcba680 0x56440bcd37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:02:52.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.888+0000 7fd49a021640 1 --2- 172.21.15.73:0/2407601270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcaf4a0 0x56440bce2b50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd48400f840 tx=0x7fd484005cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c14f668183b33a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:52.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.888+0000 7fd47ffff640 1 -- 172.21.15.73:0/2407601270 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484014070 con 0x56440bcaf4a0 2024-09-05T13:02:52.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.888+0000 7fd47ffff640 1 -- 172.21.15.73:0/2407601270 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd484010c90 con 0x56440bcaf4a0 2024-09-05T13:02:52.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.888+0000 7fd47ffff640 1 -- 172.21.15.73:0/2407601270 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484034040 con 0x56440bcaf4a0 2024-09-05T13:02:52.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.889+0000 7fd49e65b740 1 -- 172.21.15.73:0/2407601270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcaf4a0 msgr2=0x56440bce2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.890+0000 7fd49e65b740 1 --2- 172.21.15.73:0/2407601270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcaf4a0 0x56440bce2b50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd48400f840 tx=0x7fd484005cc0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.891+0000 7fd49e65b740 1 -- 172.21.15.73:0/2407601270 shutdown_connections 2024-09-05T13:02:52.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.892+0000 7fd49e65b740 1 --2- 172.21.15.73:0/2407601270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcba680 0x56440bcd37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.892+0000 7fd49e65b740 1 --2- 172.21.15.73:0/2407601270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcafdc0 0x56440bce3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.892+0000 7fd49e65b740 1 --2- 172.21.15.73:0/2407601270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcaf4a0 0x56440bce2b50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.892+0000 7fd49e65b740 1 -- 172.21.15.73:0/2407601270 >> 172.21.15.73:0/2407601270 conn(0x56440bcaba30 msgr2=0x56440bcaab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:52.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.892+0000 7fd49e65b740 1 -- 172.21.15.73:0/2407601270 shutdown_connections 2024-09-05T13:02:52.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.892+0000 7fd49e65b740 1 -- 172.21.15.73:0/2407601270 wait complete. 2024-09-05T13:02:52.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.893+0000 7fd49e65b740 1 -- start start 2024-09-05T13:02:52.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.893+0000 7fd49e65b740 1 Processor -- start 2024-09-05T13:02:52.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.893+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcd3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcafdc0 0x56440bcd0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd49e65b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcba680 0x56440bcd1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd49e65b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800cb40 con 0x56440bcba680 2024-09-05T13:02:52.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd49e65b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800dfb0 con 0x56440bcafdc0 2024-09-05T13:02:52.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd49e65b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800d210 con 0x56440bcaf4a0 2024-09-05T13:02:52.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd499820640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcafdc0 0x56440bcd0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd499820640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcafdc0 0x56440bcd0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:44600/0 (socket says 172.21.15.73:44600) 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd499820640 1 -- 172.21.15.73:0/3821378363 learned_addr learned my addr 172.21.15.73:0/3821378363 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd49e65b740 10 client.0 _ll_register_callbacks cb 0x7fd494110870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd49a021640 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcd3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd49a822640 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcba680 0x56440bcd1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd499820640 1 -- 172.21.15.73:0/3821378363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 msgr2=0x56440bcd3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd499820640 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcd3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd499820640 1 -- 172.21.15.73:0/3821378363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcba680 msgr2=0x56440bcd1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.894+0000 7fd499820640 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcba680 0x56440bcd1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.895+0000 7fd499820640 1 -- 172.21.15.73:0/3821378363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56440bcd19b0 con 0x56440bcafdc0 2024-09-05T13:02:52.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.895+0000 7fd49a822640 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcba680 0x56440bcd1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:02:52.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.898+0000 7fd499820640 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcafdc0 0x56440bcd0f30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd49002a980 tx=0x7fd490003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d5d7456ef8cd7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:52.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.898+0000 7fd47dffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:02:52.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.899+0000 7fd47dffb640 1 -- 172.21.15.73:0/3821378363 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490049040 con 0x56440bcafdc0 2024-09-05T13:02:52.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.899+0000 7fd49e65b740 1 -- 172.21.15.73:0/3821378363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd484010c90 con 0x56440bcafdc0 2024-09-05T13:02:52.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.899+0000 7fd47dffb640 1 -- 172.21.15.73:0/3821378363 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fd4900ee0c0 con 0x56440bcafdc0 2024-09-05T13:02:52.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.903+0000 7fd47dffb640 1 -- 172.21.15.73:0/3821378363 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd4900c10c0 con 0x56440bcafdc0 2024-09-05T13:02:52.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.903+0000 7fd49e65b740 10 client.25559 fetch_fsmap learned FSMap version 40 2024-09-05T13:02:52.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.903+0000 7fd49e65b740 1 -- 172.21.15.73:0/3821378363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x56440bd457d0 con 0x56440bcafdc0 2024-09-05T13:02:52.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.904+0000 7fd47dffb640 1 -- 172.21.15.73:0/3821378363 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd484010c90 con 0x56440bcafdc0 2024-09-05T13:02:52.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.904+0000 7fd47dffb640 1 -- 172.21.15.73:0/3821378363 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7fd49004c060 con 0x56440bcafdc0 2024-09-05T13:02:52.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.904+0000 7fd49e65b740 10 client.25559 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T13:02:52.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.904+0000 7fd49e65b740 10 client.25559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:02:52.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.904+0000 7fd49e65b740 20 client.25559 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:52.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.904+0000 7fd49e65b740 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56440bd45f90 0x56440bd483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:52.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.904+0000 7fd49e65b740 4 client.25559 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T13:02:52.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.904+0000 7fd49e65b740 1 -- 172.21.15.73:0/3821378363 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56440bc22850 con 0x56440bd45f90 2024-09-05T13:02:52.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.906+0000 7fd49a021640 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56440bd45f90 0x56440bd483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:52.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.908+0000 7fd49a021640 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56440bd45f90 0x56440bd483b0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=371c3affe05ac9d4 server_cookie=a8bc9e424b843f59 in_seq=0 out_seq=0 2024-09-05T13:02:52.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.908+0000 7fd47dffb640 10 client.25559 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:52.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.909+0000 7fd47dffb640 1 -- 172.21.15.73:0/3821378363 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56440bc22850 con 0x56440bd45f90 2024-09-05T13:02:52.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.909+0000 7fd47dffb640 10 client.25559 handle_command_reply: tid=0 2024-09-05T13:02:52.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.909+0000 7fd49e65b740 1 client.25559 shutdown 2024-09-05T13:02:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd49e65b740 1 -- 172.21.15.73:0/3821378363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcafdc0 msgr2=0x56440bcd0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd49e65b740 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcafdc0 0x56440bcd0f30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd49002a980 tx=0x7fd490003f90 comp rx=0 tx=0).stop 2024-09-05T13:02:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd49e65b740 1 -- 172.21.15.73:0/3821378363 shutdown_connections 2024-09-05T13:02:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd49e65b740 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x56440bd45f90 0x56440bd483b0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd49e65b740 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56440bcba680 0x56440bcd1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd47dffb640 0 client.25559 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:02:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd49e65b740 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56440bcafdc0 0x56440bcd0f30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd49e65b740 1 --2- 172.21.15.73:0/3821378363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56440bcaf4a0 0x56440bcd3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd49e65b740 1 -- 172.21.15.73:0/3821378363 >> 172.21.15.73:0/3821378363 conn(0x56440bcaba30 msgr2=0x56440bcb8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd49e65b740 1 -- 172.21.15.73:0/3821378363 shutdown_connections 2024-09-05T13:02:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.910+0000 7fd49e65b740 1 -- 172.21.15.73:0/3821378363 wait complete. 2024-09-05T13:02:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.911+0000 7fd49e65b740 20 client.25559 trim_cache size 0 max 16384 2024-09-05T13:02:52.913 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:02:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2024-09-05T13:02:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2024-09-05T13:02:52.914 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:02:52.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.911+0000 7fd49c285640 1 -- 172.21.15.73:0/3666579281 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4800a2cc0 msgr2=0x7fd4800a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.911+0000 7fd49c285640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4800a2cc0 0x7fd4800a5180 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd48400ac00 tx=0x7fd48400a5e0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.911+0000 7fd49c285640 1 -- 172.21.15.73:0/3666579281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd494109830 msgr2=0x7fd4941a7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:52.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.911+0000 7fd49c285640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd494109830 0x7fd4941a7710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd49002aa00 tx=0x7fd490003b90 comp rx=0 tx=0).stop 2024-09-05T13:02:52.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.912+0000 7fd49c285640 1 -- 172.21.15.73:0/3666579281 shutdown_connections 2024-09-05T13:02:52.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.912+0000 7fd49c285640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd4800a2cc0 0x7fd4800a5180 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.912+0000 7fd49c285640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd49411b140 0x7fd4941abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.912+0000 7fd49c285640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd494109830 0x7fd4941a7710 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.912+0000 7fd49c285640 1 --2- 172.21.15.73:0/3666579281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd494109450 0x7fd4941a71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:52.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.912+0000 7fd49c285640 1 -- 172.21.15.73:0/3666579281 >> 172.21.15.73:0/3666579281 conn(0x7fd49406e140 msgr2=0x7fd49411bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:52.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.912+0000 7fd49c285640 1 -- 172.21.15.73:0/3666579281 shutdown_connections 2024-09-05T13:02:52.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:52.912+0000 7fd49c285640 1 -- 172.21.15.73:0/3666579281 wait complete. 2024-09-05T13:02:53.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:53 smithi073 ceph-mon[30883]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 3.94k op/s 2024-09-05T13:02:53.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:53 smithi162 ceph-mon[34220]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 3.94k op/s 2024-09-05T13:02:53.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:53 smithi169 ceph-mon[34823]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 3.94k op/s 2024-09-05T13:02:54.286 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T13:02:54.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T13:02:54.780 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:02:55.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.394+0000 7fddf09e2640 1 -- 172.21.15.73:0/662049549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddec100980 msgr2=0x7fddec100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:55.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.394+0000 7fddf09e2640 1 --2- 172.21.15.73:0/662049549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddec100980 0x7fddec100d60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009900 tx=0x7fdddc02a490 comp rx=0 tx=0).stop 2024-09-05T13:02:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.395+0000 7fddf09e2640 1 -- 172.21.15.73:0/662049549 shutdown_connections 2024-09-05T13:02:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.395+0000 7fddf09e2640 1 --2- 172.21.15.73:0/662049549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddec105d90 0x7fddec106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.395+0000 7fddf09e2640 1 --2- 172.21.15.73:0/662049549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fddec1012a0 0x7fddec105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.395+0000 7fddf09e2640 1 --2- 172.21.15.73:0/662049549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddec100980 0x7fddec100d60 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.395+0000 7fddf09e2640 1 -- 172.21.15.73:0/662049549 >> 172.21.15.73:0/662049549 conn(0x7fddec0fc610 msgr2=0x7fddec0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.395+0000 7fddf09e2640 1 -- 172.21.15.73:0/662049549 shutdown_connections 2024-09-05T13:02:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.395+0000 7fddf09e2640 1 -- 172.21.15.73:0/662049549 wait complete. 2024-09-05T13:02:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.396+0000 7fddf09e2640 1 Processor -- start 2024-09-05T13:02:55.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddf09e2640 1 -- start start 2024-09-05T13:02:55.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddf09e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddec100980 0x7fddec073c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddf09e2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fddec1012a0 0x7fddec0741c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddf09e2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddec105d90 0x7fddec06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddf09e2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fddec118470 con 0x7fddec100980 2024-09-05T13:02:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddf09e2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fddec1182f0 con 0x7fddec105d90 2024-09-05T13:02:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddf09e2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fddec1185f0 con 0x7fddec1012a0 2024-09-05T13:02:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddea59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fddec1012a0 0x7fddec0741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddead9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddec100980 0x7fddec073c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddea59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fddec1012a0 0x7fddec0741c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:55006/0 (socket says 172.21.15.73:55006) 2024-09-05T13:02:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.397+0000 7fddea59c640 1 -- 172.21.15.73:0/435395716 learned_addr learned my addr 172.21.15.73:0/435395716 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.398+0000 7fddead9d640 1 -- 172.21.15.73:0/435395716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fddec1012a0 msgr2=0x7fddec0741c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.398+0000 7fddead9d640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fddec1012a0 0x7fddec0741c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.398+0000 7fddead9d640 1 -- 172.21.15.73:0/435395716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddec105d90 msgr2=0x7fddec06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.398+0000 7fddead9d640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddec105d90 0x7fddec06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.398+0000 7fddead9d640 1 -- 172.21.15.73:0/435395716 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddec06d790 con 0x7fddec100980 2024-09-05T13:02:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.398+0000 7fddead9d640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddec100980 0x7fddec073c80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdddc02a9b0 tx=0x7fdddc032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.399+0000 7fddd3fff640 1 -- 172.21.15.73:0/435395716 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc03f030 con 0x7fddec100980 2024-09-05T13:02:55.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.399+0000 7fddd3fff640 1 -- 172.21.15.73:0/435395716 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdddc003ad0 con 0x7fddec100980 2024-09-05T13:02:55.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.399+0000 7fddd3fff640 1 -- 172.21.15.73:0/435395716 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc035070 con 0x7fddec100980 2024-09-05T13:02:55.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.399+0000 7fddf09e2640 1 -- 172.21.15.73:0/435395716 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddec06da20 con 0x7fddec100980 2024-09-05T13:02:55.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.399+0000 7fddf09e2640 1 -- 172.21.15.73:0/435395716 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddec071980 con 0x7fddec100980 2024-09-05T13:02:55.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.402+0000 7fddf09e2640 1 -- 172.21.15.73:0/435395716 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddec06a850 con 0x7fddec100980 2024-09-05T13:02:55.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.402+0000 7fddd3fff640 1 -- 172.21.15.73:0/435395716 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdddc042030 con 0x7fddec100980 2024-09-05T13:02:55.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.403+0000 7fddd3fff640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddd40a2cd0 0x7fddd40a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:55.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.403+0000 7fddd3fff640 1 -- 172.21.15.73:0/435395716 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fdddc0ef390 con 0x7fddec100980 2024-09-05T13:02:55.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.405+0000 7fddea59c640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddd40a2cd0 0x7fddd40a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:55.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.407+0000 7fddea59c640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddd40a2cd0 0x7fddd40a5190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fddec06e4d0 tx=0x7fdde000b3d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:55.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.411+0000 7fddd3fff640 1 -- 172.21.15.73:0/435395716 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdddc0bc2c0 con 0x7fddec100980 2024-09-05T13:02:55.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:55 smithi073 ceph-mon[30883]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 3.81k op/s 2024-09-05T13:02:55.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:55 smithi162 ceph-mon[34220]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 3.81k op/s 2024-09-05T13:02:55.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:55 smithi169 ceph-mon[34823]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 3.81k op/s 2024-09-05T13:02:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.804+0000 7fddf09e2640 1 -- 172.21.15.73:0/435395716 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddec071c40 con 0x7fddec100980 2024-09-05T13:02:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.805+0000 7fddd3fff640 1 -- 172.21.15.73:0/435395716 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11929 (secure 0 0 0) 0x7fdddc0bbbc0 con 0x7fddec100980 2024-09-05T13:02:55.807 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T13:02:55.807 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":41,"btime":"2024-09-05T13:02:55:169982+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T13:02:54.549389+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25159":{"gid":25159,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/4110365542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":4110365542},{"type":"v1","addr":"172.21.15.169:6837","nonce":4110365542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T13:02:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 41 2024-09-05T13:02:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.807+0000 7fddf09e2640 1 -- 172.21.15.73:0/435395716 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddd40a2cd0 msgr2=0x7fddd40a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.807+0000 7fddf09e2640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddd40a2cd0 0x7fddd40a5190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fddec06e4d0 tx=0x7fdde000b3d0 comp rx=0 tx=0).stop 2024-09-05T13:02:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.808+0000 7fddf09e2640 1 -- 172.21.15.73:0/435395716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddec100980 msgr2=0x7fddec073c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.808+0000 7fddf09e2640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddec100980 0x7fddec073c80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdddc02a9b0 tx=0x7fdddc032b90 comp rx=0 tx=0).stop 2024-09-05T13:02:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.808+0000 7fddf09e2640 1 -- 172.21.15.73:0/435395716 shutdown_connections 2024-09-05T13:02:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.808+0000 7fddf09e2640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fddd40a2cd0 0x7fddd40a5190 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.808+0000 7fddf09e2640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddec105d90 0x7fddec06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.808+0000 7fddf09e2640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fddec1012a0 0x7fddec0741c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.808+0000 7fddf09e2640 1 --2- 172.21.15.73:0/435395716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddec100980 0x7fddec073c80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.808+0000 7fddf09e2640 1 -- 172.21.15.73:0/435395716 >> 172.21.15.73:0/435395716 conn(0x7fddec0fc610 msgr2=0x7fddec0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.808+0000 7fddf09e2640 1 -- 172.21.15.73:0/435395716 shutdown_connections 2024-09-05T13:02:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:55.808+0000 7fddf09e2640 1 -- 172.21.15.73:0/435395716 wait complete. 2024-09-05T13:02:56.440 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:56 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:56.440 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:56 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/435395716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:02:56.440 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:56 smithi073 ceph-mon[30883]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 3.82k op/s 2024-09-05T13:02:56.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T13:02:56.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:56 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:56.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:56 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/435395716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:02:56.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:56 smithi162 ceph-mon[34220]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 3.82k op/s 2024-09-05T13:02:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:56 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:02:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:56 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/435395716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:02:56.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:56 smithi169 ceph-mon[34823]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 3.82k op/s 2024-09-05T13:02:56.907 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:02:57.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.921+0000 7f13bffff640 1 -- 172.21.15.73:0/126290423 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0034020 con 0x7f13c8102ef0 2024-09-05T13:02:57.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.922+0000 7f13cf9e7640 1 -- 172.21.15.73:0/126290423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c8102ef0 msgr2=0x7f13c810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:57.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.922+0000 7f13cf9e7640 1 --2- 172.21.15.73:0/126290423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c8102ef0 0x7f13c810da40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009ca0 tx=0x7f13c002a980 comp rx=0 tx=0).stop 2024-09-05T13:02:57.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.923+0000 7f13cf9e7640 1 -- 172.21.15.73:0/126290423 shutdown_connections 2024-09-05T13:02:57.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.923+0000 7f13cf9e7640 1 --2- 172.21.15.73:0/126290423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c8102ef0 0x7f13c810da40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.923+0000 7f13cf9e7640 1 --2- 172.21.15.73:0/126290423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c8102570 0x7f13c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.923+0000 7f13cf9e7640 1 --2- 172.21.15.73:0/126290423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13c8100e20 0x7f13c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.923+0000 7f13cf9e7640 1 -- 172.21.15.73:0/126290423 >> 172.21.15.73:0/126290423 conn(0x7f13c80fc7d0 msgr2=0x7f13c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:57.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.924+0000 7f13cf9e7640 1 -- 172.21.15.73:0/126290423 shutdown_connections 2024-09-05T13:02:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.924+0000 7f13cf9e7640 1 -- 172.21.15.73:0/126290423 wait complete. 2024-09-05T13:02:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.925+0000 7f13cf9e7640 1 Processor -- start 2024-09-05T13:02:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.925+0000 7f13cf9e7640 1 -- start start 2024-09-05T13:02:57.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.926+0000 7f13cf9e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c8100e20 0x7f13c8107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.926+0000 7f13cf9e7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c8102570 0x7f13c8108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.926+0000 7f13cf9e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13c8102ef0 0x7f13c8108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.926+0000 7f13cf9e7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81110b0 con 0x7f13c8100e20 2024-09-05T13:02:57.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.926+0000 7f13cf9e7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8110f30 con 0x7f13c8102570 2024-09-05T13:02:57.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.926+0000 7f13cf9e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8111230 con 0x7f13c8102ef0 2024-09-05T13:02:57.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.926+0000 7f13ccf82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c8102570 0x7f13c8108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.926+0000 7f13ccf82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c8102570 0x7f13c8108020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:56138/0 (socket says 172.21.15.73:56138) 2024-09-05T13:02:57.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.926+0000 7f13ccf82640 1 -- 172.21.15.73:0/4162237445 learned_addr learned my addr 172.21.15.73:0/4162237445 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:57.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.927+0000 7f13cdf84640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13c8102ef0 0x7f13c8108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.927+0000 7f13ccf82640 1 -- 172.21.15.73:0/4162237445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13c8102ef0 msgr2=0x7f13c8108560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:57.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.927+0000 7f13ccf82640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13c8102ef0 0x7f13c8108560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.927+0000 7f13ccf82640 1 -- 172.21.15.73:0/4162237445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c8100e20 msgr2=0x7f13c8107ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:57.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.927+0000 7f13ccf82640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c8100e20 0x7f13c8107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.927+0000 7f13ccf82640 1 -- 172.21.15.73:0/4162237445 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c81aafb0 con 0x7f13c8102570 2024-09-05T13:02:57.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.933+0000 7f13ccf82640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c8102570 0x7f13c8108020 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13b800b450 tx=0x7f13b800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:57.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.933+0000 7f13be7fc640 1 -- 172.21.15.73:0/4162237445 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8015020 con 0x7f13c8102570 2024-09-05T13:02:57.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.933+0000 7f13be7fc640 1 -- 172.21.15.73:0/4162237445 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b8011d70 con 0x7f13c8102570 2024-09-05T13:02:57.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.934+0000 7f13be7fc640 1 -- 172.21.15.73:0/4162237445 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b800f340 con 0x7f13c8102570 2024-09-05T13:02:57.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.935+0000 7f13cf9e7640 1 -- 172.21.15.73:0/4162237445 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c81ab1e0 con 0x7f13c8102570 2024-09-05T13:02:57.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.935+0000 7f13cf9e7640 1 -- 172.21.15.73:0/4162237445 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c81ab6a0 con 0x7f13c8102570 2024-09-05T13:02:57.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.939+0000 7f13d1dbd740 1 Processor -- start 2024-09-05T13:02:57.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.940+0000 7f13d1dbd740 1 -- start start 2024-09-05T13:02:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.940+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 0x55cf1c452090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.940+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c452a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.940+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c45d370 0x55cf1c45f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.940+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cf1c3b82f0 con 0x55cf1c453b80 2024-09-05T13:02:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.940+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cf1c35fcf0 con 0x55cf1c45d370 2024-09-05T13:02:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.940+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cf1c3b42b0 con 0x55cf1c4525d0 2024-09-05T13:02:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.940+0000 7f13cdf84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 0x55cf1c452090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.940+0000 7f13cdf84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 0x55cf1c452090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58730/0 (socket says 172.21.15.73:58730) 2024-09-05T13:02:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.940+0000 7f13cdf84640 1 -- 172.21.15.73:0/1954171201 learned_addr learned my addr 172.21.15.73:0/1954171201 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.941+0000 7f13cd783640 1 --2- 172.21.15.73:0/1954171201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c452a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.942+0000 7f13cdf84640 1 -- 172.21.15.73:0/1954171201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 msgr2=0x55cf1c452a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.942+0000 7f13cdf84640 1 --2- 172.21.15.73:0/1954171201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c452a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.942+0000 7f13cdf84640 1 -- 172.21.15.73:0/1954171201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c45d370 msgr2=0x55cf1c45f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.942+0000 7f13cdf84640 1 --2- 172.21.15.73:0/1954171201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c45d370 0x55cf1c45f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.942+0000 7f13cdf84640 1 -- 172.21.15.73:0/1954171201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf1c3443a0 con 0x55cf1c453b80 2024-09-05T13:02:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.942+0000 7f13be7fc640 1 -- 172.21.15.73:0/4162237445 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f13b8018020 con 0x7f13c8102570 2024-09-05T13:02:57.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.942+0000 7f13cdf84640 1 --2- 172.21.15.73:0/1954171201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 0x55cf1c452090 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009430 tx=0x7f13c002fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be32721ecb06625 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:57.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.943+0000 7f13b37fe640 1 -- 172.21.15.73:0/1954171201 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0049070 con 0x55cf1c453b80 2024-09-05T13:02:57.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.943+0000 7f13b37fe640 1 -- 172.21.15.73:0/1954171201 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13c0003e50 con 0x55cf1c453b80 2024-09-05T13:02:57.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.943+0000 7f13b37fe640 1 -- 172.21.15.73:0/1954171201 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0034040 con 0x55cf1c453b80 2024-09-05T13:02:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.943+0000 7f13be7fc640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f13b40a2c20 0x7f13b40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.944+0000 7f13be7fc640 1 -- 172.21.15.73:0/4162237445 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f13b80ce970 con 0x7f13c8102570 2024-09-05T13:02:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.944+0000 7f13d1dbd740 1 -- 172.21.15.73:0/1954171201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 msgr2=0x55cf1c452090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.944+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/1954171201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 0x55cf1c452090 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009430 tx=0x7f13c002fc20 comp rx=0 tx=0).stop 2024-09-05T13:02:57.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.945+0000 7f13cd783640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f13b40a2c20 0x7f13b40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.945+0000 7f13cd783640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f13b40a2c20 0x7f13b40a50e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55cf1c453210 tx=0x7f13c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:57.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.946+0000 7f13d1dbd740 1 -- 172.21.15.73:0/1954171201 shutdown_connections 2024-09-05T13:02:57.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.946+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/1954171201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c45d370 0x55cf1c45f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.946+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/1954171201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c452a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.946+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/1954171201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 0x55cf1c452090 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.946+0000 7f13d1dbd740 1 -- 172.21.15.73:0/1954171201 >> 172.21.15.73:0/1954171201 conn(0x55cf1c41b310 msgr2=0x55cf1c44ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:57.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.948+0000 7f13d1dbd740 1 -- 172.21.15.73:0/1954171201 shutdown_connections 2024-09-05T13:02:57.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.948+0000 7f13d1dbd740 1 -- 172.21.15.73:0/1954171201 wait complete. 2024-09-05T13:02:57.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.949+0000 7f13d1dbd740 1 -- start start 2024-09-05T13:02:57.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.949+0000 7f13d1dbd740 1 Processor -- start 2024-09-05T13:02:57.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.949+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c45a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.950+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c453b80 0x55cf1c45a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.950+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 0x55cf1c45ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.950+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cf1c4600c0 con 0x55cf1c45d370 2024-09-05T13:02:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.950+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cf1c373060 con 0x55cf1c453b80 2024-09-05T13:02:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.950+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cf1c460240 con 0x55cf1c4525d0 2024-09-05T13:02:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.950+0000 7f13d1dbd740 10 client.0 _ll_register_callbacks cb 0x55cf1c0c68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:57.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.952+0000 7f13ccf82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c453b80 0x55cf1c45a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.952+0000 7f13ccf82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c453b80 0x55cf1c45a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:56162/0 (socket says 172.21.15.73:56162) 2024-09-05T13:02:57.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.952+0000 7f13ccf82640 1 -- 172.21.15.73:0/3627194529 learned_addr learned my addr 172.21.15.73:0/3627194529 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:57.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.953+0000 7f13cd783640 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c45a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.953+0000 7f13ccf82640 1 -- 172.21.15.73:0/3627194529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 msgr2=0x55cf1c45a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:57.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.953+0000 7f13ccf82640 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c45a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.953+0000 7f13ccf82640 1 -- 172.21.15.73:0/3627194529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 msgr2=0x55cf1c45ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:57.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.953+0000 7f13ccf82640 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 0x55cf1c45ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.953+0000 7f13ccf82640 1 -- 172.21.15.73:0/3627194529 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf1c1293c0 con 0x55cf1c453b80 2024-09-05T13:02:57.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.953+0000 7f13cd783640 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c45a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:02:57.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.953+0000 7f13ccf82640 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c453b80 0x55cf1c45a630 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13b8097b70 tx=0x7f13b809b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e73ab7abe2f99964 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:57.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.954+0000 7f13b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:02:57.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.954+0000 7f13b0ff9640 1 -- 172.21.15.73:0/3627194529 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b80b4060 con 0x55cf1c453b80 2024-09-05T13:02:57.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.954+0000 7f13b0ff9640 1 -- 172.21.15.73:0/3627194529 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f13b80bb0b0 con 0x55cf1c453b80 2024-09-05T13:02:57.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.954+0000 7f13d1dbd740 1 -- 172.21.15.73:0/3627194529 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13c0003e50 con 0x55cf1c453b80 2024-09-05T13:02:57.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.956+0000 7f13b0ff9640 1 -- 172.21.15.73:0/3627194529 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f13b80a3e10 con 0x55cf1c453b80 2024-09-05T13:02:57.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.956+0000 7f13d1dbd740 10 client.25565 fetch_fsmap learned FSMap version 41 2024-09-05T13:02:57.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.956+0000 7f13d1dbd740 1 -- 172.21.15.73:0/3627194529 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55cf1c47cd30 con 0x55cf1c453b80 2024-09-05T13:02:57.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.960+0000 7f13b0ff9640 1 -- 172.21.15.73:0/3627194529 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13c0003e50 con 0x55cf1c453b80 2024-09-05T13:02:57.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.960+0000 7f13b0ff9640 1 -- 172.21.15.73:0/3627194529 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f13b8022060 con 0x55cf1c453b80 2024-09-05T13:02:57.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.960+0000 7f13d1dbd740 10 client.25565 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:02:57.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.960+0000 7f13d1dbd740 10 client.25565 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T13:02:57.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.960+0000 7f13d1dbd740 20 client.25565 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:57.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.960+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55cf1c47e570 0x55cf1c4809b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.960+0000 7f13d1dbd740 4 client.25565 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:02:57.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.960+0000 7f13d1dbd740 1 -- 172.21.15.73:0/3627194529 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf1c3c5860 con 0x55cf1c47e570 2024-09-05T13:02:57.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.962+0000 7f13cd783640 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55cf1c47e570 0x55cf1c4809b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.963+0000 7f13b0ff9640 10 client.25565 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T13:02:57.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.963+0000 7f13cd783640 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55cf1c47e570 0x55cf1c4809b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11dd32975ad47a45 server_cookie=3697ad10e5687536 in_seq=0 out_seq=0 2024-09-05T13:02:57.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.964+0000 7f13b0ff9640 1 -- 172.21.15.73:0/3627194529 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf1c3c5860 con 0x55cf1c47e570 2024-09-05T13:02:57.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.964+0000 7f13b0ff9640 10 client.25565 handle_command_reply: tid=0 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.964+0000 7f13d1dbd740 1 client.25565 shutdown 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 1 -- 172.21.15.73:0/3627194529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c453b80 msgr2=0x55cf1c45a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c453b80 0x55cf1c45a630 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13b8097b70 tx=0x7f13b809b960 comp rx=0 tx=0).stop 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 1 -- 172.21.15.73:0/3627194529 shutdown_connections 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 0x55cf1c45ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c453b80 0x55cf1c45a630 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55cf1c47e570 0x55cf1c4809b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/3627194529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c45a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 1 -- 172.21.15.73:0/3627194529 >> 172.21.15.73:0/3627194529 conn(0x55cf1c41b310 msgr2=0x55cf1c454970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13b0ff9640 0 client.25565 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T13:02:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 1 -- 172.21.15.73:0/3627194529 shutdown_connections 2024-09-05T13:02:57.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 1 -- 172.21.15.73:0/3627194529 wait complete. 2024-09-05T13:02:57.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.965+0000 7f13d1dbd740 20 client.25565 trim_cache size 0 max 16384 2024-09-05T13:02:57.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.986+0000 7f13d1dbd740 1 Processor -- start 2024-09-05T13:02:57.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.986+0000 7f13d1dbd740 1 -- start start 2024-09-05T13:02:57.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c4525d0 0x55cf1c455160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c453b80 0x55cf1c4556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 0x55cf1c4862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81adb20 con 0x55cf1c45d370 2024-09-05T13:02:57.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81a4ac0 con 0x55cf1c4525d0 2024-09-05T13:02:57.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81021b0 con 0x55cf1c453b80 2024-09-05T13:02:57.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13cdf84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 0x55cf1c4862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13cdf84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 0x55cf1c4862c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58748/0 (socket says 172.21.15.73:58748) 2024-09-05T13:02:57.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13cdf84640 1 -- 172.21.15.73:0/987562316 learned_addr learned my addr 172.21.15.73:0/987562316 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13cdf84640 1 -- 172.21.15.73:0/987562316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c453b80 msgr2=0x55cf1c4556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13cdf84640 1 --2- 172.21.15.73:0/987562316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c453b80 0x55cf1c4556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13cdf84640 1 -- 172.21.15.73:0/987562316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c4525d0 msgr2=0x55cf1c455160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13cdf84640 1 --2- 172.21.15.73:0/987562316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c4525d0 0x55cf1c455160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.987+0000 7f13cdf84640 1 -- 172.21.15.73:0/987562316 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf1c481030 con 0x55cf1c45d370 2024-09-05T13:02:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.988+0000 7f13cdf84640 1 --2- 172.21.15.73:0/987562316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 0x55cf1c4862c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f13c002aea0 tx=0x7f13c00099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9db35d1c5ea7e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:57.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.990+0000 7f13b2ffd640 1 -- 172.21.15.73:0/987562316 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0049070 con 0x55cf1c45d370 2024-09-05T13:02:57.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.990+0000 7f13b2ffd640 1 -- 172.21.15.73:0/987562316 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13c0003e50 con 0x55cf1c45d370 2024-09-05T13:02:57.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.990+0000 7f13b2ffd640 1 -- 172.21.15.73:0/987562316 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c002f9a0 con 0x55cf1c45d370 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.991+0000 7f13d1dbd740 1 -- 172.21.15.73:0/987562316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 msgr2=0x55cf1c4862c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.991+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/987562316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 0x55cf1c4862c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f13c002aea0 tx=0x7f13c00099f0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.991+0000 7f13d1dbd740 1 -- 172.21.15.73:0/987562316 shutdown_connections 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.991+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/987562316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c45d370 0x55cf1c4862c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.991+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/987562316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c453b80 0x55cf1c4556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.991+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/987562316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c4525d0 0x55cf1c455160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.991+0000 7f13d1dbd740 1 -- 172.21.15.73:0/987562316 >> 172.21.15.73:0/987562316 conn(0x55cf1c41b310 msgr2=0x55cf1c45c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.992+0000 7f13d1dbd740 1 -- 172.21.15.73:0/987562316 shutdown_connections 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.992+0000 7f13d1dbd740 1 -- 172.21.15.73:0/987562316 wait complete. 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.992+0000 7f13d1dbd740 1 -- start start 2024-09-05T13:02:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.992+0000 7f13d1dbd740 1 Processor -- start 2024-09-05T13:02:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.993+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c460c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.993+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 0x55cf1c4611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.993+0000 7f13d1dbd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c45d370 0x55cf1c4e12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.993+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81a2f80 con 0x55cf1c453b80 2024-09-05T13:02:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.993+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81a43f0 con 0x55cf1c45d370 2024-09-05T13:02:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.993+0000 7f13d1dbd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81a3650 con 0x55cf1c4525d0 2024-09-05T13:02:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.993+0000 7f13d1dbd740 10 client.0 _ll_register_callbacks cb 0x7f13b8010f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.994+0000 7f13cdf84640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c45d370 0x55cf1c4e12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.994+0000 7f13cd783640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c460c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.994+0000 7f13cd783640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c460c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:55030/0 (socket says 172.21.15.73:55030) 2024-09-05T13:02:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.994+0000 7f13cd783640 1 -- 172.21.15.73:0/409797018 learned_addr learned my addr 172.21.15.73:0/409797018 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:57.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.995+0000 7f13ccf82640 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 0x55cf1c4611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:57.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.995+0000 7f13cdf84640 1 -- 172.21.15.73:0/409797018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 msgr2=0x55cf1c460c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:57.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.995+0000 7f13cdf84640 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c460c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.995+0000 7f13cdf84640 1 -- 172.21.15.73:0/409797018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 msgr2=0x55cf1c4611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:57.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.995+0000 7f13cdf84640 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 0x55cf1c4611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:57.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:57.995+0000 7f13cdf84640 1 -- 172.21.15.73:0/409797018 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf1c4e1900 con 0x55cf1c45d370 2024-09-05T13:02:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.000+0000 7f13cdf84640 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c45d370 0x55cf1c4e12c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009ca0 tx=0x7f13c002f880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=614bea2978c656e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.000+0000 7f13b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:02:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.000+0000 7f13b0ff9640 1 -- 172.21.15.73:0/409797018 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0034070 con 0x55cf1c45d370 2024-09-05T13:02:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.001+0000 7f13d1dbd740 1 -- 172.21.15.73:0/409797018 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13c0003e50 con 0x55cf1c45d370 2024-09-05T13:02:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.001+0000 7f13b0ff9640 1 -- 172.21.15.73:0/409797018 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f13c0003b80 con 0x55cf1c45d370 2024-09-05T13:02:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.002+0000 7f13b0ff9640 1 -- 172.21.15.73:0/409797018 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f13c0049040 con 0x55cf1c45d370 2024-09-05T13:02:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.002+0000 7f13d1dbd740 10 client.25568 fetch_fsmap learned FSMap version 41 2024-09-05T13:02:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.002+0000 7f13d1dbd740 1 -- 172.21.15.73:0/409797018 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55cf1c4e8c70 con 0x55cf1c45d370 2024-09-05T13:02:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.004+0000 7f13b0ff9640 1 -- 172.21.15.73:0/409797018 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13c0003e50 con 0x55cf1c45d370 2024-09-05T13:02:58.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.005+0000 7f13b0ff9640 1 -- 172.21.15.73:0/409797018 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f13c0004300 con 0x55cf1c45d370 2024-09-05T13:02:58.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.005+0000 7f13d1dbd740 10 client.25568 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:02:58.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.005+0000 7f13d1dbd740 10 client.25568 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T13:02:58.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.005+0000 7f13d1dbd740 20 client.25568 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:58.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.005+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55cf1c4e8ea0 0x55cf1c4eb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:58.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.005+0000 7f13d1dbd740 4 client.25568 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:02:58.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.005+0000 7f13d1dbd740 1 -- 172.21.15.73:0/409797018 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cf1c3bfd70 con 0x55cf1c4e8ea0 2024-09-05T13:02:58.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.007+0000 7f13cd783640 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55cf1c4e8ea0 0x55cf1c4eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.007+0000 7f13cd783640 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55cf1c4e8ea0 0x55cf1c4eb290 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5e581fecddd0e8e1 server_cookie=4ff7e49ef7a6cb96 in_seq=0 out_seq=0 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.007+0000 7f13b0ff9640 10 client.25568 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13b0ff9640 1 -- 172.21.15.73:0/409797018 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cf1c3bfd70 con 0x55cf1c4e8ea0 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13b0ff9640 10 client.25568 handle_command_reply: tid=0 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13d1dbd740 1 client.25568 shutdown 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13d1dbd740 1 -- 172.21.15.73:0/409797018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c45d370 msgr2=0x55cf1c4e12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c45d370 0x55cf1c4e12c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009ca0 tx=0x7f13c002f880 comp rx=0 tx=0).stop 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13d1dbd740 1 -- 172.21.15.73:0/409797018 shutdown_connections 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf1c45d370 0x55cf1c4e12c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cf1c453b80 0x55cf1c4611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55cf1c4e8ea0 0x55cf1c4eb290 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13d1dbd740 1 --2- 172.21.15.73:0/409797018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf1c4525d0 0x55cf1c460c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13d1dbd740 1 -- 172.21.15.73:0/409797018 >> 172.21.15.73:0/409797018 conn(0x55cf1c41b310 msgr2=0x55cf1c45a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.008+0000 7f13b0ff9640 0 client.25568 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T13:02:58.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.009+0000 7f13d1dbd740 1 -- 172.21.15.73:0/409797018 shutdown_connections 2024-09-05T13:02:58.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.009+0000 7f13d1dbd740 1 -- 172.21.15.73:0/409797018 wait complete. 2024-09-05T13:02:58.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.009+0000 7f13d1dbd740 20 client.25568 trim_cache size 0 max 16384 2024-09-05T13:02:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:02:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.009+0000 7f13cf9e7640 1 -- 172.21.15.73:0/4162237445 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f13b40a2c20 msgr2=0x7f13b40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.009+0000 7f13cf9e7640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f13b40a2c20 0x7f13b40a50e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55cf1c453210 tx=0x7f13c4008040 comp rx=0 tx=0).stop 2024-09-05T13:02:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.009+0000 7f13cf9e7640 1 -- 172.21.15.73:0/4162237445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c8102570 msgr2=0x7f13c8108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.009+0000 7f13cf9e7640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c8102570 0x7f13c8108020 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13b800b450 tx=0x7f13b800b910 comp rx=0 tx=0).stop 2024-09-05T13:02:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.010+0000 7f13cf9e7640 1 -- 172.21.15.73:0/4162237445 shutdown_connections 2024-09-05T13:02:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.010+0000 7f13cf9e7640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f13b40a2c20 0x7f13b40a50e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.010+0000 7f13cf9e7640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13c8102ef0 0x7f13c8108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.010+0000 7f13cf9e7640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c8102570 0x7f13c8108020 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.010+0000 7f13cf9e7640 1 --2- 172.21.15.73:0/4162237445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c8100e20 0x7f13c8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.010+0000 7f13cf9e7640 1 -- 172.21.15.73:0/4162237445 >> 172.21.15.73:0/4162237445 conn(0x7f13c80fc7d0 msgr2=0x7f13c8103700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.010+0000 7f13cf9e7640 1 -- 172.21.15.73:0/4162237445 shutdown_connections 2024-09-05T13:02:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:58.010+0000 7f13cf9e7640 1 -- 172.21.15.73:0/4162237445 wait complete. 2024-09-05T13:02:58.919 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T13:02:59.383 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:02:59.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:02:59 smithi073 ceph-mon[30883]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2024-09-05T13:02:59.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:02:59 smithi162 ceph-mon[34220]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2024-09-05T13:02:59.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:02:59 smithi169 ceph-mon[34823]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2024-09-05T13:02:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.930+0000 7f75616cd640 1 -- 172.21.15.73:0/3733585521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f755409b650 msgr2=0x7f755409ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.930+0000 7f75616cd640 1 --2- 172.21.15.73:0/3733585521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f755409b650 0x7f755409ba30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f755c067960 tx=0x7f755c096e10 comp rx=0 tx=0).stop 2024-09-05T13:02:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.930+0000 7f75616cd640 1 -- 172.21.15.73:0/3733585521 shutdown_connections 2024-09-05T13:02:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.930+0000 7f75616cd640 1 --2- 172.21.15.73:0/3733585521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7554096410 0x7f75540a2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.930+0000 7f75616cd640 1 --2- 172.21.15.73:0/3733585521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7554095a50 0x7f7554095ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.930+0000 7f75616cd640 1 --2- 172.21.15.73:0/3733585521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f755409b650 0x7f755409ba30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.930+0000 7f75616cd640 1 -- 172.21.15.73:0/3733585521 >> 172.21.15.73:0/3733585521 conn(0x7f755400b320 msgr2=0x7f755400b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:59.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.932+0000 7f75616cd640 1 -- 172.21.15.73:0/3733585521 shutdown_connections 2024-09-05T13:02:59.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.934+0000 7f75616cd640 1 -- 172.21.15.73:0/3733585521 wait complete. 2024-09-05T13:02:59.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.935+0000 7f75616cd640 1 Processor -- start 2024-09-05T13:02:59.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.935+0000 7f75616cd640 1 -- start start 2024-09-05T13:02:59.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.935+0000 7f75616cd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7554096410 0x7f755409fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.935+0000 7f75616cd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f755409b650 0x7f75540a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.935+0000 7f75616cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75541454f0 0x7f75541459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.935+0000 7f75616cd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f75540a7b70 con 0x7f75541454f0 2024-09-05T13:02:59.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.935+0000 7f75616cd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75540a79f0 con 0x7f7554096410 2024-09-05T13:02:59.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.935+0000 7f75616cd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f75540a7cf0 con 0x7f755409b650 2024-09-05T13:02:59.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.936+0000 7f755bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7554096410 0x7f755409fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:59.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.936+0000 7f755bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7554096410 0x7f755409fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:56200/0 (socket says 172.21.15.73:56200) 2024-09-05T13:02:59.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.936+0000 7f755bfff640 1 -- 172.21.15.73:0/2633367829 learned_addr learned my addr 172.21.15.73:0/2633367829 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:59.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.936+0000 7f755b7fe640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f755409b650 0x7f75540a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:59.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.938+0000 7f755b7fe640 1 -- 172.21.15.73:0/2633367829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7554096410 msgr2=0x7f755409fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:59.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.938+0000 7f755b7fe640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7554096410 0x7f755409fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.938+0000 7f755b7fe640 1 -- 172.21.15.73:0/2633367829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75541454f0 msgr2=0x7f75541459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:59.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.938+0000 7f755b7fe640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75541454f0 0x7f75541459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.938+0000 7f755b7fe640 1 -- 172.21.15.73:0/2633367829 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75541460a0 con 0x7f755409b650 2024-09-05T13:02:59.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.939+0000 7f755b7fe640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f755409b650 0x7f75540a0340 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f755400c6f0 tx=0x7f754800b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:59.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.940+0000 7f75597fa640 1 -- 172.21.15.73:0/2633367829 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548015020 con 0x7f755409b650 2024-09-05T13:02:59.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.940+0000 7f75597fa640 1 -- 172.21.15.73:0/2633367829 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7548011d10 con 0x7f755409b650 2024-09-05T13:02:59.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.940+0000 7f75597fa640 1 -- 172.21.15.73:0/2633367829 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754800f2e0 con 0x7f755409b650 2024-09-05T13:02:59.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.941+0000 7f75616cd640 1 -- 172.21.15.73:0/2633367829 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75540a5d20 con 0x7f755409b650 2024-09-05T13:02:59.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.941+0000 7f75616cd640 1 -- 172.21.15.73:0/2633367829 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75540a61e0 con 0x7f755409b650 2024-09-05T13:02:59.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.945+0000 7f7564d05740 1 Processor -- start 2024-09-05T13:02:59.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.945+0000 7f7564d05740 1 -- start start 2024-09-05T13:02:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.946+0000 7f7564d05740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf2d30 0x55e28baf1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.946+0000 7f7564d05740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf1780 0x55e28baf1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.946+0000 7f7564d05740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28bafc520 0x55e28bafe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.946+0000 7f7564d05740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e28ba572f0 con 0x55e28bafc520 2024-09-05T13:02:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.946+0000 7f7564d05740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e28b9fecf0 con 0x55e28baf2d30 2024-09-05T13:02:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.946+0000 7f7564d05740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e28ba532b0 con 0x55e28baf1780 2024-09-05T13:02:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.946+0000 7f7560ecc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf2d30 0x55e28baf1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.947+0000 7f7560ecc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf2d30 0x55e28baf1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:56212/0 (socket says 172.21.15.73:56212) 2024-09-05T13:02:59.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.947+0000 7f7560ecc640 1 -- 172.21.15.73:0/755000512 learned_addr learned my addr 172.21.15.73:0/755000512 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.947+0000 7f7560ecc640 1 -- 172.21.15.73:0/755000512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf1780 msgr2=0x55e28baf1be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:02:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.947+0000 7f75597fa640 1 -- 172.21.15.73:0/2633367829 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7548018020 con 0x7f755409b650 2024-09-05T13:02:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.948+0000 7f7560ecc640 1 --2- 172.21.15.73:0/755000512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf1780 0x55e28baf1be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.948+0000 7f7560ecc640 1 -- 172.21.15.73:0/755000512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28bafc520 msgr2=0x55e28bafe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:59.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.948+0000 7f7560ecc640 1 --2- 172.21.15.73:0/755000512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28bafc520 0x55e28bafe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.948+0000 7f7560ecc640 1 -- 172.21.15.73:0/755000512 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e28b9e33a0 con 0x55e28baf2d30 2024-09-05T13:02:59.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.949+0000 7f7560ecc640 1 --2- 172.21.15.73:0/755000512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf2d30 0x55e28baf1240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f755000ba90 tx=0x7f755000bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffd41969fc546f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:59.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.949+0000 7f75597fa640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f754c0a2da0 0x7f754c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.950+0000 7f75597fa640 1 -- 172.21.15.73:0/2633367829 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f75480ce840 con 0x7f755409b650 2024-09-05T13:02:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.951+0000 7f75467fc640 1 -- 172.21.15.73:0/755000512 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550016070 con 0x55e28baf2d30 2024-09-05T13:02:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.951+0000 7f75467fc640 1 -- 172.21.15.73:0/755000512 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7550005500 con 0x55e28baf2d30 2024-09-05T13:02:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.952+0000 7f7564d05740 1 -- 172.21.15.73:0/755000512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf2d30 msgr2=0x55e28baf1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.952+0000 7f7564d05740 1 --2- 172.21.15.73:0/755000512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf2d30 0x55e28baf1240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f755000ba90 tx=0x7f755000bf50 comp rx=0 tx=0).stop 2024-09-05T13:02:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.952+0000 7f7564d05740 1 -- 172.21.15.73:0/755000512 shutdown_connections 2024-09-05T13:02:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.952+0000 7f7564d05740 1 --2- 172.21.15.73:0/755000512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28bafc520 0x55e28bafe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.952+0000 7f7564d05740 1 --2- 172.21.15.73:0/755000512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf1780 0x55e28baf1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.952+0000 7f7564d05740 1 --2- 172.21.15.73:0/755000512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf2d30 0x55e28baf1240 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.952+0000 7f7564d05740 1 -- 172.21.15.73:0/755000512 >> 172.21.15.73:0/755000512 conn(0x55e28baba310 msgr2=0x55e28baede10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:59.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.953+0000 7f7564d05740 1 -- 172.21.15.73:0/755000512 shutdown_connections 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.953+0000 7f7564d05740 1 -- 172.21.15.73:0/755000512 wait complete. 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.953+0000 7f7564d05740 1 -- start start 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.953+0000 7f7564d05740 1 Processor -- start 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.954+0000 7f7564d05740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf1780 0x55e28bafbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.954+0000 7f7564d05740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf2d30 0x55e28baf91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.954+0000 7f7564d05740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28bafc520 0x55e28baf9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.954+0000 7f7564d05740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e28baff2d0 con 0x55e28baf2d30 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.954+0000 7f7564d05740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e28ba12060 con 0x55e28bafc520 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.954+0000 7f7564d05740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e28baff450 con 0x55e28baf1780 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.954+0000 7f7564d05740 10 client.0 _ll_register_callbacks cb 0x55e28b7658c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.954+0000 7f755b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf2d30 0x55e28baf91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.955+0000 7f755b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf2d30 0x55e28baf91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58780/0 (socket says 172.21.15.73:58780) 2024-09-05T13:02:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.955+0000 7f755b7fe640 1 -- 172.21.15.73:0/3850642665 learned_addr learned my addr 172.21.15.73:0/3850642665 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.955+0000 7f7560ecc640 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28bafc520 0x55e28baf9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.955+0000 7f755bfff640 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf1780 0x55e28bafbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.956+0000 7f755b7fe640 1 -- 172.21.15.73:0/3850642665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf1780 msgr2=0x55e28bafbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.956+0000 7f755b7fe640 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf1780 0x55e28bafbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.956+0000 7f755b7fe640 1 -- 172.21.15.73:0/3850642665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28bafc520 msgr2=0x55e28baf9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.956+0000 7f755b7fe640 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28bafc520 0x55e28baf9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.956+0000 7f755b7fe640 1 -- 172.21.15.73:0/3850642665 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e28b7c83c0 con 0x55e28baf2d30 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.956+0000 7f755bfff640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f754c0a2da0 0x7f754c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.956+0000 7f755b7fe640 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf2d30 0x55e28baf91a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f75480a37b0 tx=0x7f754809af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebd048bdbf9c54f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.956+0000 7f753b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.956+0000 7f753b7fe640 1 -- 172.21.15.73:0/3850642665 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754809b770 con 0x55e28baf2d30 2024-09-05T13:02:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.956+0000 7f7564d05740 1 -- 172.21.15.73:0/3850642665 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7550005500 con 0x55e28baf2d30 2024-09-05T13:02:59.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.957+0000 7f753b7fe640 1 -- 172.21.15.73:0/3850642665 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f75480cc420 con 0x55e28baf2d30 2024-09-05T13:02:59.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.957+0000 7f753b7fe640 1 -- 172.21.15.73:0/3850642665 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f754809b070 con 0x55e28baf2d30 2024-09-05T13:02:59.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.957+0000 7f7564d05740 10 client.16107 fetch_fsmap learned FSMap version 41 2024-09-05T13:02:59.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.957+0000 7f7564d05740 1 -- 172.21.15.73:0/3850642665 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55e28bb2ce50 con 0x55e28baf2d30 2024-09-05T13:02:59.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.957+0000 7f755bfff640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f754c0a2da0 0x7f754c0a5260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f755c065360 tx=0x7f755c096e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:59.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.957+0000 7f753b7fe640 1 -- 172.21.15.73:0/3850642665 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f754809f420 con 0x55e28baf2d30 2024-09-05T13:02:59.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.958+0000 7f753b7fe640 1 -- 172.21.15.73:0/3850642665 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f7548017b50 con 0x55e28baf2d30 2024-09-05T13:02:59.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.958+0000 7f7564d05740 10 client.16107 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:02:59.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.958+0000 7f7564d05740 10 client.16107 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T13:02:59.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.958+0000 7f7564d05740 20 client.16107 populate_metadata read hostname 'smithi073' 2024-09-05T13:02:59.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.958+0000 7f7564d05740 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e28bb2e4e0 0x55e28bb308d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.958+0000 7f7564d05740 4 client.16107 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:02:59.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.958+0000 7f7564d05740 1 -- 172.21.15.73:0/3850642665 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7550005500 con 0x55e28bb2e4e0 2024-09-05T13:02:59.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.960+0000 7f755bfff640 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e28bb2e4e0 0x55e28bb308d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:59.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.960+0000 7f755bfff640 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e28bb2e4e0 0x55e28bb308d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f9e0c92e41f0c564 server_cookie=220e66cf36c64b2 in_seq=0 out_seq=0 2024-09-05T13:02:59.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.961+0000 7f753b7fe640 10 client.16107 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T13:02:59.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f753b7fe640 1 -- 172.21.15.73:0/3850642665 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7550005500 con 0x55e28bb2e4e0 2024-09-05T13:02:59.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f753b7fe640 10 client.16107 handle_command_reply: tid=0 2024-09-05T13:02:59.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f7564d05740 1 client.16107 shutdown 2024-09-05T13:02:59.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f7564d05740 1 -- 172.21.15.73:0/3850642665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf2d30 msgr2=0x55e28baf91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:59.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f7564d05740 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf2d30 0x55e28baf91a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f75480a37b0 tx=0x7f754809af00 comp rx=0 tx=0).stop 2024-09-05T13:02:59.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f7564d05740 1 -- 172.21.15.73:0/3850642665 shutdown_connections 2024-09-05T13:02:59.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f7564d05740 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e28bb2e4e0 0x55e28bb308d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f7564d05740 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28bafc520 0x55e28baf9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f7564d05740 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf2d30 0x55e28baf91a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f7564d05740 1 --2- 172.21.15.73:0/3850642665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf1780 0x55e28bafbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f7564d05740 1 -- 172.21.15.73:0/3850642665 >> 172.21.15.73:0/3850642665 conn(0x55e28baba310 msgr2=0x55e28baf3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:02:59.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.965+0000 7f753b7fe640 0 client.16107 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T13:02:59.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.967+0000 7f7564d05740 1 -- 172.21.15.73:0/3850642665 shutdown_connections 2024-09-05T13:02:59.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.967+0000 7f7564d05740 1 -- 172.21.15.73:0/3850642665 wait complete. 2024-09-05T13:02:59.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.967+0000 7f7564d05740 20 client.16107 trim_cache size 0 max 16384 2024-09-05T13:02:59.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.991+0000 7f7564d05740 1 Processor -- start 2024-09-05T13:02:59.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.991+0000 7f7564d05740 1 -- start start 2024-09-05T13:02:59.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.992+0000 7f7564d05740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf1780 0x55e28bb085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.992+0000 7f7564d05740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.992+0000 7f7564d05740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28bafc520 0x55e28bb35e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:02:59.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.992+0000 7f7564d05740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7554152a20 con 0x55e28baf1780 2024-09-05T13:02:59.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.992+0000 7f7564d05740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7554150290 con 0x55e28bafc520 2024-09-05T13:02:59.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.992+0000 7f7564d05740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f755414e0e0 con 0x55e28baf2d30 2024-09-05T13:02:59.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.994+0000 7f755b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:02:59.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.994+0000 7f755b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:55066/0 (socket says 172.21.15.73:55066) 2024-09-05T13:02:59.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.994+0000 7f755b7fe640 1 -- 172.21.15.73:0/3222135623 learned_addr learned my addr 172.21.15.73:0/3222135623 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:02:59.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.995+0000 7f755b7fe640 1 -- 172.21.15.73:0/3222135623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28bafc520 msgr2=0x55e28bb35e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:02:59.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.995+0000 7f755b7fe640 1 --2- 172.21.15.73:0/3222135623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28bafc520 0x55e28bb35e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.995+0000 7f755b7fe640 1 -- 172.21.15.73:0/3222135623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf1780 msgr2=0x55e28bb085c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:02:59.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.995+0000 7f755b7fe640 1 --2- 172.21.15.73:0/3222135623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf1780 0x55e28bb085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:02:59.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.995+0000 7f755b7fe640 1 -- 172.21.15.73:0/3222135623 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e28baf9140 con 0x55e28baf2d30 2024-09-05T13:02:59.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.996+0000 7f755b7fe640 1 --2- 172.21.15.73:0/3222135623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf8180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7548017f20 tx=0x7f7548010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1affe2febf20780f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:02:59.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.996+0000 7f7545ffb640 1 -- 172.21.15.73:0/3222135623 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754809a7e0 con 0x55e28baf2d30 2024-09-05T13:02:59.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.996+0000 7f7545ffb640 1 -- 172.21.15.73:0/3222135623 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f754809b770 con 0x55e28baf2d30 2024-09-05T13:02:59.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.997+0000 7f7545ffb640 1 -- 172.21.15.73:0/3222135623 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754809f1c0 con 0x55e28baf2d30 2024-09-05T13:02:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.998+0000 7f7564d05740 1 -- 172.21.15.73:0/3222135623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 msgr2=0x55e28baf8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:02:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:02:59.998+0000 7f7564d05740 1 --2- 172.21.15.73:0/3222135623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf8180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7548017f20 tx=0x7f7548010740 comp rx=0 tx=0).stop 2024-09-05T13:03:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.000+0000 7f7564d05740 1 -- 172.21.15.73:0/3222135623 shutdown_connections 2024-09-05T13:03:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.000+0000 7f7564d05740 1 --2- 172.21.15.73:0/3222135623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28bafc520 0x55e28bb35e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.000+0000 7f7564d05740 1 --2- 172.21.15.73:0/3222135623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf8180 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.000+0000 7f7564d05740 1 --2- 172.21.15.73:0/3222135623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28baf1780 0x55e28bb085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.000+0000 7f7564d05740 1 -- 172.21.15.73:0/3222135623 >> 172.21.15.73:0/3222135623 conn(0x55e28baba310 msgr2=0x55e28baf7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:00.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.003+0000 7f7564d05740 1 -- 172.21.15.73:0/3222135623 shutdown_connections 2024-09-05T13:03:00.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.004+0000 7f7564d05740 1 -- 172.21.15.73:0/3222135623 wait complete. 2024-09-05T13:03:00.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.004+0000 7f7564d05740 1 -- start start 2024-09-05T13:03:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.005+0000 7f7564d05740 1 Processor -- start 2024-09-05T13:03:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.005+0000 7f7564d05740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf1780 0x55e28bb04b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.005+0000 7f7564d05740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.005+0000 7f7564d05740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28bafc520 0x55e28baf6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.006+0000 7f755b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.006+0000 7f755b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:55082/0 (socket says 172.21.15.73:55082) 2024-09-05T13:03:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.006+0000 7f7560ecc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28bafc520 0x55e28baf6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.006+0000 7f7560ecc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28bafc520 0x55e28baf6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58788/0 (socket says 172.21.15.73:58788) 2024-09-05T13:03:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.006+0000 7f755b7fe640 1 -- 172.21.15.73:0/36412508 learned_addr learned my addr 172.21.15.73:0/36412508 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.006+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f755414e750 con 0x55e28bafc520 2024-09-05T13:03:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.006+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f755414fbc0 con 0x55e28baf1780 2024-09-05T13:03:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.006+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f755414ee20 con 0x55e28baf2d30 2024-09-05T13:03:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.006+0000 7f7564d05740 10 client.0 _ll_register_callbacks cb 0x7f7548097310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:00.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.008+0000 7f755bfff640 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf1780 0x55e28bb04b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.008+0000 7f755b7fe640 1 -- 172.21.15.73:0/36412508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf1780 msgr2=0x55e28bb04b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.008+0000 7f755b7fe640 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf1780 0x55e28bb04b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.008+0000 7f755b7fe640 1 -- 172.21.15.73:0/36412508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28bafc520 msgr2=0x55e28baf6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:00.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.008+0000 7f755b7fe640 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28bafc520 0x55e28baf6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.008+0000 7f755b7fe640 1 -- 172.21.15.73:0/36412508 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e28baf66c0 con 0x55e28baf2d30 2024-09-05T13:03:00.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.009+0000 7f755b7fe640 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf5c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f754809b230 tx=0x7f75480108e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d566825b27d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:00.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.009+0000 7f753b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:03:00.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.009+0000 7f753b7fe640 1 -- 172.21.15.73:0/36412508 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548011a30 con 0x55e28baf2d30 2024-09-05T13:03:00.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.009+0000 7f753b7fe640 1 -- 172.21.15.73:0/36412508 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f7548096dc0 con 0x55e28baf2d30 2024-09-05T13:03:00.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.009+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f754809b770 con 0x55e28baf2d30 2024-09-05T13:03:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.012+0000 7f753b7fe640 1 -- 172.21.15.73:0/36412508 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f7548009150 con 0x55e28baf2d30 2024-09-05T13:03:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.012+0000 7f7564d05740 10 client.25669 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.012+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55e28bb98b50 con 0x55e28baf2d30 2024-09-05T13:03:00.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.013+0000 7f753b7fe640 1 -- 172.21.15.73:0/36412508 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f754809b770 con 0x55e28baf2d30 2024-09-05T13:03:00.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.013+0000 7f753b7fe640 1 -- 172.21.15.73:0/36412508 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f75480a07c0 con 0x55e28baf2d30 2024-09-05T13:03:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.013+0000 7f7564d05740 10 client.25669 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.013+0000 7f7564d05740 10 client.25669 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T13:03:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.013+0000 7f7564d05740 20 client.25669 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.014+0000 7f7564d05740 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e28bb98e40 0x55e28bb9b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.014+0000 7f7564d05740 4 client.25669 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:03:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.014+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e28ba64860 con 0x55e28bb98e40 2024-09-05T13:03:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.014+0000 7f755bfff640 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e28bb98e40 0x55e28bb9b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:00.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.015+0000 7f755bfff640 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e28bb98e40 0x55e28bb9b260 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2c0ed1955188c635 server_cookie=823b491b7b8e8594 in_seq=0 out_seq=0 2024-09-05T13:03:00.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.015+0000 7f753b7fe640 10 client.25669 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T13:03:00.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f753b7fe640 1 -- 172.21.15.73:0/36412508 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e28ba64860 con 0x55e28bb98e40 2024-09-05T13:03:00.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f753b7fe640 10 client.25669 handle_command_reply: tid=0 2024-09-05T13:03:00.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 client.25669 shutdown 2024-09-05T13:03:00.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 msgr2=0x55e28baf5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:00.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf5c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f754809b230 tx=0x7f75480108e0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 shutdown_connections 2024-09-05T13:03:00.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55e28bb98e40 0x55e28bb9b260 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e28bafc520 0x55e28baf6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e28baf2d30 0x55e28baf5c40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f753b7fe640 0 client.25669 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T13:03:00.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 --2- 172.21.15.73:0/36412508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28baf1780 0x55e28bb04b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 >> 172.21.15.73:0/36412508 conn(0x55e28baba310 msgr2=0x55e28baf8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:00.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 shutdown_connections 2024-09-05T13:03:00.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.016+0000 7f7564d05740 1 -- 172.21.15.73:0/36412508 wait complete. 2024-09-05T13:03:00.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.017+0000 7f7564d05740 20 client.25669 trim_cache size 0 max 16384 2024-09-05T13:03:00.023 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:03:00.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.022+0000 7f75616cd640 1 -- 172.21.15.73:0/2633367829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f754c0a2da0 msgr2=0x7f754c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.022+0000 7f75616cd640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f754c0a2da0 0x7f754c0a5260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f755c065360 tx=0x7f755c096e10 comp rx=0 tx=0).stop 2024-09-05T13:03:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.022+0000 7f75616cd640 1 -- 172.21.15.73:0/2633367829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f755409b650 msgr2=0x7f75540a0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.022+0000 7f75616cd640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f755409b650 0x7f75540a0340 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f755400c6f0 tx=0x7f754800b870 comp rx=0 tx=0).stop 2024-09-05T13:03:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.022+0000 7f75616cd640 1 -- 172.21.15.73:0/2633367829 shutdown_connections 2024-09-05T13:03:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.022+0000 7f75616cd640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f754c0a2da0 0x7f754c0a5260 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.022+0000 7f75616cd640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75541454f0 0x7f75541459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.022+0000 7f75616cd640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f755409b650 0x7f75540a0340 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.022+0000 7f75616cd640 1 --2- 172.21.15.73:0/2633367829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7554096410 0x7f755409fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.022+0000 7f75616cd640 1 -- 172.21.15.73:0/2633367829 >> 172.21.15.73:0/2633367829 conn(0x7f755400b320 msgr2=0x7f75540947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:00.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.023+0000 7f75616cd640 1 -- 172.21.15.73:0/2633367829 shutdown_connections 2024-09-05T13:03:00.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:00.023+0000 7f75616cd640 1 -- 172.21.15.73:0/2633367829 wait complete. 2024-09-05T13:03:00.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T13:03:01.166 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:01 smithi073 ceph-mon[30883]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 2.85k op/s 2024-09-05T13:03:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:03:01.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:01 smithi162 ceph-mon[34220]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 2.85k op/s 2024-09-05T13:03:01.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:01 smithi169 ceph-mon[34823]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 2.85k op/s 2024-09-05T13:03:01.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.922+0000 7f452ec34640 1 -- 172.21.15.73:0/2940263633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4528105f40 msgr2=0x7f45281063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:01.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.922+0000 7f452ec34640 1 --2- 172.21.15.73:0/2940263633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4528105f40 0x7f45281063d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4520009be0 tx=0x7f452002a780 comp rx=0 tx=0).stop 2024-09-05T13:03:01.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.922+0000 7f452ec34640 1 -- 172.21.15.73:0/2940263633 shutdown_connections 2024-09-05T13:03:01.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.922+0000 7f452ec34640 1 --2- 172.21.15.73:0/2940263633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4528105f40 0x7f45281063d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.922+0000 7f452ec34640 1 --2- 172.21.15.73:0/2940263633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4528101450 0x7f4528105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.922+0000 7f452ec34640 1 --2- 172.21.15.73:0/2940263633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4528100b30 0x7f4528100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.922+0000 7f452ec34640 1 -- 172.21.15.73:0/2940263633 >> 172.21.15.73:0/2940263633 conn(0x7f45280fc7a0 msgr2=0x7f45280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:01.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.923+0000 7f452ec34640 1 -- 172.21.15.73:0/2940263633 shutdown_connections 2024-09-05T13:03:01.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.926+0000 7f452ec34640 1 -- 172.21.15.73:0/2940263633 wait complete. 2024-09-05T13:03:01.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.927+0000 7f452ec34640 1 Processor -- start 2024-09-05T13:03:01.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.927+0000 7f452ec34640 1 -- start start 2024-09-05T13:03:01.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.927+0000 7f452ec34640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4528100b30 0x7f452819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.927+0000 7f452ec34640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4528101450 0x7f452819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.927+0000 7f452ec34640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4528105f40 0x7f45281a3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.927+0000 7f452ec34640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f45281185b0 con 0x7f4528100b30 2024-09-05T13:03:01.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.927+0000 7f452ec34640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4528118430 con 0x7f4528101450 2024-09-05T13:03:01.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.927+0000 7f452ec34640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4528118730 con 0x7f4528105f40 2024-09-05T13:03:01.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.927+0000 7f452d1d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4528105f40 0x7f45281a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.928+0000 7f452d1d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4528105f40 0x7f45281a3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:55106/0 (socket says 172.21.15.73:55106) 2024-09-05T13:03:01.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.928+0000 7f452d1d1640 1 -- 172.21.15.73:0/2663080060 learned_addr learned my addr 172.21.15.73:0/2663080060 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:01.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.928+0000 7f452c9d0640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4528100b30 0x7f452819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.928+0000 7f4527fff640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4528101450 0x7f452819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.928+0000 7f452d1d1640 1 -- 172.21.15.73:0/2663080060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4528101450 msgr2=0x7f452819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.928+0000 7f452d1d1640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4528101450 0x7f452819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.928+0000 7f452d1d1640 1 -- 172.21.15.73:0/2663080060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4528100b30 msgr2=0x7f452819ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.928+0000 7f452d1d1640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4528100b30 0x7f452819ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.928+0000 7f452d1d1640 1 -- 172.21.15.73:0/2663080060 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45281a3a70 con 0x7f4528105f40 2024-09-05T13:03:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.928+0000 7f452d1d1640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4528105f40 0x7f45281a3340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4520034040 tx=0x7f45200329d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.929+0000 7f4525ffb640 1 -- 172.21.15.73:0/2663080060 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520042020 con 0x7f4528105f40 2024-09-05T13:03:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.929+0000 7f452ec34640 1 -- 172.21.15.73:0/2663080060 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45281a3d00 con 0x7f4528105f40 2024-09-05T13:03:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.929+0000 7f4525ffb640 1 -- 172.21.15.73:0/2663080060 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4520030e90 con 0x7f4528105f40 2024-09-05T13:03:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.929+0000 7f4525ffb640 1 -- 172.21.15.73:0/2663080060 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452003ec00 con 0x7f4528105f40 2024-09-05T13:03:01.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.929+0000 7f452ec34640 1 -- 172.21.15.73:0/2663080060 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45281ab5f0 con 0x7f4528105f40 2024-09-05T13:03:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.933+0000 7f453100a740 1 Processor -- start 2024-09-05T13:03:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f4525ffb640 1 -- 172.21.15.73:0/2663080060 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4520045020 con 0x7f4528105f40 2024-09-05T13:03:01.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f453100a740 1 -- start start 2024-09-05T13:03:01.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f453100a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 0x5565f8b35090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f453100a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b35a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f453100a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b40370 0x5565f8b42760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f453100a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5565f8a9b2f0 con 0x5565f8b36b80 2024-09-05T13:03:01.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f453100a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5565f8a42cf0 con 0x5565f8b40370 2024-09-05T13:03:01.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f453100a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5565f8a972b0 con 0x5565f8b355d0 2024-09-05T13:03:01.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f4527fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 0x5565f8b35090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f4527fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 0x5565f8b35090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58810/0 (socket says 172.21.15.73:58810) 2024-09-05T13:03:01.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f4527fff640 1 -- 172.21.15.73:0/1306689816 learned_addr learned my addr 172.21.15.73:0/1306689816 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:01.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f4527fff640 1 --2- 172.21.15.73:0/1306689816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b40370 0x5565f8b42760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f452c9d0640 1 --2- 172.21.15.73:0/1306689816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b35a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f4527fff640 1 -- 172.21.15.73:0/1306689816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 msgr2=0x5565f8b35a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f4527fff640 1 --2- 172.21.15.73:0/1306689816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b35a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f4527fff640 1 -- 172.21.15.73:0/1306689816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b40370 msgr2=0x5565f8b42760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.934+0000 7f4527fff640 1 --2- 172.21.15.73:0/1306689816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b40370 0x5565f8b42760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.935+0000 7f4527fff640 1 -- 172.21.15.73:0/1306689816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565f8a273a0 con 0x5565f8b36b80 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.935+0000 7f4527fff640 1 --2- 172.21.15.73:0/1306689816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 0x5565f8b35090 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f451c009fd0 tx=0x7f451c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7334ac604170f3d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.935+0000 7f4525ffb640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f45100a2c40 0x7f45100a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.935+0000 7f450effd640 1 -- 172.21.15.73:0/1306689816 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c004020 con 0x5565f8b36b80 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.935+0000 7f452c9d0640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f45100a2c40 0x7f45100a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.935+0000 7f4525ffb640 1 -- 172.21.15.73:0/2663080060 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f45200f0240 con 0x7f4528105f40 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.935+0000 7f450effd640 1 -- 172.21.15.73:0/1306689816 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f451c0041c0 con 0x5565f8b36b80 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.935+0000 7f450effd640 1 -- 172.21.15.73:0/1306689816 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c010750 con 0x5565f8b36b80 2024-09-05T13:03:01.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.936+0000 7f453100a740 1 -- 172.21.15.73:0/1306689816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 msgr2=0x5565f8b35090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:01.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.936+0000 7f453100a740 1 --2- 172.21.15.73:0/1306689816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 0x5565f8b35090 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f451c009fd0 tx=0x7f451c009610 comp rx=0 tx=0).stop 2024-09-05T13:03:01.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.936+0000 7f453100a740 1 -- 172.21.15.73:0/1306689816 shutdown_connections 2024-09-05T13:03:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.936+0000 7f453100a740 1 --2- 172.21.15.73:0/1306689816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b40370 0x5565f8b42760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.936+0000 7f453100a740 1 --2- 172.21.15.73:0/1306689816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b35a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.936+0000 7f453100a740 1 --2- 172.21.15.73:0/1306689816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 0x5565f8b35090 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.936+0000 7f453100a740 1 -- 172.21.15.73:0/1306689816 >> 172.21.15.73:0/1306689816 conn(0x5565f8afe310 msgr2=0x5565f8b31c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.937+0000 7f452c9d0640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f45100a2c40 0x7f45100a5100 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4518005d80 tx=0x7f4518005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.937+0000 7f453100a740 1 -- 172.21.15.73:0/1306689816 shutdown_connections 2024-09-05T13:03:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.938+0000 7f453100a740 1 -- 172.21.15.73:0/1306689816 wait complete. 2024-09-05T13:03:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.938+0000 7f453100a740 1 -- start start 2024-09-05T13:03:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.938+0000 7f453100a740 1 Processor -- start 2024-09-05T13:03:01.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f453100a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b3fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f453100a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b3cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f453100a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 0x5565f8b3d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f453100a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5565f8b430d0 con 0x5565f8b40370 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f453100a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5565f8a56060 con 0x5565f8b36b80 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f453100a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5565f8b43250 con 0x5565f8b355d0 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f4527fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b3cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f4527fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b3cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:56282/0 (socket says 172.21.15.73:56282) 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f4527fff640 1 -- 172.21.15.73:0/200937591 learned_addr learned my addr 172.21.15.73:0/200937591 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f453100a740 10 client.0 _ll_register_callbacks cb 0x5565f87a98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.939+0000 7f452d1d1640 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 0x5565f8b3d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.940+0000 7f4527fff640 1 -- 172.21.15.73:0/200937591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 msgr2=0x5565f8b3fcc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.940+0000 7f4527fff640 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b3fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.940+0000 7f4527fff640 1 -- 172.21.15.73:0/200937591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 msgr2=0x5565f8b3d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.940+0000 7f4527fff640 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 0x5565f8b3d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.940+0000 7f4527fff640 1 -- 172.21.15.73:0/200937591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565f880c3c0 con 0x5565f8b36b80 2024-09-05T13:03:01.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.941+0000 7f4527fff640 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b3cf70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f451c009dc0 tx=0x7f451c005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad170e4254f8e576 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:01.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.942+0000 7f4507fff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:03:01.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.942+0000 7f4507fff640 1 -- 172.21.15.73:0/200937591 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c02e060 con 0x5565f8b36b80 2024-09-05T13:03:01.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.942+0000 7f4507fff640 1 -- 172.21.15.73:0/200937591 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f451c004370 con 0x5565f8b36b80 2024-09-05T13:03:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.945+0000 7f453100a740 1 -- 172.21.15.73:0/200937591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f451c0041c0 con 0x5565f8b36b80 2024-09-05T13:03:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.945+0000 7f4507fff640 1 -- 172.21.15.73:0/200937591 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f451c003ad0 con 0x5565f8b36b80 2024-09-05T13:03:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.945+0000 7f453100a740 10 client.25595 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.945+0000 7f453100a740 1 -- 172.21.15.73:0/200937591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5565f8b4eac0 con 0x5565f8b36b80 2024-09-05T13:03:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.945+0000 7f4507fff640 1 -- 172.21.15.73:0/200937591 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f451c0109d0 con 0x5565f8b36b80 2024-09-05T13:03:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.946+0000 7f4507fff640 1 -- 172.21.15.73:0/200937591 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f451c01d020 con 0x5565f8b36b80 2024-09-05T13:03:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.946+0000 7f453100a740 10 client.25595 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.946+0000 7f453100a740 10 client.25595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.946+0000 7f453100a740 20 client.25595 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.946+0000 7f453100a740 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5565f8b4ff20 0x5565f8b52310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.946+0000 7f453100a740 4 client.25595 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.946+0000 7f453100a740 1 -- 172.21.15.73:0/200937591 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f451c0041c0 con 0x5565f8b4ff20 2024-09-05T13:03:01.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.948+0000 7f452c9d0640 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5565f8b4ff20 0x5565f8b52310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.956+0000 7f452c9d0640 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5565f8b4ff20 0x5565f8b52310 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b95ef6252ea026 server_cookie=a5c2c98c17739db0 in_seq=0 out_seq=0 2024-09-05T13:03:01.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.957+0000 7f4507fff640 10 client.25595 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:01.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.958+0000 7f4507fff640 1 -- 172.21.15.73:0/200937591 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f451c0041c0 con 0x5565f8b4ff20 2024-09-05T13:03:01.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.958+0000 7f4507fff640 10 client.25595 handle_command_reply: tid=0 2024-09-05T13:03:01.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.959+0000 7f453100a740 1 client.25595 shutdown 2024-09-05T13:03:01.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.961+0000 7f453100a740 1 -- 172.21.15.73:0/200937591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 msgr2=0x5565f8b3cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:01.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.961+0000 7f453100a740 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b3cf70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f451c009dc0 tx=0x7f451c005bd0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.964+0000 7f453100a740 1 -- 172.21.15.73:0/200937591 shutdown_connections 2024-09-05T13:03:01.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.964+0000 7f453100a740 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5565f8b4ff20 0x5565f8b52310 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.965+0000 7f453100a740 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 0x5565f8b3d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.965+0000 7f453100a740 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b3cf70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.965+0000 7f453100a740 1 --2- 172.21.15.73:0/200937591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b3fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.965+0000 7f453100a740 1 -- 172.21.15.73:0/200937591 >> 172.21.15.73:0/200937591 conn(0x5565f8afe310 msgr2=0x5565f8b379a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:01.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.965+0000 7f4507fff640 0 client.25595 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:01.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.967+0000 7f453100a740 1 -- 172.21.15.73:0/200937591 shutdown_connections 2024-09-05T13:03:01.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.967+0000 7f453100a740 1 -- 172.21.15.73:0/200937591 wait complete. 2024-09-05T13:03:01.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.967+0000 7f453100a740 20 client.25595 trim_cache size 0 max 16384 2024-09-05T13:03:01.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.991+0000 7f453100a740 1 Processor -- start 2024-09-05T13:03:01.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.992+0000 7f453100a740 1 -- start start 2024-09-05T13:03:01.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.992+0000 7f453100a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b355d0 0x5565f8b3eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.992+0000 7f453100a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 0x5565f8b38160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.992+0000 7f453100a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b40370 0x5565f8b386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:01.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.992+0000 7f453100a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f45281b63a0 con 0x5565f8b36b80 2024-09-05T13:03:01.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.992+0000 7f453100a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45281b3c10 con 0x5565f8b355d0 2024-09-05T13:03:01.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.992+0000 7f453100a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45281b1a60 con 0x5565f8b40370 2024-09-05T13:03:01.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.993+0000 7f452c9d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b355d0 0x5565f8b3eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.993+0000 7f452c9d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b355d0 0x5565f8b3eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:56286/0 (socket says 172.21.15.73:56286) 2024-09-05T13:03:01.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.993+0000 7f452c9d0640 1 -- 172.21.15.73:0/1310339341 learned_addr learned my addr 172.21.15.73:0/1310339341 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:01.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.993+0000 7f4527fff640 1 --2- 172.21.15.73:0/1310339341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 0x5565f8b38160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.994+0000 7f452d1d1640 1 --2- 172.21.15.73:0/1310339341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b40370 0x5565f8b386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:01.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.994+0000 7f452c9d0640 1 -- 172.21.15.73:0/1310339341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b40370 msgr2=0x5565f8b386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:01.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.994+0000 7f452c9d0640 1 --2- 172.21.15.73:0/1310339341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b40370 0x5565f8b386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.994+0000 7f452c9d0640 1 -- 172.21.15.73:0/1310339341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 msgr2=0x5565f8b38160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:01.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.994+0000 7f452c9d0640 1 --2- 172.21.15.73:0/1310339341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 0x5565f8b38160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:01.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.994+0000 7f452c9d0640 1 -- 172.21.15.73:0/1310339341 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565f8b31510 con 0x5565f8b355d0 2024-09-05T13:03:01.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.994+0000 7f452c9d0640 1 --2- 172.21.15.73:0/1310339341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b355d0 0x5565f8b3eee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5565f8b529a0 tx=0x7f4518014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6966e2b51dc1dbae server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:02.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.997+0000 7f450e7fc640 1 -- 172.21.15.73:0/1310339341 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451802c070 con 0x5565f8b355d0 2024-09-05T13:03:02.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.998+0000 7f450e7fc640 1 -- 172.21.15.73:0/1310339341 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4518004250 con 0x5565f8b355d0 2024-09-05T13:03:02.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.998+0000 7f450e7fc640 1 -- 172.21.15.73:0/1310339341 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518027710 con 0x5565f8b355d0 2024-09-05T13:03:02.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.999+0000 7f453100a740 1 -- 172.21.15.73:0/1310339341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b355d0 msgr2=0x5565f8b3eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:02.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:01.999+0000 7f453100a740 1 --2- 172.21.15.73:0/1310339341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b355d0 0x5565f8b3eee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5565f8b529a0 tx=0x7f4518014000 comp rx=0 tx=0).stop 2024-09-05T13:03:02.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.004+0000 7f453100a740 1 -- 172.21.15.73:0/1310339341 shutdown_connections 2024-09-05T13:03:02.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.004+0000 7f453100a740 1 --2- 172.21.15.73:0/1310339341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b40370 0x5565f8b386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.004+0000 7f453100a740 1 --2- 172.21.15.73:0/1310339341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b36b80 0x5565f8b38160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.004+0000 7f453100a740 1 --2- 172.21.15.73:0/1310339341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b355d0 0x5565f8b3eee0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.004+0000 7f453100a740 1 -- 172.21.15.73:0/1310339341 >> 172.21.15.73:0/1310339341 conn(0x5565f8afe310 msgr2=0x5565f8b3e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.004+0000 7f453100a740 1 -- 172.21.15.73:0/1310339341 shutdown_connections 2024-09-05T13:03:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.004+0000 7f453100a740 1 -- 172.21.15.73:0/1310339341 wait complete. 2024-09-05T13:03:02.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.005+0000 7f453100a740 1 -- start start 2024-09-05T13:03:02.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.005+0000 7f453100a740 1 Processor -- start 2024-09-05T13:03:02.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.006+0000 7f453100a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b48890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:02.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.006+0000 7f453100a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b48dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:02.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.006+0000 7f453100a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 0x5565f8b39bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:02.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.006+0000 7f453100a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f45281b20d0 con 0x5565f8b40370 2024-09-05T13:03:02.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.006+0000 7f453100a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45281b3540 con 0x5565f8b36b80 2024-09-05T13:03:02.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.006+0000 7f453100a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45281b27a0 con 0x5565f8b355d0 2024-09-05T13:03:02.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.006+0000 7f453100a740 10 client.0 _ll_register_callbacks cb 0x7f451c013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:02.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.007+0000 7f452d1d1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 0x5565f8b39bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:02.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.007+0000 7f452d1d1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 0x5565f8b39bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58824/0 (socket says 172.21.15.73:58824) 2024-09-05T13:03:02.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.007+0000 7f452d1d1640 1 -- 172.21.15.73:0/2926285777 learned_addr learned my addr 172.21.15.73:0/2926285777 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:02.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.007+0000 7f4527fff640 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b48dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:02.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.007+0000 7f452c9d0640 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b48890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:02.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.009+0000 7f4527fff640 1 -- 172.21.15.73:0/2926285777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 msgr2=0x5565f8b48890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:02.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.009+0000 7f4527fff640 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b48890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.009+0000 7f4527fff640 1 -- 172.21.15.73:0/2926285777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 msgr2=0x5565f8b39bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:02.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.009+0000 7f4527fff640 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 0x5565f8b39bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.009+0000 7f4527fff640 1 -- 172.21.15.73:0/2926285777 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565f8b3a3e0 con 0x5565f8b36b80 2024-09-05T13:03:02.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.010+0000 7f4527fff640 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b48dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f451c029660 tx=0x7f451c029a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdb8801b60e67df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.012+0000 7f4507fff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:03:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.012+0000 7f4507fff640 1 -- 172.21.15.73:0/2926285777 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c02e040 con 0x5565f8b36b80 2024-09-05T13:03:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.012+0000 7f4507fff640 1 -- 172.21.15.73:0/2926285777 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f451c005390 con 0x5565f8b36b80 2024-09-05T13:03:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.013+0000 7f453100a740 1 -- 172.21.15.73:0/2926285777 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4518004250 con 0x5565f8b36b80 2024-09-05T13:03:02.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.014+0000 7f4507fff640 1 -- 172.21.15.73:0/2926285777 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f451c041050 con 0x5565f8b36b80 2024-09-05T13:03:02.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.014+0000 7f453100a740 10 client.25601 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:02.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.014+0000 7f453100a740 1 -- 172.21.15.73:0/2926285777 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5565f8bba6f0 con 0x5565f8b36b80 2024-09-05T13:03:02.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.015+0000 7f4507fff640 1 -- 172.21.15.73:0/2926285777 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4518004250 con 0x5565f8b36b80 2024-09-05T13:03:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.015+0000 7f4507fff640 1 -- 172.21.15.73:0/2926285777 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f451c044020 con 0x5565f8b36b80 2024-09-05T13:03:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.015+0000 7f453100a740 10 client.25601 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.015+0000 7f453100a740 10 client.25601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.015+0000 7f453100a740 20 client.25601 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.015+0000 7f453100a740 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5565f8bbae20 0x5565f8bbd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.016+0000 7f453100a740 4 client.25601 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:03:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.016+0000 7f453100a740 1 -- 172.21.15.73:0/2926285777 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5565f8aa8860 con 0x5565f8bbae20 2024-09-05T13:03:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.016+0000 7f452c9d0640 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5565f8bbae20 0x5565f8bbd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.016+0000 7f452c9d0640 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5565f8bbae20 0x5565f8bbd240 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eed288e744edd087 server_cookie=34b98e8e3196da13 in_seq=0 out_seq=0 2024-09-05T13:03:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.016+0000 7f4507fff640 10 client.25601 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.017+0000 7f4507fff640 1 -- 172.21.15.73:0/2926285777 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5565f8aa8860 con 0x5565f8bbae20 2024-09-05T13:03:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.017+0000 7f4507fff640 10 client.25601 handle_command_reply: tid=0 2024-09-05T13:03:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.017+0000 7f453100a740 1 client.25601 shutdown 2024-09-05T13:03:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.018+0000 7f453100a740 1 -- 172.21.15.73:0/2926285777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 msgr2=0x5565f8b48dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.018+0000 7f453100a740 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b48dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f451c029660 tx=0x7f451c029a80 comp rx=0 tx=0).stop 2024-09-05T13:03:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.018+0000 7f453100a740 1 -- 172.21.15.73:0/2926285777 shutdown_connections 2024-09-05T13:03:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.018+0000 7f453100a740 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5565f8bbae20 0x5565f8bbd240 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.018+0000 7f453100a740 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565f8b40370 0x5565f8b39bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.018+0000 7f453100a740 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5565f8b36b80 0x5565f8b48dd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.018+0000 7f453100a740 1 --2- 172.21.15.73:0/2926285777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565f8b355d0 0x5565f8b48890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.018+0000 7f453100a740 1 -- 172.21.15.73:0/2926285777 >> 172.21.15.73:0/2926285777 conn(0x5565f8afe310 msgr2=0x5565f8b3eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.018+0000 7f4507fff640 0 client.25601 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.019+0000 7f453100a740 1 -- 172.21.15.73:0/2926285777 shutdown_connections 2024-09-05T13:03:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.019+0000 7f453100a740 1 -- 172.21.15.73:0/2926285777 wait complete. 2024-09-05T13:03:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.019+0000 7f453100a740 20 client.25601 trim_cache size 0 max 16384 2024-09-05T13:03:02.021 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:03:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 -- 172.21.15.73:0/2663080060 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f45100a2c40 msgr2=0x7f45100a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f45100a2c40 0x7f45100a5100 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4518005d80 tx=0x7f4518005d10 comp rx=0 tx=0).stop 2024-09-05T13:03:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 -- 172.21.15.73:0/2663080060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4528105f40 msgr2=0x7f45281a3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4528105f40 0x7f45281a3340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4520034040 tx=0x7f45200329d0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 -- 172.21.15.73:0/2663080060 shutdown_connections 2024-09-05T13:03:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f45100a2c40 0x7f45100a5100 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4528105f40 0x7f45281a3340 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4528101450 0x7f452819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 --2- 172.21.15.73:0/2663080060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4528100b30 0x7f452819ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 -- 172.21.15.73:0/2663080060 >> 172.21.15.73:0/2663080060 conn(0x7f45280fc7a0 msgr2=0x7f45281038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 -- 172.21.15.73:0/2663080060 shutdown_connections 2024-09-05T13:03:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:02.021+0000 7f452ec34640 1 -- 172.21.15.73:0/2663080060 wait complete. 2024-09-05T13:03:03.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:03 smithi073 ceph-mon[30883]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 2.95k op/s 2024-09-05T13:03:03.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:03 smithi162 ceph-mon[34220]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 2.95k op/s 2024-09-05T13:03:03.620 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:03 smithi169 ceph-mon[34823]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 2.95k op/s 2024-09-05T13:03:03.801 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T13:03:03.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T13:03:04.247 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:03:04.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.844+0000 7f10d359e640 1 -- 172.21.15.73:0/1903975172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10d411b140 msgr2=0x7f10d411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:04.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.844+0000 7f10d359e640 1 --2- 172.21.15.73:0/1903975172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10d411b140 0x7f10d411d530 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10c801a910 tx=0x7f10c803b430 comp rx=0 tx=0).stop 2024-09-05T13:03:04.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.844+0000 7f10d359e640 1 -- 172.21.15.73:0/1903975172 shutdown_connections 2024-09-05T13:03:04.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.844+0000 7f10d359e640 1 --2- 172.21.15.73:0/1903975172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10d411b140 0x7f10d411d530 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.844+0000 7f10d359e640 1 --2- 172.21.15.73:0/1903975172 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d406ea30 0x7f10d406ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.844+0000 7f10d359e640 1 --2- 172.21.15.73:0/1903975172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d4110190 0x7f10d406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.844+0000 7f10d359e640 1 -- 172.21.15.73:0/1903975172 >> 172.21.15.73:0/1903975172 conn(0x7f10d4073180 msgr2=0x7f10d4073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:04.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.847+0000 7f10d359e640 1 -- 172.21.15.73:0/1903975172 shutdown_connections 2024-09-05T13:03:04.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.849+0000 7f10d359e640 1 -- 172.21.15.73:0/1903975172 wait complete. 2024-09-05T13:03:04.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.850+0000 7f10d359e640 1 Processor -- start 2024-09-05T13:03:04.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.850+0000 7f10d359e640 1 -- start start 2024-09-05T13:03:04.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.850+0000 7f10d359e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d406ea30 0x7f10d411a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.850+0000 7f10d359e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10d4110190 0x7f10d4116990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.850+0000 7f10d359e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d411b140 0x7f10d4116ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.850+0000 7f10d359e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f10d41132f0 con 0x7f10d406ea30 2024-09-05T13:03:04.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.850+0000 7f10d359e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10d4113170 con 0x7f10d4110190 2024-09-05T13:03:04.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.850+0000 7f10d359e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10d4113470 con 0x7f10d411b140 2024-09-05T13:03:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.851+0000 7f10d259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d406ea30 0x7f10d411a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.851+0000 7f10d259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d406ea30 0x7f10d411a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37514/0 (socket says 172.21.15.73:37514) 2024-09-05T13:03:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.851+0000 7f10d259c640 1 -- 172.21.15.73:0/1528856521 learned_addr learned my addr 172.21.15.73:0/1528856521 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.851+0000 7f10d259c640 1 -- 172.21.15.73:0/1528856521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d411b140 msgr2=0x7f10d4116ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.851+0000 7f10d259c640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d411b140 0x7f10d4116ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.851+0000 7f10d259c640 1 -- 172.21.15.73:0/1528856521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10d4110190 msgr2=0x7f10d4116990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T13:03:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.851+0000 7f10d259c640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10d4110190 0x7f10d4116990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.851+0000 7f10d259c640 1 -- 172.21.15.73:0/1528856521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d4117600 con 0x7f10d406ea30 2024-09-05T13:03:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.851+0000 7f10d259c640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d406ea30 0x7f10d411a8a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00ba50 tx=0x7f10cc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:04.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.854+0000 7f10c37fe640 1 -- 172.21.15.73:0/1528856521 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc019070 con 0x7f10d406ea30 2024-09-05T13:03:04.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.854+0000 7f10d359e640 1 -- 172.21.15.73:0/1528856521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d41aaf60 con 0x7f10d406ea30 2024-09-05T13:03:04.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.854+0000 7f10d359e640 1 -- 172.21.15.73:0/1528856521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d41ab360 con 0x7f10d406ea30 2024-09-05T13:03:04.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.854+0000 7f10c37fe640 1 -- 172.21.15.73:0/1528856521 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10cc00cbe0 con 0x7f10d406ea30 2024-09-05T13:03:04.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.854+0000 7f10c37fe640 1 -- 172.21.15.73:0/1528856521 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0076f0 con 0x7f10d406ea30 2024-09-05T13:03:04.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.864+0000 7f10c37fe640 1 -- 172.21.15.73:0/1528856521 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f10cc01c070 con 0x7f10d406ea30 2024-09-05T13:03:04.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.865+0000 7f10db38b740 1 Processor -- start 2024-09-05T13:03:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.866+0000 7f10db38b740 1 -- start start 2024-09-05T13:03:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.866+0000 7f10db38b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c462150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.866+0000 7f10db38b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c462690 0x55ed1c46ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.866+0000 7f10db38b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c46cf50 0x55ed1c46f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.866+0000 7f10db38b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c3c7280 con 0x55ed1c461d70 2024-09-05T13:03:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.866+0000 7f10db38b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c36eb10 con 0x55ed1c46cf50 2024-09-05T13:03:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.866+0000 7f10db38b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c3c3240 con 0x55ed1c462690 2024-09-05T13:03:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10d259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c462690 0x55ed1c46ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10d259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c462690 0x55ed1c46ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:59666/0 (socket says 172.21.15.73:59666) 2024-09-05T13:03:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10d259c640 1 -- 172.21.15.73:0/156721908 learned_addr learned my addr 172.21.15.73:0/156721908 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10c37fe640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10bc0a2d90 0x7f10bc0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10d2d9d640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10bc0a2d90 0x7f10bc0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/156721908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c46cf50 0x55ed1c46f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10d259c640 1 -- 172.21.15.73:0/156721908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c46cf50 msgr2=0x55ed1c46f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:04.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10d259c640 1 --2- 172.21.15.73:0/156721908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c46cf50 0x55ed1c46f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10d259c640 1 -- 172.21.15.73:0/156721908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 msgr2=0x55ed1c462150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:04.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10d259c640 1 --2- 172.21.15.73:0/156721908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c462150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.867+0000 7f10d259c640 1 -- 172.21.15.73:0/156721908 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed1c37b1f0 con 0x55ed1c462690 2024-09-05T13:03:04.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.868+0000 7f10d259c640 1 --2- 172.21.15.73:0/156721908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c462690 0x55ed1c46ca10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f10cc014f90 tx=0x7f10cc004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a5a92cd775001c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:04.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.868+0000 7f10c37fe640 1 -- 172.21.15.73:0/1528856521 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f10cc0cf5f0 con 0x7f10d406ea30 2024-09-05T13:03:04.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.868+0000 7f10c0ff9640 1 -- 172.21.15.73:0/156721908 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc09bbf0 con 0x55ed1c462690 2024-09-05T13:03:04.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.868+0000 7f10c0ff9640 1 -- 172.21.15.73:0/156721908 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10cc070750 con 0x55ed1c462690 2024-09-05T13:03:04.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.868+0000 7f10c0ff9640 1 -- 172.21.15.73:0/156721908 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc070940 con 0x55ed1c462690 2024-09-05T13:03:04.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.871+0000 7f10db38b740 1 -- 172.21.15.73:0/156721908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c462690 msgr2=0x55ed1c46ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:04.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.871+0000 7f10db38b740 1 --2- 172.21.15.73:0/156721908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c462690 0x55ed1c46ca10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f10cc014f90 tx=0x7f10cc004b50 comp rx=0 tx=0).stop 2024-09-05T13:03:04.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.871+0000 7f10db38b740 1 -- 172.21.15.73:0/156721908 shutdown_connections 2024-09-05T13:03:04.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.871+0000 7f10db38b740 1 --2- 172.21.15.73:0/156721908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c46cf50 0x55ed1c46f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.871+0000 7f10db38b740 1 --2- 172.21.15.73:0/156721908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c462690 0x55ed1c46ca10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.871+0000 7f10db38b740 1 --2- 172.21.15.73:0/156721908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c462150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.871+0000 7f10db38b740 1 -- 172.21.15.73:0/156721908 >> 172.21.15.73:0/156721908 conn(0x55ed1c45e300 msgr2=0x55ed1c45e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.873+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/156721908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c46cf50 0x55ed1c46f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:03:04.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.876+0000 7f10db38b740 1 -- 172.21.15.73:0/156721908 shutdown_connections 2024-09-05T13:03:04.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.877+0000 7f10db38b740 1 -- 172.21.15.73:0/156721908 wait complete. 2024-09-05T13:03:04.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.877+0000 7f10db38b740 1 -- start start 2024-09-05T13:03:04.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.877+0000 7f10db38b740 1 Processor -- start 2024-09-05T13:03:04.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10d2d9d640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10bc0a2d90 0x7f10bc0a5250 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f10c801a6d0 tx=0x7f10c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:04.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10db38b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c461d70 0x55ed1c469e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10db38b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c46a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10db38b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c46a8b0 0x55ed1c478f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10db38b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c46fa60 con 0x55ed1c46a8b0 2024-09-05T13:03:04.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10db38b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c381f10 con 0x55ed1c462690 2024-09-05T13:03:04.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10db38b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c46fbe0 con 0x55ed1c461d70 2024-09-05T13:03:04.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10d2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c46a8b0 0x55ed1c478f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10db38b740 10 client.0 _ll_register_callbacks cb 0x55ed1c34aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:04.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10d2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c46a8b0 0x55ed1c478f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37530/0 (socket says 172.21.15.73:37530) 2024-09-05T13:03:04.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10d2d9d640 1 -- 172.21.15.73:0/2123673334 learned_addr learned my addr 172.21.15.73:0/2123673334 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:04.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10d259c640 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c461d70 0x55ed1c469e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.878+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c46a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.879+0000 7f10d259c640 1 -- 172.21.15.73:0/2123673334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 msgr2=0x55ed1c46a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:04.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.879+0000 7f10d259c640 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c46a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.879+0000 7f10d259c640 1 -- 172.21.15.73:0/2123673334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c46a8b0 msgr2=0x55ed1c478f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:04.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.879+0000 7f10d259c640 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c46a8b0 0x55ed1c478f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.879+0000 7f10d259c640 1 -- 172.21.15.73:0/2123673334 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed1c1386a0 con 0x55ed1c461d70 2024-09-05T13:03:04.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.879+0000 7f10d259c640 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c461d70 0x55ed1c469e30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10cc014f90 tx=0x7f10cc00ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c51119e0b78a2a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:04.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.879+0000 7f10b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:03:04.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.883+0000 7f10b9ffb640 1 -- 172.21.15.73:0/2123673334 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc09b780 con 0x55ed1c461d70 2024-09-05T13:03:04.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.883+0000 7f10b9ffb640 1 -- 172.21.15.73:0/2123673334 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f10cc09a120 con 0x55ed1c461d70 2024-09-05T13:03:04.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.883+0000 7f10db38b740 1 -- 172.21.15.73:0/2123673334 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ed1c3d47f0 con 0x55ed1c461d70 2024-09-05T13:03:04.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.885+0000 7f10b9ffb640 1 -- 172.21.15.73:0/2123673334 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f10cc09b960 con 0x55ed1c461d70 2024-09-05T13:03:04.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.885+0000 7f10db38b740 10 client.25690 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:04.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.885+0000 7f10db38b740 1 -- 172.21.15.73:0/2123673334 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55ed1c46fa60 con 0x55ed1c461d70 2024-09-05T13:03:04.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.889+0000 7f10b9ffb640 1 -- 172.21.15.73:0/2123673334 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ed1c3d47f0 con 0x55ed1c461d70 2024-09-05T13:03:04.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.889+0000 7f10b9ffb640 1 -- 172.21.15.73:0/2123673334 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f10cc07a070 con 0x55ed1c461d70 2024-09-05T13:03:04.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.889+0000 7f10db38b740 10 client.25690 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:04.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.889+0000 7f10db38b740 10 client.25690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:04.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.889+0000 7f10db38b740 20 client.25690 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:04.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.889+0000 7f10db38b740 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ed1c47cd00 0x55ed1c47f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.890+0000 7f10db38b740 4 client.25690 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:04.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.890+0000 7f10db38b740 1 -- 172.21.15.73:0/2123673334 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed1c3ced00 con 0x55ed1c47cd00 2024-09-05T13:03:04.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.890+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ed1c47cd00 0x55ed1c47f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.892+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ed1c47cd00 0x55ed1c47f0f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e959924a49c3e8e2 server_cookie=7d7d9508899236ec in_seq=0 out_seq=0 2024-09-05T13:03:04.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.892+0000 7f10b9ffb640 10 client.25690 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:04.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.895+0000 7f10b9ffb640 1 -- 172.21.15.73:0/2123673334 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed1c3ced00 con 0x55ed1c47cd00 2024-09-05T13:03:04.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.895+0000 7f10b9ffb640 10 client.25690 handle_command_reply: tid=0 2024-09-05T13:03:04.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.895+0000 7f10db38b740 1 client.25690 shutdown 2024-09-05T13:03:04.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 1 -- 172.21.15.73:0/2123673334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c461d70 msgr2=0x55ed1c469e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:04.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c461d70 0x55ed1c469e30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10cc014f90 tx=0x7f10cc00ce00 comp rx=0 tx=0).stop 2024-09-05T13:03:04.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 1 -- 172.21.15.73:0/2123673334 shutdown_connections 2024-09-05T13:03:04.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ed1c47cd00 0x55ed1c47f0f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c46a8b0 0x55ed1c478f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10b9ffb640 0 client.25690 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:04.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c46a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 1 --2- 172.21.15.73:0/2123673334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c461d70 0x55ed1c469e30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 1 -- 172.21.15.73:0/2123673334 >> 172.21.15.73:0/2123673334 conn(0x55ed1c45e300 msgr2=0x55ed1c464060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:04.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 1 -- 172.21.15.73:0/2123673334 shutdown_connections 2024-09-05T13:03:04.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 1 -- 172.21.15.73:0/2123673334 wait complete. 2024-09-05T13:03:04.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.896+0000 7f10db38b740 20 client.25690 trim_cache size 0 max 16384 2024-09-05T13:03:04.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.926+0000 7f10db38b740 1 Processor -- start 2024-09-05T13:03:04.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.926+0000 7f10db38b740 1 -- start start 2024-09-05T13:03:04.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.927+0000 7f10db38b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 0x55ed1c46bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.927+0000 7f10db38b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c478d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.927+0000 7f10db38b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c4792b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.927+0000 7f10db38b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f10b4010d10 con 0x55ed1c461d70 2024-09-05T13:03:04.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.927+0000 7f10db38b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10b400e580 con 0x55ed1c462690 2024-09-05T13:03:04.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.927+0000 7f10db38b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10b400c3d0 con 0x55ed1c45e300 2024-09-05T13:03:04.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.929+0000 7f10d2d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c4792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.929+0000 7f10d2d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c4792b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:48104/0 (socket says 172.21.15.73:48104) 2024-09-05T13:03:04.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.929+0000 7f10d2d9d640 1 -- 172.21.15.73:0/1041171282 learned_addr learned my addr 172.21.15.73:0/1041171282 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:04.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.929+0000 7f10d259c640 1 --2- 172.21.15.73:0/1041171282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 0x55ed1c46bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.929+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/1041171282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c478d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.930+0000 7f10d2d9d640 1 -- 172.21.15.73:0/1041171282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 msgr2=0x55ed1c46bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:04.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.930+0000 7f10d2d9d640 1 --2- 172.21.15.73:0/1041171282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 0x55ed1c46bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.930+0000 7f10d2d9d640 1 -- 172.21.15.73:0/1041171282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 msgr2=0x55ed1c478d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:04.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.930+0000 7f10d2d9d640 1 --2- 172.21.15.73:0/1041171282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c478d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.930+0000 7f10d2d9d640 1 -- 172.21.15.73:0/1041171282 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed1c468de0 con 0x55ed1c462690 2024-09-05T13:03:04.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.930+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/1041171282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c478d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:03:04.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.934+0000 7f10d2d9d640 1 --2- 172.21.15.73:0/1041171282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c4792b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10c8005ab0 tx=0x7f10c804d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b8ebe1b02c558f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:04.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.935+0000 7f10bbfff640 1 -- 172.21.15.73:0/1041171282 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c805d070 con 0x55ed1c462690 2024-09-05T13:03:04.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.935+0000 7f10bbfff640 1 -- 172.21.15.73:0/1041171282 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c8051040 con 0x55ed1c462690 2024-09-05T13:03:04.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.935+0000 7f10bbfff640 1 -- 172.21.15.73:0/1041171282 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8046030 con 0x55ed1c462690 2024-09-05T13:03:04.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.936+0000 7f10db38b740 1 -- 172.21.15.73:0/1041171282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 msgr2=0x55ed1c4792b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:04.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.936+0000 7f10db38b740 1 --2- 172.21.15.73:0/1041171282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c4792b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10c8005ab0 tx=0x7f10c804d000 comp rx=0 tx=0).stop 2024-09-05T13:03:04.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.938+0000 7f10db38b740 1 -- 172.21.15.73:0/1041171282 shutdown_connections 2024-09-05T13:03:04.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.938+0000 7f10db38b740 1 --2- 172.21.15.73:0/1041171282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c4792b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.938+0000 7f10db38b740 1 --2- 172.21.15.73:0/1041171282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c478d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.938+0000 7f10db38b740 1 --2- 172.21.15.73:0/1041171282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 0x55ed1c46bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.938+0000 7f10db38b740 1 -- 172.21.15.73:0/1041171282 >> 172.21.15.73:0/1041171282 conn(0x55ed1c46a4d0 msgr2=0x55ed1c46b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:04.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.939+0000 7f10db38b740 1 -- 172.21.15.73:0/1041171282 shutdown_connections 2024-09-05T13:03:04.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.939+0000 7f10db38b740 1 -- 172.21.15.73:0/1041171282 wait complete. 2024-09-05T13:03:04.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.940+0000 7f10db38b740 1 -- start start 2024-09-05T13:03:04.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.940+0000 7f10db38b740 1 Processor -- start 2024-09-05T13:03:04.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.940+0000 7f10db38b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 0x55ed1c471810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.940+0000 7f10db38b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c471d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.940+0000 7f10db38b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c4df8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.940+0000 7f10db38b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f10b400ca40 con 0x55ed1c461d70 2024-09-05T13:03:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.940+0000 7f10db38b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10b400deb0 con 0x55ed1c462690 2024-09-05T13:03:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.940+0000 7f10db38b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10b400d110 con 0x55ed1c45e300 2024-09-05T13:03:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.940+0000 7f10db38b740 10 client.0 _ll_register_callbacks cb 0x7f10cc098150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.941+0000 7f10d259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 0x55ed1c471810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.941+0000 7f10d259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 0x55ed1c471810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:59700/0 (socket says 172.21.15.73:59700) 2024-09-05T13:03:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.941+0000 7f10d259c640 1 -- 172.21.15.73:0/1517387346 learned_addr learned my addr 172.21.15.73:0/1517387346 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.943+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c471d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.943+0000 7f10d1d9b640 1 -- 172.21.15.73:0/1517387346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 msgr2=0x55ed1c471810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.943+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 0x55ed1c471810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.943+0000 7f10d1d9b640 1 -- 172.21.15.73:0/1517387346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 msgr2=0x55ed1c4df8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.943+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c4df8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.944+0000 7f10d1d9b640 1 -- 172.21.15.73:0/1517387346 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed1c4e00b0 con 0x55ed1c461d70 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.944+0000 7f10d1d9b640 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c471d50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55ed1c463810 tx=0x7f10c400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78718248e6a6115 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.944+0000 7f10b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.944+0000 7f10b9ffb640 1 -- 172.21.15.73:0/1517387346 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c4004230 con 0x55ed1c461d70 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.944+0000 7f10b9ffb640 1 -- 172.21.15.73:0/1517387346 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f10c40043d0 con 0x55ed1c461d70 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.945+0000 7f10db38b740 1 -- 172.21.15.73:0/1517387346 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10c8051040 con 0x55ed1c461d70 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.945+0000 7f10b9ffb640 1 -- 172.21.15.73:0/1517387346 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f10c4004940 con 0x55ed1c461d70 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.945+0000 7f10db38b740 10 client.16137 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.946+0000 7f10db38b740 1 -- 172.21.15.73:0/1517387346 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55ed1c4e8500 con 0x55ed1c461d70 2024-09-05T13:03:04.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.946+0000 7f10b9ffb640 1 -- 172.21.15.73:0/1517387346 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c8051040 con 0x55ed1c461d70 2024-09-05T13:03:04.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.946+0000 7f10b9ffb640 1 -- 172.21.15.73:0/1517387346 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f10c400f040 con 0x55ed1c461d70 2024-09-05T13:03:04.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.946+0000 7f10db38b740 10 client.16137 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:04.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.946+0000 7f10db38b740 10 client.16137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:04.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.946+0000 7f10db38b740 20 client.16137 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:04.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.947+0000 7f10db38b740 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ed1c46a8b0 0x55ed1c4ead60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:04.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.947+0000 7f10db38b740 4 client.16137 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T13:03:04.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.947+0000 7f10db38b740 1 -- 172.21.15.73:0/1517387346 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ed1c34b110 con 0x55ed1c46a8b0 2024-09-05T13:03:04.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.948+0000 7f10d259c640 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ed1c46a8b0 0x55ed1c4ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:04.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.953+0000 7f10d259c640 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ed1c46a8b0 0x55ed1c4ead60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=871b2fdbf75bbfb9 server_cookie=c945fd15fec0c94e in_seq=0 out_seq=0 2024-09-05T13:03:04.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.953+0000 7f10b9ffb640 10 client.16137 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:04.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.955+0000 7f10b9ffb640 1 -- 172.21.15.73:0/1517387346 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ed1c34b110 con 0x55ed1c46a8b0 2024-09-05T13:03:04.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.955+0000 7f10b9ffb640 10 client.16137 handle_command_reply: tid=0 2024-09-05T13:03:04.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.955+0000 7f10db38b740 1 client.16137 shutdown 2024-09-05T13:03:04.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.958+0000 7f10db38b740 1 -- 172.21.15.73:0/1517387346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 msgr2=0x55ed1c471d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:04.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.958+0000 7f10db38b740 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c471d50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55ed1c463810 tx=0x7f10c400c7a0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.959+0000 7f10db38b740 1 -- 172.21.15.73:0/1517387346 shutdown_connections 2024-09-05T13:03:04.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.959+0000 7f10db38b740 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55ed1c46a8b0 0x55ed1c4ead60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.959+0000 7f10db38b740 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed1c462690 0x55ed1c4df8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.959+0000 7f10db38b740 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed1c461d70 0x55ed1c471d50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.959+0000 7f10db38b740 1 --2- 172.21.15.73:0/1517387346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed1c45e300 0x55ed1c471810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.959+0000 7f10db38b740 1 -- 172.21.15.73:0/1517387346 >> 172.21.15.73:0/1517387346 conn(0x55ed1c46a4d0 msgr2=0x55ed1c46beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:04.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.959+0000 7f10b9ffb640 0 client.16137 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:04.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.959+0000 7f10db38b740 1 -- 172.21.15.73:0/1517387346 shutdown_connections 2024-09-05T13:03:04.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.959+0000 7f10db38b740 1 -- 172.21.15.73:0/1517387346 wait complete. 2024-09-05T13:03:04.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.960+0000 7f10db38b740 20 client.16137 trim_cache size 0 max 16384 2024-09-05T13:03:04.963 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:03:04.963 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2024-09-05T13:03:04.963 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "782924fa-c098-4ee1-a9ee-2da83cbf87b7", 2024-09-05T13:03:04.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2024-09-05T13:03:04.963 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:03:04.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 -- 172.21.15.73:0/1528856521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10bc0a2d90 msgr2=0x7f10bc0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:04.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10bc0a2d90 0x7f10bc0a5250 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f10c801a6d0 tx=0x7f10c8005a20 comp rx=0 tx=0).stop 2024-09-05T13:03:04.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 -- 172.21.15.73:0/1528856521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d406ea30 msgr2=0x7f10d411a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:04.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d406ea30 0x7f10d411a8a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00ba50 tx=0x7f10cc00bf10 comp rx=0 tx=0).stop 2024-09-05T13:03:04.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 -- 172.21.15.73:0/1528856521 shutdown_connections 2024-09-05T13:03:04.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f10bc0a2d90 0x7f10bc0a5250 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d411b140 0x7f10d4116ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10d4110190 0x7f10d4116990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 --2- 172.21.15.73:0/1528856521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d406ea30 0x7f10d411a8a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:04.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 -- 172.21.15.73:0/1528856521 >> 172.21.15.73:0/1528856521 conn(0x7f10d4073180 msgr2=0x7f10d411b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:04.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 -- 172.21.15.73:0/1528856521 shutdown_connections 2024-09-05T13:03:04.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:04.963+0000 7f10d359e640 1 -- 172.21.15.73:0/1528856521 wait complete. 2024-09-05T13:03:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:05 smithi073 ceph-mon[30883]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.83k op/s 2024-09-05T13:03:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:05 smithi073 ceph-mon[30883]: scrub queued for path: / 2024-09-05T13:03:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:05 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:05.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:05 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:03:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 -- 172.21.15.73:0/1311654005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0780103150 msgr2=0x7f0780103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 --2- 172.21.15.73:0/1311654005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0780103150 0x7f0780103550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0770009900 tx=0x7f077002a410 comp rx=0 tx=0).stop 2024-09-05T13:03:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 -- 172.21.15.73:0/1311654005 shutdown_connections 2024-09-05T13:03:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 --2- 172.21.15.73:0/1311654005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0780100580 0x7f078010a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 --2- 172.21.15.73:0/1311654005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07800ffbc0 0x7f0780100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 --2- 172.21.15.73:0/1311654005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0780103150 0x7f0780103550 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 -- 172.21.15.73:0/1311654005 >> 172.21.15.73:0/1311654005 conn(0x7f07800fb970 msgr2=0x7f07800fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 -- 172.21.15.73:0/1311654005 shutdown_connections 2024-09-05T13:03:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 -- 172.21.15.73:0/1311654005 wait complete. 2024-09-05T13:03:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 Processor -- start 2024-09-05T13:03:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.533+0000 7f07868b7640 1 -- start start 2024-09-05T13:03:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f07868b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07800ffbc0 0x7f0780102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f07868b7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0780100580 0x7f0780100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f07868b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0780103150 0x7f07801013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f07868b7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f078010d7d0 con 0x7f0780100580 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f07868b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f078010d650 con 0x7f0780103150 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f07868b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f078010d950 con 0x7f07800ffbc0 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f077f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0780100580 0x7f0780100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f077f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0780100580 0x7f0780100e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37568/0 (socket says 172.21.15.73:37568) 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f077f7fe640 1 -- 172.21.15.73:0/2051033575 learned_addr learned my addr 172.21.15.73:0/2051033575 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f077ffff640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07800ffbc0 0x7f0780102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f0784e54640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0780103150 0x7f07801013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f077f7fe640 1 -- 172.21.15.73:0/2051033575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07800ffbc0 msgr2=0x7f0780102850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f077f7fe640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07800ffbc0 0x7f0780102850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f077f7fe640 1 -- 172.21.15.73:0/2051033575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0780103150 msgr2=0x7f07801013d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f077f7fe640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0780103150 0x7f07801013d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f077f7fe640 1 -- 172.21.15.73:0/2051033575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0780101c60 con 0x7f0780100580 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.534+0000 7f077f7fe640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0780100580 0x7f0780100e90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f076800ea60 tx=0x7f076800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.535+0000 7f077d7fa640 1 -- 172.21.15.73:0/2051033575 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076800cde0 con 0x7f0780100580 2024-09-05T13:03:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.535+0000 7f07868b7640 1 -- 172.21.15.73:0/2051033575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07801a1ee0 con 0x7f0780100580 2024-09-05T13:03:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.535+0000 7f077d7fa640 1 -- 172.21.15.73:0/2051033575 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07680035f0 con 0x7f0780100580 2024-09-05T13:03:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.535+0000 7f07868b7640 1 -- 172.21.15.73:0/2051033575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07801a2350 con 0x7f0780100580 2024-09-05T13:03:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.535+0000 7f077d7fa640 1 -- 172.21.15.73:0/2051033575 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0768005220 con 0x7f0780100580 2024-09-05T13:03:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.537+0000 7f077d7fa640 1 -- 172.21.15.73:0/2051033575 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f07680037a0 con 0x7f0780100580 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.537+0000 7f078964a740 1 Processor -- start 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.537+0000 7f078964a740 1 -- start start 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.537+0000 7f078964a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f29a0 0x55a2c11f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.537+0000 7f078964a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c11f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.537+0000 7f078964a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f8370 0x55a2c11fa830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.537+0000 7f078964a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a2c11562f0 con 0x55a2c11f32e0 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.537+0000 7f078964a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a2c10fe270 con 0x55a2c11f29a0 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f078964a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a2c11522b0 con 0x55a2c11f8370 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077d7fa640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f076c0a2c30 0x7f076c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c11f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c11f7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37572/0 (socket says 172.21.15.73:37572) 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077ffff640 1 -- 172.21.15.73:0/4013269012 learned_addr learned my addr 172.21.15.73:0/4013269012 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f0784e54640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f076c0a2c30 0x7f076c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077d7fa640 1 -- 172.21.15.73:0/2051033575 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f07680cf240 con 0x7f0780100580 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077f7fe640 1 --2- 172.21.15.73:0/4013269012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f8370 0x55a2c11fa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f0784e54640 1 --2- 172.21.15.73:0/4013269012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f29a0 0x55a2c11f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077ffff640 1 -- 172.21.15.73:0/4013269012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f8370 msgr2=0x55a2c11fa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077ffff640 1 --2- 172.21.15.73:0/4013269012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f8370 0x55a2c11fa830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077ffff640 1 -- 172.21.15.73:0/4013269012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f29a0 msgr2=0x55a2c11f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077ffff640 1 --2- 172.21.15.73:0/4013269012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f29a0 0x55a2c11f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077ffff640 1 -- 172.21.15.73:0/4013269012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2c10fd340 con 0x55a2c11f32e0 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f0784e54640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f076c0a2c30 0x7f076c0a50f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0778005fd0 tx=0x7f0778009be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f077ffff640 1 --2- 172.21.15.73:0/4013269012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c11f7da0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0770009900 tx=0x7f0770005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b622a6b06175e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f07767fc640 1 -- 172.21.15.73:0/4013269012 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770035030 con 0x55a2c11f32e0 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f07767fc640 1 -- 172.21.15.73:0/4013269012 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0770040070 con 0x55a2c11f32e0 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.538+0000 7f07767fc640 1 -- 172.21.15.73:0/4013269012 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770003900 con 0x55a2c11f32e0 2024-09-05T13:03:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.539+0000 7f078964a740 1 -- 172.21.15.73:0/4013269012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 msgr2=0x55a2c11f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.539+0000 7f078964a740 1 --2- 172.21.15.73:0/4013269012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c11f7da0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0770009900 tx=0x7f0770005dd0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.539+0000 7f078964a740 1 -- 172.21.15.73:0/4013269012 shutdown_connections 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.539+0000 7f078964a740 1 --2- 172.21.15.73:0/4013269012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f8370 0x55a2c11fa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.539+0000 7f078964a740 1 --2- 172.21.15.73:0/4013269012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c11f7da0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.539+0000 7f078964a740 1 --2- 172.21.15.73:0/4013269012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f29a0 0x55a2c11f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.539+0000 7f078964a740 1 -- 172.21.15.73:0/4013269012 >> 172.21.15.73:0/4013269012 conn(0x55a2c11ee010 msgr2=0x55a2c11ee410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.539+0000 7f078964a740 1 -- 172.21.15.73:0/4013269012 shutdown_connections 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.539+0000 7f078964a740 1 -- 172.21.15.73:0/4013269012 wait complete. 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.539+0000 7f078964a740 1 -- start start 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f078964a740 1 Processor -- start 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f078964a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c11fcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f078964a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 0x55a2c11fd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f078964a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c12040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f078964a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a2c11fb2e0 con 0x55a2c11f8370 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f078964a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a2c10df290 con 0x55a2c11f32e0 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f078964a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a2c11fb460 con 0x55a2c11f29a0 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f078964a740 10 client.0 _ll_register_callbacks cb 0x55a2c1110140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f0784e54640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c12040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f0784e54640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c12040b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37574/0 (socket says 172.21.15.73:37574) 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f0784e54640 1 -- 172.21.15.73:0/3341364579 learned_addr learned my addr 172.21.15.73:0/3341364579 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f077ffff640 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c11fcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f077f7fe640 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 0x55a2c11fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f0784e54640 1 -- 172.21.15.73:0/3341364579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 msgr2=0x55a2c11fcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f0784e54640 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c11fcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f0784e54640 1 -- 172.21.15.73:0/3341364579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 msgr2=0x55a2c11fd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f0784e54640 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 0x55a2c11fd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f0784e54640 1 -- 172.21.15.73:0/3341364579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2c0e69210 con 0x55a2c11f8370 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f0784e54640 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c12040b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0778003d90 tx=0x7f0778004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70852438a841121 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.540+0000 7f075f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f075f7fe640 1 -- 172.21.15.73:0/3341364579 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778004250 con 0x55a2c11f8370 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f075f7fe640 1 -- 172.21.15.73:0/3341364579 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f07780043f0 con 0x55a2c11f8370 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f078964a740 1 -- 172.21.15.73:0/3341364579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0770040070 con 0x55a2c11f8370 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f075f7fe640 1 -- 172.21.15.73:0/3341364579 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f07780045f0 con 0x55a2c11f8370 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f078964a740 10 client.16149 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f078964a740 1 -- 172.21.15.73:0/3341364579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a2c0f35620 con 0x55a2c11f8370 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f075f7fe640 1 -- 172.21.15.73:0/3341364579 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0770040070 con 0x55a2c11f8370 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f075f7fe640 1 -- 172.21.15.73:0/3341364579 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f07780204f0 con 0x55a2c11f8370 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f078964a740 10 client.16149 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f078964a740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f078964a740 20 client.16149 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f078964a740 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a2c1208820 0x55a2c120ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f078964a740 4 client.16149 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f078964a740 1 -- 172.21.15.73:0/3341364579 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2c1163a20 con 0x55a2c1208820 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.541+0000 7f077ffff640 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a2c1208820 0x55a2c120ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.542+0000 7f077ffff640 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a2c1208820 0x55a2c120ac90 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=315bd925c4abecea server_cookie=c2718df8507c49a0 in_seq=0 out_seq=0 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.542+0000 7f075f7fe640 10 client.16149 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.542+0000 7f075f7fe640 1 -- 172.21.15.73:0/3341364579 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2c1163a20 con 0x55a2c1208820 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.542+0000 7f075f7fe640 10 client.16149 handle_command_reply: tid=0 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.542+0000 7f078964a740 1 client.16149 shutdown 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 1 -- 172.21.15.73:0/3341364579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 msgr2=0x55a2c12040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c12040b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0778003d90 tx=0x7f0778004ab0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 1 -- 172.21.15.73:0/3341364579 shutdown_connections 2024-09-05T13:03:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a2c1208820 0x55a2c120ac90 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c12040b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 0x55a2c11fd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 1 --2- 172.21.15.73:0/3341364579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c11fcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f075f7fe640 0 client.16149 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 1 -- 172.21.15.73:0/3341364579 >> 172.21.15.73:0/3341364579 conn(0x55a2c11ee010 msgr2=0x55a2c11ef820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 1 -- 172.21.15.73:0/3341364579 shutdown_connections 2024-09-05T13:03:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 1 -- 172.21.15.73:0/3341364579 wait complete. 2024-09-05T13:03:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.543+0000 7f078964a740 20 client.16149 trim_cache size 0 max 16384 2024-09-05T13:03:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f078964a740 1 Processor -- start 2024-09-05T13:03:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f078964a740 1 -- start start 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f078964a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c11fcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f078964a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 0x55a2c1204070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f078964a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c11fd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f078964a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07801adaa0 con 0x55a2c11f8370 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f078964a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07801ab310 con 0x55a2c11f32e0 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f078964a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f07801a9160 con 0x55a2c11f29a0 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f0784e54640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c11fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f0784e54640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c11fd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37588/0 (socket says 172.21.15.73:37588) 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f0784e54640 1 -- 172.21.15.73:0/4240653165 learned_addr learned my addr 172.21.15.73:0/4240653165 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f077ffff640 1 --2- 172.21.15.73:0/4240653165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c11fcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f077f7fe640 1 --2- 172.21.15.73:0/4240653165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 0x55a2c1204070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f0784e54640 1 -- 172.21.15.73:0/4240653165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 msgr2=0x55a2c11fcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f0784e54640 1 --2- 172.21.15.73:0/4240653165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c11fcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f0784e54640 1 -- 172.21.15.73:0/4240653165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 msgr2=0x55a2c1204070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f0784e54640 1 --2- 172.21.15.73:0/4240653165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 0x55a2c1204070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f0784e54640 1 -- 172.21.15.73:0/4240653165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2c11ede30 con 0x55a2c11f8370 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f077f7fe640 1 --2- 172.21.15.73:0/4240653165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 0x55a2c1204070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.557+0000 7f0784e54640 1 --2- 172.21.15.73:0/4240653165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c11fd070 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0778009420 tx=0x7f0778009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dea44a0e701e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f0775ffb640 1 -- 172.21.15.73:0/4240653165 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778003970 con 0x55a2c11f8370 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f0775ffb640 1 -- 172.21.15.73:0/4240653165 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0778004790 con 0x55a2c11f8370 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f0775ffb640 1 -- 172.21.15.73:0/4240653165 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778020630 con 0x55a2c11f8370 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f078964a740 1 -- 172.21.15.73:0/4240653165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 msgr2=0x55a2c11fd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f078964a740 1 --2- 172.21.15.73:0/4240653165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c11fd070 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0778009420 tx=0x7f0778009c50 comp rx=0 tx=0).stop 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f078964a740 1 -- 172.21.15.73:0/4240653165 shutdown_connections 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f078964a740 1 --2- 172.21.15.73:0/4240653165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f8370 0x55a2c11fd070 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f078964a740 1 --2- 172.21.15.73:0/4240653165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f32e0 0x55a2c1204070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f078964a740 1 --2- 172.21.15.73:0/4240653165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c11fcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f078964a740 1 -- 172.21.15.73:0/4240653165 >> 172.21.15.73:0/4240653165 conn(0x55a2c11ee010 msgr2=0x55a2c11f4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f078964a740 1 -- 172.21.15.73:0/4240653165 shutdown_connections 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f078964a740 1 -- 172.21.15.73:0/4240653165 wait complete. 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.558+0000 7f078964a740 1 -- start start 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f078964a740 1 Processor -- start 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f078964a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c1201030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f078964a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c1201570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f078964a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f8370 0x55a2c1271560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f078964a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07801a97d0 con 0x55a2c11f32e0 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f078964a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07801aac40 con 0x55a2c11f8370 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f078964a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f07801a9ea0 con 0x55a2c11f29a0 2024-09-05T13:03:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f078964a740 10 client.0 _ll_register_callbacks cb 0x7f0778009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f077f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c1201570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f077f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c1201570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37594/0 (socket says 172.21.15.73:37594) 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f077f7fe640 1 -- 172.21.15.73:0/3131014933 learned_addr learned my addr 172.21.15.73:0/3131014933 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f077ffff640 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c1201030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f0784e54640 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f8370 0x55a2c1271560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f077f7fe640 1 -- 172.21.15.73:0/3131014933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 msgr2=0x55a2c1201030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f077f7fe640 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c1201030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f077f7fe640 1 -- 172.21.15.73:0/3131014933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f8370 msgr2=0x55a2c1271560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f077f7fe640 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f8370 0x55a2c1271560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f077f7fe640 1 -- 172.21.15.73:0/3131014933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2c1271ad0 con 0x55a2c11f32e0 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f0784e54640 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f8370 0x55a2c1271560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f077f7fe640 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c1201570 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f076800d010 tx=0x7f076809c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b46684929b98871 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.559+0000 7f075f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f075f7fe640 1 -- 172.21.15.73:0/3131014933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07680b8070 con 0x55a2c11f32e0 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f075f7fe640 1 -- 172.21.15.73:0/3131014933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0768003b30 con 0x55a2c11f32e0 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f078964a740 1 -- 172.21.15.73:0/3131014933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0778004790 con 0x55a2c11f32e0 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f075f7fe640 1 -- 172.21.15.73:0/3131014933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f0768081070 con 0x55a2c11f32e0 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f078964a740 10 client.16155 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f078964a740 1 -- 172.21.15.73:0/3131014933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a2c1272e50 con 0x55a2c11f32e0 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f075f7fe640 1 -- 172.21.15.73:0/3131014933 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0778004790 con 0x55a2c11f32e0 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f075f7fe640 1 -- 172.21.15.73:0/3131014933 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f07680053c0 con 0x55a2c11f32e0 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f078964a740 10 client.16155 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f078964a740 10 client.16155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f078964a740 20 client.16155 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f078964a740 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a2c12737e0 0x55a2c1275c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f078964a740 4 client.16155 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:03:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.560+0000 7f078964a740 1 -- 172.21.15.73:0/3131014933 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a2c115dd70 con 0x55a2c12737e0 2024-09-05T13:03:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.561+0000 7f077ffff640 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a2c12737e0 0x55a2c1275c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.561+0000 7f077ffff640 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a2c12737e0 0x55a2c1275c00 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25ae730a294c08d7 server_cookie=906e86da4ef72a5b in_seq=0 out_seq=0 2024-09-05T13:03:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.561+0000 7f075f7fe640 10 client.16155 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.600+0000 7f075f7fe640 1 -- 172.21.15.73:0/3131014933 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a2c115dd70 con 0x55a2c12737e0 2024-09-05T13:03:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.600+0000 7f075f7fe640 10 client.16155 handle_command_reply: tid=0 2024-09-05T13:03:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.602+0000 7f078964a740 1 client.16155 shutdown 2024-09-05T13:03:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.603+0000 7f078964a740 1 -- 172.21.15.73:0/3131014933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 msgr2=0x55a2c1201570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.603+0000 7f078964a740 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c1201570 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f076800d010 tx=0x7f076809c1d0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.603+0000 7f078964a740 1 -- 172.21.15.73:0/3131014933 shutdown_connections 2024-09-05T13:03:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.603+0000 7f078964a740 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a2c12737e0 0x55a2c1275c00 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.603+0000 7f078964a740 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a2c11f8370 0x55a2c1271560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.603+0000 7f078964a740 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a2c11f32e0 0x55a2c1201570 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.603+0000 7f078964a740 1 --2- 172.21.15.73:0/3131014933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2c11f29a0 0x55a2c1201030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.603+0000 7f078964a740 1 -- 172.21.15.73:0/3131014933 >> 172.21.15.73:0/3131014933 conn(0x55a2c11ee010 msgr2=0x55a2c11f4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.604+0000 7f075f7fe640 0 client.16155 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.604+0000 7f078964a740 1 -- 172.21.15.73:0/3131014933 shutdown_connections 2024-09-05T13:03:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.607+0000 7f078964a740 1 -- 172.21.15.73:0/3131014933 wait complete. 2024-09-05T13:03:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.609+0000 7f078964a740 20 client.16155 trim_cache size 0 max 16384 2024-09-05T13:03:05.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:05 smithi162 ceph-mon[34220]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.83k op/s 2024-09-05T13:03:05.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:05 smithi162 ceph-mon[34220]: scrub queued for path: / 2024-09-05T13:03:05.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:05 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:05.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:05 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:03:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:03:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:03:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:03:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:03:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.610+0000 7f07868b7640 1 -- 172.21.15.73:0/2051033575 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f076c0a2c30 msgr2=0x7f076c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.610+0000 7f07868b7640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f076c0a2c30 0x7f076c0a50f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0778005fd0 tx=0x7f0778009be0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.610+0000 7f07868b7640 1 -- 172.21.15.73:0/2051033575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0780100580 msgr2=0x7f0780100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.610+0000 7f07868b7640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0780100580 0x7f0780100e90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f076800ea60 tx=0x7f076800ef20 comp rx=0 tx=0).stop 2024-09-05T13:03:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.613+0000 7f07868b7640 1 -- 172.21.15.73:0/2051033575 shutdown_connections 2024-09-05T13:03:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.613+0000 7f07868b7640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f076c0a2c30 0x7f076c0a50f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.613+0000 7f07868b7640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0780103150 0x7f07801013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.613+0000 7f07868b7640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0780100580 0x7f0780100e90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.613+0000 7f07868b7640 1 --2- 172.21.15.73:0/2051033575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07800ffbc0 0x7f0780102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.613+0000 7f07868b7640 1 -- 172.21.15.73:0/2051033575 >> 172.21.15.73:0/2051033575 conn(0x7f07800fb970 msgr2=0x7f0780106200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.614+0000 7f07868b7640 1 -- 172.21.15.73:0/2051033575 shutdown_connections 2024-09-05T13:03:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:05.614+0000 7f07868b7640 1 -- 172.21.15.73:0/2051033575 wait complete. 2024-09-05T13:03:05.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:05 smithi169 ceph-mon[34823]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.83k op/s 2024-09-05T13:03:05.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:05 smithi169 ceph-mon[34823]: scrub queued for path: / 2024-09-05T13:03:05.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:05 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:05.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:05 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:03:05.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T13:03:06.145 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:03:06.443 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:06 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:03:06.443 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:06 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:03:06.443 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:06 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:06.443 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:06 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:06.443 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:06 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:06.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:06 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:03:06.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:06 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:03:06.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:06 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:06.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:06 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:06.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:06 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:06.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:06 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:03:06.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:06 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:03:06.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:06 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:06.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:06 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:06.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:06 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:03:06.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.730+0000 7fc395ae8640 1 -- 172.21.15.73:0/2857374774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390112b80 msgr2=0x7fc390114f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:06.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.730+0000 7fc395ae8640 1 --2- 172.21.15.73:0/2857374774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390112b80 0x7fc390114f70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc388009ca0 tx=0x7fc38802a980 comp rx=0 tx=0).stop 2024-09-05T13:03:06.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.734+0000 7fc395ae8640 1 -- 172.21.15.73:0/2857374774 shutdown_connections 2024-09-05T13:03:06.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.734+0000 7fc395ae8640 1 --2- 172.21.15.73:0/2857374774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390112b80 0x7fc390114f70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.734+0000 7fc395ae8640 1 --2- 172.21.15.73:0/2857374774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc390074eb0 0x7fc390112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.734+0000 7fc395ae8640 1 --2- 172.21.15.73:0/2857374774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc390074590 0x7fc390074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.734+0000 7fc395ae8640 1 -- 172.21.15.73:0/2857374774 >> 172.21.15.73:0/2857374774 conn(0x7fc3900fd8b0 msgr2=0x7fc3900ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:06.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.734+0000 7fc395ae8640 1 -- 172.21.15.73:0/2857374774 shutdown_connections 2024-09-05T13:03:06.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.738+0000 7fc395ae8640 1 -- 172.21.15.73:0/2857374774 wait complete. 2024-09-05T13:03:06.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.739+0000 7fc395ae8640 1 Processor -- start 2024-09-05T13:03:06.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.744+0000 7fc395ae8640 1 -- start start 2024-09-05T13:03:06.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.744+0000 7fc395ae8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390074590 0x7fc390073d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.745+0000 7fc395ae8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc390074eb0 0x7fc39006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.745+0000 7fc395ae8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc390112b80 0x7fc390070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.745+0000 7fc395ae8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc39006e610 con 0x7fc390074eb0 2024-09-05T13:03:06.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.745+0000 7fc395ae8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc39006e490 con 0x7fc390074590 2024-09-05T13:03:06.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.745+0000 7fc395ae8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc39006e790 con 0x7fc390112b80 2024-09-05T13:03:06.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.745+0000 7fc38effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc390074eb0 0x7fc39006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.745+0000 7fc38effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc390074eb0 0x7fc39006fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37606/0 (socket says 172.21.15.73:37606) 2024-09-05T13:03:06.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.745+0000 7fc38effd640 1 -- 172.21.15.73:0/968500087 learned_addr learned my addr 172.21.15.73:0/968500087 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:06.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.746+0000 7fc38ffff640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc390112b80 0x7fc390070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.746+0000 7fc38f7fe640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390074590 0x7fc390073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.747+0000 7fc38f7fe640 1 -- 172.21.15.73:0/968500087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc390112b80 msgr2=0x7fc390070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:06.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.747+0000 7fc38f7fe640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc390112b80 0x7fc390070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.747+0000 7fc38f7fe640 1 -- 172.21.15.73:0/968500087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc390074eb0 msgr2=0x7fc39006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:06.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.747+0000 7fc38f7fe640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc390074eb0 0x7fc39006fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.747+0000 7fc38f7fe640 1 -- 172.21.15.73:0/968500087 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc390070c10 con 0x7fc390074590 2024-09-05T13:03:06.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.747+0000 7fc38f7fe640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390074590 0x7fc390073d70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc38000b3f0 tx=0x7fc38000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:06.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.749+0000 7fc38cff9640 1 -- 172.21.15.73:0/968500087 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380026020 con 0x7fc390074590 2024-09-05T13:03:06.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.749+0000 7fc38cff9640 1 -- 172.21.15.73:0/968500087 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc380022b20 con 0x7fc390074590 2024-09-05T13:03:06.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.749+0000 7fc38cff9640 1 -- 172.21.15.73:0/968500087 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380021c90 con 0x7fc390074590 2024-09-05T13:03:06.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.750+0000 7fc395ae8640 1 -- 172.21.15.73:0/968500087 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc390105e10 con 0x7fc390074590 2024-09-05T13:03:06.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.750+0000 7fc395ae8640 1 -- 172.21.15.73:0/968500087 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3901062d0 con 0x7fc390074590 2024-09-05T13:03:06.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.757+0000 7fc397ebe740 1 Processor -- start 2024-09-05T13:03:06.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.757+0000 7fc397ebe740 1 -- start start 2024-09-05T13:03:06.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.758+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c084a0 0x565014c08880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.758+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c08dc0 0x565014c13140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.758+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c13680 0x565014c15a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.758+0000 7fc397ebe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x565014b6e2e0 con 0x565014c08dc0 2024-09-05T13:03:06.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.758+0000 7fc397ebe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x565014b15ce0 con 0x565014c084a0 2024-09-05T13:03:06.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.758+0000 7fc397ebe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x565014b6a2a0 con 0x565014c13680 2024-09-05T13:03:06.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.758+0000 7fc38effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c13680 0x565014c15a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.758+0000 7fc38effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c13680 0x565014c15a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:59772/0 (socket says 172.21.15.73:59772) 2024-09-05T13:03:06.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.758+0000 7fc38ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c084a0 0x565014c08880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.758+0000 7fc38effd640 1 -- 172.21.15.73:0/1764273365 learned_addr learned my addr 172.21.15.73:0/1764273365 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:06.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.759+0000 7fc38ffff640 1 -- 172.21.15.73:0/1764273365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c13680 msgr2=0x565014c15a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:06.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.759+0000 7fc38ffff640 1 --2- 172.21.15.73:0/1764273365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c13680 0x565014c15a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.759+0000 7fc38ffff640 1 -- 172.21.15.73:0/1764273365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c08dc0 msgr2=0x565014c13140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:03:06.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.759+0000 7fc38ffff640 1 --2- 172.21.15.73:0/1764273365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c08dc0 0x565014c13140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.759+0000 7fc38ffff640 1 -- 172.21.15.73:0/1764273365 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565014afa440 con 0x565014c084a0 2024-09-05T13:03:06.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.759+0000 7fc38effd640 1 --2- 172.21.15.73:0/1764273365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c13680 0x565014c15a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:03:06.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.760+0000 7fc38cff9640 1 -- 172.21.15.73:0/968500087 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc380029020 con 0x7fc390074590 2024-09-05T13:03:06.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.761+0000 7fc38ffff640 1 --2- 172.21.15.73:0/1764273365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c084a0 0x565014c08880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc38802af70 tx=0x7fc388009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1bdb095723555d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:06.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.761+0000 7fc38cff9640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc37c0b3da0 0x7fc37c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.762+0000 7fc385ffb640 1 -- 172.21.15.73:0/1764273365 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388048070 con 0x565014c084a0 2024-09-05T13:03:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.762+0000 7fc385ffb640 1 -- 172.21.15.73:0/1764273365 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc388003e50 con 0x565014c084a0 2024-09-05T13:03:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.762+0000 7fc385ffb640 1 -- 172.21.15.73:0/1764273365 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388034040 con 0x565014c084a0 2024-09-05T13:03:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.762+0000 7fc38cff9640 1 -- 172.21.15.73:0/968500087 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fc3800df5f0 con 0x7fc390074590 2024-09-05T13:03:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.762+0000 7fc38f7fe640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc37c0b3da0 0x7fc37c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.763+0000 7fc397ebe740 1 -- 172.21.15.73:0/1764273365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c084a0 msgr2=0x565014c08880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.763+0000 7fc397ebe740 1 --2- 172.21.15.73:0/1764273365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c084a0 0x565014c08880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc38802af70 tx=0x7fc388009a20 comp rx=0 tx=0).stop 2024-09-05T13:03:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.763+0000 7fc397ebe740 1 -- 172.21.15.73:0/1764273365 shutdown_connections 2024-09-05T13:03:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.763+0000 7fc397ebe740 1 --2- 172.21.15.73:0/1764273365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c13680 0x565014c15a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.763+0000 7fc397ebe740 1 --2- 172.21.15.73:0/1764273365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c08dc0 0x565014c13140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.763+0000 7fc397ebe740 1 --2- 172.21.15.73:0/1764273365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c084a0 0x565014c08880 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.763+0000 7fc397ebe740 1 -- 172.21.15.73:0/1764273365 >> 172.21.15.73:0/1764273365 conn(0x565014c04a30 msgr2=0x565014c04e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.763+0000 7fc38f7fe640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc37c0b3da0 0x7fc37c0b6260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc38000b3c0 tx=0x7fc380009330 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.764+0000 7fc397ebe740 1 -- 172.21.15.73:0/1764273365 shutdown_connections 2024-09-05T13:03:06.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.766+0000 7fc397ebe740 1 -- 172.21.15.73:0/1764273365 wait complete. 2024-09-05T13:03:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.767+0000 7fc397ebe740 1 -- start start 2024-09-05T13:03:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.767+0000 7fc397ebe740 1 Processor -- start 2024-09-05T13:03:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.768+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c084a0 0x565014c10470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.768+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.768+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c13680 0x565014c10ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.769+0000 7fc397ebe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x565014c161f0 con 0x565014c13680 2024-09-05T13:03:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.769+0000 7fc38effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c109b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.769+0000 7fc397ebe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x565014b29050 con 0x565014c084a0 2024-09-05T13:03:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.769+0000 7fc397ebe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x565014c16370 con 0x565014c08dc0 2024-09-05T13:03:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.769+0000 7fc38effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c109b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:59778/0 (socket says 172.21.15.73:59778) 2024-09-05T13:03:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.769+0000 7fc38effd640 1 -- 172.21.15.73:0/191731452 learned_addr learned my addr 172.21.15.73:0/191731452 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.770+0000 7fc397ebe740 10 client.0 _ll_register_callbacks cb 0x565014b69160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:06.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.770+0000 7fc38effd640 1 -- 172.21.15.73:0/191731452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c084a0 msgr2=0x565014c10470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:06.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.770+0000 7fc38effd640 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c084a0 0x565014c10470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.770+0000 7fc38effd640 1 -- 172.21.15.73:0/191731452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c13680 msgr2=0x565014c10ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:06.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.770+0000 7fc38effd640 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c13680 0x565014c10ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.770+0000 7fc38effd640 1 -- 172.21.15.73:0/191731452 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650148df3c0 con 0x565014c08dc0 2024-09-05T13:03:06.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.771+0000 7fc38effd640 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c109b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3780115d0 tx=0x7fc378011a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa9c6537592686a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.771+0000 7fc36effd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:03:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.771+0000 7fc36effd640 1 -- 172.21.15.73:0/191731452 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37800f750 con 0x565014c08dc0 2024-09-05T13:03:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.771+0000 7fc36effd640 1 -- 172.21.15.73:0/191731452 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fc37800f8f0 con 0x565014c08dc0 2024-09-05T13:03:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.771+0000 7fc397ebe740 1 -- 172.21.15.73:0/191731452 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc388003e50 con 0x565014c08dc0 2024-09-05T13:03:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.772+0000 7fc36effd640 1 -- 172.21.15.73:0/191731452 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc37800faf0 con 0x565014c08dc0 2024-09-05T13:03:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.772+0000 7fc397ebe740 10 client.25723 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.772+0000 7fc397ebe740 1 -- 172.21.15.73:0/191731452 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x565014c21dc0 con 0x565014c08dc0 2024-09-05T13:03:06.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.774+0000 7fc36effd640 1 -- 172.21.15.73:0/191731452 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc388003e50 con 0x565014c08dc0 2024-09-05T13:03:06.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.774+0000 7fc36effd640 1 -- 172.21.15.73:0/191731452 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7fc37801d400 con 0x565014c08dc0 2024-09-05T13:03:06.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.774+0000 7fc397ebe740 10 client.25723 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:06.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.774+0000 7fc397ebe740 10 client.25723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:06.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.774+0000 7fc397ebe740 20 client.25723 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:06.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.774+0000 7fc397ebe740 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x565014c23320 0x565014c25770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.774+0000 7fc397ebe740 4 client.25723 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.774+0000 7fc397ebe740 1 -- 172.21.15.73:0/191731452 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565014b7b850 con 0x565014c23320 2024-09-05T13:03:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.774+0000 7fc38ffff640 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x565014c23320 0x565014c25770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.775+0000 7fc36effd640 10 client.25723 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.775+0000 7fc38ffff640 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x565014c23320 0x565014c25770 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d06960382ab5de74 server_cookie=c621a05cfacb4d9b in_seq=0 out_seq=0 2024-09-05T13:03:06.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.777+0000 7fc36effd640 1 -- 172.21.15.73:0/191731452 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565014b7b850 con 0x565014c23320 2024-09-05T13:03:06.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.777+0000 7fc36effd640 10 client.25723 handle_command_reply: tid=0 2024-09-05T13:03:06.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.777+0000 7fc397ebe740 1 client.25723 shutdown 2024-09-05T13:03:06.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.779+0000 7fc397ebe740 1 -- 172.21.15.73:0/191731452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 msgr2=0x565014c109b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.779+0000 7fc397ebe740 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c109b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3780115d0 tx=0x7fc378011a90 comp rx=0 tx=0).stop 2024-09-05T13:03:06.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.780+0000 7fc397ebe740 1 -- 172.21.15.73:0/191731452 shutdown_connections 2024-09-05T13:03:06.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.780+0000 7fc397ebe740 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x565014c23320 0x565014c25770 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.780+0000 7fc397ebe740 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c13680 0x565014c10ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.780+0000 7fc397ebe740 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c109b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.780+0000 7fc397ebe740 1 --2- 172.21.15.73:0/191731452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c084a0 0x565014c10470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.780+0000 7fc397ebe740 1 -- 172.21.15.73:0/191731452 >> 172.21.15.73:0/191731452 conn(0x565014c04a30 msgr2=0x565014c0a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:06.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.781+0000 7fc36effd640 0 client.25723 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:06.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.782+0000 7fc397ebe740 1 -- 172.21.15.73:0/191731452 shutdown_connections 2024-09-05T13:03:06.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.782+0000 7fc397ebe740 1 -- 172.21.15.73:0/191731452 wait complete. 2024-09-05T13:03:06.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.782+0000 7fc397ebe740 20 client.25723 trim_cache size 0 max 16384 2024-09-05T13:03:06.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.818+0000 7fc397ebe740 1 Processor -- start 2024-09-05T13:03:06.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.818+0000 7fc397ebe740 1 -- start start 2024-09-05T13:03:06.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c084a0 0x565014c0ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c2b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c13680 0x565014c2b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc38ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c084a0 0x565014c0ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc38ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c084a0 0x565014c0ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37618/0 (socket says 172.21.15.73:37618) 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc397ebe740 1 -- 172.21.15.73:0/112036167 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc3901a55e0 con 0x565014c084a0 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc38ffff640 1 -- 172.21.15.73:0/112036167 learned_addr learned my addr 172.21.15.73:0/112036167 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc397ebe740 1 -- 172.21.15.73:0/112036167 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3901a2e50 con 0x565014c13680 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc397ebe740 1 -- 172.21.15.73:0/112036167 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc39010c960 con 0x565014c08dc0 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc38effd640 1 --2- 172.21.15.73:0/112036167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c2b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc38effd640 1 -- 172.21.15.73:0/112036167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c13680 msgr2=0x565014c2b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc38effd640 1 --2- 172.21.15.73:0/112036167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c13680 0x565014c2b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc38effd640 1 -- 172.21.15.73:0/112036167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c084a0 msgr2=0x565014c0ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc38effd640 1 --2- 172.21.15.73:0/112036167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c084a0 0x565014c0ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.819+0000 7fc38effd640 1 -- 172.21.15.73:0/112036167 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565014c0f420 con 0x565014c08dc0 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.820+0000 7fc38effd640 1 --2- 172.21.15.73:0/112036167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c2b080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x565014c11a20 tx=0x7fc3780046a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afef9a4cf73ac2ea server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.820+0000 7fc3857fa640 1 -- 172.21.15.73:0/112036167 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37800f750 con 0x565014c08dc0 2024-09-05T13:03:06.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.820+0000 7fc3857fa640 1 -- 172.21.15.73:0/112036167 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc37800f8f0 con 0x565014c08dc0 2024-09-05T13:03:06.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.820+0000 7fc3857fa640 1 -- 172.21.15.73:0/112036167 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc378014910 con 0x565014c08dc0 2024-09-05T13:03:06.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.821+0000 7fc397ebe740 1 -- 172.21.15.73:0/112036167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 msgr2=0x565014c2b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.821+0000 7fc397ebe740 1 --2- 172.21.15.73:0/112036167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c2b080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x565014c11a20 tx=0x7fc3780046a0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.821+0000 7fc397ebe740 1 -- 172.21.15.73:0/112036167 shutdown_connections 2024-09-05T13:03:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.821+0000 7fc397ebe740 1 --2- 172.21.15.73:0/112036167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c13680 0x565014c2b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.821+0000 7fc397ebe740 1 --2- 172.21.15.73:0/112036167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c08dc0 0x565014c2b080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.821+0000 7fc397ebe740 1 --2- 172.21.15.73:0/112036167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c084a0 0x565014c0ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.821+0000 7fc397ebe740 1 -- 172.21.15.73:0/112036167 >> 172.21.15.73:0/112036167 conn(0x565014c04a30 msgr2=0x565014c03b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.821+0000 7fc397ebe740 1 -- 172.21.15.73:0/112036167 shutdown_connections 2024-09-05T13:03:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.821+0000 7fc397ebe740 1 -- 172.21.15.73:0/112036167 wait complete. 2024-09-05T13:03:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc397ebe740 1 -- start start 2024-09-05T13:03:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc397ebe740 1 Processor -- start 2024-09-05T13:03:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c084a0 0x565014c1bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c08dc0 0x565014c19030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc397ebe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c13680 0x565014c19570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc397ebe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc39010cfd0 con 0x565014c08dc0 2024-09-05T13:03:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc397ebe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc39010e440 con 0x565014c13680 2024-09-05T13:03:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc397ebe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc39010d6a0 con 0x565014c084a0 2024-09-05T13:03:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc397ebe740 10 client.0 _ll_register_callbacks cb 0x7fc3780096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc38ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c084a0 0x565014c1bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc38ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c084a0 0x565014c1bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:59800/0 (socket says 172.21.15.73:59800) 2024-09-05T13:03:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.822+0000 7fc38ffff640 1 -- 172.21.15.73:0/613117200 learned_addr learned my addr 172.21.15.73:0/613117200 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc38effd640 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c08dc0 0x565014c19030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc38ffff640 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c13680 0x565014c19570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc38ffff640 1 -- 172.21.15.73:0/613117200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c13680 msgr2=0x565014c19570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc38ffff640 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c13680 0x565014c19570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc38ffff640 1 -- 172.21.15.73:0/613117200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c08dc0 msgr2=0x565014c19030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc38ffff640 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c08dc0 0x565014c19030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc38ffff640 1 -- 172.21.15.73:0/613117200 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565014c19d70 con 0x565014c084a0 2024-09-05T13:03:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc38ffff640 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c084a0 0x565014c1bce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc3880098d0 tx=0x7fc388005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e07d9c8b2dc5ea server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc36effd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:03:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc36effd640 1 -- 172.21.15.73:0/613117200 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388048070 con 0x565014c084a0 2024-09-05T13:03:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc397ebe740 1 -- 172.21.15.73:0/613117200 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc37800f8f0 con 0x565014c084a0 2024-09-05T13:03:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc36effd640 1 -- 172.21.15.73:0/613117200 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fc38802fdf0 con 0x565014c084a0 2024-09-05T13:03:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc36effd640 1 -- 172.21.15.73:0/613117200 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc38804de80 con 0x565014c084a0 2024-09-05T13:03:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc397ebe740 10 client.25729 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc397ebe740 1 -- 172.21.15.73:0/613117200 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x565014c8e040 con 0x565014c084a0 2024-09-05T13:03:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.823+0000 7fc36effd640 1 -- 172.21.15.73:0/613117200 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc37800f8f0 con 0x565014c084a0 2024-09-05T13:03:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.824+0000 7fc36effd640 1 -- 172.21.15.73:0/613117200 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7fc38804d6c0 con 0x565014c084a0 2024-09-05T13:03:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.824+0000 7fc397ebe740 10 client.25729 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.824+0000 7fc397ebe740 10 client.25729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.824+0000 7fc397ebe740 20 client.25729 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.824+0000 7fc397ebe740 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x565014c8e3d0 0x565014c907c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.824+0000 7fc397ebe740 4 client.25729 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T13:03:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.824+0000 7fc397ebe740 1 -- 172.21.15.73:0/613117200 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x565014b75d60 con 0x565014c8e3d0 2024-09-05T13:03:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.825+0000 7fc38effd640 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x565014c8e3d0 0x565014c907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:06.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.829+0000 7fc38effd640 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x565014c8e3d0 0x565014c907c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d055efb2328869f server_cookie=c60652f67a4b7a5e in_seq=0 out_seq=0 2024-09-05T13:03:06.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.831+0000 7fc36effd640 10 client.25729 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:06.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.831+0000 7fc36effd640 1 -- 172.21.15.73:0/613117200 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x565014b75d60 con 0x565014c8e3d0 2024-09-05T13:03:06.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.831+0000 7fc36effd640 10 client.25729 handle_command_reply: tid=0 2024-09-05T13:03:06.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.832+0000 7fc397ebe740 1 client.25729 shutdown 2024-09-05T13:03:06.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.838+0000 7fc397ebe740 1 -- 172.21.15.73:0/613117200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c084a0 msgr2=0x565014c1bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:06.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.838+0000 7fc397ebe740 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c084a0 0x565014c1bce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc3880098d0 tx=0x7fc388005bd0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.838+0000 7fc397ebe740 1 -- 172.21.15.73:0/613117200 shutdown_connections 2024-09-05T13:03:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.838+0000 7fc397ebe740 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x565014c8e3d0 0x565014c907c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.838+0000 7fc397ebe740 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565014c13680 0x565014c19570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.838+0000 7fc397ebe740 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565014c08dc0 0x565014c19030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.839+0000 7fc36effd640 0 client.25729 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.839+0000 7fc397ebe740 1 --2- 172.21.15.73:0/613117200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565014c084a0 0x565014c1bce0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.839+0000 7fc397ebe740 1 -- 172.21.15.73:0/613117200 >> 172.21.15.73:0/613117200 conn(0x565014c04a30 msgr2=0x565014c10430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:06.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.839+0000 7fc397ebe740 1 -- 172.21.15.73:0/613117200 shutdown_connections 2024-09-05T13:03:06.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.839+0000 7fc397ebe740 1 -- 172.21.15.73:0/613117200 wait complete. 2024-09-05T13:03:06.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.841+0000 7fc397ebe740 20 client.25729 trim_cache size 0 max 16384 2024-09-05T13:03:06.863 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:03:06.863 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-05T13:03:06.864 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2024-09-05T13:03:06.864 INFO:teuthology.orchestra.run.smithi073.stdout: "782924fa-c098-4ee1-a9ee-2da83cbf87b7": { 2024-09-05T13:03:06.864 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-05T13:03:06.864 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "782924fa-c098-4ee1-a9ee-2da83cbf87b7", 2024-09-05T13:03:06.864 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2024-09-05T13:03:06.864 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:03:06.864 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:03:06.865 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:03:06.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.849+0000 7fc395ae8640 1 -- 172.21.15.73:0/968500087 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc37c0b3da0 msgr2=0x7fc37c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:06.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.849+0000 7fc395ae8640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc37c0b3da0 0x7fc37c0b6260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc38000b3c0 tx=0x7fc380009330 comp rx=0 tx=0).stop 2024-09-05T13:03:06.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.849+0000 7fc395ae8640 1 -- 172.21.15.73:0/968500087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390074590 msgr2=0x7fc390073d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:06.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.849+0000 7fc395ae8640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390074590 0x7fc390073d70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc38000b3f0 tx=0x7fc38000b8b0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.853+0000 7fc395ae8640 1 -- 172.21.15.73:0/968500087 shutdown_connections 2024-09-05T13:03:06.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.853+0000 7fc395ae8640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc37c0b3da0 0x7fc37c0b6260 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.853+0000 7fc395ae8640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc390112b80 0x7fc390070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.853+0000 7fc395ae8640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc390074eb0 0x7fc39006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.853+0000 7fc395ae8640 1 --2- 172.21.15.73:0/968500087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390074590 0x7fc390073d70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:06.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.853+0000 7fc395ae8640 1 -- 172.21.15.73:0/968500087 >> 172.21.15.73:0/968500087 conn(0x7fc3900fd8b0 msgr2=0x7fc3900ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:06.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.856+0000 7fc395ae8640 1 -- 172.21.15.73:0/968500087 shutdown_connections 2024-09-05T13:03:06.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:06.856+0000 7fc395ae8640 1 -- 172.21.15.73:0/968500087 wait complete. 2024-09-05T13:03:07.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:07 smithi073 ceph-mon[30883]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.4 MiB/s wr, 1.39k op/s 2024-09-05T13:03:07.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:07 smithi162 ceph-mon[34220]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.4 MiB/s wr, 1.39k op/s 2024-09-05T13:03:07.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:07 smithi169 ceph-mon[34823]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.4 MiB/s wr, 1.39k op/s 2024-09-05T13:03:07.959 INFO:tasks.cephfs.filesystem:scrub status for tag:782924fa-c098-4ee1-a9ee-2da83cbf87b7 - {'path': '/', 'tag': '782924fa-c098-4ee1-a9ee-2da83cbf87b7', 'options': 'recursive,force'} 2024-09-05T13:03:08.241 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:08 smithi073 ceph-mon[30883]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.5 MiB/s wr, 2.41k op/s 2024-09-05T13:03:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:08 smithi162 ceph-mon[34220]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.5 MiB/s wr, 2.41k op/s 2024-09-05T13:03:08.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:08 smithi169 ceph-mon[34823]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.5 MiB/s wr, 2.41k op/s 2024-09-05T13:03:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:11 smithi073 ceph-mon[30883]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.3 MiB/s wr, 2.11k op/s 2024-09-05T13:03:11.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:11 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:03:11.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:11 smithi162 ceph-mon[34220]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.3 MiB/s wr, 2.11k op/s 2024-09-05T13:03:11.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:11 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:03:11.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:11 smithi169 ceph-mon[34823]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.3 MiB/s wr, 2.11k op/s 2024-09-05T13:03:11.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:11 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:03:12.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:12 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:03:12.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:12 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:03:12.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:12 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:03:12.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:12 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:03:12.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:12 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:03:12.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:12 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:03:13.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:13 smithi073 ceph-mon[30883]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 2.59k op/s 2024-09-05T13:03:13.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:13 smithi162 ceph-mon[34220]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 2.59k op/s 2024-09-05T13:03:13.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:13 smithi169 ceph-mon[34823]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 2.59k op/s 2024-09-05T13:03:14.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:14 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:03:14.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:14 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:03:14.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:14 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:03:15.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:15 smithi162 ceph-mon[34220]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 21 MiB/s wr, 5.09k op/s 2024-09-05T13:03:15.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:15 smithi073 ceph-mon[30883]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 21 MiB/s wr, 5.09k op/s 2024-09-05T13:03:15.518 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:15 smithi169 ceph-mon[34823]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 21 MiB/s wr, 5.09k op/s 2024-09-05T13:03:16.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:16 smithi073 ceph-mon[30883]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2024-09-05T13:03:16.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:16 smithi162 ceph-mon[34220]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2024-09-05T13:03:16.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:16 smithi169 ceph-mon[34823]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2024-09-05T13:03:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:03:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:03:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:03:17.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:03:17.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:03:17.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:03:17.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:03:17.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:03:17.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:03:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:18 smithi073 ceph-mon[30883]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 5.08k op/s 2024-09-05T13:03:18.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:18 smithi162 ceph-mon[34220]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 5.08k op/s 2024-09-05T13:03:18.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:18 smithi169 ceph-mon[34823]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 5.08k op/s 2024-09-05T13:03:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.774+0000 7fdeba023640 1 -- 172.21.15.73:0/394755643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4100a60 msgr2=0x7fdeb4100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.774+0000 7fdeba023640 1 --2- 172.21.15.73:0/394755643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4100a60 0x7fdeb4100e60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009900 tx=0x7fdea402a420 comp rx=0 tx=0).stop 2024-09-05T13:03:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.776+0000 7fdeba023640 1 -- 172.21.15.73:0/394755643 shutdown_connections 2024-09-05T13:03:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.776+0000 7fdeba023640 1 --2- 172.21.15.73:0/394755643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdeb4102610 0x7fdeb4108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.776+0000 7fdeba023640 1 --2- 172.21.15.73:0/394755643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb4101c50 0x7fdeb41020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.776+0000 7fdeba023640 1 --2- 172.21.15.73:0/394755643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4100a60 0x7fdeb4100e60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.776+0000 7fdeba023640 1 -- 172.21.15.73:0/394755643 >> 172.21.15.73:0/394755643 conn(0x7fdeb40fc1e0 msgr2=0x7fdeb40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.776+0000 7fdeba023640 1 -- 172.21.15.73:0/394755643 shutdown_connections 2024-09-05T13:03:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.777+0000 7fdeba023640 1 -- 172.21.15.73:0/394755643 wait complete. 2024-09-05T13:03:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.778+0000 7fdeba023640 1 Processor -- start 2024-09-05T13:03:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.778+0000 7fdeba023640 1 -- start start 2024-09-05T13:03:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.779+0000 7fdeba023640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4100a60 0x7fdeb4195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.779+0000 7fdeba023640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdeb4101c50 0x7fdeb4196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.779+0000 7fdeba023640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb4102610 0x7fdeb419d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.779+0000 7fdeba023640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb410b620 con 0x7fdeb4102610 2024-09-05T13:03:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.779+0000 7fdeba023640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb410b4a0 con 0x7fdeb4101c50 2024-09-05T13:03:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.779+0000 7fdeba023640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb410b7a0 con 0x7fdeb4100a60 2024-09-05T13:03:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.782+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4100a60 0x7fdeb4195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.782+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4100a60 0x7fdeb4195c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:55550/0 (socket says 172.21.15.73:55550) 2024-09-05T13:03:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.782+0000 7fdeb37fe640 1 -- 172.21.15.73:0/1525010460 learned_addr learned my addr 172.21.15.73:0/1525010460 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.782+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb4102610 0x7fdeb419d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.783+0000 7fdeb37fe640 1 -- 172.21.15.73:0/1525010460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdeb4101c50 msgr2=0x7fdeb4196160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T13:03:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.783+0000 7fdeb37fe640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdeb4101c50 0x7fdeb4196160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.783+0000 7fdeb37fe640 1 -- 172.21.15.73:0/1525010460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb4102610 msgr2=0x7fdeb419d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.783+0000 7fdeb37fe640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb4102610 0x7fdeb419d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.783+0000 7fdeb37fe640 1 -- 172.21.15.73:0/1525010460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb419d830 con 0x7fdeb4100a60 2024-09-05T13:03:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.783+0000 7fdeb37fe640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4100a60 0x7fdeb4195c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdea402aa10 tx=0x7fdea4005230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.789+0000 7fdeb0ff9640 1 -- 172.21.15.73:0/1525010460 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4040030 con 0x7fdeb4100a60 2024-09-05T13:03:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.789+0000 7fdeba023640 1 -- 172.21.15.73:0/1525010460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb419dac0 con 0x7fdeb4100a60 2024-09-05T13:03:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.789+0000 7fdeb0ff9640 1 -- 172.21.15.73:0/1525010460 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea4003e30 con 0x7fdeb4100a60 2024-09-05T13:03:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.789+0000 7fdeba023640 1 -- 172.21.15.73:0/1525010460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb419df80 con 0x7fdeb4100a60 2024-09-05T13:03:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.792+0000 7fdeb0ff9640 1 -- 172.21.15.73:0/1525010460 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea403ca50 con 0x7fdeb4100a60 2024-09-05T13:03:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.793+0000 7fdebc9fd740 1 Processor -- start 2024-09-05T13:03:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.794+0000 7fdebc9fd740 1 -- start start 2024-09-05T13:03:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.794+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce8111b0 0x55d6ce8115b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.794+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce811af0 0x55d6ce8165b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.794+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce819040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.794+0000 7fdebc9fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d6ce76c2f0 con 0x55d6ce8111b0 2024-09-05T13:03:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.794+0000 7fdebc9fd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d6ce714270 con 0x55d6ce811af0 2024-09-05T13:03:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.794+0000 7fdebc9fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d6ce7682b0 con 0x55d6ce816b80 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.796+0000 7fdeb0ff9640 1 -- 172.21.15.73:0/1525010460 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdea4043030 con 0x7fdeb4100a60 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.796+0000 7fdeb2ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce819040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.796+0000 7fdeb2ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce819040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:55560/0 (socket says 172.21.15.73:55560) 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.796+0000 7fdeb2ffd640 1 -- 172.21.15.73:0/2733814208 learned_addr learned my addr 172.21.15.73:0/2733814208 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.796+0000 7fdeb2ffd640 1 -- 172.21.15.73:0/2733814208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce811af0 msgr2=0x55d6ce8165b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.796+0000 7fdeb2ffd640 1 --2- 172.21.15.73:0/2733814208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce811af0 0x55d6ce8165b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.796+0000 7fdeb2ffd640 1 -- 172.21.15.73:0/2733814208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce8111b0 msgr2=0x55d6ce8115b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.796+0000 7fdeb2ffd640 1 --2- 172.21.15.73:0/2733814208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce8111b0 0x55d6ce8115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.796+0000 7fdeb2ffd640 1 -- 172.21.15.73:0/2733814208 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6ce713340 con 0x55d6ce816b80 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.796+0000 7fdeb2ffd640 1 --2- 172.21.15.73:0/2733814208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce819040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009e30 tx=0x7fdeac00e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e16bd713d83edf7f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.797+0000 7fde99ffb640 1 -- 172.21.15.73:0/2733814208 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac004d20 con 0x55d6ce816b80 2024-09-05T13:03:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.797+0000 7fde99ffb640 1 -- 172.21.15.73:0/2733814208 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdeac005500 con 0x55d6ce816b80 2024-09-05T13:03:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.797+0000 7fde99ffb640 1 -- 172.21.15.73:0/2733814208 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac010850 con 0x55d6ce816b80 2024-09-05T13:03:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.797+0000 7fdeb0ff9640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fde9c0a2dd0 0x7fde9c0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.798+0000 7fdeb0ff9640 1 -- 172.21.15.73:0/1525010460 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fdea40ef5a0 con 0x7fdeb4100a60 2024-09-05T13:03:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.798+0000 7fdebc9fd740 1 -- 172.21.15.73:0/2733814208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 msgr2=0x55d6ce819040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.798+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/2733814208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce819040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009e30 tx=0x7fdeac00e720 comp rx=0 tx=0).stop 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.798+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fde9c0a2dd0 0x7fde9c0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.798+0000 7fdebc9fd740 1 -- 172.21.15.73:0/2733814208 shutdown_connections 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.798+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/2733814208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce819040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.798+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/2733814208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce811af0 0x55d6ce8165b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.798+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/2733814208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce8111b0 0x55d6ce8115b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.798+0000 7fdebc9fd740 1 -- 172.21.15.73:0/2733814208 >> 172.21.15.73:0/2733814208 conn(0x55d6ce80c820 msgr2=0x55d6ce80cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.799+0000 7fdebc9fd740 1 -- 172.21.15.73:0/2733814208 shutdown_connections 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.799+0000 7fdebc9fd740 1 -- 172.21.15.73:0/2733814208 wait complete. 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.799+0000 7fdebc9fd740 1 -- start start 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fde9c0a2dd0 0x7fde9c0a5290 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdea8004450 tx=0x7fdea8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdebc9fd740 1 Processor -- start 2024-09-05T13:03:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce8111b0 0x55d6ce805760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce816b80 0x55d6ce805ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce80ac60 0x55d6ce80b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdebc9fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d6ce803c10 con 0x55d6ce80ac60 2024-09-05T13:03:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdebc9fd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d6ce6f5290 con 0x55d6ce816b80 2024-09-05T13:03:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdebc9fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d6ce803d90 con 0x55d6ce8111b0 2024-09-05T13:03:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdebc9fd740 10 client.0 _ll_register_callbacks cb 0x55d6ce726140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce8111b0 0x55d6ce805760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce8111b0 0x55d6ce805760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:55568/0 (socket says 172.21.15.73:55568) 2024-09-05T13:03:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.800+0000 7fdeb37fe640 1 -- 172.21.15.73:0/4034531382 learned_addr learned my addr 172.21.15.73:0/4034531382 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.801+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce80ac60 0x55d6ce80b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.801+0000 7fdeb2ffd640 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce816b80 0x55d6ce805ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.802+0000 7fdeb3fff640 1 -- 172.21.15.73:0/4034531382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce8111b0 msgr2=0x55d6ce805760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.802+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce8111b0 0x55d6ce805760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.802+0000 7fdeb3fff640 1 -- 172.21.15.73:0/4034531382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce816b80 msgr2=0x55d6ce805ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.802+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce816b80 0x55d6ce805ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.802+0000 7fdeb3fff640 1 -- 172.21.15.73:0/4034531382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6ce47f210 con 0x55d6ce80ac60 2024-09-05T13:03:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.802+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce80ac60 0x55d6ce80b0c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdea800b3c0 tx=0x7fdea8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c2cb4fb85c835a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.803+0000 7fde92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:03:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.803+0000 7fde92ffd640 1 -- 172.21.15.73:0/4034531382 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8028060 con 0x55d6ce80ac60 2024-09-05T13:03:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.803+0000 7fde92ffd640 1 -- 172.21.15.73:0/4034531382 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fdea8018670 con 0x55d6ce80ac60 2024-09-05T13:03:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.803+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4034531382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeac005500 con 0x55d6ce80ac60 2024-09-05T13:03:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.808+0000 7fde92ffd640 1 -- 172.21.15.73:0/4034531382 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fdea8018870 con 0x55d6ce80ac60 2024-09-05T13:03:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.809+0000 7fdebc9fd740 10 client.16173 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.809+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4034531382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d6ce54b620 con 0x55d6ce80ac60 2024-09-05T13:03:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.810+0000 7fde92ffd640 1 -- 172.21.15.73:0/4034531382 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdeac005500 con 0x55d6ce80ac60 2024-09-05T13:03:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.810+0000 7fde92ffd640 1 -- 172.21.15.73:0/4034531382 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7fdea8017c00 con 0x55d6ce80ac60 2024-09-05T13:03:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.810+0000 7fdebc9fd740 10 client.16173 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.811+0000 7fdebc9fd740 10 client.16173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.811+0000 7fdebc9fd740 20 client.16173 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.811+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d6ce830270 0x55d6ce8326f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.811+0000 7fdebc9fd740 4 client.16173 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.811+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4034531382 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6ce779a20 con 0x55d6ce830270 2024-09-05T13:03:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.811+0000 7fdeb37fe640 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d6ce830270 0x55d6ce8326f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.812+0000 7fdeb37fe640 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d6ce830270 0x55d6ce8326f0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76055cabdbfa8f06 server_cookie=1286b7df4b08d9c3 in_seq=0 out_seq=0 2024-09-05T13:03:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.812+0000 7fde92ffd640 10 client.16173 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.816+0000 7fde92ffd640 1 -- 172.21.15.73:0/4034531382 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6ce779a20 con 0x55d6ce830270 2024-09-05T13:03:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.816+0000 7fde92ffd640 10 client.16173 handle_command_reply: tid=0 2024-09-05T13:03:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.817+0000 7fdebc9fd740 1 client.16173 shutdown 2024-09-05T13:03:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4034531382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce80ac60 msgr2=0x55d6ce80b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce80ac60 0x55d6ce80b0c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdea800b3c0 tx=0x7fdea8004730 comp rx=0 tx=0).stop 2024-09-05T13:03:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4034531382 shutdown_connections 2024-09-05T13:03:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d6ce830270 0x55d6ce8326f0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce80ac60 0x55d6ce80b0c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce816b80 0x55d6ce805ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4034531382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce8111b0 0x55d6ce805760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4034531382 >> 172.21.15.73:0/4034531382 conn(0x55d6ce80c820 msgr2=0x55d6ce8031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fde92ffd640 0 client.16173 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4034531382 shutdown_connections 2024-09-05T13:03:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.818+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4034531382 wait complete. 2024-09-05T13:03:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.819+0000 7fdebc9fd740 20 client.16173 trim_cache size 0 max 16384 2024-09-05T13:03:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.845+0000 7fdebc9fd740 1 Processor -- start 2024-09-05T13:03:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.846+0000 7fdebc9fd740 1 -- start start 2024-09-05T13:03:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.847+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce80ac60 0x55d6ce805760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.847+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 0x55d6ce805ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.847+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce816b80 0x55d6ce812e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.847+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce80ac60 0x55d6ce805760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.847+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce80ac60 0x55d6ce805760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:55576/0 (socket says 172.21.15.73:55576) 2024-09-05T13:03:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.847+0000 7fdeb37fe640 1 -- 172.21.15.73:0/1053177817 learned_addr learned my addr 172.21.15.73:0/1053177817 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.847+0000 7fdeb2ffd640 1 --2- 172.21.15.73:0/1053177817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 0x55d6ce805ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.847+0000 7fdebc9fd740 1 -- 172.21.15.73:0/1053177817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0010de0 con 0x55d6ce816b80 2024-09-05T13:03:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.847+0000 7fdebc9fd740 1 -- 172.21.15.73:0/1053177817 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdea000e650 con 0x55d6ce8111b0 2024-09-05T13:03:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.847+0000 7fdebc9fd740 1 -- 172.21.15.73:0/1053177817 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdea000c4a0 con 0x55d6ce80ac60 2024-09-05T13:03:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.848+0000 7fdeb37fe640 1 -- 172.21.15.73:0/1053177817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 msgr2=0x55d6ce805ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.848+0000 7fdeb37fe640 1 --2- 172.21.15.73:0/1053177817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 0x55d6ce805ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.848+0000 7fdeb37fe640 1 -- 172.21.15.73:0/1053177817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce816b80 msgr2=0x55d6ce812e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.848+0000 7fdeb37fe640 1 --2- 172.21.15.73:0/1053177817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce816b80 0x55d6ce812e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.848+0000 7fdeb37fe640 1 -- 172.21.15.73:0/1053177817 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6ce80c640 con 0x55d6ce80ac60 2024-09-05T13:03:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.848+0000 7fdeb37fe640 1 --2- 172.21.15.73:0/1053177817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce80ac60 0x55d6ce805760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdea4004b60 tx=0x7fdea40dc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a10b7f8f6f9bbeb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.849+0000 7fde997fa640 1 -- 172.21.15.73:0/1053177817 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea40b9f70 con 0x55d6ce80ac60 2024-09-05T13:03:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.849+0000 7fde997fa640 1 -- 172.21.15.73:0/1053177817 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea40bc530 con 0x55d6ce80ac60 2024-09-05T13:03:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.849+0000 7fde997fa640 1 -- 172.21.15.73:0/1053177817 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea40ba130 con 0x55d6ce80ac60 2024-09-05T13:03:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.850+0000 7fdebc9fd740 1 -- 172.21.15.73:0/1053177817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce80ac60 msgr2=0x55d6ce805760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.850+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/1053177817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce80ac60 0x55d6ce805760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdea4004b60 tx=0x7fdea40dc040 comp rx=0 tx=0).stop 2024-09-05T13:03:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.852+0000 7fdebc9fd740 1 -- 172.21.15.73:0/1053177817 shutdown_connections 2024-09-05T13:03:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.852+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/1053177817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce816b80 0x55d6ce812e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.852+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/1053177817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 0x55d6ce805ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.852+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/1053177817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce80ac60 0x55d6ce805760 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.852+0000 7fdebc9fd740 1 -- 172.21.15.73:0/1053177817 >> 172.21.15.73:0/1053177817 conn(0x55d6ce80c820 msgr2=0x55d6ce804cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.854+0000 7fdebc9fd740 1 -- 172.21.15.73:0/1053177817 shutdown_connections 2024-09-05T13:03:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.858+0000 7fdebc9fd740 1 -- 172.21.15.73:0/1053177817 wait complete. 2024-09-05T13:03:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.858+0000 7fdebc9fd740 1 -- start start 2024-09-05T13:03:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.858+0000 7fdebc9fd740 1 Processor -- start 2024-09-05T13:03:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.859+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce80ac60 0x55d6ce841580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.859+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 0x55d6ce841ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.859+0000 7fdebc9fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce898e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.859+0000 7fdebc9fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdea000cb10 con 0x55d6ce80ac60 2024-09-05T13:03:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.860+0000 7fdeb2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 0x55d6ce841ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.860+0000 7fdeb2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 0x55d6ce841ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:47490/0 (socket says 172.21.15.73:47490) 2024-09-05T13:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.860+0000 7fdeb2ffd640 1 -- 172.21.15.73:0/4131989630 learned_addr learned my addr 172.21.15.73:0/4131989630 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.860+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce898e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.860+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4131989630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdea000df80 con 0x55d6ce8111b0 2024-09-05T13:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.860+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4131989630 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdea000d1e0 con 0x55d6ce816b80 2024-09-05T13:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.860+0000 7fdebc9fd740 10 client.0 _ll_register_callbacks cb 0x7fdea8004200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.861+0000 7fdeb3fff640 1 -- 172.21.15.73:0/4131989630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 msgr2=0x55d6ce841ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.861+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 0x55d6ce841ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.861+0000 7fdeb3fff640 1 -- 172.21.15.73:0/4131989630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce80ac60 msgr2=0x55d6ce841580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.861+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce80ac60 0x55d6ce841580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.861+0000 7fdeb3fff640 1 -- 172.21.15.73:0/4131989630 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6ce899380 con 0x55d6ce816b80 2024-09-05T13:03:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.864+0000 7fdeb3fff640 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce898e40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdea8018020 tx=0x7fdea8005b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5266f710826d743 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.866+0000 7fde92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:03:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.866+0000 7fde92ffd640 1 -- 172.21.15.73:0/4131989630 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8032080 con 0x55d6ce816b80 2024-09-05T13:03:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.867+0000 7fde92ffd640 1 -- 172.21.15.73:0/4131989630 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fdea8018670 con 0x55d6ce816b80 2024-09-05T13:03:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.869+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4131989630 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdea40bc530 con 0x55d6ce816b80 2024-09-05T13:03:18.872 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.870+0000 7fde92ffd640 1 -- 172.21.15.73:0/4131989630 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fdea8028020 con 0x55d6ce816b80 2024-09-05T13:03:18.872 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.870+0000 7fdebc9fd740 10 client.25747 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.870+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4131989630 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d6ce89a5b0 con 0x55d6ce816b80 2024-09-05T13:03:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.871+0000 7fde92ffd640 1 -- 172.21.15.73:0/4131989630 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea40bc530 con 0x55d6ce816b80 2024-09-05T13:03:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.871+0000 7fde92ffd640 1 -- 172.21.15.73:0/4131989630 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7fdea8004660 con 0x55d6ce816b80 2024-09-05T13:03:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.872+0000 7fdebc9fd740 10 client.25747 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.872+0000 7fdebc9fd740 10 client.25747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.872+0000 7fdebc9fd740 20 client.25747 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.872+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d6ce89af40 0x55d6ce89d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.872+0000 7fdebc9fd740 4 client.25747 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:03:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.872+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4131989630 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d6ce773d70 con 0x55d6ce89af40 2024-09-05T13:03:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.873+0000 7fdeb37fe640 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d6ce89af40 0x55d6ce89d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:18.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.875+0000 7fdeb37fe640 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d6ce89af40 0x55d6ce89d360 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=883a9f2e60692639 server_cookie=f6dbfc5fedbfe31a in_seq=0 out_seq=0 2024-09-05T13:03:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.876+0000 7fde92ffd640 10 client.25747 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.902+0000 7fde92ffd640 1 -- 172.21.15.73:0/4131989630 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d6ce773d70 con 0x55d6ce89af40 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fde92ffd640 10 client.25747 handle_command_reply: tid=0 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 client.25747 shutdown 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4131989630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 msgr2=0x55d6ce898e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce898e40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdea8018020 tx=0x7fdea8005b20 comp rx=0 tx=0).stop 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4131989630 shutdown_connections 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d6ce89af40 0x55d6ce89d360 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6ce816b80 0x55d6ce898e40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6ce8111b0 0x55d6ce841ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 --2- 172.21.15.73:0/4131989630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d6ce80ac60 0x55d6ce841580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4131989630 >> 172.21.15.73:0/4131989630 conn(0x55d6ce80c820 msgr2=0x55d6ce812e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fde92ffd640 0 client.25747 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4131989630 shutdown_connections 2024-09-05T13:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 1 -- 172.21.15.73:0/4131989630 wait complete. 2024-09-05T13:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.903+0000 7fdebc9fd740 20 client.25747 trim_cache size 0 max 16384 2024-09-05T13:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 -- 172.21.15.73:0/1525010460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fde9c0a2dd0 msgr2=0x7fde9c0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fde9c0a2dd0 0x7fde9c0a5290 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdea8004450 tx=0x7fdea8005f90 comp rx=0 tx=0).stop 2024-09-05T13:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 -- 172.21.15.73:0/1525010460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4100a60 msgr2=0x7fdeb4195c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4100a60 0x7fdeb4195c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdea402aa10 tx=0x7fdea4005230 comp rx=0 tx=0).stop 2024-09-05T13:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 -- 172.21.15.73:0/1525010460 shutdown_connections 2024-09-05T13:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fde9c0a2dd0 0x7fde9c0a5290 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb4102610 0x7fdeb419d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdeb4101c50 0x7fdeb4196160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 --2- 172.21.15.73:0/1525010460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4100a60 0x7fdeb4195c20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 -- 172.21.15.73:0/1525010460 >> 172.21.15.73:0/1525010460 conn(0x7fdeb40fc1e0 msgr2=0x7fdeb4104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 -- 172.21.15.73:0/1525010460 shutdown_connections 2024-09-05T13:03:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:18.904+0000 7fdeba023640 1 -- 172.21.15.73:0/1525010460 wait complete. 2024-09-05T13:03:21.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:21 smithi073 ceph-mon[30883]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 3.94k op/s 2024-09-05T13:03:21.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:21 smithi162 ceph-mon[34220]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 3.94k op/s 2024-09-05T13:03:21.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:21 smithi169 ceph-mon[34823]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 3.94k op/s 2024-09-05T13:03:23.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:23 smithi073 ceph-mon[30883]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 3.76k op/s 2024-09-05T13:03:23.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:23 smithi162 ceph-mon[34220]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 3.76k op/s 2024-09-05T13:03:23.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:23 smithi169 ceph-mon[34823]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 3.76k op/s 2024-09-05T13:03:25.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:25 smithi073 ceph-mon[30883]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 21 MiB/s wr, 5.07k op/s 2024-09-05T13:03:25.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:25 smithi162 ceph-mon[34220]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 21 MiB/s wr, 5.07k op/s 2024-09-05T13:03:25.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:25 smithi169 ceph-mon[34823]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 21 MiB/s wr, 5.07k op/s 2024-09-05T13:03:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:27 smithi073 ceph-mon[30883]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 3.34k op/s 2024-09-05T13:03:27.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:27 smithi162 ceph-mon[34220]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 3.34k op/s 2024-09-05T13:03:27.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:27 smithi169 ceph-mon[34823]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 3.34k op/s 2024-09-05T13:03:29.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:29 smithi073 ceph-mon[30883]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 MiB/s wr, 4.28k op/s 2024-09-05T13:03:29.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:29 smithi162 ceph-mon[34220]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 MiB/s wr, 4.28k op/s 2024-09-05T13:03:29.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:29 smithi169 ceph-mon[34823]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 MiB/s wr, 4.28k op/s 2024-09-05T13:03:31.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:31 smithi073 ceph-mon[30883]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2024-09-05T13:03:31.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:31 smithi162 ceph-mon[34220]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2024-09-05T13:03:31.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:31 smithi169 ceph-mon[34823]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2024-09-05T13:03:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.049+0000 7fb8fe79f640 1 -- 172.21.15.73:0/1532856639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f8077df0 msgr2=0x7fb8f8078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.049+0000 7fb8fe79f640 1 --2- 172.21.15.73:0/1532856639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f8077df0 0x7fb8f8078250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb8e801a910 tx=0x7fb8e803b450 comp rx=0 tx=0).stop 2024-09-05T13:03:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.049+0000 7fb8fe79f640 1 -- 172.21.15.73:0/1532856639 shutdown_connections 2024-09-05T13:03:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.049+0000 7fb8fe79f640 1 --2- 172.21.15.73:0/1532856639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8078790 0x7fb8f8079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.049+0000 7fb8fe79f640 1 --2- 172.21.15.73:0/1532856639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f8077df0 0x7fb8f8078250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.049+0000 7fb8fe79f640 1 --2- 172.21.15.73:0/1532856639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8f8076bb0 0x7fb8f8076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.049+0000 7fb8fe79f640 1 -- 172.21.15.73:0/1532856639 >> 172.21.15.73:0/1532856639 conn(0x7fb8f80ff4e0 msgr2=0x7fb8f8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.049+0000 7fb8fe79f640 1 -- 172.21.15.73:0/1532856639 shutdown_connections 2024-09-05T13:03:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.050+0000 7fb8fe79f640 1 -- 172.21.15.73:0/1532856639 wait complete. 2024-09-05T13:03:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8fe79f640 1 Processor -- start 2024-09-05T13:03:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8fe79f640 1 -- start start 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8fe79f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f8076bb0 0x7fb8f8108690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8fe79f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8077df0 0x7fb8f8108bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8fe79f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8f8078790 0x7fb8f810fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8fe79f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f8105620 con 0x7fb8f8078790 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8fe79f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f81054a0 con 0x7fb8f8076bb0 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8fe79f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f81057a0 con 0x7fb8f8077df0 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8f7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f8076bb0 0x7fb8f8108690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8f7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f8076bb0 0x7fb8f8108690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:40830/0 (socket says 172.21.15.73:40830) 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8f7fff640 1 -- 172.21.15.73:0/24297509 learned_addr learned my addr 172.21.15.73:0/24297509 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8f77fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8077df0 0x7fb8f8108bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.051+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8f8078790 0x7fb8f810fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8f77fe640 1 -- 172.21.15.73:0/24297509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f8076bb0 msgr2=0x7fb8f8108690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f8076bb0 0x7fb8f8108690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8f77fe640 1 -- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8f8078790 msgr2=0x7fb8f810fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8f8078790 0x7fb8f810fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8f77fe640 1 -- 172.21.15.73:0/24297509 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f81102b0 con 0x7fb8f8077df0 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8f7fff640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f8076bb0 0x7fb8f8108690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8f8078790 0x7fb8f810fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8077df0 0x7fb8f8108bd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb8e801a860 tx=0x7fb8e8005490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8f57fa640 1 -- 172.21.15.73:0/24297509 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8051070 con 0x7fb8f8077df0 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8fe79f640 1 -- 172.21.15.73:0/24297509 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f8110540 con 0x7fb8f8077df0 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8f57fa640 1 -- 172.21.15.73:0/24297509 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8e80409f0 con 0x7fb8f8077df0 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8f57fa640 1 -- 172.21.15.73:0/24297509 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8042a30 con 0x7fb8f8077df0 2024-09-05T13:03:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.052+0000 7fb8fe79f640 1 -- 172.21.15.73:0/24297509 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f8110ab0 con 0x7fb8f8077df0 2024-09-05T13:03:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb90161b740 1 Processor -- start 2024-09-05T13:03:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb90161b740 1 -- start start 2024-09-05T13:03:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb90161b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b39da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb90161b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b3eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb90161b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b3f370 0x556538b41830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb90161b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556538a9d2f0 con 0x556538b3a2e0 2024-09-05T13:03:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb90161b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556538a45270 con 0x556538b3f370 2024-09-05T13:03:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb90161b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556538a992b0 con 0x556538b399a0 2024-09-05T13:03:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb8f57fa640 1 -- 172.21.15.73:0/24297509 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb8e8054070 con 0x7fb8f8077df0 2024-09-05T13:03:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb8f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b3eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb8f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b3eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45368/0 (socket says 172.21.15.73:45368) 2024-09-05T13:03:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb8f7fff640 1 -- 172.21.15.73:0/1420741519 learned_addr learned my addr 172.21.15.73:0/1420741519 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.055+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/1420741519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b39da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.056+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/1420741519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b3f370 0x556538b41830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.056+0000 7fb8f57fa640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb8e00a2c80 0x7fb8e00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.057+0000 7fb8f57fa640 1 -- 172.21.15.73:0/24297509 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb8e81008d0 con 0x7fb8f8077df0 2024-09-05T13:03:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.057+0000 7fb8fcd3c640 1 -- 172.21.15.73:0/1420741519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b3f370 msgr2=0x556538b41830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.057+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/1420741519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b3f370 0x556538b41830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.057+0000 7fb8fcd3c640 1 -- 172.21.15.73:0/1420741519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 msgr2=0x556538b3eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.057+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/1420741519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b3eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.057+0000 7fb8fcd3c640 1 -- 172.21.15.73:0/1420741519 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556538a44340 con 0x556538b399a0 2024-09-05T13:03:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.057+0000 7fb8f7fff640 1 --2- 172.21.15.73:0/1420741519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b3eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:03:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.057+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb8e00a2c80 0x7fb8e00a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.057+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/1420741519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b39da0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0005fd0 tx=0x7fb8f0011d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5274697fe7a45a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.058+0000 7fb8de7fc640 1 -- 172.21.15.73:0/1420741519 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0017070 con 0x556538b399a0 2024-09-05T13:03:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.058+0000 7fb8de7fc640 1 -- 172.21.15.73:0/1420741519 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8f001c430 con 0x556538b399a0 2024-09-05T13:03:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.058+0000 7fb8de7fc640 1 -- 172.21.15.73:0/1420741519 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f000e5b0 con 0x556538b399a0 2024-09-05T13:03:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb90161b740 1 -- 172.21.15.73:0/1420741519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 msgr2=0x556538b39da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb90161b740 1 --2- 172.21.15.73:0/1420741519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b39da0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0005fd0 tx=0x7fb8f0011d50 comp rx=0 tx=0).stop 2024-09-05T13:03:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb8e00a2c80 0x7fb8e00a5140 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0023000 tx=0x7fb8f0024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb90161b740 1 -- 172.21.15.73:0/1420741519 shutdown_connections 2024-09-05T13:03:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb90161b740 1 --2- 172.21.15.73:0/1420741519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b3f370 0x556538b41830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb90161b740 1 --2- 172.21.15.73:0/1420741519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b3eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb90161b740 1 --2- 172.21.15.73:0/1420741519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b39da0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb90161b740 1 -- 172.21.15.73:0/1420741519 >> 172.21.15.73:0/1420741519 conn(0x556538b35010 msgr2=0x556538b35410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb90161b740 1 -- 172.21.15.73:0/1420741519 shutdown_connections 2024-09-05T13:03:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb90161b740 1 -- 172.21.15.73:0/1420741519 wait complete. 2024-09-05T13:03:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.059+0000 7fb90161b740 1 -- start start 2024-09-05T13:03:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.060+0000 7fb90161b740 1 Processor -- start 2024-09-05T13:03:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.060+0000 7fb90161b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b43bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.060+0000 7fb90161b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b3a2e0 0x556538b44100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.060+0000 7fb90161b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 0x556538b4b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.060+0000 7fb8f7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b43bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.060+0000 7fb90161b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556538b423e0 con 0x556538b3f370 2024-09-05T13:03:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.060+0000 7fb90161b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556538a26290 con 0x556538b3a2e0 2024-09-05T13:03:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.060+0000 7fb90161b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556538b42560 con 0x556538b399a0 2024-09-05T13:03:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.060+0000 7fb8f7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b43bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:54916/0 (socket says 172.21.15.73:54916) 2024-09-05T13:03:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.060+0000 7fb8f7fff640 1 -- 172.21.15.73:0/3060224912 learned_addr learned my addr 172.21.15.73:0/3060224912 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb90161b740 10 client.0 _ll_register_callbacks cb 0x556538a57140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 0x556538b4b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb8f7fff640 1 -- 172.21.15.73:0/3060224912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b3a2e0 msgr2=0x556538b44100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb8f7fff640 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b3a2e0 0x556538b44100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb8f7fff640 1 -- 172.21.15.73:0/3060224912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 msgr2=0x556538b4b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb8f7fff640 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 0x556538b4b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb8f7fff640 1 -- 172.21.15.73:0/3060224912 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565387b0210 con 0x556538b399a0 2024-09-05T13:03:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 0x556538b4b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:03:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb8f7fff640 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b43bc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec011960 tx=0x7fb8ec011d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=398fce553a28e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb8d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:03:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.061+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3060224912 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec004300 con 0x556538b399a0 2024-09-05T13:03:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3060224912 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb8ec010990 con 0x556538b399a0 2024-09-05T13:03:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb90161b740 1 -- 172.21.15.73:0/3060224912 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8f001c430 con 0x556538b399a0 2024-09-05T13:03:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3060224912 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fb8ec0044a0 con 0x556538b399a0 2024-09-05T13:03:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb90161b740 10 client.25759 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb90161b740 1 -- 172.21.15.73:0/3060224912 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55653887c620 con 0x556538b399a0 2024-09-05T13:03:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3060224912 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8f001c430 con 0x556538b399a0 2024-09-05T13:03:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3060224912 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7fb8ec026420 con 0x556538b399a0 2024-09-05T13:03:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb90161b740 10 client.25759 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb90161b740 10 client.25759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb90161b740 20 client.25759 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.062+0000 7fb90161b740 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556538b4fd50 0x556538b52210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.063+0000 7fb90161b740 4 client.25759 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.063+0000 7fb90161b740 1 -- 172.21.15.73:0/3060224912 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556538aaaa20 con 0x556538b4fd50 2024-09-05T13:03:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.063+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556538b4fd50 0x556538b52210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.065+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556538b4fd50 0x556538b52210 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b3b1c757eb37a1 server_cookie=c522dd2dd345925a in_seq=0 out_seq=0 2024-09-05T13:03:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.066+0000 7fb8d77fe640 10 client.25759 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.067+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3060224912 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556538aaaa20 con 0x556538b4fd50 2024-09-05T13:03:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.067+0000 7fb8d77fe640 10 client.25759 handle_command_reply: tid=0 2024-09-05T13:03:32.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.067+0000 7fb90161b740 1 client.25759 shutdown 2024-09-05T13:03:32.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.068+0000 7fb90161b740 1 -- 172.21.15.73:0/3060224912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 msgr2=0x556538b43bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:32.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.068+0000 7fb90161b740 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b43bc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec011960 tx=0x7fb8ec011d60 comp rx=0 tx=0).stop 2024-09-05T13:03:32.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.068+0000 7fb90161b740 1 -- 172.21.15.73:0/3060224912 shutdown_connections 2024-09-05T13:03:32.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.068+0000 7fb90161b740 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556538b4fd50 0x556538b52210 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.068+0000 7fb90161b740 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 0x556538b4b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.068+0000 7fb8d77fe640 0 client.25759 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.068+0000 7fb90161b740 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b3a2e0 0x556538b44100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.068+0000 7fb90161b740 1 --2- 172.21.15.73:0/3060224912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b399a0 0x556538b43bc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.069+0000 7fb90161b740 1 -- 172.21.15.73:0/3060224912 >> 172.21.15.73:0/3060224912 conn(0x556538b35010 msgr2=0x556538b36820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.069+0000 7fb90161b740 1 -- 172.21.15.73:0/3060224912 shutdown_connections 2024-09-05T13:03:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.069+0000 7fb90161b740 1 -- 172.21.15.73:0/3060224912 wait complete. 2024-09-05T13:03:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.069+0000 7fb90161b740 20 client.25759 trim_cache size 0 max 16384 2024-09-05T13:03:32.110 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.108+0000 7fb90161b740 1 Processor -- start 2024-09-05T13:03:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.109+0000 7fb90161b740 1 -- start start 2024-09-05T13:03:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.109+0000 7fb90161b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b399a0 0x556538b43970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.109+0000 7fb90161b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3a2e0 0x556538b4b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.109+0000 7fb90161b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 0x556538b43eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.109+0000 7fb90161b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f81b1e20 con 0x556538b3f370 2024-09-05T13:03:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.109+0000 7fb90161b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f81af690 con 0x556538b399a0 2024-09-05T13:03:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.109+0000 7fb90161b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f81ad4e0 con 0x556538b3a2e0 2024-09-05T13:03:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.110+0000 7fb8f7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b399a0 0x556538b43970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.112+0000 7fb8f77fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3a2e0 0x556538b4b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.113+0000 7fb8f77fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3a2e0 0x556538b4b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:54920/0 (socket says 172.21.15.73:54920) 2024-09-05T13:03:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.113+0000 7fb8f77fe640 1 -- 172.21.15.73:0/2763698442 learned_addr learned my addr 172.21.15.73:0/2763698442 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.115+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/2763698442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 0x556538b43eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.116+0000 7fb8f77fe640 1 -- 172.21.15.73:0/2763698442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b399a0 msgr2=0x556538b43970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.116+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/2763698442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b399a0 0x556538b43970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.116+0000 7fb8f77fe640 1 -- 172.21.15.73:0/2763698442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 msgr2=0x556538b43eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.116+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/2763698442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 0x556538b43eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.116+0000 7fb8f77fe640 1 -- 172.21.15.73:0/2763698442 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556538b3a7c0 con 0x556538b3a2e0 2024-09-05T13:03:32.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.120+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/2763698442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3a2e0 0x556538b4b100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80049d0 tx=0x7fb8e80b8040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6e4f9d78a0d4e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.125+0000 7fb8ddffb640 1 -- 172.21.15.73:0/2763698442 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e805b040 con 0x556538b3a2e0 2024-09-05T13:03:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.125+0000 7fb8ddffb640 1 -- 172.21.15.73:0/2763698442 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8e80cd210 con 0x556538b3a2e0 2024-09-05T13:03:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.125+0000 7fb8ddffb640 1 -- 172.21.15.73:0/2763698442 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8042510 con 0x556538b3a2e0 2024-09-05T13:03:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.131+0000 7fb90161b740 1 -- 172.21.15.73:0/2763698442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3a2e0 msgr2=0x556538b4b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.131+0000 7fb90161b740 1 --2- 172.21.15.73:0/2763698442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3a2e0 0x556538b4b100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80049d0 tx=0x7fb8e80b8040 comp rx=0 tx=0).stop 2024-09-05T13:03:32.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.136+0000 7fb90161b740 1 -- 172.21.15.73:0/2763698442 shutdown_connections 2024-09-05T13:03:32.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.136+0000 7fb90161b740 1 --2- 172.21.15.73:0/2763698442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3f370 0x556538b43eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.136+0000 7fb90161b740 1 --2- 172.21.15.73:0/2763698442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3a2e0 0x556538b4b100 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.136+0000 7fb90161b740 1 --2- 172.21.15.73:0/2763698442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b399a0 0x556538b43970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.136+0000 7fb90161b740 1 -- 172.21.15.73:0/2763698442 >> 172.21.15.73:0/2763698442 conn(0x556538b35010 msgr2=0x556538b43120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:32.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.139+0000 7fb90161b740 1 -- 172.21.15.73:0/2763698442 shutdown_connections 2024-09-05T13:03:32.144 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.143+0000 7fb90161b740 1 -- 172.21.15.73:0/2763698442 wait complete. 2024-09-05T13:03:32.144 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.143+0000 7fb90161b740 1 -- start start 2024-09-05T13:03:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.144+0000 7fb90161b740 1 Processor -- start 2024-09-05T13:03:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.145+0000 7fb90161b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b399a0 0x556538b48510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.145+0000 7fb90161b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b48a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.145+0000 7fb90161b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3f370 0x556538b499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.145+0000 7fb90161b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f81adb50 con 0x556538b3a2e0 2024-09-05T13:03:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.145+0000 7fb90161b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f81aefc0 con 0x556538b399a0 2024-09-05T13:03:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.145+0000 7fb90161b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f81ae220 con 0x556538b3f370 2024-09-05T13:03:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.145+0000 7fb90161b740 10 client.0 _ll_register_callbacks cb 0x7fb8ec00be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.146+0000 7fb8f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b48a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.147+0000 7fb8f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b48a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45408/0 (socket says 172.21.15.73:45408) 2024-09-05T13:03:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.147+0000 7fb8f77fe640 1 -- 172.21.15.73:0/3066787255 learned_addr learned my addr 172.21.15.73:0/3066787255 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.147+0000 7fb8fcd3c640 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3f370 0x556538b499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.147+0000 7fb8f77fe640 1 -- 172.21.15.73:0/3066787255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3f370 msgr2=0x556538b499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.147+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3f370 0x556538b499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.147+0000 7fb8f77fe640 1 -- 172.21.15.73:0/3066787255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b399a0 msgr2=0x556538b48510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.147+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b399a0 0x556538b48510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.147+0000 7fb8f77fe640 1 -- 172.21.15.73:0/3066787255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556538b4a000 con 0x556538b3a2e0 2024-09-05T13:03:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.148+0000 7fb8f77fe640 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b48a50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb8e801a2b0 tx=0x7fb8e803b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce6b60769d8e127 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.149+0000 7fb8d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:03:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.149+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3066787255 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80e5070 con 0x556538b3a2e0 2024-09-05T13:03:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.149+0000 7fb90161b740 1 -- 172.21.15.73:0/3066787255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8e80cd210 con 0x556538b3a2e0 2024-09-05T13:03:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.149+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3066787255 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb8e80c9ce0 con 0x556538b3a2e0 2024-09-05T13:03:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.149+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3066787255 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fb8e805b070 con 0x556538b3a2e0 2024-09-05T13:03:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.149+0000 7fb90161b740 10 client.16188 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.149+0000 7fb90161b740 1 -- 172.21.15.73:0/3066787255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x556538b4b310 con 0x556538b3a2e0 2024-09-05T13:03:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.150+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3066787255 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8e80cd210 con 0x556538b3a2e0 2024-09-05T13:03:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.150+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3066787255 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7fb8e80cd470 con 0x556538b3a2e0 2024-09-05T13:03:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.150+0000 7fb90161b740 10 client.16188 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.150+0000 7fb90161b740 10 client.16188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.150+0000 7fb90161b740 20 client.16188 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.150+0000 7fb90161b740 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556538b4fd50 0x556538bbd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.150+0000 7fb90161b740 4 client.16188 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:03:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.150+0000 7fb90161b740 1 -- 172.21.15.73:0/3066787255 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556538aa4d70 con 0x556538b4fd50 2024-09-05T13:03:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.151+0000 7fb8f7fff640 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556538b4fd50 0x556538bbd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.161+0000 7fb8f7fff640 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556538b4fd50 0x556538bbd140 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=315ef7c95e4072b0 server_cookie=ab39f5bda783be1a in_seq=0 out_seq=0 2024-09-05T13:03:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:32.161+0000 7fb8d77fe640 10 client.16188 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:32.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:32 smithi073 ceph-mon[30883]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 4.71k op/s 2024-09-05T13:03:32.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:32 smithi162 ceph-mon[34220]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 4.71k op/s 2024-09-05T13:03:32.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:32 smithi169 ceph-mon[34823]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 4.71k op/s 2024-09-05T13:03:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb8d77fe640 1 -- 172.21.15.73:0/3066787255 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556538aa4d70 con 0x556538b4fd50 2024-09-05T13:03:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb8d77fe640 10 client.16188 handle_command_reply: tid=0 2024-09-05T13:03:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb90161b740 1 client.16188 shutdown 2024-09-05T13:03:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb90161b740 1 -- 172.21.15.73:0/3066787255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 msgr2=0x556538b48a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb90161b740 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b48a50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb8e801a2b0 tx=0x7fb8e803b450 comp rx=0 tx=0).stop 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb90161b740 1 -- 172.21.15.73:0/3066787255 shutdown_connections 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb90161b740 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x556538b4fd50 0x556538bbd140 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb90161b740 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556538b3f370 0x556538b499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb90161b740 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556538b3a2e0 0x556538b48a50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb8d77fe640 0 client.16188 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.992+0000 7fb90161b740 1 --2- 172.21.15.73:0/3066787255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556538b399a0 0x556538b48510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.993+0000 7fb90161b740 1 -- 172.21.15.73:0/3066787255 >> 172.21.15.73:0/3066787255 conn(0x556538b35010 msgr2=0x556538b3e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.993+0000 7fb90161b740 1 -- 172.21.15.73:0/3066787255 shutdown_connections 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.993+0000 7fb90161b740 1 -- 172.21.15.73:0/3066787255 wait complete. 2024-09-05T13:03:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.993+0000 7fb90161b740 20 client.16188 trim_cache size 0 max 16384 2024-09-05T13:03:34.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:03:34.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:03:34.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:03:34.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.993+0000 7fb8fe79f640 1 -- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb8e00a2c80 msgr2=0x7fb8e00a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.993+0000 7fb8fe79f640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb8e00a2c80 0x7fb8e00a5140 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0023000 tx=0x7fb8f0024000 comp rx=0 tx=0).stop 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.994+0000 7fb8fe79f640 1 -- 172.21.15.73:0/24297509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8077df0 msgr2=0x7fb8f8108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.994+0000 7fb8fe79f640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8077df0 0x7fb8f8108bd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb8e801a860 tx=0x7fb8e8005490 comp rx=0 tx=0).stop 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.994+0000 7fb8fe79f640 1 -- 172.21.15.73:0/24297509 shutdown_connections 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.994+0000 7fb8fe79f640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fb8e00a2c80 0x7fb8e00a5140 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.994+0000 7fb8fe79f640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8f8078790 0x7fb8f810fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.994+0000 7fb8fe79f640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8077df0 0x7fb8f8108bd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.994+0000 7fb8fe79f640 1 --2- 172.21.15.73:0/24297509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f8076bb0 0x7fb8f8108690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.994+0000 7fb8fe79f640 1 -- 172.21.15.73:0/24297509 >> 172.21.15.73:0/24297509 conn(0x7fb8f80ff4e0 msgr2=0x7fb8f8100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.994+0000 7fb8fe79f640 1 -- 172.21.15.73:0/24297509 shutdown_connections 2024-09-05T13:03:34.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:34.994+0000 7fb8fe79f640 1 -- 172.21.15.73:0/24297509 wait complete. 2024-09-05T13:03:35.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:35 smithi073 ceph-mon[30883]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.04k op/s 2024-09-05T13:03:35.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:35 smithi162 ceph-mon[34220]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.04k op/s 2024-09-05T13:03:35.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:35 smithi169 ceph-mon[34823]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.04k op/s 2024-09-05T13:03:37.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:37 smithi073 ceph-mon[30883]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 5.72k op/s 2024-09-05T13:03:37.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:37 smithi162 ceph-mon[34220]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 5.72k op/s 2024-09-05T13:03:37.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:37 smithi169 ceph-mon[34823]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 5.72k op/s 2024-09-05T13:03:37.961 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T13:03:38.397 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:03:39.444 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:39 smithi073 ceph-mon[30883]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 MiB/s wr, 5.04k op/s 2024-09-05T13:03:39.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:39 smithi162 ceph-mon[34220]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 MiB/s wr, 5.04k op/s 2024-09-05T13:03:39.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:39 smithi169 ceph-mon[34823]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 MiB/s wr, 5.04k op/s 2024-09-05T13:03:41.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.273+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3701162300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bc4099150 msgr2=0x7f5bc4099530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:41.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.273+0000 7f5bcb59e640 1 --2- 172.21.15.73:0/3701162300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bc4099150 0x7f5bc4099530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009860 tx=0x7f5bbc02a3d0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.274+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3701162300 shutdown_connections 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.274+0000 7f5bcb59e640 1 --2- 172.21.15.73:0/3701162300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc40a6500 0x7f5bc40a88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.274+0000 7f5bcb59e640 1 --2- 172.21.15.73:0/3701162300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc4099a70 0x7f5bc40a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.274+0000 7f5bcb59e640 1 --2- 172.21.15.73:0/3701162300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bc4099150 0x7f5bc4099530 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.274+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3701162300 >> 172.21.15.73:0/3701162300 conn(0x7f5bc400abc0 msgr2=0x7f5bc400afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.275+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3701162300 shutdown_connections 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.276+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3701162300 wait complete. 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.277+0000 7f5bcb59e640 1 Processor -- start 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.278+0000 7f5bcb59e640 1 -- start start 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.279+0000 7f5bcb59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc4099150 0x7f5bc40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.279+0000 7f5bcb59e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc4099a70 0x7f5bc409c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.279+0000 7f5bcb59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bc40a6500 0x7f5bc409cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.279+0000 7f5bcb59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc40abf70 con 0x7f5bc4099150 2024-09-05T13:03:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.279+0000 7f5bcb59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc40abdf0 con 0x7f5bc40a6500 2024-09-05T13:03:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.279+0000 7f5bcb59e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc40ac0f0 con 0x7f5bc4099a70 2024-09-05T13:03:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.279+0000 7f5bcad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bc40a6500 0x7f5bc409cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.279+0000 7f5bcad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bc40a6500 0x7f5bc409cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42946/0 (socket says 172.21.15.73:42946) 2024-09-05T13:03:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.279+0000 7f5bcad9d640 1 -- 172.21.15.73:0/3980426228 learned_addr learned my addr 172.21.15.73:0/3980426228 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.280+0000 7f5bca59c640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc4099150 0x7f5bc40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.280+0000 7f5bca59c640 1 -- 172.21.15.73:0/3980426228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc4099a70 msgr2=0x7f5bc409c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.280+0000 7f5bca59c640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc4099a70 0x7f5bc409c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.280+0000 7f5bca59c640 1 -- 172.21.15.73:0/3980426228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bc40a6500 msgr2=0x7f5bc409cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.280+0000 7f5bca59c640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bc40a6500 0x7f5bc409cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.280+0000 7f5bca59c640 1 -- 172.21.15.73:0/3980426228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc409d0e0 con 0x7f5bc4099150 2024-09-05T13:03:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.280+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bc40a6500 0x7f5bc409cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:03:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.281+0000 7f5bca59c640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc4099150 0x7f5bc40a3550 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc02a8f0 tx=0x7f5bbc030940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:41.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.283+0000 7f5bbb7fe640 1 -- 172.21.15.73:0/3980426228 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc040070 con 0x7f5bc4099150 2024-09-05T13:03:41.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.283+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3980426228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc409d370 con 0x7f5bc4099150 2024-09-05T13:03:41.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.283+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3980426228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc40a1300 con 0x7f5bc4099150 2024-09-05T13:03:41.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.285+0000 7f5bbb7fe640 1 -- 172.21.15.73:0/3980426228 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bbc005460 con 0x7f5bc4099150 2024-09-05T13:03:41.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.285+0000 7f5bbb7fe640 1 -- 172.21.15.73:0/3980426228 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc004be0 con 0x7f5bc4099150 2024-09-05T13:03:41.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.287+0000 7f5bbb7fe640 1 -- 172.21.15.73:0/3980426228 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5bbc043070 con 0x7f5bc4099150 2024-09-05T13:03:41.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.288+0000 7f5bbb7fe640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5bb40a2d60 0x7f5bb40a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.289+0000 7f5bbb7fe640 1 -- 172.21.15.73:0/3980426228 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f5bbc0f0c20 con 0x7f5bc4099150 2024-09-05T13:03:41.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.289+0000 7f5bc9d9b640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5bb40a2d60 0x7f5bb40a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.292+0000 7f5bd2bf7740 1 Processor -- start 2024-09-05T13:03:41.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.293+0000 7f5bc9d9b640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5bb40a2d60 0x7f5bb40a5220 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00058c0 tx=0x7f5bc0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:41.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.294+0000 7f5bd2bf7740 1 -- start start 2024-09-05T13:03:41.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.294+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a549130670 0x55a549130a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.294+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a54913b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.294+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54913b850 0x55a54913dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.294+0000 7f5bd2bf7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a5490962e0 con 0x55a549130670 2024-09-05T13:03:41.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.294+0000 7f5bd2bf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a54903dce0 con 0x55a54913b850 2024-09-05T13:03:41.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.294+0000 7f5bd2bf7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a5490922a0 con 0x55a549130f90 2024-09-05T13:03:41.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.295+0000 7f5bcad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54913b850 0x55a54913dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.295+0000 7f5bcad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54913b850 0x55a54913dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42954/0 (socket says 172.21.15.73:42954) 2024-09-05T13:03:41.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.295+0000 7f5bcad9d640 1 -- 172.21.15.73:0/1674206298 learned_addr learned my addr 172.21.15.73:0/1674206298 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:41.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.295+0000 7f5bca59c640 1 --2- 172.21.15.73:0/1674206298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a549130670 0x55a549130a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.295+0000 7f5bc9d9b640 1 --2- 172.21.15.73:0/1674206298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a54913b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.295+0000 7f5bcad9d640 1 -- 172.21.15.73:0/1674206298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 msgr2=0x55a54913b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:41.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.295+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/1674206298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a54913b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.295+0000 7f5bcad9d640 1 -- 172.21.15.73:0/1674206298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a549130670 msgr2=0x55a549130a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:41.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.295+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/1674206298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a549130670 0x55a549130a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.295+0000 7f5bcad9d640 1 -- 172.21.15.73:0/1674206298 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a549022440 con 0x55a54913b850 2024-09-05T13:03:41.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.298+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/1674206298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54913b850 0x55a54913dc40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc051790 tx=0x7f5bcc06b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b98ffc3d51b52dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:41.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.298+0000 7f5bb8ff9640 1 -- 172.21.15.73:0/1674206298 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc080bf0 con 0x55a54913b850 2024-09-05T13:03:41.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.298+0000 7f5bb8ff9640 1 -- 172.21.15.73:0/1674206298 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bcc080d90 con 0x55a54913b850 2024-09-05T13:03:41.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.298+0000 7f5bb8ff9640 1 -- 172.21.15.73:0/1674206298 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc07d640 con 0x55a54913b850 2024-09-05T13:03:41.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.300+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1674206298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54913b850 msgr2=0x55a54913dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:41.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.300+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/1674206298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54913b850 0x55a54913dc40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc051790 tx=0x7f5bcc06b7a0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.302+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1674206298 shutdown_connections 2024-09-05T13:03:41.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.302+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/1674206298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54913b850 0x55a54913dc40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.302+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/1674206298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a54913b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.302+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/1674206298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a549130670 0x55a549130a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.302+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1674206298 >> 172.21.15.73:0/1674206298 conn(0x55a54912cc00 msgr2=0x55a54912cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:41.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.306+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1674206298 shutdown_connections 2024-09-05T13:03:41.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.306+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1674206298 wait complete. 2024-09-05T13:03:41.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.306+0000 7f5bd2bf7740 1 -- start start 2024-09-05T13:03:41.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.306+0000 7f5bd2bf7740 1 Processor -- start 2024-09-05T13:03:41.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.307+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130670 0x55a54913b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.307+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a5491383b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.307+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54913b850 0x55a5491388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.307+0000 7f5bd2bf7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a54913e420 con 0x55a54913b850 2024-09-05T13:03:41.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.307+0000 7f5bd2bf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a549051050 con 0x55a549130670 2024-09-05T13:03:41.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.307+0000 7f5bd2bf7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a54913e5a0 con 0x55a549130f90 2024-09-05T13:03:41.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.307+0000 7f5bd2bf7740 10 client.0 _ll_register_callbacks cb 0x55a549091160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:41.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.311+0000 7f5bcad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54913b850 0x55a5491388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.311+0000 7f5bcad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54913b850 0x55a5491388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52648/0 (socket says 172.21.15.73:52648) 2024-09-05T13:03:41.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.311+0000 7f5bcad9d640 1 -- 172.21.15.73:0/1428485919 learned_addr learned my addr 172.21.15.73:0/1428485919 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:41.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.311+0000 7f5bc9d9b640 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a5491383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.311+0000 7f5bcad9d640 1 -- 172.21.15.73:0/1428485919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 msgr2=0x55a5491383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:41.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.311+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a5491383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.311+0000 7f5bcad9d640 1 -- 172.21.15.73:0/1428485919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130670 msgr2=0x55a54913b100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:03:41.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.311+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130670 0x55a54913b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.311+0000 7f5bcad9d640 1 -- 172.21.15.73:0/1428485919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a548e073c0 con 0x55a54913b850 2024-09-05T13:03:41.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.312+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54913b850 0x55a5491388f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc000b60 tx=0x7f5bcc068410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24ade09194631cc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:41.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.312+0000 7f5bb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:03:41.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.313+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/1428485919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc06de00 con 0x55a54913b850 2024-09-05T13:03:41.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.313+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1428485919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bcc080d90 con 0x55a54913b850 2024-09-05T13:03:41.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.313+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/1428485919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f5bcc06bcc0 con 0x55a54913b850 2024-09-05T13:03:41.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.313+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/1428485919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f5bcc06d110 con 0x55a54913b850 2024-09-05T13:03:41.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.313+0000 7f5bd2bf7740 10 client.16200 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:41.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.313+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1428485919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a54915ada0 con 0x55a54913b850 2024-09-05T13:03:41.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.314+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/1428485919 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bcc080d90 con 0x55a54913b850 2024-09-05T13:03:41.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.314+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/1428485919 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f5bcc0747f0 con 0x55a54913b850 2024-09-05T13:03:41.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.314+0000 7f5bd2bf7740 10 client.16200 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:41.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.314+0000 7f5bd2bf7740 10 client.16200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:41.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.314+0000 7f5bd2bf7740 20 client.16200 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:41.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.314+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a54915c610 0x55a54915ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.314+0000 7f5bd2bf7740 4 client.16200 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:41.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.314+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1428485919 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5490a3850 con 0x55a54915c610 2024-09-05T13:03:41.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.319+0000 7f5bca59c640 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a54915c610 0x55a54915ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.320+0000 7f5bb1ffb640 10 client.16200 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:41.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.320+0000 7f5bca59c640 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a54915c610 0x55a54915ea90 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65998195ebb0e7d2 server_cookie=d3f2ff669cf2b106 in_seq=0 out_seq=0 2024-09-05T13:03:41.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.322+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/1428485919 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5490a3850 con 0x55a54915c610 2024-09-05T13:03:41.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.323+0000 7f5bb1ffb640 10 client.16200 handle_command_reply: tid=0 2024-09-05T13:03:41.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.323+0000 7f5bd2bf7740 1 client.16200 shutdown 2024-09-05T13:03:41.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.323+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1428485919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54913b850 msgr2=0x55a5491388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:41.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.323+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54913b850 0x55a5491388f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc000b60 tx=0x7f5bcc068410 comp rx=0 tx=0).stop 2024-09-05T13:03:41.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.327+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1428485919 shutdown_connections 2024-09-05T13:03:41.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.327+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a54915c610 0x55a54915ea90 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.327+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54913b850 0x55a5491388f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.327+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a5491383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.327+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/1428485919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130670 0x55a54913b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.327+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1428485919 >> 172.21.15.73:0/1428485919 conn(0x55a54912cc00 msgr2=0x55a549132930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:41.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.327+0000 7f5bb1ffb640 0 client.16200 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:41.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.329+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1428485919 shutdown_connections 2024-09-05T13:03:41.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.329+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/1428485919 wait complete. 2024-09-05T13:03:41.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.329+0000 7f5bd2bf7740 20 client.16200 trim_cache size 0 max 16384 2024-09-05T13:03:41.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.362+0000 7f5bd2bf7740 1 Processor -- start 2024-09-05T13:03:41.363 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:41 smithi073 ceph-mon[30883]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 5.26k op/s 2024-09-05T13:03:41.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.362+0000 7f5bd2bf7740 1 -- start start 2024-09-05T13:03:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.363+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 0x55a549138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.363+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130670 0x55a549133930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.363+0000 7f5bca59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 0x55a549138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.363+0000 7f5bca59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 0x55a549138370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52664/0 (socket says 172.21.15.73:52664) 2024-09-05T13:03:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.363+0000 7f5bca59c640 1 -- 172.21.15.73:0/3362642624 learned_addr learned my addr 172.21.15.73:0/3362642624 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.363+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/3362642624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a5491643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.363+0000 7f5bc9d9b640 1 --2- 172.21.15.73:0/3362642624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130670 0x55a549133930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.364+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/3362642624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac010d60 con 0x55a54912cc00 2024-09-05T13:03:41.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.364+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/3362642624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a5491643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.364+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/3362642624 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac00e5d0 con 0x55a549130670 2024-09-05T13:03:41.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.364+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/3362642624 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac00c420 con 0x55a549130f90 2024-09-05T13:03:41.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.365+0000 7f5bca59c640 1 -- 172.21.15.73:0/3362642624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 msgr2=0x55a5491643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:41.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.365+0000 7f5bca59c640 1 --2- 172.21.15.73:0/3362642624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a5491643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.365+0000 7f5bca59c640 1 -- 172.21.15.73:0/3362642624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130670 msgr2=0x55a549133930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:41.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.365+0000 7f5bca59c640 1 --2- 172.21.15.73:0/3362642624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130670 0x55a549133930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.365+0000 7f5bca59c640 1 -- 172.21.15.73:0/3362642624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a549137360 con 0x55a54912cc00 2024-09-05T13:03:41.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.366+0000 7f5bca59c640 1 --2- 172.21.15.73:0/3362642624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 0x55a549138370 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0b9e20 tx=0x7f5bbc0b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61b2152e5e790eb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:41.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.366+0000 7f5bb3fff640 1 -- 172.21.15.73:0/3362642624 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0d6070 con 0x55a54912cc00 2024-09-05T13:03:41.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.366+0000 7f5bb3fff640 1 -- 172.21.15.73:0/3362642624 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bbc0c60c0 con 0x55a54912cc00 2024-09-05T13:03:41.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.366+0000 7f5bb3fff640 1 -- 172.21.15.73:0/3362642624 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc04a040 con 0x55a54912cc00 2024-09-05T13:03:41.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.370+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/3362642624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 msgr2=0x55a549138370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:41.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.370+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/3362642624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 0x55a549138370 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0b9e20 tx=0x7f5bbc0b9040 comp rx=0 tx=0).stop 2024-09-05T13:03:41.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.371+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/3362642624 shutdown_connections 2024-09-05T13:03:41.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.371+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/3362642624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130f90 0x55a5491643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.371+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/3362642624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130670 0x55a549133930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.371+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/3362642624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 0x55a549138370 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.371+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/3362642624 >> 172.21.15.73:0/3362642624 conn(0x55a549138a50 msgr2=0x55a549133220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.372+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/3362642624 shutdown_connections 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.372+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/3362642624 wait complete. 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.372+0000 7f5bd2bf7740 1 -- start start 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.372+0000 7f5bd2bf7740 1 Processor -- start 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.373+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 0x55a549143d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.373+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130670 0x55a54913f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.373+0000 7f5bd2bf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130f90 0x55a54913f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.374+0000 7f5bd2bf7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac00ca90 con 0x55a54912cc00 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.374+0000 7f5bd2bf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac00df00 con 0x55a549130f90 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.374+0000 7f5bd2bf7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac00d160 con 0x55a549130670 2024-09-05T13:03:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.374+0000 7f5bd2bf7740 10 client.0 _ll_register_callbacks cb 0x7f5bcc069150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.374+0000 7f5bcad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130f90 0x55a54913f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.374+0000 7f5bcad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130f90 0x55a54913f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42982/0 (socket says 172.21.15.73:42982) 2024-09-05T13:03:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.374+0000 7f5bcad9d640 1 -- 172.21.15.73:0/144860672 learned_addr learned my addr 172.21.15.73:0/144860672 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.375+0000 7f5bc9d9b640 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130670 0x55a54913f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.375+0000 7f5bcad9d640 1 -- 172.21.15.73:0/144860672 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130670 msgr2=0x55a54913f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.375+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130670 0x55a54913f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.375+0000 7f5bcad9d640 1 -- 172.21.15.73:0/144860672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 msgr2=0x55a549143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:41.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.375+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 0x55a549143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.375+0000 7f5bcad9d640 1 -- 172.21.15.73:0/144860672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a549130dc0 con 0x55a549130f90 2024-09-05T13:03:41.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.377+0000 7f5bcad9d640 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130f90 0x55a54913f600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc067bf0 tx=0x7f5bcc095f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a73cf56089320821 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:41.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.377+0000 7f5bb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:03:41.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.377+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/144860672 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc074de0 con 0x55a549130f90 2024-09-05T13:03:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.377+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/144860672 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f5bcc095460 con 0x55a549130f90 2024-09-05T13:03:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.377+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/144860672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bbc0c60c0 con 0x55a549130f90 2024-09-05T13:03:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.378+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/144860672 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f5bcc06d2b0 con 0x55a549130f90 2024-09-05T13:03:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.378+0000 7f5bd2bf7740 10 client.25679 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:41.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.378+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/144860672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a5491c6fc0 con 0x55a549130f90 2024-09-05T13:03:41.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.379+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/144860672 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bcc08e070 con 0x55a549130f90 2024-09-05T13:03:41.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.379+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/144860672 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f5bcc06dce0 con 0x55a549130f90 2024-09-05T13:03:41.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.379+0000 7f5bd2bf7740 10 client.25679 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:41.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.379+0000 7f5bd2bf7740 10 client.25679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:41.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.379+0000 7f5bd2bf7740 20 client.25679 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:41.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.379+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a54913b850 0x55a5491c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:41.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.379+0000 7f5bd2bf7740 4 client.25679 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T13:03:41.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.379+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/144860672 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f5bbc0c60c0 con 0x55a54913b850 2024-09-05T13:03:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.381+0000 7f5bca59c640 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a54913b850 0x55a5491c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.382+0000 7f5bca59c640 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a54913b850 0x55a5491c96a0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89bd9467d3c0353f server_cookie=f2959f492fc63111 in_seq=0 out_seq=0 2024-09-05T13:03:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.382+0000 7f5bb1ffb640 10 client.25679 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.382+0000 7f5bb1ffb640 1 -- 172.21.15.73:0/144860672 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f5bbc0c60c0 con 0x55a54913b850 2024-09-05T13:03:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.382+0000 7f5bb1ffb640 10 client.25679 handle_command_reply: tid=0 2024-09-05T13:03:41.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.382+0000 7f5bd2bf7740 1 client.25679 shutdown 2024-09-05T13:03:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.384+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/144860672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130f90 msgr2=0x55a54913f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.384+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130f90 0x55a54913f600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc067bf0 tx=0x7f5bcc095f60 comp rx=0 tx=0).stop 2024-09-05T13:03:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.384+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/144860672 shutdown_connections 2024-09-05T13:03:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.384+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a54913b850 0x55a5491c96a0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.384+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a549130f90 0x55a54913f600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.384+0000 7f5bb1ffb640 0 client.25679 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.384+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a549130670 0x55a54913f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.384+0000 7f5bd2bf7740 1 --2- 172.21.15.73:0/144860672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a54912cc00 0x55a549143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.385+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/144860672 >> 172.21.15.73:0/144860672 conn(0x55a549138a50 msgr2=0x55a549133a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:41.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.386+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/144860672 shutdown_connections 2024-09-05T13:03:41.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.388+0000 7f5bd2bf7740 1 -- 172.21.15.73:0/144860672 wait complete. 2024-09-05T13:03:41.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.388+0000 7f5bd2bf7740 20 client.25679 trim_cache size 0 max 16384 2024-09-05T13:03:41.389 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:03:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2024-09-05T13:03:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2024-09-05T13:03:41.389 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:03:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.388+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5bb40a2d60 msgr2=0x7f5bb40a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.388+0000 7f5bcb59e640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5bb40a2d60 0x7f5bb40a5220 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00058c0 tx=0x7f5bc0005850 comp rx=0 tx=0).stop 2024-09-05T13:03:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.388+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc4099150 msgr2=0x7f5bc40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.388+0000 7f5bcb59e640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc4099150 0x7f5bc40a3550 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc02a8f0 tx=0x7f5bbc030940 comp rx=0 tx=0).stop 2024-09-05T13:03:41.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.389+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3980426228 shutdown_connections 2024-09-05T13:03:41.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.389+0000 7f5bcb59e640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f5bb40a2d60 0x7f5bb40a5220 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.389+0000 7f5bcb59e640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bc40a6500 0x7f5bc409cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.389+0000 7f5bcb59e640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc4099a70 0x7f5bc409c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.389+0000 7f5bcb59e640 1 --2- 172.21.15.73:0/3980426228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc4099150 0x7f5bc40a3550 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:41.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.389+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3980426228 >> 172.21.15.73:0/3980426228 conn(0x7f5bc400abc0 msgr2=0x7f5bc40a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:41.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.389+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3980426228 shutdown_connections 2024-09-05T13:03:41.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:41.389+0000 7f5bcb59e640 1 -- 172.21.15.73:0/3980426228 wait complete. 2024-09-05T13:03:41.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:41 smithi162 ceph-mon[34220]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 5.26k op/s 2024-09-05T13:03:41.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:41 smithi169 ceph-mon[34823]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 5.26k op/s 2024-09-05T13:03:42.256 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T13:03:42.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T13:03:42.681 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:03:43.443 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:43 smithi073 ceph-mon[30883]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.46k op/s 2024-09-05T13:03:43.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.591+0000 7fdbd924a640 1 -- 172.21.15.73:0/1493049724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd411b140 msgr2=0x7fdbd411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:43.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.591+0000 7fdbd924a640 1 --2- 172.21.15.73:0/1493049724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd411b140 0x7fdbd411d530 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009ca0 tx=0x7fdbcc02a8f0 comp rx=0 tx=0).stop 2024-09-05T13:03:43.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.593+0000 7fdbd924a640 1 -- 172.21.15.73:0/1493049724 shutdown_connections 2024-09-05T13:03:43.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.593+0000 7fdbd924a640 1 --2- 172.21.15.73:0/1493049724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd411b140 0x7fdbd411d530 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:43.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.593+0000 7fdbd924a640 1 --2- 172.21.15.73:0/1493049724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbd4109830 0x7fdbd4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:43.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.593+0000 7fdbd924a640 1 --2- 172.21.15.73:0/1493049724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4109450 0x7fdbd4110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:43.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.593+0000 7fdbd924a640 1 -- 172.21.15.73:0/1493049724 >> 172.21.15.73:0/1493049724 conn(0x7fdbd406e140 msgr2=0x7fdbd406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:43.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.595+0000 7fdbd924a640 1 -- 172.21.15.73:0/1493049724 shutdown_connections 2024-09-05T13:03:43.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.595+0000 7fdbd924a640 1 -- 172.21.15.73:0/1493049724 wait complete. 2024-09-05T13:03:43.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.597+0000 7fdbd924a640 1 Processor -- start 2024-09-05T13:03:43.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.597+0000 7fdbd924a640 1 -- start start 2024-09-05T13:03:43.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.597+0000 7fdbd924a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4109450 0x7fdbd411a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:43.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.598+0000 7fdbd924a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbd4109830 0x7fdbd4113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:43.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.598+0000 7fdbd924a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd411b140 0x7fdbd4113d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:43.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.598+0000 7fdbd924a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4120e80 con 0x7fdbd411b140 2024-09-05T13:03:43.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.598+0000 7fdbd924a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4120d00 con 0x7fdbd4109830 2024-09-05T13:03:43.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.598+0000 7fdbd924a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4121000 con 0x7fdbd4109450 2024-09-05T13:03:43.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.599+0000 7fdbd259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbd4109830 0x7fdbd4113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:43.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.599+0000 7fdbd2d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4109450 0x7fdbd411a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:43.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.599+0000 7fdbd259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbd4109830 0x7fdbd4113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39078/0 (socket says 172.21.15.73:39078) 2024-09-05T13:03:43.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.599+0000 7fdbd259c640 1 -- 172.21.15.73:0/3150333132 learned_addr learned my addr 172.21.15.73:0/3150333132 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.601+0000 7fdbd259c640 1 -- 172.21.15.73:0/3150333132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4109450 msgr2=0x7fdbd411a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.601+0000 7fdbd359e640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd411b140 0x7fdbd4113d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.601+0000 7fdbd259c640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4109450 0x7fdbd411a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.602+0000 7fdbd259c640 1 -- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd411b140 msgr2=0x7fdbd4113d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:43.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.602+0000 7fdbd259c640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd411b140 0x7fdbd4113d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:43.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.602+0000 7fdbd259c640 1 -- 172.21.15.73:0/3150333132 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd4114350 con 0x7fdbd4109830 2024-09-05T13:03:43.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.602+0000 7fdbd359e640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd411b140 0x7fdbd4113d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:03:43.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.607+0000 7fdbd259c640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbd4109830 0x7fdbd4113800 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00b450 tx=0x7fdbbc00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:43.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:43 smithi162 ceph-mon[34220]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.46k op/s 2024-09-05T13:03:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.612+0000 7fdbcbfff640 1 -- 172.21.15.73:0/3150333132 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc015020 con 0x7fdbd4109830 2024-09-05T13:03:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.612+0000 7fdbcbfff640 1 -- 172.21.15.73:0/3150333132 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbbc011d70 con 0x7fdbd4109830 2024-09-05T13:03:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.612+0000 7fdbcbfff640 1 -- 172.21.15.73:0/3150333132 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00f340 con 0x7fdbd4109830 2024-09-05T13:03:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.612+0000 7fdbd924a640 1 -- 172.21.15.73:0/3150333132 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd4114640 con 0x7fdbd4109830 2024-09-05T13:03:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.612+0000 7fdbd924a640 1 -- 172.21.15.73:0/3150333132 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd41185c0 con 0x7fdbd4109830 2024-09-05T13:03:43.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.616+0000 7fdbd924a640 1 -- 172.21.15.73:0/3150333132 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb4005290 con 0x7fdbd4109830 2024-09-05T13:03:43.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:43 smithi169 ceph-mon[34823]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.46k op/s 2024-09-05T13:03:43.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.625+0000 7fdbcbfff640 1 -- 172.21.15.73:0/3150333132 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdbbc018020 con 0x7fdbd4109830 2024-09-05T13:03:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.626+0000 7fdbcbfff640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdbc00a2d90 0x7fdbc00a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.626+0000 7fdbcbfff640 1 -- 172.21.15.73:0/3150333132 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fdbbc0ceea0 con 0x7fdbd4109830 2024-09-05T13:03:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.627+0000 7fdbd2d9d640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdbc00a2d90 0x7fdbc00a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.627+0000 7fdbcbfff640 1 -- 172.21.15.73:0/3150333132 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdbbc01f020 con 0x7fdbd4109830 2024-09-05T13:03:43.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:43.631+0000 7fdbd2d9d640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdbc00a2d90 0x7fdbc00a5250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400a7d0 tx=0x7fdbc4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:44.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.037+0000 7fdbd924a640 1 -- 172.21.15.73:0/3150333132 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbb4005580 con 0x7fdbd4109830 2024-09-05T13:03:44.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.038+0000 7fdbcbfff640 1 -- 172.21.15.73:0/3150333132 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11929 (secure 0 0 0) 0x7fdbbc00d040 con 0x7fdbd4109830 2024-09-05T13:03:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T13:03:44.040 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":41,"btime":"2024-09-05T13:02:55:169982+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T13:02:54.549389+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25159":{"gid":25159,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/4110365542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":4110365542},{"type":"v1","addr":"172.21.15.169:6837","nonce":4110365542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T13:03:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 41 2024-09-05T13:03:44.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.046+0000 7fdbd924a640 1 -- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdbc00a2d90 msgr2=0x7fdbc00a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:44.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.046+0000 7fdbd924a640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdbc00a2d90 0x7fdbc00a5250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400a7d0 tx=0x7fdbc4008040 comp rx=0 tx=0).stop 2024-09-05T13:03:44.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.046+0000 7fdbd924a640 1 -- 172.21.15.73:0/3150333132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbd4109830 msgr2=0x7fdbd4113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:44.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.046+0000 7fdbd924a640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbd4109830 0x7fdbd4113800 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00b450 tx=0x7fdbbc00b910 comp rx=0 tx=0).stop 2024-09-05T13:03:44.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.048+0000 7fdbd924a640 1 -- 172.21.15.73:0/3150333132 shutdown_connections 2024-09-05T13:03:44.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.049+0000 7fdbd924a640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fdbc00a2d90 0x7fdbc00a5250 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:44.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.049+0000 7fdbd924a640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd411b140 0x7fdbd4113d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:44.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.049+0000 7fdbd924a640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbd4109830 0x7fdbd4113800 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:44.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.049+0000 7fdbd924a640 1 --2- 172.21.15.73:0/3150333132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4109450 0x7fdbd411a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:44.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.049+0000 7fdbd924a640 1 -- 172.21.15.73:0/3150333132 >> 172.21.15.73:0/3150333132 conn(0x7fdbd406e140 msgr2=0x7fdbd4070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:44.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.051+0000 7fdbd924a640 1 -- 172.21.15.73:0/3150333132 shutdown_connections 2024-09-05T13:03:44.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:44.053+0000 7fdbd924a640 1 -- 172.21.15.73:0/3150333132 wait complete. 2024-09-05T13:03:44.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:44 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3150333132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:03:44.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:44 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3150333132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:03:44.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:44 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3150333132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:03:45.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:45 smithi073 ceph-mon[30883]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 MiB/s wr, 4.91k op/s 2024-09-05T13:03:45.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:45 smithi162 ceph-mon[34220]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 MiB/s wr, 4.91k op/s 2024-09-05T13:03:45.518 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:45 smithi169 ceph-mon[34823]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 MiB/s wr, 4.91k op/s 2024-09-05T13:03:46.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:46 smithi073 ceph-mon[30883]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 5.54k op/s 2024-09-05T13:03:46.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:46 smithi162 ceph-mon[34220]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 5.54k op/s 2024-09-05T13:03:46.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:46 smithi169 ceph-mon[34823]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 5.54k op/s 2024-09-05T13:03:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.225+0000 7f593f8d9640 1 -- 172.21.15.73:0/2878334868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5938103710 msgr2=0x7f5938109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.225+0000 7f593f8d9640 1 --2- 172.21.15.73:0/2878334868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5938103710 0x7f5938109fa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f592c009900 tx=0x7f592c02a410 comp rx=0 tx=0).stop 2024-09-05T13:03:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.225+0000 7f593f8d9640 1 -- 172.21.15.73:0/2878334868 shutdown_connections 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.225+0000 7f593f8d9640 1 --2- 172.21.15.73:0/2878334868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5938103710 0x7f5938109fa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.225+0000 7f593f8d9640 1 --2- 172.21.15.73:0/2878334868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5938102d50 0x7f59381031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.225+0000 7f593f8d9640 1 --2- 172.21.15.73:0/2878334868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938101b60 0x7f5938101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.225+0000 7f593f8d9640 1 -- 172.21.15.73:0/2878334868 >> 172.21.15.73:0/2878334868 conn(0x7f59380fd2e0 msgr2=0x7f59380ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.225+0000 7f593f8d9640 1 -- 172.21.15.73:0/2878334868 shutdown_connections 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.225+0000 7f593f8d9640 1 -- 172.21.15.73:0/2878334868 wait complete. 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.226+0000 7f593f8d9640 1 Processor -- start 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.226+0000 7f593f8d9640 1 -- start start 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.226+0000 7f593f8d9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5938101b60 0x7f5938197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593f8d9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5938102d50 0x7f5938198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593f8d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938103710 0x7f593819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593f8d9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f593810d860 con 0x7f5938102d50 2024-09-05T13:03:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593f8d9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f593810d6e0 con 0x7f5938103710 2024-09-05T13:03:48.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593f8d9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f593810d9e0 con 0x7f5938101b60 2024-09-05T13:03:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593d675640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5938101b60 0x7f5938197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593ce74640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5938102d50 0x7f5938198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593de76640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938103710 0x7f593819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593ce74640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5938102d50 0x7f5938198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47036/0 (socket says 172.21.15.73:47036) 2024-09-05T13:03:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593de76640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938103710 0x7f593819f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39108/0 (socket says 172.21.15.73:39108) 2024-09-05T13:03:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593ce74640 1 -- 172.21.15.73:0/2214272935 learned_addr learned my addr 172.21.15.73:0/2214272935 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593ce74640 1 -- 172.21.15.73:0/2214272935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5938101b60 msgr2=0x7f5938197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593ce74640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5938101b60 0x7f5938197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593ce74640 1 -- 172.21.15.73:0/2214272935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938103710 msgr2=0x7f593819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593ce74640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938103710 0x7f593819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593ce74640 1 -- 172.21.15.73:0/2214272935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5938074520 con 0x7f5938102d50 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.227+0000 7f593de76640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938103710 0x7f593819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.228+0000 7f593ce74640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5938102d50 0x7f5938198310 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f592800ba50 tx=0x7f592800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.228+0000 7f59367fc640 1 -- 172.21.15.73:0/2214272935 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5928019070 con 0x7f5938102d50 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.228+0000 7f593f8d9640 1 -- 172.21.15.73:0/2214272935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5938074810 con 0x7f5938102d50 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.228+0000 7f59367fc640 1 -- 172.21.15.73:0/2214272935 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f592800cbe0 con 0x7f5938102d50 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.228+0000 7f59367fc640 1 -- 172.21.15.73:0/2214272935 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59280076e0 con 0x7f5938102d50 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.228+0000 7f593f8d9640 1 -- 172.21.15.73:0/2214272935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5938074de0 con 0x7f5938102d50 2024-09-05T13:03:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.230+0000 7f59367fc640 1 -- 172.21.15.73:0/2214272935 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f592801c070 con 0x7f5938102d50 2024-09-05T13:03:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.231+0000 7f594266e740 1 Processor -- start 2024-09-05T13:03:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.231+0000 7f59367fc640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59200a2cb0 0x7f59200a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.231+0000 7f594266e740 1 -- start start 2024-09-05T13:03:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f59367fc640 1 -- 172.21.15.73:0/2214272935 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f59280ce600 con 0x7f5938102d50 2024-09-05T13:03:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f594266e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 0x5576c53f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f594266e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f594266e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 0x5576c53fb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f594266e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5576c53572f0 con 0x5576c53f39a0 2024-09-05T13:03:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f594266e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5576c52ff270 con 0x5576c53f42e0 2024-09-05T13:03:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f594266e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5576c53532b0 con 0x5576c53f9370 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593de76640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59200a2cb0 0x7f59200a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593d675640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 0x5576c53f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593d675640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 0x5576c53f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47044/0 (socket says 172.21.15.73:47044) 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593d675640 1 -- 172.21.15.73:0/925782317 learned_addr learned my addr 172.21.15.73:0/925782317 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593de76640 1 --2- 172.21.15.73:0/925782317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 0x5576c53fb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593ce74640 1 --2- 172.21.15.73:0/925782317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593d675640 1 -- 172.21.15.73:0/925782317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 msgr2=0x5576c53fb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593d675640 1 --2- 172.21.15.73:0/925782317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 0x5576c53fb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593d675640 1 -- 172.21.15.73:0/925782317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 msgr2=0x5576c53f8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593d675640 1 --2- 172.21.15.73:0/925782317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53f8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593d675640 1 -- 172.21.15.73:0/925782317 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c52fe340 con 0x5576c53f39a0 2024-09-05T13:03:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593ce74640 1 --2- 172.21.15.73:0/925782317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:03:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593de76640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59200a2cb0 0x7f59200a5170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f592c006010 tx=0x7f592c0316b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.232+0000 7f593d675640 1 --2- 172.21.15.73:0/925782317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 0x5576c53f3da0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5930009c20 tx=0x7f5930011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96af7147d5b0fcec server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f591f7fe640 1 -- 172.21.15.73:0/925782317 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5930009dd0 con 0x5576c53f39a0 2024-09-05T13:03:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f591f7fe640 1 -- 172.21.15.73:0/925782317 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59300035f0 con 0x5576c53f39a0 2024-09-05T13:03:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f591f7fe640 1 -- 172.21.15.73:0/925782317 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5930019650 con 0x5576c53f39a0 2024-09-05T13:03:48.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f594266e740 1 -- 172.21.15.73:0/925782317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 msgr2=0x5576c53f3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:48.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f594266e740 1 --2- 172.21.15.73:0/925782317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 0x5576c53f3da0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5930009c20 tx=0x7f5930011810 comp rx=0 tx=0).stop 2024-09-05T13:03:48.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f594266e740 1 -- 172.21.15.73:0/925782317 shutdown_connections 2024-09-05T13:03:48.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f594266e740 1 --2- 172.21.15.73:0/925782317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 0x5576c53fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f594266e740 1 --2- 172.21.15.73:0/925782317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f594266e740 1 --2- 172.21.15.73:0/925782317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 0x5576c53f3da0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f594266e740 1 -- 172.21.15.73:0/925782317 >> 172.21.15.73:0/925782317 conn(0x5576c53ef010 msgr2=0x5576c53ef410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:48.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f594266e740 1 -- 172.21.15.73:0/925782317 shutdown_connections 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.233+0000 7f594266e740 1 -- 172.21.15.73:0/925782317 wait complete. 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.234+0000 7f594266e740 1 -- start start 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.234+0000 7f594266e740 1 Processor -- start 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.234+0000 7f594266e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 0x5576c53fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.234+0000 7f594266e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53fe070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.234+0000 7f594266e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 0x5576c54050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f594266e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5576c53fc340 con 0x5576c53f9370 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f594266e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5576c52e0290 con 0x5576c53f42e0 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f594266e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5576c53fc4c0 con 0x5576c53f39a0 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593ce74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53fe070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593d675640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 0x5576c53fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593de76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 0x5576c54050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593ce74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53fe070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39120/0 (socket says 172.21.15.73:39120) 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593d675640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 0x5576c53fdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39128/0 (socket says 172.21.15.73:39128) 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593ce74640 1 -- 172.21.15.73:0/2354458558 learned_addr learned my addr 172.21.15.73:0/2354458558 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f594266e740 10 client.0 _ll_register_callbacks cb 0x5576c5311140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593ce74640 1 -- 172.21.15.73:0/2354458558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 msgr2=0x5576c53fdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593ce74640 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 0x5576c53fdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593ce74640 1 -- 172.21.15.73:0/2354458558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 msgr2=0x5576c54050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593ce74640 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 0x5576c54050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593ce74640 1 -- 172.21.15.73:0/2354458558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576c506a210 con 0x5576c53f42e0 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593de76640 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 0x5576c54050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f593ce74640 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53fe070 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f592809abe0 tx=0x7f5928004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca858456dd542660 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f591cff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f591cff9640 1 -- 172.21.15.73:0/2354458558 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59280a3610 con 0x5576c53f42e0 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f591cff9640 1 -- 172.21.15.73:0/2354458558 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f59280a37b0 con 0x5576c53f42e0 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f594266e740 1 -- 172.21.15.73:0/2354458558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59300035f0 con 0x5576c53f42e0 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f591cff9640 1 -- 172.21.15.73:0/2354458558 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f592807e050 con 0x5576c53f42e0 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.235+0000 7f594266e740 10 client.25694 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.236+0000 7f594266e740 1 -- 172.21.15.73:0/2354458558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5576c5136620 con 0x5576c53f42e0 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.236+0000 7f591cff9640 1 -- 172.21.15.73:0/2354458558 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59300035f0 con 0x5576c53f42e0 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.236+0000 7f591cff9640 1 -- 172.21.15.73:0/2354458558 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f5928099da0 con 0x5576c53f42e0 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.236+0000 7f594266e740 10 client.25694 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.236+0000 7f594266e740 10 client.25694 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.236+0000 7f594266e740 20 client.25694 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.236+0000 7f594266e740 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5576c5409820 0x5576c540bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.236+0000 7f594266e740 4 client.25694 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.236+0000 7f594266e740 1 -- 172.21.15.73:0/2354458558 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576c5364a20 con 0x5576c5409820 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.236+0000 7f593d675640 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5576c5409820 0x5576c540bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f593d675640 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5576c5409820 0x5576c540bc30 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ca507769a8720f8 server_cookie=fe20390772832979 in_seq=0 out_seq=0 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f591cff9640 10 client.25694 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f591cff9640 1 -- 172.21.15.73:0/2354458558 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576c5364a20 con 0x5576c5409820 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f591cff9640 10 client.25694 handle_command_reply: tid=0 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f594266e740 1 client.25694 shutdown 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f594266e740 1 -- 172.21.15.73:0/2354458558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 msgr2=0x5576c53fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f594266e740 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53fe070 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f592809abe0 tx=0x7f5928004a40 comp rx=0 tx=0).stop 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f594266e740 1 -- 172.21.15.73:0/2354458558 shutdown_connections 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f594266e740 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5576c5409820 0x5576c540bc30 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f594266e740 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 0x5576c54050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f591cff9640 0 client.25694 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f594266e740 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c53fe070 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f594266e740 1 --2- 172.21.15.73:0/2354458558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 0x5576c53fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.237+0000 7f594266e740 1 -- 172.21.15.73:0/2354458558 >> 172.21.15.73:0/2354458558 conn(0x5576c53ef010 msgr2=0x5576c53f0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.238+0000 7f594266e740 1 -- 172.21.15.73:0/2354458558 shutdown_connections 2024-09-05T13:03:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.238+0000 7f594266e740 1 -- 172.21.15.73:0/2354458558 wait complete. 2024-09-05T13:03:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.238+0000 7f594266e740 20 client.25694 trim_cache size 0 max 16384 2024-09-05T13:03:48.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.259+0000 7f594266e740 1 Processor -- start 2024-09-05T13:03:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.259+0000 7f594266e740 1 -- start start 2024-09-05T13:03:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.259+0000 7f594266e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 0x5576c53f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.259+0000 7f594266e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c5405070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.260+0000 7f594266e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 0x5576c53efec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.260+0000 7f593ce74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c5405070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.260+0000 7f593ce74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c5405070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39134/0 (socket says 172.21.15.73:39134) 2024-09-05T13:03:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.260+0000 7f593ce74640 1 -- 172.21.15.73:0/1685313 learned_addr learned my addr 172.21.15.73:0/1685313 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.260+0000 7f593de76640 1 --2- 172.21.15.73:0/1685313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 0x5576c53efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.260+0000 7f594266e740 1 -- 172.21.15.73:0/1685313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f59381adaa0 con 0x5576c53f9370 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.260+0000 7f594266e740 1 -- 172.21.15.73:0/1685313 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59381ab310 con 0x5576c53f42e0 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.260+0000 7f594266e740 1 -- 172.21.15.73:0/1685313 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f59381a9160 con 0x5576c53f39a0 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.260+0000 7f593d675640 1 --2- 172.21.15.73:0/1685313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 0x5576c53f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.261+0000 7f593de76640 1 -- 172.21.15.73:0/1685313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 msgr2=0x5576c53f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.261+0000 7f593de76640 1 --2- 172.21.15.73:0/1685313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 0x5576c53f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.261+0000 7f593de76640 1 -- 172.21.15.73:0/1685313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 msgr2=0x5576c5405070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.261+0000 7f593de76640 1 --2- 172.21.15.73:0/1685313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c5405070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.261+0000 7f593de76640 1 -- 172.21.15.73:0/1685313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c53f9110 con 0x5576c53f9370 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.261+0000 7f593de76640 1 --2- 172.21.15.73:0/1685313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 0x5576c53efec0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f592c0314e0 tx=0x7f592c049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aef2334a824a99a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.261+0000 7f591effd640 1 -- 172.21.15.73:0/1685313 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c0054c0 con 0x5576c53f9370 2024-09-05T13:03:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.261+0000 7f591effd640 1 -- 172.21.15.73:0/1685313 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f592c005660 con 0x5576c53f9370 2024-09-05T13:03:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.261+0000 7f591effd640 1 -- 172.21.15.73:0/1685313 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c003bd0 con 0x5576c53f9370 2024-09-05T13:03:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.262+0000 7f594266e740 1 -- 172.21.15.73:0/1685313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 msgr2=0x5576c53efec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.263+0000 7f594266e740 1 --2- 172.21.15.73:0/1685313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 0x5576c53efec0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f592c0314e0 tx=0x7f592c049000 comp rx=0 tx=0).stop 2024-09-05T13:03:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.263+0000 7f594266e740 1 -- 172.21.15.73:0/1685313 shutdown_connections 2024-09-05T13:03:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.263+0000 7f594266e740 1 --2- 172.21.15.73:0/1685313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f9370 0x5576c53efec0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.263+0000 7f594266e740 1 --2- 172.21.15.73:0/1685313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c5405070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.263+0000 7f594266e740 1 --2- 172.21.15.73:0/1685313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f39a0 0x5576c53f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.263+0000 7f594266e740 1 -- 172.21.15.73:0/1685313 >> 172.21.15.73:0/1685313 conn(0x5576c53ef010 msgr2=0x5576c53f5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.264+0000 7f594266e740 1 -- 172.21.15.73:0/1685313 shutdown_connections 2024-09-05T13:03:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.264+0000 7f594266e740 1 -- 172.21.15.73:0/1685313 wait complete. 2024-09-05T13:03:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.264+0000 7f594266e740 1 -- start start 2024-09-05T13:03:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.265+0000 7f594266e740 1 Processor -- start 2024-09-05T13:03:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.265+0000 7f594266e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 0x5576c5401fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.265+0000 7f594266e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c54024e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.266+0000 7f594266e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 0x5576c5472500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.266+0000 7f593ce74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c54024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.266+0000 7f593ce74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c54024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39148/0 (socket says 172.21.15.73:39148) 2024-09-05T13:03:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.266+0000 7f593de76640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 0x5576c5472500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.266+0000 7f593de76640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 0x5576c5472500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39136/0 (socket says 172.21.15.73:39136) 2024-09-05T13:03:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.266+0000 7f593ce74640 1 -- 172.21.15.73:0/3638562878 learned_addr learned my addr 172.21.15.73:0/3638562878 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.266+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f59381a97d0 con 0x5576c53f39a0 2024-09-05T13:03:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.266+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59381aac40 con 0x5576c53f42e0 2024-09-05T13:03:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.266+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f59381a9ea0 con 0x5576c53f9370 2024-09-05T13:03:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.267+0000 7f594266e740 10 client.0 _ll_register_callbacks cb 0x7f5928014c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.267+0000 7f593ce74640 1 -- 172.21.15.73:0/3638562878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 msgr2=0x5576c5472500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.267+0000 7f593ce74640 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 0x5576c5472500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.267+0000 7f593ce74640 1 -- 172.21.15.73:0/3638562878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 msgr2=0x5576c5401fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:03:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.267+0000 7f593ce74640 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 0x5576c5401fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.267+0000 7f593ce74640 1 -- 172.21.15.73:0/3638562878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576c5472a70 con 0x5576c53f42e0 2024-09-05T13:03:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.267+0000 7f593ce74640 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c54024e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f592809abe0 tx=0x7f59280993f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a08ae4637b132b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.267+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f592c005660 con 0x5576c53f42e0 2024-09-05T13:03:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.267+0000 7f591cff9640 10 client.25700 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:03:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.268+0000 7f591cff9640 1 -- 172.21.15.73:0/3638562878 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592809a330 con 0x5576c53f42e0 2024-09-05T13:03:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.268+0000 7f591cff9640 1 -- 172.21.15.73:0/3638562878 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f5928009040 con 0x5576c53f42e0 2024-09-05T13:03:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.268+0000 7f591cff9640 1 -- 172.21.15.73:0/3638562878 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f592809a560 con 0x5576c53f42e0 2024-09-05T13:03:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.268+0000 7f594266e740 10 client.25700 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.268+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=41}) -- 0x5576c5473ca0 con 0x5576c53f42e0 2024-09-05T13:03:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.268+0000 7f591cff9640 1 -- 172.21.15.73:0/3638562878 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f59280a0530 con 0x5576c53f42e0 2024-09-05T13:03:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.269+0000 7f594266e740 10 client.25700 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.269+0000 7f594266e740 10 client.25700 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.269+0000 7f594266e740 20 client.25700 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.269+0000 7f594266e740 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5576c5409820 0x5576c5476640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.269+0000 7f594266e740 4 client.25700 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:03:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.269+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f592c005660 con 0x5576c5409820 2024-09-05T13:03:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.270+0000 7f593d675640 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5576c5409820 0x5576c5476640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.270+0000 7f593d675640 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5576c5409820 0x5576c5476640 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6d32c47e8b77421 server_cookie=f7f4ec0481965747 in_seq=0 out_seq=0 2024-09-05T13:03:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.270+0000 7f591cff9640 10 client.25700 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.290+0000 7f591cff9640 1 -- 172.21.15.73:0/3638562878 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f592c005660 con 0x5576c5409820 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.290+0000 7f591cff9640 10 client.25700 handle_command_reply: tid=0 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.290+0000 7f594266e740 1 client.25700 shutdown 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.290+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 msgr2=0x5576c54024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.290+0000 7f594266e740 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c54024e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f592809abe0 tx=0x7f59280993f0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.290+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 shutdown_connections 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.290+0000 7f594266e740 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5576c5409820 0x5576c5476640 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.291+0000 7f594266e740 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576c53f9370 0x5576c5472500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.291+0000 7f591cff9640 0 client.25700 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.291+0000 7f594266e740 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5576c53f42e0 0x5576c54024e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.291+0000 7f594266e740 1 --2- 172.21.15.73:0/3638562878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5576c53f39a0 0x5576c5401fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.291+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 >> 172.21.15.73:0/3638562878 conn(0x5576c53ef010 msgr2=0x5576c53ed9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.291+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 shutdown_connections 2024-09-05T13:03:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.291+0000 7f594266e740 1 -- 172.21.15.73:0/3638562878 wait complete. 2024-09-05T13:03:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.291+0000 7f594266e740 20 client.25700 trim_cache size 0 max 16384 2024-09-05T13:03:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:03:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:03:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:03:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:03:48.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.292+0000 7f593f8d9640 1 -- 172.21.15.73:0/2214272935 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59200a2cb0 msgr2=0x7f59200a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:48.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.292+0000 7f593f8d9640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59200a2cb0 0x7f59200a5170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f592c006010 tx=0x7f592c0316b0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.292+0000 7f593f8d9640 1 -- 172.21.15.73:0/2214272935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5938102d50 msgr2=0x7f5938198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.292+0000 7f593f8d9640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5938102d50 0x7f5938198310 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f592800ba50 tx=0x7f592800bf10 comp rx=0 tx=0).stop 2024-09-05T13:03:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.292+0000 7f593f8d9640 1 -- 172.21.15.73:0/2214272935 shutdown_connections 2024-09-05T13:03:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.292+0000 7f593f8d9640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f59200a2cb0 0x7f59200a5170 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.292+0000 7f593f8d9640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938103710 0x7f593819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.292+0000 7f593f8d9640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5938102d50 0x7f5938198310 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.292+0000 7f593f8d9640 1 --2- 172.21.15.73:0/2214272935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5938101b60 0x7f5938197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.292+0000 7f593f8d9640 1 -- 172.21.15.73:0/2214272935 >> 172.21.15.73:0/2214272935 conn(0x7f59380fd2e0 msgr2=0x7f5938106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.293+0000 7f593f8d9640 1 -- 172.21.15.73:0/2214272935 shutdown_connections 2024-09-05T13:03:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:03:48.293+0000 7f593f8d9640 1 -- 172.21.15.73:0/2214272935 wait complete. 2024-09-05T13:03:48.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T13:03:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:03:49.442 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:49 smithi073 ceph-mon[30883]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.53k op/s 2024-09-05T13:03:49.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:49 smithi162 ceph-mon[34220]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.53k op/s 2024-09-05T13:03:49.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:49 smithi169 ceph-mon[34823]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.53k op/s 2024-09-05T13:03:49.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.724+0000 7f88393ee640 1 -- 172.21.15.73:0/1416608139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8834074eb0 msgr2=0x7f8834112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:49.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.724+0000 7f88393ee640 1 --2- 172.21.15.73:0/1416608139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8834074eb0 0x7f8834112660 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f881c009900 tx=0x7f881c02a480 comp rx=0 tx=0).stop 2024-09-05T13:03:49.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.725+0000 7f88393ee640 1 -- 172.21.15.73:0/1416608139 shutdown_connections 2024-09-05T13:03:49.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.725+0000 7f88393ee640 1 --2- 172.21.15.73:0/1416608139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8834112ba0 0x7f8834114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.725+0000 7f88393ee640 1 --2- 172.21.15.73:0/1416608139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8834074eb0 0x7f8834112660 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.725+0000 7f88393ee640 1 --2- 172.21.15.73:0/1416608139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8834074590 0x7f8834074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.725+0000 7f88393ee640 1 -- 172.21.15.73:0/1416608139 >> 172.21.15.73:0/1416608139 conn(0x7f88340fd8b0 msgr2=0x7f88340ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.726+0000 7f88393ee640 1 -- 172.21.15.73:0/1416608139 shutdown_connections 2024-09-05T13:03:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.726+0000 7f88393ee640 1 -- 172.21.15.73:0/1416608139 wait complete. 2024-09-05T13:03:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.727+0000 7f88393ee640 1 Processor -- start 2024-09-05T13:03:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.727+0000 7f88393ee640 1 -- start start 2024-09-05T13:03:49.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.727+0000 7f88393ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8834074590 0x7f88341a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.727+0000 7f88393ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8834074eb0 0x7f88341a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.727+0000 7f88393ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8834112ba0 0x7f883419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.727+0000 7f88393ee640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8834118630 con 0x7f8834074590 2024-09-05T13:03:49.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.727+0000 7f88393ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88341184b0 con 0x7f8834074eb0 2024-09-05T13:03:49.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.727+0000 7f88393ee640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f88341187b0 con 0x7f8834112ba0 2024-09-05T13:03:49.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.727+0000 7f8832ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8834074590 0x7f88341a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.728+0000 7f8832ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8834074590 0x7f88341a47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47086/0 (socket says 172.21.15.73:47086) 2024-09-05T13:03:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.728+0000 7f8832ffd640 1 -- 172.21.15.73:0/3157514428 learned_addr learned my addr 172.21.15.73:0/3157514428 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.728+0000 7f88337fe640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8834112ba0 0x7f883419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.728+0000 7f8832ffd640 1 -- 172.21.15.73:0/3157514428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8834112ba0 msgr2=0x7f883419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.728+0000 7f8832ffd640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8834112ba0 0x7f883419e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.728+0000 7f8832ffd640 1 -- 172.21.15.73:0/3157514428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8834074eb0 msgr2=0x7f88341a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.728+0000 7f8832ffd640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8834074eb0 0x7f88341a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.728+0000 7f8832ffd640 1 -- 172.21.15.73:0/3157514428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883419f090 con 0x7f8834074590 2024-09-05T13:03:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.728+0000 7f8832ffd640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8834074590 0x7f88341a47a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f882400d950 tx=0x7f882400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.729+0000 7f8830ff9640 1 -- 172.21.15.73:0/3157514428 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824017070 con 0x7f8834074590 2024-09-05T13:03:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.729+0000 7f8830ff9640 1 -- 172.21.15.73:0/3157514428 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8824009c30 con 0x7f8834074590 2024-09-05T13:03:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.730+0000 7f88393ee640 1 -- 172.21.15.73:0/3157514428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883419f380 con 0x7f8834074590 2024-09-05T13:03:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.730+0000 7f88393ee640 1 -- 172.21.15.73:0/3157514428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88341ab670 con 0x7f8834074590 2024-09-05T13:03:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.730+0000 7f8830ff9640 1 -- 172.21.15.73:0/3157514428 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882400f6b0 con 0x7f8834074590 2024-09-05T13:03:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.741+0000 7f8830ff9640 1 -- 172.21.15.73:0/3157514428 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f88240109d0 con 0x7f8834074590 2024-09-05T13:03:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.741+0000 7f883b7c4740 1 Processor -- start 2024-09-05T13:03:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.742+0000 7f883b7c4740 1 -- start start 2024-09-05T13:03:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.742+0000 7f8830ff9640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f88200a2c80 0x7f88200a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.742+0000 7f8830ff9640 1 -- 172.21.15.73:0/3157514428 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f88240ceed0 con 0x7f8834074590 2024-09-05T13:03:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.743+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a07b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.743+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a07b5d0 0x56171a07ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.743+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a088760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.743+0000 7f883b7c4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561719fe12f0 con 0x56171a07cb80 2024-09-05T13:03:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.743+0000 7f883b7c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561719f88cf0 con 0x56171a07b5d0 2024-09-05T13:03:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.743+0000 7f883b7c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561719fdd2b0 con 0x56171a086370 2024-09-05T13:03:49.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.743+0000 7f88337fe640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f88200a2c80 0x7f88200a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.744+0000 7f88337fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a088760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.744+0000 7f88337fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a088760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39148/0 (socket says 172.21.15.73:39148) 2024-09-05T13:03:49.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.744+0000 7f88337fe640 1 -- 172.21.15.73:0/3493673173 learned_addr learned my addr 172.21.15.73:0/3493673173 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:49.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.744+0000 7f88337fe640 1 -- 172.21.15.73:0/3493673173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a07b5d0 msgr2=0x56171a07ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:49.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.744+0000 7f88337fe640 1 --2- 172.21.15.73:0/3493673173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a07b5d0 0x56171a07ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.744+0000 7f88337fe640 1 -- 172.21.15.73:0/3493673173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 msgr2=0x56171a07b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.744+0000 7f88337fe640 1 --2- 172.21.15.73:0/3493673173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a07b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.744+0000 7f88337fe640 1 -- 172.21.15.73:0/3493673173 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561719f6d3a0 con 0x56171a086370 2024-09-05T13:03:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.744+0000 7f88337fe640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f88200a2c80 0x7f88200a5140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f882c009fd0 tx=0x7f882c009f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.745+0000 7f88337fe640 1 --2- 172.21.15.73:0/3493673173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a088760 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f882c008b20 tx=0x7f882c01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ed2b3f1baff4869 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.745+0000 7f88297fa640 1 -- 172.21.15.73:0/3493673173 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c014040 con 0x56171a086370 2024-09-05T13:03:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.747+0000 7f88297fa640 1 -- 172.21.15.73:0/3493673173 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f882c01a8d0 con 0x56171a086370 2024-09-05T13:03:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.747+0000 7f88297fa640 1 -- 172.21.15.73:0/3493673173 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c023600 con 0x56171a086370 2024-09-05T13:03:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.748+0000 7f883b7c4740 1 -- 172.21.15.73:0/3493673173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 msgr2=0x56171a088760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.748+0000 7f883b7c4740 1 --2- 172.21.15.73:0/3493673173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a088760 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f882c008b20 tx=0x7f882c01a000 comp rx=0 tx=0).stop 2024-09-05T13:03:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.748+0000 7f883b7c4740 1 -- 172.21.15.73:0/3493673173 shutdown_connections 2024-09-05T13:03:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.748+0000 7f883b7c4740 1 --2- 172.21.15.73:0/3493673173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a088760 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.748+0000 7f883b7c4740 1 --2- 172.21.15.73:0/3493673173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a07b5d0 0x56171a07ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.748+0000 7f883b7c4740 1 --2- 172.21.15.73:0/3493673173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a07b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.748+0000 7f883b7c4740 1 -- 172.21.15.73:0/3493673173 >> 172.21.15.73:0/3493673173 conn(0x56171a044310 msgr2=0x56171a077c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:49.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.751+0000 7f883b7c4740 1 -- 172.21.15.73:0/3493673173 shutdown_connections 2024-09-05T13:03:49.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.753+0000 7f883b7c4740 1 -- 172.21.15.73:0/3493673173 wait complete. 2024-09-05T13:03:49.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.753+0000 7f883b7c4740 1 -- start start 2024-09-05T13:03:49.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.753+0000 7f883b7c4740 1 Processor -- start 2024-09-05T13:03:49.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.754+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07b5d0 0x56171a085c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.754+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07cb80 0x56171a082f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.754+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 0x56171a083480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.754+0000 7f883b7c4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56171a089110 con 0x56171a07b5d0 2024-09-05T13:03:49.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.754+0000 7f883b7c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561719f9c060 con 0x56171a086370 2024-09-05T13:03:49.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.754+0000 7f883b7c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56171a089290 con 0x56171a07cb80 2024-09-05T13:03:49.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.755+0000 7f88337fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 0x56171a083480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.755+0000 7f882a7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07cb80 0x56171a082f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.755+0000 7f88337fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 0x56171a083480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39190/0 (socket says 172.21.15.73:39190) 2024-09-05T13:03:49.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.755+0000 7f88337fe640 1 -- 172.21.15.73:0/2088977261 learned_addr learned my addr 172.21.15.73:0/2088977261 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:49.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.755+0000 7f883b7c4740 10 client.0 _ll_register_callbacks cb 0x561719cef8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.757+0000 7f8832ffd640 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07b5d0 0x56171a085c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.757+0000 7f88337fe640 1 -- 172.21.15.73:0/2088977261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07cb80 msgr2=0x56171a082f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.757+0000 7f88337fe640 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07cb80 0x56171a082f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.757+0000 7f88337fe640 1 -- 172.21.15.73:0/2088977261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07b5d0 msgr2=0x56171a085c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.757+0000 7f88337fe640 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07b5d0 0x56171a085c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.757+0000 7f88337fe640 1 -- 172.21.15.73:0/2088977261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561719d523c0 con 0x56171a086370 2024-09-05T13:03:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.757+0000 7f8832ffd640 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07b5d0 0x56171a085c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:03:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.757+0000 7f88337fe640 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 0x56171a083480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f882c008b70 tx=0x7f882c00ba80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36633f80022f9616 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.757+0000 7f881a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.757+0000 7f881a7fc640 1 -- 172.21.15.73:0/2088977261 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c01aa80 con 0x56171a086370 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.758+0000 7f881a7fc640 1 -- 172.21.15.73:0/2088977261 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f882c029070 con 0x56171a086370 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.758+0000 7f883b7c4740 1 -- 172.21.15.73:0/2088977261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f882c01a8d0 con 0x56171a086370 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.758+0000 7f881a7fc640 1 -- 172.21.15.73:0/2088977261 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f882c01ac20 con 0x56171a086370 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.758+0000 7f883b7c4740 10 client.25706 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.758+0000 7f883b7c4740 1 -- 172.21.15.73:0/2088977261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56171a094b90 con 0x56171a086370 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.759+0000 7f881a7fc640 1 -- 172.21.15.73:0/2088977261 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f882c01a8d0 con 0x56171a086370 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.760+0000 7f881a7fc640 1 -- 172.21.15.73:0/2088977261 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f882c0249f0 con 0x56171a086370 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.760+0000 7f883b7c4740 10 client.25706 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.760+0000 7f883b7c4740 10 client.25706 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.760+0000 7f883b7c4740 20 client.25706 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.760+0000 7f883b7c4740 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x56171a095f40 0x56171a098330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.760+0000 7f883b7c4740 4 client.25706 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:49.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.760+0000 7f883b7c4740 1 -- 172.21.15.73:0/2088977261 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561719fee860 con 0x56171a095f40 2024-09-05T13:03:49.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.760+0000 7f8832ffd640 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x56171a095f40 0x56171a098330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.763+0000 7f8832ffd640 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x56171a095f40 0x56171a098330 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8918bea3cab71dee server_cookie=e240a4507ac86afc in_seq=0 out_seq=0 2024-09-05T13:03:49.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.763+0000 7f881a7fc640 10 client.25706 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T13:03:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.765+0000 7f881a7fc640 1 -- 172.21.15.73:0/2088977261 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561719fee860 con 0x56171a095f40 2024-09-05T13:03:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.765+0000 7f881a7fc640 10 client.25706 handle_command_reply: tid=0 2024-09-05T13:03:49.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.766+0000 7f883b7c4740 1 client.25706 shutdown 2024-09-05T13:03:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f883b7c4740 1 -- 172.21.15.73:0/2088977261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 msgr2=0x56171a083480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f883b7c4740 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 0x56171a083480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f882c008b70 tx=0x7f882c00ba80 comp rx=0 tx=0).stop 2024-09-05T13:03:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f883b7c4740 1 -- 172.21.15.73:0/2088977261 shutdown_connections 2024-09-05T13:03:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f883b7c4740 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 0x56171a083480 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f883b7c4740 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x56171a095f40 0x56171a098330 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f883b7c4740 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07cb80 0x56171a082f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f883b7c4740 1 --2- 172.21.15.73:0/2088977261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07b5d0 0x56171a085c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f883b7c4740 1 -- 172.21.15.73:0/2088977261 >> 172.21.15.73:0/2088977261 conn(0x56171a044310 msgr2=0x56171a07d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:49.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f881a7fc640 0 client.25706 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T13:03:49.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f883b7c4740 1 -- 172.21.15.73:0/2088977261 shutdown_connections 2024-09-05T13:03:49.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.767+0000 7f883b7c4740 1 -- 172.21.15.73:0/2088977261 wait complete. 2024-09-05T13:03:49.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.768+0000 7f883b7c4740 20 client.25706 trim_cache size 0 max 16384 2024-09-05T13:03:49.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.791+0000 7f883b7c4740 1 Processor -- start 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.791+0000 7f883b7c4740 1 -- start start 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a07b5d0 0x56171a084eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a07e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a07e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f883b7c4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8814010d60 con 0x56171a07cb80 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f883b7c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f881400e5d0 con 0x56171a07b5d0 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f883b7c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f881400c420 con 0x56171a086370 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f8832ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a07b5d0 0x56171a084eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f8832ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a07b5d0 0x56171a084eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39196/0 (socket says 172.21.15.73:39196) 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f8832ffd640 1 -- 172.21.15.73:0/2290862038 learned_addr learned my addr 172.21.15.73:0/2290862038 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f88337fe640 1 --2- 172.21.15.73:0/2290862038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a07e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f882a7fc640 1 --2- 172.21.15.73:0/2290862038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a07e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f88337fe640 1 -- 172.21.15.73:0/2290862038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a07b5d0 msgr2=0x56171a084eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:49.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f88337fe640 1 --2- 172.21.15.73:0/2290862038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a07b5d0 0x56171a084eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f88337fe640 1 -- 172.21.15.73:0/2290862038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 msgr2=0x56171a07e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:49.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f88337fe640 1 --2- 172.21.15.73:0/2290862038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a07e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.792+0000 7f88337fe640 1 -- 172.21.15.73:0/2290862038 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171a078df0 con 0x56171a086370 2024-09-05T13:03:49.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.793+0000 7f88337fe640 1 --2- 172.21.15.73:0/2290862038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a07e6a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f882c024dc0 tx=0x7f882c008fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668c164653e5f3aa server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:49.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.793+0000 7f8828ff9640 1 -- 172.21.15.73:0/2290862038 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c00b7b0 con 0x56171a086370 2024-09-05T13:03:49.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.793+0000 7f8828ff9640 1 -- 172.21.15.73:0/2290862038 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f882c01adc0 con 0x56171a086370 2024-09-05T13:03:49.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.793+0000 7f8828ff9640 1 -- 172.21.15.73:0/2290862038 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c035cb0 con 0x56171a086370 2024-09-05T13:03:49.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.794+0000 7f883b7c4740 1 -- 172.21.15.73:0/2290862038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 msgr2=0x56171a07e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:49.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.794+0000 7f883b7c4740 1 --2- 172.21.15.73:0/2290862038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a07e6a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f882c024dc0 tx=0x7f882c008fb0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.794+0000 7f883b7c4740 1 -- 172.21.15.73:0/2290862038 shutdown_connections 2024-09-05T13:03:49.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.794+0000 7f883b7c4740 1 --2- 172.21.15.73:0/2290862038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a086370 0x56171a07e6a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.795+0000 7f883b7c4740 1 --2- 172.21.15.73:0/2290862038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a07e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.795+0000 7f883b7c4740 1 --2- 172.21.15.73:0/2290862038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a07b5d0 0x56171a084eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.795+0000 7f883b7c4740 1 -- 172.21.15.73:0/2290862038 >> 172.21.15.73:0/2290862038 conn(0x56171a044310 msgr2=0x56171a0847a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:49.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.795+0000 7f883b7c4740 1 -- 172.21.15.73:0/2290862038 shutdown_connections 2024-09-05T13:03:49.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.795+0000 7f883b7c4740 1 -- 172.21.15.73:0/2290862038 wait complete. 2024-09-05T13:03:49.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.795+0000 7f883b7c4740 1 -- start start 2024-09-05T13:03:49.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.795+0000 7f883b7c4740 1 Processor -- start 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07b5d0 0x56171a08eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a089ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f883b7c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 0x56171a08a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f883b7c4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f881400ca90 con 0x56171a07cb80 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f883b7c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f881400df00 con 0x56171a086370 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f883b7c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f881400d160 con 0x56171a07b5d0 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f883b7c4740 10 client.0 _ll_register_callbacks cb 0x7f882c008ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f8832ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07b5d0 0x56171a08eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f8832ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07b5d0 0x56171a08eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39172/0 (socket says 172.21.15.73:39172) 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f8832ffd640 1 -- 172.21.15.73:0/3852002666 learned_addr learned my addr 172.21.15.73:0/3852002666 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f882a7fc640 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a089ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f88337fe640 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 0x56171a08a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f882a7fc640 1 -- 172.21.15.73:0/3852002666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07b5d0 msgr2=0x56171a08eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f882a7fc640 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07b5d0 0x56171a08eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f882a7fc640 1 -- 172.21.15.73:0/3852002666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 msgr2=0x56171a08a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f882a7fc640 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 0x56171a08a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f882a7fc640 1 -- 172.21.15.73:0/3852002666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171a08aa40 con 0x56171a07cb80 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.796+0000 7f881a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.797+0000 7f882a7fc640 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a089ec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x56171a07c210 tx=0x7f881c004440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbf2f2bda6784d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.797+0000 7f881a7fc640 1 -- 172.21.15.73:0/3852002666 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c035040 con 0x56171a07cb80 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.797+0000 7f883b7c4740 1 -- 172.21.15.73:0/3852002666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f882c01adc0 con 0x56171a07cb80 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.797+0000 7f881a7fc640 1 -- 172.21.15.73:0/3852002666 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f881c005020 con 0x56171a07cb80 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.797+0000 7f881a7fc640 1 -- 172.21.15.73:0/3852002666 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f881c035040 con 0x56171a07cb80 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.797+0000 7f883b7c4740 10 client.16230 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.797+0000 7f883b7c4740 1 -- 172.21.15.73:0/3852002666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56171a100930 con 0x56171a07cb80 2024-09-05T13:03:49.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.797+0000 7f881a7fc640 1 -- 172.21.15.73:0/3852002666 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f882c01adc0 con 0x56171a07cb80 2024-09-05T13:03:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.798+0000 7f881a7fc640 1 -- 172.21.15.73:0/3852002666 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f881c044030 con 0x56171a07cb80 2024-09-05T13:03:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.798+0000 7f883b7c4740 10 client.16230 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.798+0000 7f883b7c4740 10 client.16230 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T13:03:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.798+0000 7f883b7c4740 20 client.16230 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.798+0000 7f883b7c4740 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x56171a101040 0x56171a103460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.798+0000 7f883b7c4740 4 client.16230 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:03:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.798+0000 7f883b7c4740 1 -- 172.21.15.73:0/3852002666 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561719fe8d70 con 0x56171a101040 2024-09-05T13:03:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.798+0000 7f8832ffd640 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x56171a101040 0x56171a103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.799+0000 7f8832ffd640 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x56171a101040 0x56171a103460 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc20a65fd696aa09 server_cookie=1ba43a188733b296 in_seq=0 out_seq=0 2024-09-05T13:03:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.799+0000 7f881a7fc640 10 client.16230 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T13:03:49.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.800+0000 7f881a7fc640 1 -- 172.21.15.73:0/3852002666 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561719fe8d70 con 0x56171a101040 2024-09-05T13:03:49.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.800+0000 7f881a7fc640 10 client.16230 handle_command_reply: tid=0 2024-09-05T13:03:49.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.801+0000 7f883b7c4740 1 client.16230 shutdown 2024-09-05T13:03:49.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.801+0000 7f883b7c4740 1 -- 172.21.15.73:0/3852002666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 msgr2=0x56171a089ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.801+0000 7f883b7c4740 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a089ec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x56171a07c210 tx=0x7f881c004440 comp rx=0 tx=0).stop 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.801+0000 7f883b7c4740 1 -- 172.21.15.73:0/3852002666 shutdown_connections 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.801+0000 7f883b7c4740 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56171a086370 0x56171a08a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.801+0000 7f883b7c4740 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56171a07cb80 0x56171a089ec0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.801+0000 7f883b7c4740 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x56171a101040 0x56171a103460 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.801+0000 7f883b7c4740 1 --2- 172.21.15.73:0/3852002666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a07b5d0 0x56171a08eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.801+0000 7f883b7c4740 1 -- 172.21.15.73:0/3852002666 >> 172.21.15.73:0/3852002666 conn(0x56171a044310 msgr2=0x56171a084fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.801+0000 7f881a7fc640 0 client.16230 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.802+0000 7f883b7c4740 1 -- 172.21.15.73:0/3852002666 shutdown_connections 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.802+0000 7f883b7c4740 1 -- 172.21.15.73:0/3852002666 wait complete. 2024-09-05T13:03:49.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.802+0000 7f883b7c4740 20 client.16230 trim_cache size 0 max 16384 2024-09-05T13:03:49.807 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:03:49.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 -- 172.21.15.73:0/3157514428 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f88200a2c80 msgr2=0x7f88200a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:49.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f88200a2c80 0x7f88200a5140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f882c009fd0 tx=0x7f882c009f60 comp rx=0 tx=0).stop 2024-09-05T13:03:49.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 -- 172.21.15.73:0/3157514428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8834074590 msgr2=0x7f88341a47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:49.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8834074590 0x7f88341a47a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f882400d950 tx=0x7f882400de10 comp rx=0 tx=0).stop 2024-09-05T13:03:49.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 -- 172.21.15.73:0/3157514428 shutdown_connections 2024-09-05T13:03:49.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f88200a2c80 0x7f88200a5140 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8834112ba0 0x7f883419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8834074eb0 0x7f88341a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 --2- 172.21.15.73:0/3157514428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8834074590 0x7f88341a47a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:49.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 -- 172.21.15.73:0/3157514428 >> 172.21.15.73:0/3157514428 conn(0x7f88340fd8b0 msgr2=0x7f88340ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:49.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 -- 172.21.15.73:0/3157514428 shutdown_connections 2024-09-05T13:03:49.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:49.803+0000 7f88393ee640 1 -- 172.21.15.73:0/3157514428 wait complete. 2024-09-05T13:03:50.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T13:03:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:03:51.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:51 smithi073 ceph-mon[30883]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 6.20k op/s 2024-09-05T13:03:51.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:51 smithi162 ceph-mon[34220]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 6.20k op/s 2024-09-05T13:03:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:51 smithi169 ceph-mon[34823]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 6.20k op/s 2024-09-05T13:03:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.778+0000 7f4b36452640 1 -- 172.21.15.73:0/4054192194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b28005650 msgr2=0x7f4b280a2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.778+0000 7f4b36452640 1 --2- 172.21.15.73:0/4054192194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b28005650 0x7f4b280a2420 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4b30051500 tx=0x7f4b30096d90 comp rx=0 tx=0).stop 2024-09-05T13:03:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.778+0000 7f4b36452640 1 -- 172.21.15.73:0/4054192194 shutdown_connections 2024-09-05T13:03:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.778+0000 7f4b36452640 1 --2- 172.21.15.73:0/4054192194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b28005650 0x7f4b280a2420 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.778+0000 7f4b36452640 1 --2- 172.21.15.73:0/4054192194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b28004cb0 0x7f4b28005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.778+0000 7f4b36452640 1 --2- 172.21.15.73:0/4054192194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b2809b600 0x7f4b2809b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.778+0000 7f4b36452640 1 -- 172.21.15.73:0/4054192194 >> 172.21.15.73:0/4054192194 conn(0x7f4b2800a1f0 msgr2=0x7f4b2800a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.779+0000 7f4b36452640 1 -- 172.21.15.73:0/4054192194 shutdown_connections 2024-09-05T13:03:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.779+0000 7f4b36452640 1 -- 172.21.15.73:0/4054192194 wait complete. 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.779+0000 7f4b36452640 1 Processor -- start 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b36452640 1 -- start start 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b36452640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b28004cb0 0x7f4b2812df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b36452640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28005650 0x7f4b2812e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b36452640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b2809b600 0x7f4b28132810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b36452640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4b280a5920 con 0x7f4b2809b600 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b36452640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b280a57a0 con 0x7f4b28004cb0 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b36452640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b280a5aa0 con 0x7f4b28005650 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b35c51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b2809b600 0x7f4b28132810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b35c51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b2809b600 0x7f4b28132810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47120/0 (socket says 172.21.15.73:47120) 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b35c51640 1 -- 172.21.15.73:0/2025326368 learned_addr learned my addr 172.21.15.73:0/2025326368 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b35450640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b28004cb0 0x7f4b2812df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28005650 0x7f4b2812e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b35450640 1 -- 172.21.15.73:0/2025326368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28005650 msgr2=0x7f4b2812e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b35450640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28005650 0x7f4b2812e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b35450640 1 -- 172.21.15.73:0/2025326368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b2809b600 msgr2=0x7f4b28132810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b35450640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b2809b600 0x7f4b28132810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b35450640 1 -- 172.21.15.73:0/2025326368 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b28132ef0 con 0x7f4b28004cb0 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.780+0000 7f4b35c51640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b2809b600 0x7f4b28132810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.781+0000 7f4b35450640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b28004cb0 0x7f4b2812df40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00e9f0 tx=0x7f4b2c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.781+0000 7f4b267fc640 1 -- 172.21.15.73:0/2025326368 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00ccc0 con 0x7f4b28004cb0 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.781+0000 7f4b36452640 1 -- 172.21.15.73:0/2025326368 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b281331e0 con 0x7f4b28004cb0 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.781+0000 7f4b267fc640 1 -- 172.21.15.73:0/2025326368 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b2c005020 con 0x7f4b28004cb0 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.781+0000 7f4b36452640 1 -- 172.21.15.73:0/2025326368 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2813aac0 con 0x7f4b28004cb0 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.781+0000 7f4b267fc640 1 -- 172.21.15.73:0/2025326368 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c01c070 con 0x7f4b28004cb0 2024-09-05T13:03:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b39a8a740 1 Processor -- start 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b39a8a740 1 -- start start 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b267fc640 1 -- 172.21.15.73:0/2025326368 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4b2c005540 con 0x7f4b28004cb0 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2f540 0x55c00bf2da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2df90 0x55c00bf2e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf38d30 0x55c00bf3b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c00be8b2f0 con 0x55c00bf2df90 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c00be32cf0 con 0x55c00bf38d30 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c00be872b0 con 0x55c00bf2f540 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b35450640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2df90 0x55c00bf2e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.785+0000 7f4b34c4f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf38d30 0x55c00bf3b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.786+0000 7f4b34c4f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf38d30 0x55c00bf3b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:39230/0 (socket says 172.21.15.73:39230) 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.786+0000 7f4b34c4f640 1 -- 172.21.15.73:0/3145266145 learned_addr learned my addr 172.21.15.73:0/3145266145 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.786+0000 7f4b35c51640 1 --2- 172.21.15.73:0/3145266145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2f540 0x55c00bf2da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.786+0000 7f4b34c4f640 1 -- 172.21.15.73:0/3145266145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2f540 msgr2=0x55c00bf2da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.786+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/3145266145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2f540 0x55c00bf2da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.786+0000 7f4b34c4f640 1 -- 172.21.15.73:0/3145266145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2df90 msgr2=0x55c00bf2e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.786+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/3145266145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2df90 0x55c00bf2e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.786+0000 7f4b34c4f640 1 -- 172.21.15.73:0/3145266145 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c00be173a0 con 0x55c00bf38d30 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.787+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/3145266145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf38d30 0x55c00bf3b120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009c90 tx=0x7f4b20011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4456f7f04204c812 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.787+0000 7f4b267fc640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4b1c0a2c10 0x7f4b1c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.787+0000 7f4b267fc640 1 -- 172.21.15.73:0/2025326368 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f4b2c0cf010 con 0x7f4b28004cb0 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.787+0000 7f4b35c51640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4b1c0a2c10 0x7f4b1c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.788+0000 7f4b1b7fe640 1 -- 172.21.15.73:0/3145266145 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2001e070 con 0x55c00bf38d30 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.788+0000 7f4b1b7fe640 1 -- 172.21.15.73:0/3145266145 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b20019b10 con 0x55c00bf38d30 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.788+0000 7f4b1b7fe640 1 -- 172.21.15.73:0/3145266145 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000eac0 con 0x55c00bf38d30 2024-09-05T13:03:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 -- 172.21.15.73:0/3145266145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf38d30 msgr2=0x55c00bf3b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/3145266145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf38d30 0x55c00bf3b120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009c90 tx=0x7f4b20011810 comp rx=0 tx=0).stop 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b35c51640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4b1c0a2c10 0x7f4b1c0a50d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4b300637b0 tx=0x7f4b30068300 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 -- 172.21.15.73:0/3145266145 shutdown_connections 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/3145266145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf38d30 0x55c00bf3b120 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/3145266145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2df90 0x55c00bf2e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/3145266145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2f540 0x55c00bf2da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 -- 172.21.15.73:0/3145266145 >> 172.21.15.73:0/3145266145 conn(0x55c00beee310 msgr2=0x55c00bf2a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 -- 172.21.15.73:0/3145266145 shutdown_connections 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 -- 172.21.15.73:0/3145266145 wait complete. 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 -- start start 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.789+0000 7f4b39a8a740 1 Processor -- start 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 0x55c00bf38620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2f540 0x55c00bf35920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf35e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c00bf3bae0 con 0x55c00bf38d30 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c00be46060 con 0x55c00bf2f540 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c00bf3bc60 con 0x55c00bf2df90 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b35450640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 0x55c00bf38620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b35450640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 0x55c00bf38620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:39206/0 (socket says 172.21.15.73:39206) 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b35450640 1 -- 172.21.15.73:0/1176338427 learned_addr learned my addr 172.21.15.73:0/1176338427 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b35c51640 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf35e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b35450640 1 -- 172.21.15.73:0/1176338427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2f540 msgr2=0x55c00bf35920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b35450640 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2f540 0x55c00bf35920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b35450640 1 -- 172.21.15.73:0/1176338427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 msgr2=0x55c00bf35e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.790+0000 7f4b35450640 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf35e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b35450640 1 -- 172.21.15.73:0/1176338427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c00bbfc3c0 con 0x55c00bf2df90 2024-09-05T13:03:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b35c51640 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf35e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b39a8a740 10 client.0 _ll_register_callbacks cb 0x55c00bb998c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b39a8a740 1 -- 172.21.15.73:0/1176338427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b20019b10 con 0x55c00bf2df90 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b35450640 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 0x55c00bf38620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0a3f80 tx=0x7f4b2c09b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb0f71e2f9c0e1af server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b18ff9640 10 client.25825 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b18ff9640 1 -- 172.21.15.73:0/1176338427 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0051d0 con 0x55c00bf2df90 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b18ff9640 1 -- 172.21.15.73:0/1176338427 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f4b2c09bca0 con 0x55c00bf2df90 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b18ff9640 1 -- 172.21.15.73:0/1176338427 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f4b2c09bf40 con 0x55c00bf2df90 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b39a8a740 10 client.25825 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b39a8a740 1 -- 172.21.15.73:0/1176338427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({fsmap=41}) -- 0x55c00bf29a70 con 0x55c00bf2df90 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b18ff9640 1 -- 172.21.15.73:0/1176338427 <== mon.1 v2:172.21.15.169:3300/0 4 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f4b2c0a4020 con 0x55c00bf2df90 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b39a8a740 10 client.25825 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.791+0000 7f4b39a8a740 10 client.25825 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T13:03:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.792+0000 7f4b39a8a740 20 client.25825 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.792+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55c00bf512e0 0x55c00bf536d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.792+0000 7f4b39a8a740 4 client.25825 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.792+0000 7f4b39a8a740 1 -- 172.21.15.73:0/1176338427 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c00be98860 con 0x55c00bf512e0 2024-09-05T13:03:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.792+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55c00bf512e0 0x55c00bf536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.792+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55c00bf512e0 0x55c00bf536d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=122a5e10ee658db server_cookie=c0f226b7afd26df2 in_seq=0 out_seq=0 2024-09-05T13:03:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.792+0000 7f4b18ff9640 10 client.25825 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T13:03:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.793+0000 7f4b18ff9640 1 -- 172.21.15.73:0/1176338427 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c00be98860 con 0x55c00bf512e0 2024-09-05T13:03:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.793+0000 7f4b18ff9640 10 client.25825 handle_command_reply: tid=0 2024-09-05T13:03:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.793+0000 7f4b39a8a740 1 client.25825 shutdown 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.793+0000 7f4b39a8a740 1 -- 172.21.15.73:0/1176338427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 msgr2=0x55c00bf38620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.793+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 0x55c00bf38620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0a3f80 tx=0x7f4b2c09b610 comp rx=0 tx=0).stop 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.794+0000 7f4b39a8a740 1 -- 172.21.15.73:0/1176338427 shutdown_connections 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.794+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55c00bf512e0 0x55c00bf536d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.794+0000 7f4b18ff9640 0 client.25825 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.794+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf35e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.794+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2f540 0x55c00bf35920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.794+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/1176338427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 0x55c00bf38620 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.794+0000 7f4b39a8a740 1 -- 172.21.15.73:0/1176338427 >> 172.21.15.73:0/1176338427 conn(0x55c00beee310 msgr2=0x55c00bf30330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.795+0000 7f4b39a8a740 1 -- 172.21.15.73:0/1176338427 shutdown_connections 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.795+0000 7f4b39a8a740 1 -- 172.21.15.73:0/1176338427 wait complete. 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.796+0000 7f4b39a8a740 20 client.25825 trim_cache size 0 max 16384 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.820+0000 7f4b39a8a740 1 Processor -- start 2024-09-05T13:03:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.820+0000 7f4b39a8a740 1 -- start start 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.820+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 0x55c00bf30b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.820+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2f540 0x55c00bf31060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.820+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf58e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.820+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4b28141510 con 0x55c00bf38d30 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.820+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2813ed80 con 0x55c00bf2f540 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.820+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2813cc30 con 0x55c00bf2df90 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.820+0000 7f4b35c51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf58e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b35c51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf58e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47146/0 (socket says 172.21.15.73:47146) 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b35c51640 1 -- 172.21.15.73:0/3904046399 learned_addr learned my addr 172.21.15.73:0/3904046399 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b35450640 1 --2- 172.21.15.73:0/3904046399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 0x55c00bf30b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/3904046399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2f540 0x55c00bf31060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b35c51640 1 -- 172.21.15.73:0/3904046399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 msgr2=0x55c00bf30b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b35c51640 1 --2- 172.21.15.73:0/3904046399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 0x55c00bf30b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b35c51640 1 -- 172.21.15.73:0/3904046399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2f540 msgr2=0x55c00bf31060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b35c51640 1 --2- 172.21.15.73:0/3904046399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2f540 0x55c00bf31060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b35c51640 1 -- 172.21.15.73:0/3904046399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c00bf2b740 con 0x55c00bf38d30 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/3904046399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2f540 0x55c00bf31060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.821+0000 7f4b35c51640 1 --2- 172.21.15.73:0/3904046399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf58e10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4b30000b60 tx=0x7f4b300ac040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b673e0c609a0b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.822+0000 7f4b1affd640 1 -- 172.21.15.73:0/3904046399 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30062b80 con 0x55c00bf38d30 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.824+0000 7f4b1affd640 1 -- 172.21.15.73:0/3904046399 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b3009b040 con 0x55c00bf38d30 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.824+0000 7f4b1affd640 1 -- 172.21.15.73:0/3904046399 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3009f410 con 0x55c00bf38d30 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.825+0000 7f4b39a8a740 1 -- 172.21.15.73:0/3904046399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 msgr2=0x55c00bf58e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.825+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/3904046399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf58e10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4b30000b60 tx=0x7f4b300ac040 comp rx=0 tx=0).stop 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.825+0000 7f4b39a8a740 1 -- 172.21.15.73:0/3904046399 shutdown_connections 2024-09-05T13:03:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.825+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/3904046399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf38d30 0x55c00bf58e10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.825+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/3904046399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2f540 0x55c00bf31060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.825+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/3904046399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf2df90 0x55c00bf30b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.825+0000 7f4b39a8a740 1 -- 172.21.15.73:0/3904046399 >> 172.21.15.73:0/3904046399 conn(0x55c00beee310 msgr2=0x55c00bf20eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.827+0000 7f4b39a8a740 1 -- 172.21.15.73:0/3904046399 shutdown_connections 2024-09-05T13:03:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.828+0000 7f4b39a8a740 1 -- 172.21.15.73:0/3904046399 wait complete. 2024-09-05T13:03:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.828+0000 7f4b39a8a740 1 -- start start 2024-09-05T13:03:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.828+0000 7f4b39a8a740 1 Processor -- start 2024-09-05T13:03:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2df90 0x55c00bf28550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2f540 0x55c00bf23880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b39a8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf38d30 0x55c00bf23dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2813d280 con 0x55c00bf2f540 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2813e6b0 con 0x55c00bf2df90 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b39a8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2813d910 con 0x55c00bf38d30 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b39a8a740 10 client.0 _ll_register_callbacks cb 0x7f4b2c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b34c4f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2f540 0x55c00bf23880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b34c4f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2f540 0x55c00bf23880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47160/0 (socket says 172.21.15.73:47160) 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b34c4f640 1 -- 172.21.15.73:0/2391202388 learned_addr learned my addr 172.21.15.73:0/2391202388 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.829+0000 7f4b35450640 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2df90 0x55c00bf28550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.831+0000 7f4b34c4f640 1 -- 172.21.15.73:0/2391202388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf38d30 msgr2=0x55c00bf23dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.831+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf38d30 0x55c00bf23dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.831+0000 7f4b34c4f640 1 -- 172.21.15.73:0/2391202388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2df90 msgr2=0x55c00bf28550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.831+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2df90 0x55c00bf28550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.831+0000 7f4b34c4f640 1 -- 172.21.15.73:0/2391202388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c00bf24430 con 0x55c00bf2f540 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.831+0000 7f4b34c4f640 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2f540 0x55c00bf23880 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000e6b0 tx=0x7f4b20009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba091573ec9d5b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.831+0000 7f4b18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.832+0000 7f4b18ff9640 1 -- 172.21.15.73:0/2391202388 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20034060 con 0x55c00bf2f540 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.832+0000 7f4b18ff9640 1 -- 172.21.15.73:0/2391202388 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f4b20019630 con 0x55c00bf2f540 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.834+0000 7f4b39a8a740 1 -- 172.21.15.73:0/2391202388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b3009b040 con 0x55c00bf2f540 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.834+0000 7f4b18ff9640 1 -- 172.21.15.73:0/2391202388 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f4b2001e040 con 0x55c00bf2f540 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.835+0000 7f4b39a8a740 10 client.16248 fetch_fsmap learned FSMap version 41 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.835+0000 7f4b39a8a740 1 -- 172.21.15.73:0/2391202388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c00bfbbcb0 con 0x55c00bf2f540 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.835+0000 7f4b18ff9640 1 -- 172.21.15.73:0/2391202388 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b3009b040 con 0x55c00bf2f540 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.835+0000 7f4b18ff9640 1 -- 172.21.15.73:0/2391202388 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 8354+0+0 (secure 0 0 0) 0x7f4b2000e750 con 0x55c00bf2f540 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.835+0000 7f4b39a8a740 10 client.16248 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.835+0000 7f4b39a8a740 10 client.16248 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.835+0000 7f4b39a8a740 20 client.16248 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.836+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55c00bf512e0 0x55c00bfbe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.836+0000 7f4b39a8a740 4 client.16248 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:03:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.836+0000 7f4b39a8a740 1 -- 172.21.15.73:0/2391202388 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c00be92d70 con 0x55c00bf512e0 2024-09-05T13:03:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.836+0000 7f4b35450640 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55c00bf512e0 0x55c00bfbe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.837+0000 7f4b35450640 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55c00bf512e0 0x55c00bfbe260 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=636f17d3974fcbe0 server_cookie=31d377959d52c81f in_seq=0 out_seq=0 2024-09-05T13:03:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.837+0000 7f4b18ff9640 10 client.16248 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T13:03:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.838+0000 7f4b18ff9640 1 -- 172.21.15.73:0/2391202388 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c00be92d70 con 0x55c00bf512e0 2024-09-05T13:03:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.838+0000 7f4b18ff9640 10 client.16248 handle_command_reply: tid=0 2024-09-05T13:03:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.838+0000 7f4b39a8a740 1 client.16248 shutdown 2024-09-05T13:03:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b39a8a740 1 -- 172.21.15.73:0/2391202388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2f540 msgr2=0x55c00bf23880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2f540 0x55c00bf23880 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000e6b0 tx=0x7f4b20009850 comp rx=0 tx=0).stop 2024-09-05T13:03:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b39a8a740 1 -- 172.21.15.73:0/2391202388 shutdown_connections 2024-09-05T13:03:52.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55c00bf512e0 0x55c00bfbe260 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c00bf38d30 0x55c00bf23dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c00bf2f540 0x55c00bf23880 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.965 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b39a8a740 1 --2- 172.21.15.73:0/2391202388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c00bf2df90 0x55c00bf28550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b39a8a740 1 -- 172.21.15.73:0/2391202388 >> 172.21.15.73:0/2391202388 conn(0x55c00beee310 msgr2=0x55c00bf351e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b18ff9640 0 client.16248 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b39a8a740 1 -- 172.21.15.73:0/2391202388 shutdown_connections 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.839+0000 7f4b39a8a740 1 -- 172.21.15.73:0/2391202388 wait complete. 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.840+0000 7f4b39a8a740 20 client.16248 trim_cache size 0 max 16384 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.841+0000 7f4b36452640 1 -- 172.21.15.73:0/2025326368 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4b1c0a2c10 msgr2=0x7f4b1c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.841+0000 7f4b36452640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4b1c0a2c10 0x7f4b1c0a50d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4b300637b0 tx=0x7f4b30068300 comp rx=0 tx=0).stop 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.841+0000 7f4b36452640 1 -- 172.21.15.73:0/2025326368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b28004cb0 msgr2=0x7f4b2812df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.841+0000 7f4b36452640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b28004cb0 0x7f4b2812df40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00e9f0 tx=0x7f4b2c00eeb0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.842+0000 7f4b36452640 1 -- 172.21.15.73:0/2025326368 shutdown_connections 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.842+0000 7f4b36452640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f4b1c0a2c10 0x7f4b1c0a50d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.842+0000 7f4b36452640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b2809b600 0x7f4b28132810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.842+0000 7f4b36452640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28005650 0x7f4b2812e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.842+0000 7f4b36452640 1 --2- 172.21.15.73:0/2025326368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b28004cb0 0x7f4b2812df40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:52.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.842+0000 7f4b36452640 1 -- 172.21.15.73:0/2025326368 >> 172.21.15.73:0/2025326368 conn(0x7f4b2800a1f0 msgr2=0x7f4b28093420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:52.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.843+0000 7f4b36452640 1 -- 172.21.15.73:0/2025326368 shutdown_connections 2024-09-05T13:03:52.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:51.843+0000 7f4b36452640 1 -- 172.21.15.73:0/2025326368 wait complete. 2024-09-05T13:03:53.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:53 smithi073 ceph-mon[30883]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.35k op/s 2024-09-05T13:03:53.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:53 smithi162 ceph-mon[34220]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.35k op/s 2024-09-05T13:03:53.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:53 smithi169 ceph-mon[34823]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.35k op/s 2024-09-05T13:03:55.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:55 smithi073 ceph-mon[30883]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 6.47k op/s 2024-09-05T13:03:55.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:55 smithi162 ceph-mon[34220]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 6.47k op/s 2024-09-05T13:03:55.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:55 smithi169 ceph-mon[34823]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 6.47k op/s 2024-09-05T13:03:57.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T13:03:57.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:57 smithi073 ceph-mon[30883]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 6.31k op/s 2024-09-05T13:03:57.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:57 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:03:57.565 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:03:57.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:57 smithi162 ceph-mon[34220]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 6.31k op/s 2024-09-05T13:03:57.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:57 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:03:57.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:57 smithi169 ceph-mon[34823]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 6.31k op/s 2024-09-05T13:03:57.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:57 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:03:58.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.244+0000 7fecf0b72640 1 -- 172.21.15.73:0/891126780 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8031940 con 0x7fecec06ea30 2024-09-05T13:03:58.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.244+0000 7fecf2b76640 1 -- 172.21.15.73:0/891126780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecec06ea30 msgr2=0x7fecec06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:58.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.244+0000 7fecf2b76640 1 --2- 172.21.15.73:0/891126780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecec06ea30 0x7fecec06ee70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fece8009900 tx=0x7fece802a420 comp rx=0 tx=0).stop 2024-09-05T13:03:58.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.247+0000 7fecf2b76640 1 -- 172.21.15.73:0/891126780 shutdown_connections 2024-09-05T13:03:58.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.247+0000 7fecf2b76640 1 --2- 172.21.15.73:0/891126780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecec11b140 0x7fecec11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.247+0000 7fecf2b76640 1 --2- 172.21.15.73:0/891126780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecec06ea30 0x7fecec06ee70 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.247+0000 7fecf2b76640 1 --2- 172.21.15.73:0/891126780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecec110190 0x7fecec06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.247+0000 7fecf2b76640 1 -- 172.21.15.73:0/891126780 >> 172.21.15.73:0/891126780 conn(0x7fecec073180 msgr2=0x7fecec073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.249+0000 7fecf2b76640 1 -- 172.21.15.73:0/891126780 shutdown_connections 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.249+0000 7fecf2b76640 1 -- 172.21.15.73:0/891126780 wait complete. 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.249+0000 7fecf2b76640 1 Processor -- start 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf2b76640 1 -- start start 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf2b76640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecec06ea30 0x7fecec118850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf2b76640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecec110190 0x7fecec1118e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf2b76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecec11b140 0x7fecec111e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf2b76640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fecec120be0 con 0x7fecec11b140 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf2b76640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fecec120a60 con 0x7fecec06ea30 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf2b76640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fecec120d60 con 0x7fecec110190 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf2375640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecec11b140 0x7fecec111e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf2375640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecec11b140 0x7fecec111e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50320/0 (socket says 172.21.15.73:50320) 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf2375640 1 -- 172.21.15.73:0/348900109 learned_addr learned my addr 172.21.15.73:0/348900109 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.250+0000 7fecf1373640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecec110190 0x7fecec1118e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.251+0000 7fecf2375640 1 -- 172.21.15.73:0/348900109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecec110190 msgr2=0x7fecec1118e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.251+0000 7fecf2375640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecec110190 0x7fecec1118e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.251+0000 7fecf2375640 1 -- 172.21.15.73:0/348900109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecec06ea30 msgr2=0x7fecec118850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.251+0000 7fecf2375640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecec06ea30 0x7fecec118850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.251+0000 7fecf2375640 1 -- 172.21.15.73:0/348900109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec112550 con 0x7fecec11b140 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.251+0000 7fecf2375640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecec11b140 0x7fecec111e20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fece400eab0 tx=0x7fece4009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.254+0000 7fecdeffd640 1 -- 172.21.15.73:0/348900109 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece400ce40 con 0x7fecec11b140 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.254+0000 7fecdeffd640 1 -- 172.21.15.73:0/348900109 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fece4005020 con 0x7fecec11b140 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.254+0000 7fecdeffd640 1 -- 172.21.15.73:0/348900109 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4010720 con 0x7fecec11b140 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.254+0000 7fecf2b76640 1 -- 172.21.15.73:0/348900109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecec116380 con 0x7fecec11b140 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.254+0000 7fecf2b76640 1 -- 172.21.15.73:0/348900109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecec116840 con 0x7fecec11b140 2024-09-05T13:03:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.258+0000 7fecf61ae740 1 Processor -- start 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.258+0000 7fecf61ae740 1 -- start start 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.258+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 0x55b8383c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.258+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 0x55b8383c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.258+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.258+0000 7fecf61ae740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b83832c2f0 con 0x55b8383c7d30 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.258+0000 7fecf61ae740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b8382d3cf0 con 0x55b8383c6780 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.258+0000 7fecf61ae740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b8383282b0 con 0x55b8383d1520 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.259+0000 7fecf1373640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.259+0000 7fecf1373640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383d3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:37688/0 (socket says 172.21.15.73:37688) 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.259+0000 7fecf1373640 1 -- 172.21.15.73:0/1577128215 learned_addr learned my addr 172.21.15.73:0/1577128215 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.259+0000 7fecf1373640 1 -- 172.21.15.73:0/1577128215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 msgr2=0x55b8383c6be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.259+0000 7fecf1373640 1 --2- 172.21.15.73:0/1577128215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 0x55b8383c6be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.259+0000 7fecf1373640 1 -- 172.21.15.73:0/1577128215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 msgr2=0x55b8383c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.259+0000 7fecf1373640 1 --2- 172.21.15.73:0/1577128215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 0x55b8383c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.259+0000 7fecf1373640 1 -- 172.21.15.73:0/1577128215 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8382b83a0 con 0x55b8383d1520 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.260+0000 7fecf1373640 1 --2- 172.21.15.73:0/1577128215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383d3910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fece8009900 tx=0x7fece8009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fff130266767ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.264+0000 7fecd7fff640 1 -- 172.21.15.73:0/1577128215 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8035040 con 0x55b8383d1520 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.264+0000 7fecd7fff640 1 -- 172.21.15.73:0/1577128215 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fece8004040 con 0x55b8383d1520 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.264+0000 7fecd7fff640 1 -- 172.21.15.73:0/1577128215 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8003a60 con 0x55b8383d1520 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.266+0000 7fecf61ae740 1 -- 172.21.15.73:0/1577128215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 msgr2=0x55b8383d3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.266+0000 7fecf61ae740 1 --2- 172.21.15.73:0/1577128215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383d3910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fece8009900 tx=0x7fece8009680 comp rx=0 tx=0).stop 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.267+0000 7fecdeffd640 1 -- 172.21.15.73:0/348900109 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fece4004a40 con 0x7fecec11b140 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.267+0000 7fecdeffd640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fecd80a2d50 0x7fecd80a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.268+0000 7fecdeffd640 1 -- 172.21.15.73:0/348900109 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fece40cf730 con 0x7fecec11b140 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.271+0000 7fecf61ae740 1 -- 172.21.15.73:0/1577128215 shutdown_connections 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.271+0000 7fecf61ae740 1 --2- 172.21.15.73:0/1577128215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383d3910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.271+0000 7fecf61ae740 1 --2- 172.21.15.73:0/1577128215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 0x55b8383c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.271+0000 7fecf61ae740 1 --2- 172.21.15.73:0/1577128215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 0x55b8383c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.271+0000 7fecf61ae740 1 -- 172.21.15.73:0/1577128215 >> 172.21.15.73:0/1577128215 conn(0x55b83838f310 msgr2=0x55b8383c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.271+0000 7fecf1373640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fecd80a2d50 0x7fecd80a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.272+0000 7fecf61ae740 1 -- 172.21.15.73:0/1577128215 shutdown_connections 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.272+0000 7fecf1373640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fecd80a2d50 0x7fecd80a5210 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fece80095c0 tx=0x7fece8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.274+0000 7fecf61ae740 1 -- 172.21.15.73:0/1577128215 wait complete. 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.274+0000 7fecf61ae740 1 -- start start 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.274+0000 7fecf61ae740 1 Processor -- start 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.275+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 0x55b8383d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.275+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 0x55b8383ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.275+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.275+0000 7fecf61ae740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b8383d4220 con 0x55b8383c7d30 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.275+0000 7fecf61ae740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b8382e7060 con 0x55b8383c6780 2024-09-05T13:03:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.275+0000 7fecf61ae740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b8383d43a0 con 0x55b8383d1520 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.275+0000 7fecf61ae740 10 client.0 _ll_register_callbacks cb 0x55b83803a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.276+0000 7fecf2375640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.276+0000 7fecf2375640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:37694/0 (socket says 172.21.15.73:37694) 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.276+0000 7fecf2375640 1 -- 172.21.15.73:0/1559704694 learned_addr learned my addr 172.21.15.73:0/1559704694 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.276+0000 7fecf1b74640 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 0x55b8383d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.277+0000 7fecf2375640 1 -- 172.21.15.73:0/1559704694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 msgr2=0x55b8383d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.277+0000 7fecf2375640 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 0x55b8383d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.277+0000 7fecf2375640 1 -- 172.21.15.73:0/1559704694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 msgr2=0x55b8383ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.277+0000 7fecf2375640 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 0x55b8383ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.277+0000 7fecf2375640 1 -- 172.21.15.73:0/1559704694 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b83809d3c0 con 0x55b8383d1520 2024-09-05T13:03:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.277+0000 7fecf2375640 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383ce7b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fece4098370 tx=0x7fece409bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883162d323dae13c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.277+0000 7fecd57fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.277+0000 7fecd57fa640 1 -- 172.21.15.73:0/1559704694 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece40b4070 con 0x55b8383d1520 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.277+0000 7fecd57fa640 1 -- 172.21.15.73:0/1559704694 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fece40051d0 con 0x55b8383d1520 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.279+0000 7fecf61ae740 1 -- 172.21.15.73:0/1559704694 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fece8004040 con 0x55b8383d1520 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.279+0000 7fecd57fa640 1 -- 172.21.15.73:0/1559704694 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fece40a4bd0 con 0x55b8383d1520 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.279+0000 7fecf61ae740 10 client.25840 fetch_fsmap learned FSMap version 42 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.279+0000 7fecf61ae740 1 -- 172.21.15.73:0/1559704694 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b8383dfd80 con 0x55b8383d1520 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.280+0000 7fecd57fa640 1 -- 172.21.15.73:0/1559704694 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fece8004040 con 0x55b8383d1520 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.280+0000 7fecd57fa640 1 -- 172.21.15.73:0/1559704694 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 42) ==== 8350+0+0 (secure 0 0 0) 0x7fece401f9d0 con 0x55b8383d1520 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.280+0000 7fecf61ae740 10 client.25840 fetch_fsmap finished waiting for FSMap version 42 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.280+0000 7fecf61ae740 10 client.25840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.280+0000 7fecf61ae740 20 client.25840 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.280+0000 7fecf61ae740 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b8383e1240 0x55b8383e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.280+0000 7fecf61ae740 4 client.25840 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:03:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.280+0000 7fecf61ae740 1 -- 172.21.15.73:0/1559704694 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b838339860 con 0x55b8383e1240 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.281+0000 7fecf1b74640 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b8383e1240 0x55b8383e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.282+0000 7fecf1b74640 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b8383e1240 0x55b8383e36b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=accd7d6b9a970204 server_cookie=191f6fb7d941ce9c in_seq=0 out_seq=0 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.282+0000 7fecd57fa640 10 client.25840 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.282+0000 7fecd57fa640 1 -- 172.21.15.73:0/1559704694 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b838339860 con 0x55b8383e1240 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecd57fa640 10 client.25840 handle_command_reply: tid=0 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecf61ae740 1 client.25840 shutdown 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecf61ae740 1 -- 172.21.15.73:0/1559704694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 msgr2=0x55b8383ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecf61ae740 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383ce7b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fece4098370 tx=0x7fece409bf60 comp rx=0 tx=0).stop 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecf61ae740 1 -- 172.21.15.73:0/1559704694 shutdown_connections 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecf61ae740 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b8383e1240 0x55b8383e36b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecf61ae740 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383ce7b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecf61ae740 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 0x55b8383ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecd57fa640 0 client.25840 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecf61ae740 1 --2- 172.21.15.73:0/1559704694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 0x55b8383d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecf61ae740 1 -- 172.21.15.73:0/1559704694 >> 172.21.15.73:0/1559704694 conn(0x55b83838f310 msgr2=0x55b8383c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.283+0000 7fecf61ae740 1 -- 172.21.15.73:0/1559704694 shutdown_connections 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.284+0000 7fecf61ae740 1 -- 172.21.15.73:0/1559704694 wait complete. 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.284+0000 7fecf61ae740 20 client.25840 trim_cache size 0 max 16384 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf61ae740 1 Processor -- start 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf61ae740 1 -- start start 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 0x55b8383c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 0x55b8383dd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf61ae740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1b60e0 con 0x55b8383c7d30 2024-09-05T13:03:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf61ae740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1b3980 con 0x55b8383c6780 2024-09-05T13:03:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf61ae740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1b17d0 con 0x55b8383d1520 2024-09-05T13:03:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf2375640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf2375640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383e8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:37700/0 (socket says 172.21.15.73:37700) 2024-09-05T13:03:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.307+0000 7fecf2375640 1 -- 172.21.15.73:0/607571418 learned_addr learned my addr 172.21.15.73:0/607571418 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.308+0000 7fecf2375640 1 -- 172.21.15.73:0/607571418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 msgr2=0x55b8383c2fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:03:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.308+0000 7fecf2375640 1 --2- 172.21.15.73:0/607571418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 0x55b8383c2fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.308+0000 7fecf2375640 1 -- 172.21.15.73:0/607571418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 msgr2=0x55b8383dd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.308+0000 7fecf2375640 1 --2- 172.21.15.73:0/607571418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 0x55b8383dd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.308+0000 7fecf2375640 1 -- 172.21.15.73:0/607571418 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8383dda60 con 0x55b8383d1520 2024-09-05T13:03:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.308+0000 7fecf2375640 1 --2- 172.21.15.73:0/607571418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383e8f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fece40a04d0 tx=0x7fece40bc130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9998f947adca4fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.308+0000 7fecd77fe640 1 -- 172.21.15.73:0/607571418 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece40b4070 con 0x55b8383d1520 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.309+0000 7fecd77fe640 1 -- 172.21.15.73:0/607571418 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fece40054d0 con 0x55b8383d1520 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.309+0000 7fecd77fe640 1 -- 172.21.15.73:0/607571418 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece40baba0 con 0x55b8383d1520 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.310+0000 7fecf61ae740 1 -- 172.21.15.73:0/607571418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 msgr2=0x55b8383e8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.310+0000 7fecf61ae740 1 --2- 172.21.15.73:0/607571418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383e8f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fece40a04d0 tx=0x7fece40bc130 comp rx=0 tx=0).stop 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.310+0000 7fecf61ae740 1 -- 172.21.15.73:0/607571418 shutdown_connections 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.310+0000 7fecf61ae740 1 --2- 172.21.15.73:0/607571418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383d1520 0x55b8383e8f50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.310+0000 7fecf61ae740 1 --2- 172.21.15.73:0/607571418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383c7d30 0x55b8383dd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.310+0000 7fecf61ae740 1 --2- 172.21.15.73:0/607571418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c6780 0x55b8383c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.310+0000 7fecf61ae740 1 -- 172.21.15.73:0/607571418 >> 172.21.15.73:0/607571418 conn(0x55b83838f310 msgr2=0x55b8383c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.313+0000 7fecf61ae740 1 -- 172.21.15.73:0/607571418 shutdown_connections 2024-09-05T13:03:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.313+0000 7fecf61ae740 1 -- 172.21.15.73:0/607571418 wait complete. 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.314+0000 7fecf61ae740 1 -- start start 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.314+0000 7fecf61ae740 1 Processor -- start 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.314+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383c6780 0x55b8383d57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.314+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c7d30 0x55b8383d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.314+0000 7fecf61ae740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383d1520 0x55b83844af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.314+0000 7fecf61ae740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1b1e40 con 0x55b8383d1520 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.315+0000 7fecf61ae740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1b32b0 con 0x55b8383c7d30 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.315+0000 7fecf61ae740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1b2510 con 0x55b8383c6780 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.315+0000 7fecf61ae740 10 client.0 _ll_register_callbacks cb 0x7fece4098200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.315+0000 7fecf1373640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c7d30 0x55b8383d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.315+0000 7fecf1b74640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383c6780 0x55b8383d57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.315+0000 7fecf1373640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c7d30 0x55b8383d5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:43608/0 (socket says 172.21.15.73:43608) 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.315+0000 7fecf1373640 1 -- 172.21.15.73:0/4081149729 learned_addr learned my addr 172.21.15.73:0/4081149729 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.316+0000 7fecf1373640 1 -- 172.21.15.73:0/4081149729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383c6780 msgr2=0x55b8383d57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.316+0000 7fecf1373640 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383c6780 0x55b8383d57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.316+0000 7fecf1373640 1 -- 172.21.15.73:0/4081149729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383d1520 msgr2=0x55b83844af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:03:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.316+0000 7fecf1373640 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383d1520 0x55b83844af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.316+0000 7fecf1373640 1 -- 172.21.15.73:0/4081149729 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8383d65d0 con 0x55b8383c7d30 2024-09-05T13:03:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.316+0000 7fecf1373640 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c7d30 0x55b8383d5cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fece8009230 tx=0x7fece8003770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940f33de93f23d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:03:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.317+0000 7fecd57fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:03:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.317+0000 7fecd57fa640 1 -- 172.21.15.73:0/4081149729 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8035040 con 0x55b8383c7d30 2024-09-05T13:03:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.317+0000 7fecd57fa640 1 -- 172.21.15.73:0/4081149729 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fece8003880 con 0x55b8383c7d30 2024-09-05T13:03:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.317+0000 7fecf61ae740 1 -- 172.21.15.73:0/4081149729 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fece40054d0 con 0x55b8383c7d30 2024-09-05T13:03:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.317+0000 7fecd57fa640 1 -- 172.21.15.73:0/4081149729 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fece8062070 con 0x55b8383c7d30 2024-09-05T13:03:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.317+0000 7fecf61ae740 10 client.25736 fetch_fsmap learned FSMap version 42 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.317+0000 7fecf61ae740 1 -- 172.21.15.73:0/4081149729 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b83844c5a0 con 0x55b8383c7d30 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.318+0000 7fecd57fa640 1 -- 172.21.15.73:0/4081149729 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fece40054d0 con 0x55b8383c7d30 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.319+0000 7fecd57fa640 1 -- 172.21.15.73:0/4081149729 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 42) ==== 8350+0+0 (secure 0 0 0) 0x7fece803a040 con 0x55b8383c7d30 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.319+0000 7fecf61ae740 10 client.25736 fetch_fsmap finished waiting for FSMap version 42 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.319+0000 7fecf61ae740 10 client.25736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.319+0000 7fecf61ae740 20 client.25736 populate_metadata read hostname 'smithi073' 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.319+0000 7fecf61ae740 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b83844cce0 0x55b83844f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.319+0000 7fecf61ae740 4 client.25736 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.319+0000 7fecf61ae740 1 -- 172.21.15.73:0/4081149729 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b838333d70 con 0x55b83844cce0 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.319+0000 7fecf1b74640 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b83844cce0 0x55b83844f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.320+0000 7fecf1b74640 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b83844cce0 0x55b83844f100 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87bcd2b65c6a6162 server_cookie=ec8694913cf0e9aa in_seq=0 out_seq=0 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.320+0000 7fecd57fa640 10 client.25736 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.320+0000 7fecd57fa640 1 -- 172.21.15.73:0/4081149729 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b838333d70 con 0x55b83844cce0 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.320+0000 7fecd57fa640 10 client.25736 handle_command_reply: tid=0 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.320+0000 7fecf61ae740 1 client.25736 shutdown 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecf61ae740 1 -- 172.21.15.73:0/4081149729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c7d30 msgr2=0x55b8383d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecf61ae740 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c7d30 0x55b8383d5cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fece8009230 tx=0x7fece8003770 comp rx=0 tx=0).stop 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecf61ae740 1 -- 172.21.15.73:0/4081149729 shutdown_connections 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecf61ae740 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55b83844cce0 0x55b83844f100 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecf61ae740 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8383d1520 0x55b83844af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecf61ae740 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8383c7d30 0x55b8383d5cf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecf61ae740 1 --2- 172.21.15.73:0/4081149729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8383c6780 0x55b8383d57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecf61ae740 1 -- 172.21.15.73:0/4081149729 >> 172.21.15.73:0/4081149729 conn(0x55b83838f310 msgr2=0x55b8383d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecd57fa640 0 client.25736 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecf61ae740 1 -- 172.21.15.73:0/4081149729 shutdown_connections 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.321+0000 7fecf61ae740 1 -- 172.21.15.73:0/4081149729 wait complete. 2024-09-05T13:03:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.322+0000 7fecf61ae740 20 client.25736 trim_cache size 0 max 16384 2024-09-05T13:03:58.338 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:03:58.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 -- 172.21.15.73:0/348900109 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fecd80a2d50 msgr2=0x7fecd80a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:58.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fecd80a2d50 0x7fecd80a5210 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fece80095c0 tx=0x7fece8009260 comp rx=0 tx=0).stop 2024-09-05T13:03:58.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 -- 172.21.15.73:0/348900109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecec11b140 msgr2=0x7fecec111e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:03:58.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecec11b140 0x7fecec111e20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fece400eab0 tx=0x7fece4009f80 comp rx=0 tx=0).stop 2024-09-05T13:03:58.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 -- 172.21.15.73:0/348900109 shutdown_connections 2024-09-05T13:03:58.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fecd80a2d50 0x7fecd80a5210 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecec11b140 0x7fecec111e20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecec110190 0x7fecec1118e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 --2- 172.21.15.73:0/348900109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecec06ea30 0x7fecec118850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:03:58.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 -- 172.21.15.73:0/348900109 >> 172.21.15.73:0/348900109 conn(0x7fecec073180 msgr2=0x7fecec1194a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:03:58.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 -- 172.21.15.73:0/348900109 shutdown_connections 2024-09-05T13:03:58.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:03:58.324+0000 7fecf2b76640 1 -- 172.21.15.73:0/348900109 wait complete. 2024-09-05T13:03:58.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:03:58 smithi073 ceph-mon[30883]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.30k op/s 2024-09-05T13:03:58.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:03:58 smithi162 ceph-mon[34220]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.30k op/s 2024-09-05T13:03:58.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:03:58 smithi169 ceph-mon[34823]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 4.30k op/s 2024-09-05T13:04:00.006 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T13:04:00.007 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T13:04:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:04:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.057+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3880366212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ecc09a4c0 msgr2=0x7f3ecc09a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.058+0000 7f3ed9a44640 1 --2- 172.21.15.73:0/3880366212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ecc09a4c0 0x7f3ecc09a8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009900 tx=0x7f3ec402a420 comp rx=0 tx=0).stop 2024-09-05T13:04:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.058+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3880366212 shutdown_connections 2024-09-05T13:04:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.058+0000 7f3ed9a44640 1 --2- 172.21.15.73:0/3880366212 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ecc0051d0 0x7f3ecc097fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.058+0000 7f3ed9a44640 1 --2- 172.21.15.73:0/3880366212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc004740 0x7f3ecc004b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.058+0000 7f3ed9a44640 1 --2- 172.21.15.73:0/3880366212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ecc09a4c0 0x7f3ecc09a8a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.058+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3880366212 >> 172.21.15.73:0/3880366212 conn(0x7f3ecc00a1b0 msgr2=0x7f3ecc00a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.058+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3880366212 shutdown_connections 2024-09-05T13:04:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.058+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3880366212 wait complete. 2024-09-05T13:04:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.059+0000 7f3ed9a44640 1 Processor -- start 2024-09-05T13:04:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.059+0000 7f3ed9a44640 1 -- start start 2024-09-05T13:04:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.060+0000 7f3ed9a44640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ecc004740 0x7f3ecc1323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.060+0000 7f3ed9a44640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ecc0051d0 0x7f3ecc132900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.060+0000 7f3ed9a44640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc09a4c0 0x7f3ecc136c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.060+0000 7f3ed9a44640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc0ac0a0 con 0x7f3ecc004740 2024-09-05T13:04:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.060+0000 7f3ed9a44640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc0abf20 con 0x7f3ecc09a4c0 2024-09-05T13:04:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.060+0000 7f3ed9a44640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc0ac220 con 0x7f3ecc0051d0 2024-09-05T13:04:01.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.060+0000 7f3ed37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc09a4c0 0x7f3ecc136c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.060+0000 7f3ed37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc09a4c0 0x7f3ecc136c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:43624/0 (socket says 172.21.15.73:43624) 2024-09-05T13:04:01.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.060+0000 7f3ed37fe640 1 -- 172.21.15.73:0/3358113294 learned_addr learned my addr 172.21.15.73:0/3358113294 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:01.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.061+0000 7f3ed27fc640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ecc0051d0 0x7f3ecc132900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.061+0000 7f3ed37fe640 1 -- 172.21.15.73:0/3358113294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ecc0051d0 msgr2=0x7f3ecc132900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.061+0000 7f3ed37fe640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ecc0051d0 0x7f3ecc132900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.061+0000 7f3ed37fe640 1 -- 172.21.15.73:0/3358113294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ecc004740 msgr2=0x7f3ecc1323c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.061+0000 7f3ed37fe640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ecc004740 0x7f3ecc1323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.061+0000 7f3ed37fe640 1 -- 172.21.15.73:0/3358113294 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc137370 con 0x7f3ecc09a4c0 2024-09-05T13:04:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.061+0000 7f3ed27fc640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ecc0051d0 0x7f3ecc132900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:04:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.061+0000 7f3ed37fe640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc09a4c0 0x7f3ecc136c90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4067960 tx=0x7f3ed406bb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.062+0000 7f3ed8a42640 1 -- 172.21.15.73:0/3358113294 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4086070 con 0x7f3ecc09a4c0 2024-09-05T13:04:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.062+0000 7f3ed8a42640 1 -- 172.21.15.73:0/3358113294 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ed4074dc0 con 0x7f3ecc09a4c0 2024-09-05T13:04:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.062+0000 7f3ed8a42640 1 -- 172.21.15.73:0/3358113294 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4080860 con 0x7f3ecc09a4c0 2024-09-05T13:04:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.065+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3358113294 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ecc137660 con 0x7f3ecc09a4c0 2024-09-05T13:04:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.065+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3358113294 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ecc137ac0 con 0x7f3ecc09a4c0 2024-09-05T13:04:01.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.070+0000 7f3edbe1a740 1 Processor -- start 2024-09-05T13:04:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.073+0000 7f3ed8a42640 1 -- 172.21.15.73:0/3358113294 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3ed4081bd0 con 0x7f3ecc09a4c0 2024-09-05T13:04:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.074+0000 7f3ed8a42640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3ebc0a2c10 0x7f3ebc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.074+0000 7f3ed8a42640 1 -- 172.21.15.73:0/3358113294 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f3ed413a950 con 0x7f3ecc09a4c0 2024-09-05T13:04:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.074+0000 7f3ed27fc640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3ebc0a2c10 0x7f3ebc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.075+0000 7f3ed27fc640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3ebc0a2c10 0x7f3ebc0a50d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0943a0 tx=0x7f3ec8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3edbe1a740 1 -- start start 2024-09-05T13:04:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ebb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ebb660 0x555c26ec59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ec5f20 0x555c26ec8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3edbe1a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555c26e20280 con 0x555c26ec5f20 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3edbe1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555c26dc7b10 con 0x555c26ebad40 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3edbe1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555c26e1c240 con 0x555c26ebb660 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3ed2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ebb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3ed2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ebb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:43638/0 (socket says 172.21.15.73:43638) 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3ed2ffd640 1 -- 172.21.15.73:0/1904820220 learned_addr learned my addr 172.21.15.73:0/1904820220 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3ed27fc640 1 --2- 172.21.15.73:0/1904820220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ebb660 0x555c26ec59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.076+0000 7f3ed37fe640 1 --2- 172.21.15.73:0/1904820220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ec5f20 0x555c26ec8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.077+0000 7f3ed2ffd640 1 -- 172.21.15.73:0/1904820220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ebb660 msgr2=0x555c26ec59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.077+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/1904820220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ebb660 0x555c26ec59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.077+0000 7f3ed2ffd640 1 -- 172.21.15.73:0/1904820220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ec5f20 msgr2=0x555c26ec8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.077+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/1904820220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ec5f20 0x555c26ec8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.077+0000 7f3ed2ffd640 1 -- 172.21.15.73:0/1904820220 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c26dd41f0 con 0x555c26ebad40 2024-09-05T13:04:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.078+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/1904820220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ebb120 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3ec402a940 tx=0x7f3ec400b050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fd3782ea9a18f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.078+0000 7f3eb9ffb640 1 -- 172.21.15.73:0/1904820220 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec403e070 con 0x555c26ebad40 2024-09-05T13:04:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.078+0000 7f3eb9ffb640 1 -- 172.21.15.73:0/1904820220 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec4005450 con 0x555c26ebad40 2024-09-05T13:04:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.078+0000 7f3eb9ffb640 1 -- 172.21.15.73:0/1904820220 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4035040 con 0x555c26ebad40 2024-09-05T13:04:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.080+0000 7f3edbe1a740 1 -- 172.21.15.73:0/1904820220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 msgr2=0x555c26ebb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.080+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/1904820220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ebb120 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3ec402a940 tx=0x7f3ec400b050 comp rx=0 tx=0).stop 2024-09-05T13:04:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.085+0000 7f3edbe1a740 1 -- 172.21.15.73:0/1904820220 shutdown_connections 2024-09-05T13:04:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.085+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/1904820220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ec5f20 0x555c26ec8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.085+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/1904820220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ebb660 0x555c26ec59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.085+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/1904820220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ebb120 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.085+0000 7f3edbe1a740 1 -- 172.21.15.73:0/1904820220 >> 172.21.15.73:0/1904820220 conn(0x555c26eb72d0 msgr2=0x555c26eb76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.085+0000 7f3edbe1a740 1 -- 172.21.15.73:0/1904820220 shutdown_connections 2024-09-05T13:04:01.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.085+0000 7f3edbe1a740 1 -- 172.21.15.73:0/1904820220 wait complete. 2024-09-05T13:04:01.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.086+0000 7f3edbe1a740 1 -- start start 2024-09-05T13:04:01.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.086+0000 7f3edbe1a740 1 Processor -- start 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ebad40 0x555c26ec2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebb660 0x555c26ec32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ec5f20 0x555c26ec3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3edbe1a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555c26ec8a90 con 0x555c26ebad40 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3edbe1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555c26ddaf10 con 0x555c26ebb660 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3edbe1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555c26ec8c10 con 0x555c26ec5f20 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3ed27fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebb660 0x555c26ec32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3ed27fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebb660 0x555c26ec32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:43642/0 (socket says 172.21.15.73:43642) 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3ed27fc640 1 -- 172.21.15.73:0/3318943358 learned_addr learned my addr 172.21.15.73:0/3318943358 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3ed37fe640 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ec5f20 0x555c26ec3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3edbe1a740 10 client.0 _ll_register_callbacks cb 0x555c26da3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3ed27fc640 1 -- 172.21.15.73:0/3318943358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ec5f20 msgr2=0x555c26ec3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3ed27fc640 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ec5f20 0x555c26ec3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3ed27fc640 1 -- 172.21.15.73:0/3318943358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ebad40 msgr2=0x555c26ec2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3ed27fc640 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ebad40 0x555c26ec2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3ed27fc640 1 -- 172.21.15.73:0/3318943358 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c26b916a0 con 0x555c26ebb660 2024-09-05T13:04:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.087+0000 7f3ed37fe640 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ec5f20 0x555c26ec3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:04:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.088+0000 7f3ed27fc640 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebb660 0x555c26ec32e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8014460 tx=0x7f3ec80047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e76361123d6a04af server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.089+0000 7f3eb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:04:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.089+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3318943358 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8024020 con 0x555c26ebb660 2024-09-05T13:04:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.089+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3318943358 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ec4005450 con 0x555c26ebb660 2024-09-05T13:04:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.089+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3318943358 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f3ec800f040 con 0x555c26ebb660 2024-09-05T13:04:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.096+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3318943358 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3ec8020600 con 0x555c26ebb660 2024-09-05T13:04:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.096+0000 7f3edbe1a740 10 client.25745 fetch_fsmap learned FSMap version 42 2024-09-05T13:04:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.096+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3318943358 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555c26ed4760 con 0x555c26ebb660 2024-09-05T13:04:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.097+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3318943358 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec8020c80 con 0x555c26ebb660 2024-09-05T13:04:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.100+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3318943358 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 42) ==== 8350+0+0 (secure 0 0 0) 0x7f3ec8013070 con 0x555c26ebb660 2024-09-05T13:04:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.100+0000 7f3edbe1a740 10 client.25745 fetch_fsmap finished waiting for FSMap version 42 2024-09-05T13:04:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.100+0000 7f3edbe1a740 10 client.25745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:01.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.100+0000 7f3edbe1a740 20 client.25745 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:01.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.100+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x555c26ed6110 0x555c26ed85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.100+0000 7f3edbe1a740 4 client.25745 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:04:01.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.100+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3318943358 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3ec4005450 con 0x555c26ed6110 2024-09-05T13:04:01.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.101+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x555c26ed6110 0x555c26ed85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.102+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x555c26ed6110 0x555c26ed85b0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=777e7aab4356fae4 server_cookie=8436e8ced1034a5a in_seq=0 out_seq=0 2024-09-05T13:04:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.102+0000 7f3eb2ffd640 10 client.25745 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.103+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3318943358 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3ec4005450 con 0x555c26ed6110 2024-09-05T13:04:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.103+0000 7f3eb2ffd640 10 client.25745 handle_command_reply: tid=0 2024-09-05T13:04:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.103+0000 7f3edbe1a740 1 client.25745 shutdown 2024-09-05T13:04:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.109+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3318943358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebb660 msgr2=0x555c26ec32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.109+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebb660 0x555c26ec32e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8014460 tx=0x7f3ec80047d0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.109+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3318943358 shutdown_connections 2024-09-05T13:04:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.109+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x555c26ed6110 0x555c26ed85b0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.109+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26ec5f20 0x555c26ec3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.109+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebb660 0x555c26ec32e0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8014460 tx=0x7f3ec80047d0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.109+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3318943358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ebad40 0x555c26ec2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.109+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3318943358 >> 172.21.15.73:0/3318943358 conn(0x555c26eb72d0 msgr2=0x555c26ebcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.110+0000 7f3eb2ffd640 0 client.25745 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:01.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.110+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3318943358 shutdown_connections 2024-09-05T13:04:01.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.110+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3318943358 wait complete. 2024-09-05T13:04:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.112+0000 7f3edbe1a740 20 client.25745 trim_cache size 0 max 16384 2024-09-05T13:04:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.145+0000 7f3edbe1a740 1 Processor -- start 2024-09-05T13:04:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.146+0000 7f3edbe1a740 1 -- start start 2024-09-05T13:04:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.146+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ebad40 0x555c26ebd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.146+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ec5f20 0x555c26ec3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.146+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 0x555c26ede2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.146+0000 7f3edbe1a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc149e50 con 0x555c26ebad40 2024-09-05T13:04:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.146+0000 7f3edbe1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc1476f0 con 0x555c26ec5f20 2024-09-05T13:04:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.146+0000 7f3edbe1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc145540 con 0x555c26edde80 2024-09-05T13:04:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.146+0000 7f3ed37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 0x555c26ede2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.147+0000 7f3ed37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 0x555c26ede2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:37746/0 (socket says 172.21.15.73:37746) 2024-09-05T13:04:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.147+0000 7f3ed37fe640 1 -- 172.21.15.73:0/2221734358 learned_addr learned my addr 172.21.15.73:0/2221734358 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.147+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/2221734358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ebad40 0x555c26ebd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.147+0000 7f3ed2ffd640 1 -- 172.21.15.73:0/2221734358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 msgr2=0x555c26ede2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.147+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/2221734358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 0x555c26ede2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.147+0000 7f3ed2ffd640 1 -- 172.21.15.73:0/2221734358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ec5f20 msgr2=0x555c26ec3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.147+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/2221734358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ec5f20 0x555c26ec3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.147+0000 7f3ed2ffd640 1 -- 172.21.15.73:0/2221734358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c26ec8c00 con 0x555c26ebad40 2024-09-05T13:04:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.147+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/2221734358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ebad40 0x555c26ebd7a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4005ab0 tx=0x7f3ec40058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118614f1ad79f5ef server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.149+0000 7f3eb97fa640 1 -- 172.21.15.73:0/2221734358 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4051020 con 0x555c26ebad40 2024-09-05T13:04:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.149+0000 7f3eb97fa640 1 -- 172.21.15.73:0/2221734358 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec4005450 con 0x555c26ebad40 2024-09-05T13:04:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.149+0000 7f3eb97fa640 1 -- 172.21.15.73:0/2221734358 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec403e040 con 0x555c26ebad40 2024-09-05T13:04:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.150+0000 7f3edbe1a740 1 -- 172.21.15.73:0/2221734358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ebad40 msgr2=0x555c26ebd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.150+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/2221734358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ebad40 0x555c26ebd7a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4005ab0 tx=0x7f3ec40058b0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.151+0000 7f3edbe1a740 1 -- 172.21.15.73:0/2221734358 shutdown_connections 2024-09-05T13:04:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.151+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/2221734358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 0x555c26ede2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.151+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/2221734358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ec5f20 0x555c26ec3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.151+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/2221734358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ebad40 0x555c26ebd7a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.151+0000 7f3edbe1a740 1 -- 172.21.15.73:0/2221734358 >> 172.21.15.73:0/2221734358 conn(0x555c26eb72d0 msgr2=0x555c26ec4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.154+0000 7f3edbe1a740 1 -- 172.21.15.73:0/2221734358 shutdown_connections 2024-09-05T13:04:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.154+0000 7f3edbe1a740 1 -- 172.21.15.73:0/2221734358 wait complete. 2024-09-05T13:04:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.155+0000 7f3edbe1a740 1 -- start start 2024-09-05T13:04:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.155+0000 7f3edbe1a740 1 Processor -- start 2024-09-05T13:04:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.156+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ece4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.156+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ec5f20 0x555c26ebfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.156+0000 7f3edbe1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 0x555c26ebff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.156+0000 7f3ed2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ece4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.156+0000 7f3ed2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ece4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:43664/0 (socket says 172.21.15.73:43664) 2024-09-05T13:04:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.156+0000 7f3ed2ffd640 1 -- 172.21.15.73:0/3977809907 learned_addr learned my addr 172.21.15.73:0/3977809907 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.156+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc145bb0 con 0x555c26ec5f20 2024-09-05T13:04:01.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.157+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc147020 con 0x555c26ebad40 2024-09-05T13:04:01.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.157+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc146280 con 0x555c26edde80 2024-09-05T13:04:01.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.157+0000 7f3edbe1a740 10 client.0 _ll_register_callbacks cb 0x7f3ec800d7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:01.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.157+0000 7f3ed37fe640 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 0x555c26ebff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.157+0000 7f3ed27fc640 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ec5f20 0x555c26ebfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.158+0000 7f3ed37fe640 1 -- 172.21.15.73:0/3977809907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 msgr2=0x555c26ece4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.158+0000 7f3ed37fe640 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ece4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.158+0000 7f3ed37fe640 1 -- 172.21.15.73:0/3977809907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ec5f20 msgr2=0x555c26ebfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.158+0000 7f3ed37fe640 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ec5f20 0x555c26ebfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.158+0000 7f3ed37fe640 1 -- 172.21.15.73:0/3977809907 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c26ec0660 con 0x555c26edde80 2024-09-05T13:04:01.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.158+0000 7f3ed37fe640 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 0x555c26ebff50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4103640 tx=0x7f3ed4081f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea60a78c35b0d504 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.160+0000 7f3eb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:04:01.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.160+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3977809907 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed410b590 con 0x555c26edde80 2024-09-05T13:04:01.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.160+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3977809907 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f3ed4103850 con 0x555c26edde80 2024-09-05T13:04:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.162+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ec4005450 con 0x555c26edde80 2024-09-05T13:04:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.164+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3977809907 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3ed410fe50 con 0x555c26edde80 2024-09-05T13:04:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.165+0000 7f3edbe1a740 10 client.25864 fetch_fsmap learned FSMap version 42 2024-09-05T13:04:01.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.165+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555c26f40e10 con 0x555c26edde80 2024-09-05T13:04:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.167+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3977809907 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ed411f030 con 0x555c26edde80 2024-09-05T13:04:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.167+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3977809907 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 42) ==== 8350+0+0 (secure 0 0 0) 0x7f3ed4106630 con 0x555c26edde80 2024-09-05T13:04:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.170+0000 7f3edbe1a740 10 client.25864 fetch_fsmap finished waiting for FSMap version 42 2024-09-05T13:04:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.170+0000 7f3edbe1a740 10 client.25864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.170+0000 7f3edbe1a740 20 client.25864 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.170+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x555c26f414c0 0x555c26f438e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.170+0000 7f3edbe1a740 4 client.25864 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T13:04:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.170+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f3ec4005450 con 0x555c26f414c0 2024-09-05T13:04:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.170+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x555c26f414c0 0x555c26f438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.182+0000 7f3ed2ffd640 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x555c26f414c0 0x555c26f438e0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5818b5df1c37106c server_cookie=c2f2dedfa2442390 in_seq=0 out_seq=0 2024-09-05T13:04:01.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.182+0000 7f3eb2ffd640 10 client.25864 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:01.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.183+0000 7f3eb2ffd640 1 -- 172.21.15.73:0/3977809907 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f3ec4005450 con 0x555c26f414c0 2024-09-05T13:04:01.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.183+0000 7f3eb2ffd640 10 client.25864 handle_command_reply: tid=0 2024-09-05T13:04:01.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.183+0000 7f3edbe1a740 1 client.25864 shutdown 2024-09-05T13:04:01.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.184+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 msgr2=0x555c26ebff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.184+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 0x555c26ebff50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4103640 tx=0x7f3ed4081f70 comp rx=0 tx=0).stop 2024-09-05T13:04:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.185+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 shutdown_connections 2024-09-05T13:04:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.185+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x555c26f414c0 0x555c26f438e0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.185+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c26edde80 0x555c26ebff50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.185+0000 7f3eb2ffd640 0 client.25864 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.185+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c26ec5f20 0x555c26ebfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.185+0000 7f3edbe1a740 1 --2- 172.21.15.73:0/3977809907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c26ebad40 0x555c26ece4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.185+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 >> 172.21.15.73:0/3977809907 conn(0x555c26eb72d0 msgr2=0x555c26ec1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.185+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 shutdown_connections 2024-09-05T13:04:01.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.185+0000 7f3edbe1a740 1 -- 172.21.15.73:0/3977809907 wait complete. 2024-09-05T13:04:01.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.185+0000 7f3edbe1a740 20 client.25864 trim_cache size 0 max 16384 2024-09-05T13:04:01.191 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:04:01.191 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2024-09-05T13:04:01.191 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "c3b34c64-f94c-44f2-9ac6-6a49509babcb", 2024-09-05T13:04:01.191 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2024-09-05T13:04:01.191 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:04:01.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.189+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3358113294 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3ebc0a2c10 msgr2=0x7f3ebc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.189+0000 7f3ed9a44640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3ebc0a2c10 0x7f3ebc0a50d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0943a0 tx=0x7f3ec8008040 comp rx=0 tx=0).stop 2024-09-05T13:04:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.189+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3358113294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc09a4c0 msgr2=0x7f3ecc136c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.189+0000 7f3ed9a44640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc09a4c0 0x7f3ecc136c90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4067960 tx=0x7f3ed406bb60 comp rx=0 tx=0).stop 2024-09-05T13:04:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.189+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3358113294 shutdown_connections 2024-09-05T13:04:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.189+0000 7f3ed9a44640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f3ebc0a2c10 0x7f3ebc0a50d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.189+0000 7f3ed9a44640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc09a4c0 0x7f3ecc136c90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.189+0000 7f3ed9a44640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ecc0051d0 0x7f3ecc132900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.189+0000 7f3ed9a44640 1 --2- 172.21.15.73:0/3358113294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ecc004740 0x7f3ecc1323c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.189+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3358113294 >> 172.21.15.73:0/3358113294 conn(0x7f3ecc00a1b0 msgr2=0x7f3ecc092210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.190+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3358113294 shutdown_connections 2024-09-05T13:04:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:01.190+0000 7f3ed9a44640 1 -- 172.21.15.73:0/3358113294 wait complete. 2024-09-05T13:04:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.433+0000 7f91e56af640 1 -- 172.21.15.73:0/587740299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e0100a40 msgr2=0x7f91e0100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.433+0000 7f91de7fc640 1 -- 172.21.15.73:0/587740299 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0039070 con 0x7f91e0100a40 2024-09-05T13:04:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.433+0000 7f91e56af640 1 --2- 172.21.15.73:0/587740299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e0100a40 0x7f91e0100e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f91d000d960 tx=0x7f91d002c2d0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.435+0000 7f91e56af640 1 -- 172.21.15.73:0/587740299 shutdown_connections 2024-09-05T13:04:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.435+0000 7f91e56af640 1 --2- 172.21.15.73:0/587740299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e01025f0 0x7f91e0108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.435+0000 7f91e56af640 1 --2- 172.21.15.73:0/587740299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91e0101c30 0x7f91e01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.435+0000 7f91e56af640 1 --2- 172.21.15.73:0/587740299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e0100a40 0x7f91e0100e40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.435+0000 7f91e56af640 1 -- 172.21.15.73:0/587740299 >> 172.21.15.73:0/587740299 conn(0x7f91e00fc1e0 msgr2=0x7f91e00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.436+0000 7f91e56af640 1 -- 172.21.15.73:0/587740299 shutdown_connections 2024-09-05T13:04:01.444 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.441+0000 7f91e56af640 1 -- 172.21.15.73:0/587740299 wait complete. 2024-09-05T13:04:01.444 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.442+0000 7f91e56af640 1 Processor -- start 2024-09-05T13:04:01.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.443+0000 7f91e56af640 1 -- start start 2024-09-05T13:04:01.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.443+0000 7f91e56af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91e0100a40 0x7f91e0199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.443+0000 7f91e56af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e0101c30 0x7f91e01996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.443+0000 7f91e56af640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e01025f0 0x7f91e0195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.443+0000 7f91e56af640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f91e010b640 con 0x7f91e01025f0 2024-09-05T13:04:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.443+0000 7f91e56af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91e010b4c0 con 0x7f91e0101c30 2024-09-05T13:04:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.443+0000 7f91e56af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91e010b7c0 con 0x7f91e0100a40 2024-09-05T13:04:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.444+0000 7f91df7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e01025f0 0x7f91e0195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.444+0000 7f91df7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e01025f0 0x7f91e0195ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50446/0 (socket says 172.21.15.73:50446) 2024-09-05T13:04:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.444+0000 7f91df7fe640 1 -- 172.21.15.73:0/405149237 learned_addr learned my addr 172.21.15.73:0/405149237 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.444+0000 7f91d67fc640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e0101c30 0x7f91e01996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.444+0000 7f91df7fe640 1 -- 172.21.15.73:0/405149237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91e0100a40 msgr2=0x7f91e0199170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T13:04:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.444+0000 7f91df7fe640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91e0100a40 0x7f91e0199170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.444+0000 7f91df7fe640 1 -- 172.21.15.73:0/405149237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e0101c30 msgr2=0x7f91e01996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.444+0000 7f91df7fe640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e0101c30 0x7f91e01996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.444+0000 7f91df7fe640 1 -- 172.21.15.73:0/405149237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e01965a0 con 0x7f91e01025f0 2024-09-05T13:04:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.444+0000 7f91df7fe640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e01025f0 0x7f91e0195ce0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f91d800eb10 tx=0x7f91d800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.445+0000 7f91dcff9640 1 -- 172.21.15.73:0/405149237 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d800ce20 con 0x7f91e01025f0 2024-09-05T13:04:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.445+0000 7f91dcff9640 1 -- 172.21.15.73:0/405149237 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d8005020 con 0x7f91e01025f0 2024-09-05T13:04:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.446+0000 7f91dcff9640 1 -- 172.21.15.73:0/405149237 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8010720 con 0x7f91e01025f0 2024-09-05T13:04:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.448+0000 7f91e56af640 1 -- 172.21.15.73:0/405149237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e0199c10 con 0x7f91e01025f0 2024-09-05T13:04:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.448+0000 7f91e56af640 1 -- 172.21.15.73:0/405149237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e019a0e0 con 0x7f91e01025f0 2024-09-05T13:04:01.454 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.452+0000 7f91e843d740 1 Processor -- start 2024-09-05T13:04:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.453+0000 7f91dcff9640 1 -- 172.21.15.73:0/405149237 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f91d80051d0 con 0x7f91e01025f0 2024-09-05T13:04:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.453+0000 7f91e843d740 1 -- start start 2024-09-05T13:04:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91e843d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 0x557203207da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91e843d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x55720320cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91e843d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55720320d370 0x55720320f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91e843d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55720316b2f0 con 0x5572032082e0 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91e843d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557203113270 con 0x55720320d370 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91e843d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5572031672b0 con 0x5572032079a0 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91d67fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 0x557203207da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91d67fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 0x557203207da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:37788/0 (socket says 172.21.15.73:37788) 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91d67fc640 1 -- 172.21.15.73:0/2417825537 learned_addr learned my addr 172.21.15.73:0/2417825537 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91d67fc640 1 --2- 172.21.15.73:0/2417825537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55720320d370 0x55720320f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.454+0000 7f91deffd640 1 --2- 172.21.15.73:0/2417825537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x55720320cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91d67fc640 1 -- 172.21.15.73:0/2417825537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55720320d370 msgr2=0x55720320f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91d67fc640 1 --2- 172.21.15.73:0/2417825537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55720320d370 0x55720320f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91d67fc640 1 -- 172.21.15.73:0/2417825537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 msgr2=0x55720320cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91d67fc640 1 --2- 172.21.15.73:0/2417825537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x55720320cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91d67fc640 1 -- 172.21.15.73:0/2417825537 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557203112340 con 0x5572032079a0 2024-09-05T13:04:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91dcff9640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f91cc0a2bf0 0x7f91cc0a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91d67fc640 1 --2- 172.21.15.73:0/2417825537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 0x557203207da0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f91c80058c0 tx=0x7f91c8005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25d6c649578d5636 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91dcff9640 1 -- 172.21.15.73:0/405149237 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f91d80cf610 con 0x7f91e01025f0 2024-09-05T13:04:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91deffd640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f91cc0a2bf0 0x7f91cc0a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91d57fa640 1 -- 172.21.15.73:0/2417825537 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8004050 con 0x5572032079a0 2024-09-05T13:04:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.455+0000 7f91d57fa640 1 -- 172.21.15.73:0/2417825537 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c8005500 con 0x5572032079a0 2024-09-05T13:04:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.456+0000 7f91e843d740 1 -- 172.21.15.73:0/2417825537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 msgr2=0x557203207da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.456+0000 7f91deffd640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f91cc0a2bf0 0x7f91cc0a50b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f91d0037040 tx=0x7f91d002c7d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.456+0000 7f91e843d740 1 --2- 172.21.15.73:0/2417825537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 0x557203207da0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f91c80058c0 tx=0x7f91c8005850 comp rx=0 tx=0).stop 2024-09-05T13:04:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.456+0000 7f91d57fa640 1 -- 172.21.15.73:0/2417825537 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8004b90 con 0x5572032079a0 2024-09-05T13:04:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.457+0000 7f91e843d740 1 -- 172.21.15.73:0/2417825537 shutdown_connections 2024-09-05T13:04:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.457+0000 7f91e843d740 1 --2- 172.21.15.73:0/2417825537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55720320d370 0x55720320f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.457+0000 7f91e843d740 1 --2- 172.21.15.73:0/2417825537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x55720320cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.457+0000 7f91e843d740 1 --2- 172.21.15.73:0/2417825537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 0x557203207da0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.457+0000 7f91e843d740 1 -- 172.21.15.73:0/2417825537 >> 172.21.15.73:0/2417825537 conn(0x557203203010 msgr2=0x557203203410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.457+0000 7f91e843d740 1 -- 172.21.15.73:0/2417825537 shutdown_connections 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.457+0000 7f91e843d740 1 -- 172.21.15.73:0/2417825537 wait complete. 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.457+0000 7f91e843d740 1 -- start start 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.457+0000 7f91e843d740 1 Processor -- start 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91e843d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 0x557203211c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91e843d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x5572032121b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91e843d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55720320d370 0x557203219180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91e843d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557203210390 con 0x5572032082e0 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91e843d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5572030f4290 con 0x5572032079a0 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91e843d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557203210510 con 0x55720320d370 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91e843d740 10 client.0 _ll_register_callbacks cb 0x557203125140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91df7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55720320d370 0x557203219180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91d67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x5572032121b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91df7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55720320d370 0x557203219180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:37804/0 (socket says 172.21.15.73:37804) 2024-09-05T13:04:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91df7fe640 1 -- 172.21.15.73:0/1255431156 learned_addr learned my addr 172.21.15.73:0/1255431156 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91deffd640 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 0x557203211c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91df7fe640 1 -- 172.21.15.73:0/1255431156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 msgr2=0x557203211c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91df7fe640 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 0x557203211c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91df7fe640 1 -- 172.21.15.73:0/1255431156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 msgr2=0x5572032121b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91df7fe640 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x5572032121b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.458+0000 7f91df7fe640 1 -- 172.21.15.73:0/1255431156 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557202e7e210 con 0x55720320d370 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.459+0000 7f91df7fe640 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55720320d370 0x557203219180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f91d80a45e0 tx=0x7f91d809bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ac6cd14f86a6ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.459+0000 7f91c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.459+0000 7f91c67fc640 1 -- 172.21.15.73:0/1255431156 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d809a1a0 con 0x55720320d370 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.459+0000 7f91e843d740 1 -- 172.21.15.73:0/1255431156 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91c8005500 con 0x55720320d370 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.459+0000 7f91c67fc640 1 -- 172.21.15.73:0/1255431156 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f91d80b9030 con 0x55720320d370 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.459+0000 7f91c67fc640 1 -- 172.21.15.73:0/1255431156 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f91d8098510 con 0x55720320d370 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.459+0000 7f91e843d740 10 client.25873 fetch_fsmap learned FSMap version 42 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.459+0000 7f91e843d740 1 -- 172.21.15.73:0/1255431156 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557202f4a620 con 0x55720320d370 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.460+0000 7f91c67fc640 1 -- 172.21.15.73:0/1255431156 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c8005500 con 0x55720320d370 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.460+0000 7f91c67fc640 1 -- 172.21.15.73:0/1255431156 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 42) ==== 8350+0+0 (secure 0 0 0) 0x7f91d809b410 con 0x55720320d370 2024-09-05T13:04:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.460+0000 7f91e843d740 10 client.25873 fetch_fsmap finished waiting for FSMap version 42 2024-09-05T13:04:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.460+0000 7f91e843d740 10 client.25873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.460+0000 7f91e843d740 20 client.25873 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.460+0000 7f91e843d740 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55720322e930 0x557203230d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.460+0000 7f91e843d740 4 client.25873 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:04:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.460+0000 7f91e843d740 1 -- 172.21.15.73:0/1255431156 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557203178a20 con 0x55720322e930 2024-09-05T13:04:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.460+0000 7f91deffd640 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55720322e930 0x557203230d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.461+0000 7f91deffd640 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55720322e930 0x557203230d20 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb29abd24cfc25c server_cookie=645db580f6fb786 in_seq=0 out_seq=0 2024-09-05T13:04:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.461+0000 7f91c67fc640 10 client.25873 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91c67fc640 1 -- 172.21.15.73:0/1255431156 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557203178a20 con 0x55720322e930 2024-09-05T13:04:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91c67fc640 10 client.25873 handle_command_reply: tid=0 2024-09-05T13:04:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 client.25873 shutdown 2024-09-05T13:04:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 -- 172.21.15.73:0/1255431156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55720320d370 msgr2=0x557203219180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55720320d370 0x557203219180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f91d80a45e0 tx=0x7f91d809bf60 comp rx=0 tx=0).stop 2024-09-05T13:04:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 -- 172.21.15.73:0/1255431156 shutdown_connections 2024-09-05T13:04:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55720322e930 0x557203230d20 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55720320d370 0x557203219180 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x5572032121b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 --2- 172.21.15.73:0/1255431156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 0x557203211c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 -- 172.21.15.73:0/1255431156 >> 172.21.15.73:0/1255431156 conn(0x557203203010 msgr2=0x557203204820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91c67fc640 0 client.25873 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 -- 172.21.15.73:0/1255431156 shutdown_connections 2024-09-05T13:04:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 1 -- 172.21.15.73:0/1255431156 wait complete. 2024-09-05T13:04:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.462+0000 7f91e843d740 20 client.25873 trim_cache size 0 max 16384 2024-09-05T13:04:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.489+0000 7f91e843d740 1 Processor -- start 2024-09-05T13:04:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.490+0000 7f91e843d740 1 -- start start 2024-09-05T13:04:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.491+0000 7f91e843d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 0x5572032020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.491+0000 7f91e843d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032082e0 0x557203219140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.491+0000 7f91e843d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55720320d370 0x5572032355e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.491+0000 7f91e843d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f91e006ecb0 con 0x55720320d370 2024-09-05T13:04:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.491+0000 7f91e843d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91e006c590 con 0x5572032079a0 2024-09-05T13:04:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.492+0000 7f91e843d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01a0b90 con 0x5572032082e0 2024-09-05T13:04:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.494+0000 7f91d67fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032082e0 0x557203219140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.494+0000 7f91df7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55720320d370 0x5572032355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.494+0000 7f91df7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55720320d370 0x5572032355e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50474/0 (socket says 172.21.15.73:50474) 2024-09-05T13:04:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.494+0000 7f91df7fe640 1 -- 172.21.15.73:0/311351510 learned_addr learned my addr 172.21.15.73:0/311351510 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.495+0000 7f91deffd640 1 --2- 172.21.15.73:0/311351510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 0x5572032020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.496+0000 7f91deffd640 1 -- 172.21.15.73:0/311351510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032082e0 msgr2=0x557203219140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.496+0000 7f91deffd640 1 --2- 172.21.15.73:0/311351510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032082e0 0x557203219140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.496+0000 7f91deffd640 1 -- 172.21.15.73:0/311351510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55720320d370 msgr2=0x5572032355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.496+0000 7f91deffd640 1 --2- 172.21.15.73:0/311351510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55720320d370 0x5572032355e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.496+0000 7f91deffd640 1 -- 172.21.15.73:0/311351510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557203202e30 con 0x5572032079a0 2024-09-05T13:04:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.496+0000 7f91deffd640 1 --2- 172.21.15.73:0/311351510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 0x5572032020b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x557203208d10 tx=0x7f91d003e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f71e5e9bfbe587 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.497+0000 7f91d4ff9640 1 -- 172.21.15.73:0/311351510 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0039040 con 0x5572032079a0 2024-09-05T13:04:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.497+0000 7f91d4ff9640 1 -- 172.21.15.73:0/311351510 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d0005520 con 0x5572032079a0 2024-09-05T13:04:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.497+0000 7f91d4ff9640 1 -- 172.21.15.73:0/311351510 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0004920 con 0x5572032079a0 2024-09-05T13:04:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.498+0000 7f91e843d740 1 -- 172.21.15.73:0/311351510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 msgr2=0x5572032020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.498+0000 7f91e843d740 1 --2- 172.21.15.73:0/311351510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 0x5572032020b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x557203208d10 tx=0x7f91d003e000 comp rx=0 tx=0).stop 2024-09-05T13:04:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.498+0000 7f91e843d740 1 -- 172.21.15.73:0/311351510 shutdown_connections 2024-09-05T13:04:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.498+0000 7f91e843d740 1 --2- 172.21.15.73:0/311351510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55720320d370 0x5572032355e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.498+0000 7f91e843d740 1 --2- 172.21.15.73:0/311351510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032082e0 0x557203219140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.498+0000 7f91e843d740 1 --2- 172.21.15.73:0/311351510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572032079a0 0x5572032020b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.498+0000 7f91e843d740 1 -- 172.21.15.73:0/311351510 >> 172.21.15.73:0/311351510 conn(0x557203203010 msgr2=0x5572032019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.499+0000 7f91e843d740 1 -- 172.21.15.73:0/311351510 shutdown_connections 2024-09-05T13:04:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.499+0000 7f91e843d740 1 -- 172.21.15.73:0/311351510 wait complete. 2024-09-05T13:04:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.500+0000 7f91e843d740 1 -- start start 2024-09-05T13:04:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.500+0000 7f91e843d740 1 Processor -- start 2024-09-05T13:04:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.500+0000 7f91e843d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 0x557203216130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.500+0000 7f91e843d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x557203216670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.501+0000 7f91e843d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55720320d370 0x5572032975b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.501+0000 7f91e843d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01a1220 con 0x5572032082e0 2024-09-05T13:04:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.501+0000 7f91d67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x557203216670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.501+0000 7f91d67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x557203216670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50486/0 (socket says 172.21.15.73:50486) 2024-09-05T13:04:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.501+0000 7f91d67fc640 1 -- 172.21.15.73:0/491799977 learned_addr learned my addr 172.21.15.73:0/491799977 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.501+0000 7f91e843d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91e006bec0 con 0x55720320d370 2024-09-05T13:04:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.501+0000 7f91e843d740 1 -- 172.21.15.73:0/491799977 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01a18f0 con 0x5572032079a0 2024-09-05T13:04:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.501+0000 7f91e843d740 10 client.0 _ll_register_callbacks cb 0x7f91d809c5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.501+0000 7f91deffd640 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 0x557203216130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.501+0000 7f91df7fe640 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55720320d370 0x5572032975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.502+0000 7f91d67fc640 1 -- 172.21.15.73:0/491799977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 msgr2=0x557203216130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.502+0000 7f91d67fc640 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 0x557203216130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.502+0000 7f91d67fc640 1 -- 172.21.15.73:0/491799977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55720320d370 msgr2=0x5572032975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.502+0000 7f91d67fc640 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55720320d370 0x5572032975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.502+0000 7f91d67fc640 1 -- 172.21.15.73:0/491799977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557203297bc0 con 0x5572032082e0 2024-09-05T13:04:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.502+0000 7f91d67fc640 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x557203216670 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f91c801c000 tx=0x7f91c8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a48a6b5464f6d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.502+0000 7f91c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:04:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.503+0000 7f91c67fc640 1 -- 172.21.15.73:0/491799977 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8031060 con 0x5572032082e0 2024-09-05T13:04:01.506 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.503+0000 7f91c67fc640 1 -- 172.21.15.73:0/491799977 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f91c8011230 con 0x5572032082e0 2024-09-05T13:04:01.506 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.503+0000 7f91e843d740 1 -- 172.21.15.73:0/491799977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91d0005520 con 0x5572032082e0 2024-09-05T13:04:01.506 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.503+0000 7f91c67fc640 1 -- 172.21.15.73:0/491799977 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f91c8009bd0 con 0x5572032082e0 2024-09-05T13:04:01.506 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.503+0000 7f91e843d740 10 client.16281 fetch_fsmap learned FSMap version 42 2024-09-05T13:04:01.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.503+0000 7f91e843d740 1 -- 172.21.15.73:0/491799977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557203298eb0 con 0x5572032082e0 2024-09-05T13:04:01.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.504+0000 7f91c67fc640 1 -- 172.21.15.73:0/491799977 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d0005520 con 0x5572032082e0 2024-09-05T13:04:01.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.504+0000 7f91c67fc640 1 -- 172.21.15.73:0/491799977 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 42) ==== 8350+0+0 (secure 0 0 0) 0x7f91c8003ad0 con 0x5572032082e0 2024-09-05T13:04:01.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.504+0000 7f91e843d740 10 client.16281 fetch_fsmap finished waiting for FSMap version 42 2024-09-05T13:04:01.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.504+0000 7f91e843d740 10 client.16281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:01.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.504+0000 7f91e843d740 20 client.16281 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:01.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.504+0000 7f91e843d740 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5572032996d0 0x55720329baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:01.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.504+0000 7f91e843d740 4 client.16281 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:04:01.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.504+0000 7f91e843d740 1 -- 172.21.15.73:0/491799977 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557203172d70 con 0x5572032996d0 2024-09-05T13:04:01.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.505+0000 7f91deffd640 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5572032996d0 0x55720329baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:01.508 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.506+0000 7f91deffd640 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5572032996d0 0x55720329baf0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=529c0aa9ba916e7a server_cookie=819748dae0052f21 in_seq=0 out_seq=0 2024-09-05T13:04:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.506+0000 7f91c67fc640 10 client.16281 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:01.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:01 smithi073 ceph-mon[30883]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.09k op/s 2024-09-05T13:04:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91c67fc640 1 -- 172.21.15.73:0/491799977 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557203172d70 con 0x5572032996d0 2024-09-05T13:04:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91c67fc640 10 client.16281 handle_command_reply: tid=0 2024-09-05T13:04:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91e843d740 1 client.16281 shutdown 2024-09-05T13:04:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91e843d740 1 -- 172.21.15.73:0/491799977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 msgr2=0x557203216670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91e843d740 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x557203216670 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f91c801c000 tx=0x7f91c8005fd0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91e843d740 1 -- 172.21.15.73:0/491799977 shutdown_connections 2024-09-05T13:04:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91e843d740 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5572032996d0 0x55720329baf0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91e843d740 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55720320d370 0x5572032975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91e843d740 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5572032082e0 0x557203216670 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91e843d740 1 --2- 172.21.15.73:0/491799977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572032079a0 0x557203216130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91e843d740 1 -- 172.21.15.73:0/491799977 >> 172.21.15.73:0/491799977 conn(0x557203203010 msgr2=0x5572032021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.549+0000 7f91c67fc640 0 client.16281 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.550+0000 7f91e843d740 1 -- 172.21.15.73:0/491799977 shutdown_connections 2024-09-05T13:04:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.550+0000 7f91e843d740 1 -- 172.21.15.73:0/491799977 wait complete. 2024-09-05T13:04:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.550+0000 7f91e843d740 20 client.16281 trim_cache size 0 max 16384 2024-09-05T13:04:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:04:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:04:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:04:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:04:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 -- 172.21.15.73:0/405149237 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f91cc0a2bf0 msgr2=0x7f91cc0a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f91cc0a2bf0 0x7f91cc0a50b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f91d0037040 tx=0x7f91d002c7d0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 -- 172.21.15.73:0/405149237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e01025f0 msgr2=0x7f91e0195ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e01025f0 0x7f91e0195ce0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f91d800eb10 tx=0x7f91d800ef10 comp rx=0 tx=0).stop 2024-09-05T13:04:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 -- 172.21.15.73:0/405149237 shutdown_connections 2024-09-05T13:04:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f91cc0a2bf0 0x7f91cc0a50b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e01025f0 0x7f91e0195ce0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e0101c30 0x7f91e01996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 --2- 172.21.15.73:0/405149237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91e0100a40 0x7f91e0199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 -- 172.21.15.73:0/405149237 >> 172.21.15.73:0/405149237 conn(0x7f91e00fc1e0 msgr2=0x7f91e0104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 -- 172.21.15.73:0/405149237 shutdown_connections 2024-09-05T13:04:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:01.552+0000 7f91e56af640 1 -- 172.21.15.73:0/405149237 wait complete. 2024-09-05T13:04:01.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:01 smithi162 ceph-mon[34220]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.09k op/s 2024-09-05T13:04:01.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:01 smithi169 ceph-mon[34823]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 4.09k op/s 2024-09-05T13:04:01.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T13:04:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:04:02.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:02 smithi073 ceph-mon[30883]: scrub queued for path: / 2024-09-05T13:04:02.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:02 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:02 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:04:02.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:02 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:04:02.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:02 smithi073 ceph-mon[30883]: scrub summary: active paths [/] 2024-09-05T13:04:02.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:02 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:02 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:02 smithi073 ceph-mon[30883]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:02 smithi162 ceph-mon[34220]: scrub queued for path: / 2024-09-05T13:04:02.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:02 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:02 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:04:02.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:02 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:04:02.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:02 smithi162 ceph-mon[34220]: scrub summary: active paths [/] 2024-09-05T13:04:02.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:02 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:02 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:02 smithi162 ceph-mon[34220]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:02 smithi169 ceph-mon[34823]: scrub queued for path: / 2024-09-05T13:04:02.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:02 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:02 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:04:02.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:02 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:04:02.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:02 smithi169 ceph-mon[34823]: scrub summary: active paths [/] 2024-09-05T13:04:02.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:02 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:02 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:02.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:02 smithi169 ceph-mon[34823]: scrub summary: idle+waiting paths [/] 2024-09-05T13:04:03.233 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:03 smithi073 ceph-mon[30883]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 2.49k op/s 2024-09-05T13:04:03.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:03 smithi162 ceph-mon[34220]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 2.49k op/s 2024-09-05T13:04:03.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:03 smithi169 ceph-mon[34823]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 2.49k op/s 2024-09-05T13:04:04.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.436+0000 7fa9e283c640 1 -- 172.21.15.73:0/2199046613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9dc109290 msgr2=0x7fa9dc109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.436+0000 7fa9e283c640 1 --2- 172.21.15.73:0/2199046613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9dc109290 0x7fa9dc109670 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009900 tx=0x7fa9cc02a420 comp rx=0 tx=0).stop 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.437+0000 7fa9e283c640 1 -- 172.21.15.73:0/2199046613 shutdown_connections 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.437+0000 7fa9e283c640 1 --2- 172.21.15.73:0/2199046613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc10e7b0 0x7fa9dc115130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.437+0000 7fa9e283c640 1 --2- 172.21.15.73:0/2199046613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9dc109c40 0x7fa9dc10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.437+0000 7fa9e283c640 1 --2- 172.21.15.73:0/2199046613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9dc109290 0x7fa9dc109670 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.437+0000 7fa9e283c640 1 -- 172.21.15.73:0/2199046613 >> 172.21.15.73:0/2199046613 conn(0x7fa9dc077c10 msgr2=0x7fa9dc07a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.439+0000 7fa9e283c640 1 -- 172.21.15.73:0/2199046613 shutdown_connections 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.439+0000 7fa9e283c640 1 -- 172.21.15.73:0/2199046613 wait complete. 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.441+0000 7fa9e283c640 1 Processor -- start 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.441+0000 7fa9e283c640 1 -- start start 2024-09-05T13:04:04.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.441+0000 7fa9e283c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc109290 0x7fa9dc1a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.442+0000 7fa9e283c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9dc109c40 0x7fa9dc1a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.442+0000 7fa9e283c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9dc10e7b0 0x7fa9dc19e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.442+0000 7fa9dbfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc109290 0x7fa9dc1a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.442+0000 7fa9dbfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc109290 0x7fa9dc1a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:43088/0 (socket says 172.21.15.73:43088) 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.442+0000 7fa9dbfff640 1 -- 172.21.15.73:0/533701850 learned_addr learned my addr 172.21.15.73:0/533701850 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.442+0000 7fa9e0dd9640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9dc10e7b0 0x7fa9dc19e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.442+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc118650 con 0x7fa9dc10e7b0 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.442+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1184d0 con 0x7fa9dc109c40 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.442+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1187d0 con 0x7fa9dc109290 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.442+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9dc109c40 0x7fa9dc1a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.443+0000 7fa9dbfff640 1 -- 172.21.15.73:0/533701850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9dc109c40 msgr2=0x7fa9dc1a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.443+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9dc109c40 0x7fa9dc1a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.443+0000 7fa9dbfff640 1 -- 172.21.15.73:0/533701850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9dc10e7b0 msgr2=0x7fa9dc19e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.443+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9dc10e7b0 0x7fa9dc19e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.443+0000 7fa9dbfff640 1 -- 172.21.15.73:0/533701850 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc19ef70 con 0x7fa9dc109290 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.443+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc109290 0x7fa9dc1a4630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009850 tx=0x7fa9cc0309c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.444+0000 7fa9d9ffb640 1 -- 172.21.15.73:0/533701850 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc03f070 con 0x7fa9dc109290 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.444+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9dc19f200 con 0x7fa9dc109290 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.444+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9dc1ab460 con 0x7fa9dc109290 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.444+0000 7fa9d9ffb640 1 -- 172.21.15.73:0/533701850 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9cc0035f0 con 0x7fa9dc109290 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.444+0000 7fa9d9ffb640 1 -- 172.21.15.73:0/533701850 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc035030 con 0x7fa9dc109290 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9e4c12740 1 Processor -- start 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9e4c12740 1 -- start start 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b3404a0 0x55800b340880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 0x55800b34b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b34da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55800b2a62e0 con 0x55800b34b680 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55800b24dce0 con 0x55800b3404a0 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55800b2a22a0 con 0x55800b340dc0 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b34da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9e0dd9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b3404a0 0x55800b340880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b34da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55208/0 (socket says 172.21.15.73:55208) 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.448+0000 7fa9d3fff640 1 -- 172.21.15.73:0/1181021797 learned_addr learned my addr 172.21.15.73:0/1181021797 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.449+0000 7fa9d9ffb640 1 -- 172.21.15.73:0/533701850 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa9cc042070 con 0x7fa9dc109290 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.450+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/1181021797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 0x55800b34b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.450+0000 7fa9d9ffb640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa9c80a2c80 0x7fa9c80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.451+0000 7fa9d9ffb640 1 -- 172.21.15.73:0/533701850 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fa9cc0efbb0 con 0x7fa9dc109290 2024-09-05T13:04:04.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.451+0000 7fa9d3fff640 1 -- 172.21.15.73:0/1181021797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 msgr2=0x55800b34b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.451+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/1181021797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 0x55800b34b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.451+0000 7fa9d3fff640 1 -- 172.21.15.73:0/1181021797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b3404a0 msgr2=0x55800b340880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.451+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/1181021797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b3404a0 0x55800b340880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.451+0000 7fa9d3fff640 1 -- 172.21.15.73:0/1181021797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55800b232440 con 0x55800b34b680 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.451+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/1181021797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 0x55800b34b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.452+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/1181021797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b34da70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400bc40 tx=0x7fa9c400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f3707538eb1654 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.452+0000 7fa9d27fc640 1 -- 172.21.15.73:0/1181021797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4015070 con 0x55800b34b680 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.452+0000 7fa9d27fc640 1 -- 172.21.15.73:0/1181021797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9c401a940 con 0x55800b34b680 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.452+0000 7fa9d27fc640 1 -- 172.21.15.73:0/1181021797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4011a30 con 0x55800b34b680 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.453+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1181021797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 msgr2=0x55800b34da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.453+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/1181021797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b34da70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400bc40 tx=0x7fa9c400f730 comp rx=0 tx=0).stop 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.454+0000 7fa9e0dd9640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa9c80a2c80 0x7fa9c80a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.454+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1181021797 shutdown_connections 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.454+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/1181021797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b34da70 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.454+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/1181021797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 0x55800b34b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.454+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/1181021797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b3404a0 0x55800b340880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.454+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1181021797 >> 172.21.15.73:0/1181021797 conn(0x55800b33ca30 msgr2=0x55800b33ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.455+0000 7fa9e0dd9640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa9c80a2c80 0x7fa9c80a5140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400a940 tx=0x7fa9d4004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.455+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1181021797 shutdown_connections 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.455+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1181021797 wait complete. 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.455+0000 7fa9e4c12740 1 -- start start 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.455+0000 7fa9e4c12740 1 Processor -- start 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b3404a0 0x55800b34b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b340dc0 0x55800b3482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b34b680 0x55800b348840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55800b34e250 con 0x55800b3404a0 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55800b261050 con 0x55800b340dc0 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55800b34e3d0 con 0x55800b34b680 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9e4c12740 10 client.0 _ll_register_callbacks cb 0x55800b2a1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9d3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b340dc0 0x55800b3482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9d3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b340dc0 0x55800b3482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:33838/0 (socket says 172.21.15.73:33838) 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9dbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b3404a0 0x55800b34b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.456+0000 7fa9d3fff640 1 -- 172.21.15.73:0/1901572953 learned_addr learned my addr 172.21.15.73:0/1901572953 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.457+0000 7fa9d3fff640 1 -- 172.21.15.73:0/1901572953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b34b680 msgr2=0x55800b348840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.457+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b34b680 0x55800b348840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.457+0000 7fa9d3fff640 1 -- 172.21.15.73:0/1901572953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b3404a0 msgr2=0x55800b34b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.457+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b3404a0 0x55800b34b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.457+0000 7fa9d3fff640 1 -- 172.21.15.73:0/1901572953 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55800b0173c0 con 0x55800b340dc0 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.457+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b340dc0 0x55800b3482c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4000c00 tx=0x7fa9c400bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a17037d91706e283 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.457+0000 7fa9bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.457+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/1901572953 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4015070 con 0x55800b340dc0 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.457+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1901572953 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c401a940 con 0x55800b340dc0 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.458+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/1901572953 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fa9c401a730 con 0x55800b340dc0 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.458+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/1901572953 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa9c401aaf0 con 0x55800b340dc0 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.458+0000 7fa9e4c12740 10 client.25775 fetch_fsmap learned FSMap version 42 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.458+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1901572953 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55800b36ac80 con 0x55800b340dc0 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.458+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/1901572953 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9c4005520 con 0x55800b340dc0 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.458+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/1901572953 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 42) ==== 8350+0+0 (secure 0 0 0) 0x7fa9c4011bd0 con 0x55800b340dc0 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.459+0000 7fa9e4c12740 10 client.25775 fetch_fsmap finished waiting for FSMap version 42 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.459+0000 7fa9e4c12740 10 client.25775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.459+0000 7fa9e4c12740 20 client.25775 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.459+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55800b36bfd0 0x55800b36e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.459+0000 7fa9e4c12740 4 client.25775 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.459+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1901572953 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa9c401a940 con 0x55800b36bfd0 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.460+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55800b36bfd0 0x55800b36e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.460+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55800b36bfd0 0x55800b36e3c0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16ce59942f7d3b79 server_cookie=b6cf5818f2070aef in_seq=0 out_seq=0 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.460+0000 7fa9bb7fe640 10 client.25775 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.461+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/1901572953 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa9c401a940 con 0x55800b36bfd0 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.461+0000 7fa9bb7fe640 10 client.25775 handle_command_reply: tid=0 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.461+0000 7fa9e4c12740 1 client.25775 shutdown 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1901572953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b340dc0 msgr2=0x55800b3482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b340dc0 0x55800b3482c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4000c00 tx=0x7fa9c400bf60 comp rx=0 tx=0).stop 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1901572953 shutdown_connections 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55800b36bfd0 0x55800b36e3c0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b34b680 0x55800b348840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b340dc0 0x55800b3482c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9bb7fe640 0 client.25775 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/1901572953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b3404a0 0x55800b34b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1901572953 >> 172.21.15.73:0/1901572953 conn(0x55800b33ca30 msgr2=0x55800b342710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1901572953 shutdown_connections 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 1 -- 172.21.15.73:0/1901572953 wait complete. 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.462+0000 7fa9e4c12740 20 client.25775 trim_cache size 0 max 16384 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.493+0000 7fa9e4c12740 1 Processor -- start 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.493+0000 7fa9e4c12740 1 -- start start 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.493+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b3404a0 0x55800b373ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.493+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 0x55800b3740e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.493+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b346a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1adc60 con 0x55800b34b680 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1ab690 con 0x55800b3404a0 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc19fc30 con 0x55800b340dc0 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9e0dd9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b346a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9e0dd9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b346a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55218/0 (socket says 172.21.15.73:55218) 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9e0dd9640 1 -- 172.21.15.73:0/3258306579 learned_addr learned my addr 172.21.15.73:0/3258306579 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/3258306579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b3404a0 0x55800b373ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/3258306579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 0x55800b3740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9d3fff640 1 -- 172.21.15.73:0/3258306579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b3404a0 msgr2=0x55800b373ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/3258306579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b3404a0 0x55800b373ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9d3fff640 1 -- 172.21.15.73:0/3258306579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 msgr2=0x55800b346a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.494+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/3258306579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b346a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.495+0000 7fa9d3fff640 1 -- 172.21.15.73:0/3258306579 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55800b36e730 con 0x55800b340dc0 2024-09-05T13:04:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.495+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/3258306579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 0x55800b3740e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40047c0 tx=0x7fa9c400ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=397772d0bc4bf58 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.496+0000 7fa9d1ffb640 1 -- 172.21.15.73:0/3258306579 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4015040 con 0x55800b340dc0 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.496+0000 7fa9d1ffb640 1 -- 172.21.15.73:0/3258306579 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9c4032070 con 0x55800b340dc0 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.497+0000 7fa9e4c12740 1 -- 172.21.15.73:0/3258306579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 msgr2=0x55800b3740e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.497+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/3258306579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 0x55800b3740e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40047c0 tx=0x7fa9c400ba90 comp rx=0 tx=0).stop 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.498+0000 7fa9e4c12740 1 -- 172.21.15.73:0/3258306579 shutdown_connections 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.498+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/3258306579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b34b680 0x55800b346a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.498+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/3258306579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b340dc0 0x55800b3740e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.498+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/3258306579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b3404a0 0x55800b373ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.498+0000 7fa9e4c12740 1 -- 172.21.15.73:0/3258306579 >> 172.21.15.73:0/3258306579 conn(0x55800b33ca30 msgr2=0x55800b343870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.498+0000 7fa9e4c12740 1 -- 172.21.15.73:0/3258306579 shutdown_connections 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.499+0000 7fa9e4c12740 1 -- 172.21.15.73:0/3258306579 wait complete. 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.499+0000 7fa9e4c12740 1 -- start start 2024-09-05T13:04:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.499+0000 7fa9e4c12740 1 Processor -- start 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.500+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b3404a0 0x55800b3539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.500+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b340dc0 0x55800b353f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.500+0000 7fa9e4c12740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b34b680 0x55800b34ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.500+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc0727b0 con 0x55800b340dc0 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.500+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc073c20 con 0x55800b34b680 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.500+0000 7fa9e4c12740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc072e80 con 0x55800b3404a0 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.500+0000 7fa9e4c12740 10 client.0 _ll_register_callbacks cb 0x7fa9d40099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.500+0000 7fa9e0dd9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b34b680 0x55800b34ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.500+0000 7fa9e0dd9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b34b680 0x55800b34ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:33860/0 (socket says 172.21.15.73:33860) 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.500+0000 7fa9e0dd9640 1 -- 172.21.15.73:0/2413412877 learned_addr learned my addr 172.21.15.73:0/2413412877 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.501+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b340dc0 0x55800b353f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.501+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b3404a0 0x55800b3539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.501+0000 7fa9e0dd9640 1 -- 172.21.15.73:0/2413412877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b3404a0 msgr2=0x55800b3539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.501+0000 7fa9e0dd9640 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b3404a0 0x55800b3539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.501+0000 7fa9e0dd9640 1 -- 172.21.15.73:0/2413412877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b340dc0 msgr2=0x55800b353f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.501+0000 7fa9e0dd9640 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b340dc0 0x55800b353f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.501+0000 7fa9e0dd9640 1 -- 172.21.15.73:0/2413412877 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55800b34f770 con 0x55800b34b680 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.501+0000 7fa9e0dd9640 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b34b680 0x55800b34ef40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40155c0 tx=0x7fa9d4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aaf3ee663d87f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.502+0000 7fa9bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.502+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/2413412877 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4019c50 con 0x55800b34b680 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.502+0000 7fa9e4c12740 1 -- 172.21.15.73:0/2413412877 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c4032070 con 0x55800b34b680 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.502+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/2413412877 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fa9d4019df0 con 0x55800b34b680 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.502+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/2413412877 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa9d4026480 con 0x55800b34b680 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.502+0000 7fa9e4c12740 10 client.25781 fetch_fsmap learned FSMap version 42 2024-09-05T13:04:04.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.502+0000 7fa9e4c12740 1 -- 172.21.15.73:0/2413412877 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55800b3d6870 con 0x55800b34b680 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.503+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/2413412877 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9c4032070 con 0x55800b34b680 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.503+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/2413412877 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 42) ==== 8350+0+0 (secure 0 0 0) 0x7fa9d402f900 con 0x55800b34b680 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.503+0000 7fa9e4c12740 10 client.25781 fetch_fsmap finished waiting for FSMap version 42 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.503+0000 7fa9e4c12740 10 client.25781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.503+0000 7fa9e4c12740 20 client.25781 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.503+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55800b3d7020 0x55800b3d9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.503+0000 7fa9e4c12740 4 client.25781 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.503+0000 7fa9e4c12740 1 -- 172.21.15.73:0/2413412877 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55800b2b3850 con 0x55800b3d7020 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.505+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55800b3d7020 0x55800b3d9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.506+0000 7fa9dbfff640 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55800b3d7020 0x55800b3d9440 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3fb3aa295a2e047 server_cookie=abd201f321b6a6ad in_seq=0 out_seq=0 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.506+0000 7fa9bb7fe640 10 client.25781 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.507+0000 7fa9bb7fe640 1 -- 172.21.15.73:0/2413412877 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55800b2b3850 con 0x55800b3d7020 2024-09-05T13:04:04.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.507+0000 7fa9bb7fe640 10 client.25781 handle_command_reply: tid=0 2024-09-05T13:04:04.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.507+0000 7fa9e4c12740 1 client.25781 shutdown 2024-09-05T13:04:04.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9e4c12740 1 -- 172.21.15.73:0/2413412877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b34b680 msgr2=0x55800b34ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:04.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b34b680 0x55800b34ef40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40155c0 tx=0x7fa9d4004ad0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9e4c12740 1 -- 172.21.15.73:0/2413412877 shutdown_connections 2024-09-05T13:04:04.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55800b3d7020 0x55800b3d9440 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.197 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:04:04.197 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-05T13:04:04.197 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stdout: "c3b34c64-f94c-44f2-9ac6-6a49509babcb": { 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "c3b34c64-f94c-44f2-9ac6-6a49509babcb", 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55800b34b680 0x55800b34ef40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55800b340dc0 0x55800b353f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9e4c12740 1 --2- 172.21.15.73:0/2413412877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55800b3404a0 0x55800b3539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9e4c12740 1 -- 172.21.15.73:0/2413412877 >> 172.21.15.73:0/2413412877 conn(0x55800b33ca30 msgr2=0x55800b33b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9bb7fe640 0 client.25781 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9e4c12740 1 -- 172.21.15.73:0/2413412877 shutdown_connections 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.508+0000 7fa9e4c12740 1 -- 172.21.15.73:0/2413412877 wait complete. 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.509+0000 7fa9e4c12740 20 client.25781 trim_cache size 0 max 16384 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa9c80a2c80 msgr2=0x7fa9c80a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa9c80a2c80 0x7fa9c80a5140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400a940 tx=0x7fa9d4004a60 comp rx=0 tx=0).stop 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc109290 msgr2=0x7fa9dc1a4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc109290 0x7fa9dc1a4630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009850 tx=0x7fa9cc0309c0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 shutdown_connections 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa9c80a2c80 0x7fa9c80a5140 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9dc10e7b0 0x7fa9dc19e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9dc109c40 0x7fa9dc1a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 --2- 172.21.15.73:0/533701850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc109290 0x7fa9dc1a4630 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:04.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 >> 172.21.15.73:0/533701850 conn(0x7fa9dc077c10 msgr2=0x7fa9dc07a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:04.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 shutdown_connections 2024-09-05T13:04:04.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:03.516+0000 7fa9e283c640 1 -- 172.21.15.73:0/533701850 wait complete. 2024-09-05T13:04:04.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:04 smithi073 ceph-mon[30883]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.2 MiB/s wr, 1.83k op/s 2024-09-05T13:04:04.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:04 smithi162 ceph-mon[34220]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.2 MiB/s wr, 1.83k op/s 2024-09-05T13:04:04.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:04 smithi169 ceph-mon[34823]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.2 MiB/s wr, 1.83k op/s 2024-09-05T13:04:05.419 INFO:tasks.cephfs.filesystem:scrub status for tag:c3b34c64-f94c-44f2-9ac6-6a49509babcb - {'path': '/', 'tag': 'c3b34c64-f94c-44f2-9ac6-6a49509babcb', 'options': 'recursive,force'} 2024-09-05T13:04:07.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:07 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:07.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:07 smithi162 ceph-mon[34220]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 14 MiB/s wr, 3.48k op/s 2024-09-05T13:04:07.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:07 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:07.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:07 smithi169 ceph-mon[34823]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 14 MiB/s wr, 3.48k op/s 2024-09-05T13:04:07.494 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:07 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:07.494 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:07 smithi073 ceph-mon[30883]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 14 MiB/s wr, 3.48k op/s 2024-09-05T13:04:09.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:09 smithi073 ceph-mon[30883]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 3.20k op/s 2024-09-05T13:04:09.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:09 smithi162 ceph-mon[34220]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 3.20k op/s 2024-09-05T13:04:09.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:09 smithi169 ceph-mon[34823]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 3.20k op/s 2024-09-05T13:04:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:11 smithi073 ceph-mon[30883]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 3.46k op/s 2024-09-05T13:04:11.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:11 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:04:11.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:11 smithi162 ceph-mon[34220]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 3.46k op/s 2024-09-05T13:04:11.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:11 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:04:11.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:11 smithi169 ceph-mon[34823]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 3.46k op/s 2024-09-05T13:04:11.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:11 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:04:12.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:12 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:04:12.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:12 smithi073 ceph-mon[30883]: scrub summary: idle 2024-09-05T13:04:12.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:12 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:04:12.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:12 smithi162 ceph-mon[34220]: scrub summary: idle 2024-09-05T13:04:12.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:12 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:04:12.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:12 smithi169 ceph-mon[34823]: scrub summary: idle 2024-09-05T13:04:13.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:13 smithi073 ceph-mon[30883]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 3.45k op/s 2024-09-05T13:04:13.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:13 smithi162 ceph-mon[34220]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 3.45k op/s 2024-09-05T13:04:13.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:13 smithi169 ceph-mon[34823]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 3.45k op/s 2024-09-05T13:04:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.664+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/4069404808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa00ffe10 msgr2=0x7f0fa0100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.664+0000 7f0fa7b7f640 1 --2- 172.21.15.73:0/4069404808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa00ffe10 0x7f0fa0100210 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009900 tx=0x7f0f9c02a410 comp rx=0 tx=0).stop 2024-09-05T13:04:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.664+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/4069404808 shutdown_connections 2024-09-05T13:04:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.664+0000 7f0fa7b7f640 1 --2- 172.21.15.73:0/4069404808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa01037a0 0x7f0fa010a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.664+0000 7f0fa7b7f640 1 --2- 172.21.15.73:0/4069404808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fa0102de0 0x7f0fa0103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.664+0000 7f0fa7b7f640 1 --2- 172.21.15.73:0/4069404808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa00ffe10 0x7f0fa0100210 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.664+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/4069404808 >> 172.21.15.73:0/4069404808 conn(0x7f0fa00fb930 msgr2=0x7f0fa00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.664+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/4069404808 shutdown_connections 2024-09-05T13:04:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.664+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/4069404808 wait complete. 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa7b7f640 1 Processor -- start 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa7b7f640 1 -- start start 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa7b7f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00ffe10 0x7f0fa0197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa7b7f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa0102de0 0x7f0fa0198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa7b7f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fa01037a0 0x7f0fa019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa7b7f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa010d830 con 0x7f0fa0102de0 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa7b7f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa010d6b0 con 0x7f0fa00ffe10 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa7b7f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa010d9b0 con 0x7f0fa01037a0 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa511a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa0102de0 0x7f0fa0198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa591b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00ffe10 0x7f0fa0197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa511a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa0102de0 0x7f0fa0198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39872/0 (socket says 172.21.15.73:39872) 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa591b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00ffe10 0x7f0fa0197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:60770/0 (socket says 172.21.15.73:60770) 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa511a640 1 -- 172.21.15.73:0/2517224 learned_addr learned my addr 172.21.15.73:0/2517224 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa611c640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fa01037a0 0x7f0fa019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa511a640 1 -- 172.21.15.73:0/2517224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fa01037a0 msgr2=0x7f0fa019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa511a640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fa01037a0 0x7f0fa019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa511a640 1 -- 172.21.15.73:0/2517224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00ffe10 msgr2=0x7f0fa0197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa511a640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00ffe10 0x7f0fa0197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa511a640 1 -- 172.21.15.73:0/2517224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa019fa20 con 0x7f0fa0102de0 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.665+0000 7f0fa591b640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00ffe10 0x7f0fa0197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.666+0000 7f0fa511a640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa0102de0 0x7f0fa0198340 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000e9f0 tx=0x7f0f9000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.666+0000 7f0f96ffd640 1 -- 172.21.15.73:0/2517224 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000cd80 con 0x7f0fa0102de0 2024-09-05T13:04:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.666+0000 7f0f96ffd640 1 -- 172.21.15.73:0/2517224 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f90005500 con 0x7f0fa0102de0 2024-09-05T13:04:14.671 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.666+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/2517224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa019fd10 con 0x7f0fa0102de0 2024-09-05T13:04:14.671 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.666+0000 7f0f96ffd640 1 -- 172.21.15.73:0/2517224 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f90010690 con 0x7f0fa0102de0 2024-09-05T13:04:14.671 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.666+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/2517224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa01a0200 con 0x7f0fa0102de0 2024-09-05T13:04:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.670+0000 7f0f96ffd640 1 -- 172.21.15.73:0/2517224 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0f900046c0 con 0x7f0fa0102de0 2024-09-05T13:04:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.670+0000 7f0f96ffd640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0f8c0a2cb0 0x7f0f8c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.670+0000 7f0f96ffd640 1 -- 172.21.15.73:0/2517224 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0f900cf390 con 0x7f0fa0102de0 2024-09-05T13:04:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.671+0000 7f0fa591b640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0f8c0a2cb0 0x7f0f8c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.671+0000 7f0fa591b640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0f8c0a2cb0 0x7f0f8c0a5170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c02aa00 tx=0x7f0f9c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.671+0000 7f0faa9ee740 1 Processor -- start 2024-09-05T13:04:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0faa9ee740 1 -- start start 2024-09-05T13:04:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10ad2e0 0x5617f10b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 0x5617f10b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5617f10102f0 con 0x5617f10b2370 2024-09-05T13:04:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5617f0fb8270 con 0x5617f10ad2e0 2024-09-05T13:04:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5617f100c2b0 con 0x5617f10ac9a0 2024-09-05T13:04:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0fa591b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0fa591b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:36796/0 (socket says 172.21.15.73:36796) 2024-09-05T13:04:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0fa591b640 1 -- 172.21.15.73:0/2501392650 learned_addr learned my addr 172.21.15.73:0/2501392650 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0fa611c640 1 --2- 172.21.15.73:0/2501392650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 0x5617f10b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.672+0000 7f0fa511a640 1 --2- 172.21.15.73:0/2501392650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10ad2e0 0x5617f10b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.677 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.673+0000 7f0fa591b640 1 -- 172.21.15.73:0/2501392650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10ad2e0 msgr2=0x5617f10b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:14.677 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.673+0000 7f0fa591b640 1 --2- 172.21.15.73:0/2501392650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10ad2e0 0x5617f10b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.677 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.673+0000 7f0fa591b640 1 -- 172.21.15.73:0/2501392650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 msgr2=0x5617f10b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:14.677 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.673+0000 7f0fa591b640 1 --2- 172.21.15.73:0/2501392650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 0x5617f10b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.679 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.673+0000 7f0fa591b640 1 -- 172.21.15.73:0/2501392650 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617f0fb7340 con 0x5617f10ac9a0 2024-09-05T13:04:14.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.673+0000 7f0fa611c640 1 --2- 172.21.15.73:0/2501392650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 0x5617f10b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:04:14.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.673+0000 7f0fa591b640 1 --2- 172.21.15.73:0/2501392650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10acda0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00696a0 tx=0x7f0f9c03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=815ddfcfeeac30b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:14.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.673+0000 7f0f8bfff640 1 -- 172.21.15.73:0/2501392650 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c035040 con 0x5617f10ac9a0 2024-09-05T13:04:14.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.673+0000 7f0f8bfff640 1 -- 172.21.15.73:0/2501392650 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f9c04e070 con 0x5617f10ac9a0 2024-09-05T13:04:14.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.673+0000 7f0f8bfff640 1 -- 172.21.15.73:0/2501392650 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c032db0 con 0x5617f10ac9a0 2024-09-05T13:04:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.674+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2501392650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 msgr2=0x5617f10acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.674+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/2501392650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10acda0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00696a0 tx=0x7f0f9c03d000 comp rx=0 tx=0).stop 2024-09-05T13:04:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.674+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2501392650 shutdown_connections 2024-09-05T13:04:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.674+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/2501392650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 0x5617f10b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.674+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/2501392650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10ad2e0 0x5617f10b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.674+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/2501392650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10acda0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.674+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2501392650 >> 172.21.15.73:0/2501392650 conn(0x5617f10a8010 msgr2=0x5617f10a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.674+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2501392650 shutdown_connections 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.674+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2501392650 wait complete. 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.675+0000 7f0faa9ee740 1 -- start start 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.675+0000 7f0faa9ee740 1 Processor -- start 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.675+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 0x5617f10b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 0x5617f10b7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 0x5617f10be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5617f10b52e0 con 0x5617f10ac9a0 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5617f0f99290 con 0x5617f10b2370 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5617f10b5460 con 0x5617f10ad2e0 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0faa9ee740 10 client.0 _ll_register_callbacks cb 0x5617f0fca140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa611c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 0x5617f10be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa611c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 0x5617f10be090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:60788/0 (socket says 172.21.15.73:60788) 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa611c640 1 -- 172.21.15.73:0/2088904629 learned_addr learned my addr 172.21.15.73:0/2088904629 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa511a640 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 0x5617f10b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa591b640 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 0x5617f10b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa611c640 1 -- 172.21.15.73:0/2088904629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 msgr2=0x5617f10b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa611c640 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 0x5617f10b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa611c640 1 -- 172.21.15.73:0/2088904629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 msgr2=0x5617f10b6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa611c640 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 0x5617f10b6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa611c640 1 -- 172.21.15.73:0/2088904629 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617f0d23210 con 0x5617f10b2370 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.676+0000 7f0fa511a640 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 0x5617f10b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.677+0000 7f0fa611c640 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 0x5617f10be090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f98011d10 tx=0x7f0f9800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec1d8e47609041f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.677+0000 7f0f897fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.677+0000 7f0f897fa640 1 -- 172.21.15.73:0/2088904629 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9801e060 con 0x5617f10b2370 2024-09-05T13:04:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.677+0000 7f0f897fa640 1 -- 172.21.15.73:0/2088904629 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0f98003970 con 0x5617f10b2370 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.677+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2088904629 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f9c04e070 con 0x5617f10b2370 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.677+0000 7f0f897fa640 1 -- 172.21.15.73:0/2088904629 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f0f9800fe60 con 0x5617f10b2370 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.677+0000 7f0faa9ee740 10 client.25793 fetch_fsmap learned FSMap version 43 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.677+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2088904629 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5617f0def620 con 0x5617f10b2370 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.677+0000 7f0f897fa640 1 -- 172.21.15.73:0/2088904629 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f9c04e070 con 0x5617f10b2370 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.678+0000 7f0f897fa640 1 -- 172.21.15.73:0/2088904629 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 43) ==== 8346+0+0 (secure 0 0 0) 0x7f0f98019070 con 0x5617f10b2370 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.678+0000 7f0faa9ee740 10 client.25793 fetch_fsmap finished waiting for FSMap version 43 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.678+0000 7f0faa9ee740 10 client.25793 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.678+0000 7f0faa9ee740 20 client.25793 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.678+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5617f10c2850 0x5617f10c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.678+0000 7f0faa9ee740 4 client.25793 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.678+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2088904629 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617f101da20 con 0x5617f10c2850 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.678+0000 7f0fa591b640 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5617f10c2850 0x5617f10c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.679+0000 7f0f897fa640 10 client.25793 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.679+0000 7f0fa591b640 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5617f10c2850 0x5617f10c4c40 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59940cc527562413 server_cookie=7baae1d430f74f6 in_seq=0 out_seq=0 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.679+0000 7f0f897fa640 1 -- 172.21.15.73:0/2088904629 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617f101da20 con 0x5617f10c2850 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.679+0000 7f0f897fa640 10 client.25793 handle_command_reply: tid=0 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 client.25793 shutdown 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2088904629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 msgr2=0x5617f10be090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 0x5617f10be090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f98011d10 tx=0x7f0f9800f790 comp rx=0 tx=0).stop 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2088904629 shutdown_connections 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5617f10c2850 0x5617f10c4c40 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0f897fa640 0 client.25793 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 0x5617f10be090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 0x5617f10b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/2088904629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 0x5617f10b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.690 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2088904629 >> 172.21.15.73:0/2088904629 conn(0x5617f10a8010 msgr2=0x5617f10a9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:14.690 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2088904629 shutdown_connections 2024-09-05T13:04:14.690 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 1 -- 172.21.15.73:0/2088904629 wait complete. 2024-09-05T13:04:14.690 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.680+0000 7f0faa9ee740 20 client.25793 trim_cache size 0 max 16384 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.696+0000 7f0faa9ee740 1 Processor -- start 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.696+0000 7f0faa9ee740 1 -- start start 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.696+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 0x5617f10acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.696+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 0x5617f10be050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.696+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 0x5617f10a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.696+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa01ab730 con 0x5617f10ac9a0 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.696+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa01a9000 con 0x5617f10b2370 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.696+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa01a6e50 con 0x5617f10ad2e0 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa591b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 0x5617f10acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa591b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 0x5617f10acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39902/0 (socket says 172.21.15.73:39902) 2024-09-05T13:04:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa591b640 1 -- 172.21.15.73:0/3595291633 learned_addr learned my addr 172.21.15.73:0/3595291633 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa511a640 1 --2- 172.21.15.73:0/3595291633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 0x5617f10be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa611c640 1 --2- 172.21.15.73:0/3595291633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 0x5617f10a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa591b640 1 -- 172.21.15.73:0/3595291633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 msgr2=0x5617f10be050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa591b640 1 --2- 172.21.15.73:0/3595291633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 0x5617f10be050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa591b640 1 -- 172.21.15.73:0/3595291633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 msgr2=0x5617f10a83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa591b640 1 --2- 172.21.15.73:0/3595291633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 0x5617f10a83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa591b640 1 -- 172.21.15.73:0/3595291633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617f10ad7c0 con 0x5617f10ac9a0 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0fa591b640 1 --2- 172.21.15.73:0/3595291633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 0x5617f10acd80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c006010 tx=0x7f0f9c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d60dae46e35496 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0f8b7fe640 1 -- 172.21.15.73:0/3595291633 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c040040 con 0x5617f10ac9a0 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0f8b7fe640 1 -- 172.21.15.73:0/3595291633 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f9c063070 con 0x5617f10ac9a0 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.697+0000 7f0f8b7fe640 1 -- 172.21.15.73:0/3595291633 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c035040 con 0x5617f10ac9a0 2024-09-05T13:04:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.698+0000 7f0faa9ee740 1 -- 172.21.15.73:0/3595291633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 msgr2=0x5617f10acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.698+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/3595291633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 0x5617f10acd80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c006010 tx=0x7f0f9c005740 comp rx=0 tx=0).stop 2024-09-05T13:04:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.698+0000 7f0faa9ee740 1 -- 172.21.15.73:0/3595291633 shutdown_connections 2024-09-05T13:04:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.698+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/3595291633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10b2370 0x5617f10a83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.698+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/3595291633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ad2e0 0x5617f10be050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.698+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/3595291633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10ac9a0 0x5617f10acd80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.698+0000 7f0faa9ee740 1 -- 172.21.15.73:0/3595291633 >> 172.21.15.73:0/3595291633 conn(0x5617f10a8010 msgr2=0x5617f10b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.698+0000 7f0faa9ee740 1 -- 172.21.15.73:0/3595291633 shutdown_connections 2024-09-05T13:04:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.698+0000 7f0faa9ee740 1 -- 172.21.15.73:0/3595291633 wait complete. 2024-09-05T13:04:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.698+0000 7f0faa9ee740 1 -- start start 2024-09-05T13:04:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0faa9ee740 1 Processor -- start 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10bb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10ad2e0 0x5617f10bb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0faa9ee740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 0x5617f10bc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa01a74c0 con 0x5617f10b2370 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa01a8930 con 0x5617f10ad2e0 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0faa9ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa01a7b90 con 0x5617f10ac9a0 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0fa591b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10bb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0fa591b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10bb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:36842/0 (socket says 172.21.15.73:36842) 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0fa591b640 1 -- 172.21.15.73:0/1594203110 learned_addr learned my addr 172.21.15.73:0/1594203110 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0fa511a640 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10ad2e0 0x5617f10bb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0fa611c640 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 0x5617f10bc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0faa9ee740 10 client.0 _ll_register_callbacks cb 0x7f0f98009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0fa591b640 1 -- 172.21.15.73:0/1594203110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10ad2e0 msgr2=0x5617f10bb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.699+0000 7f0fa591b640 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10ad2e0 0x5617f10bb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0fa591b640 1 -- 172.21.15.73:0/1594203110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 msgr2=0x5617f10bc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0fa591b640 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 0x5617f10bc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0fa591b640 1 -- 172.21.15.73:0/1594203110 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617f10bce90 con 0x5617f10ac9a0 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0fa611c640 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 0x5617f10bc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0fa591b640 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10bb330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c004460 tx=0x7f0f9c009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f504878624b6093 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0f897fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0f897fa640 1 -- 172.21.15.73:0/1594203110 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c040030 con 0x5617f10ac9a0 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0f897fa640 1 -- 172.21.15.73:0/1594203110 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f0f9c0037f0 con 0x5617f10ac9a0 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0faa9ee740 1 -- 172.21.15.73:0/1594203110 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f9c063070 con 0x5617f10ac9a0 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0f897fa640 1 -- 172.21.15.73:0/1594203110 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f0f9c035040 con 0x5617f10ac9a0 2024-09-05T13:04:14.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0faa9ee740 10 client.25906 fetch_fsmap learned FSMap version 43 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0faa9ee740 1 -- 172.21.15.73:0/1594203110 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5617f10be160 con 0x5617f10ac9a0 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.700+0000 7f0f897fa640 1 -- 172.21.15.73:0/1594203110 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f9c04e070 con 0x5617f10ac9a0 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.701+0000 7f0f897fa640 1 -- 172.21.15.73:0/1594203110 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 43) ==== 8346+0+0 (secure 0 0 0) 0x7f0f9c004b50 con 0x5617f10ac9a0 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.701+0000 7f0faa9ee740 10 client.25906 fetch_fsmap finished waiting for FSMap version 43 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.701+0000 7f0faa9ee740 10 client.25906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.701+0000 7f0faa9ee740 20 client.25906 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.701+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5617f112d550 0x5617f112f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.701+0000 7f0faa9ee740 4 client.25906 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.701+0000 7f0faa9ee740 1 -- 172.21.15.73:0/1594203110 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f0f9c063070 con 0x5617f112d550 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.701+0000 7f0fa511a640 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5617f112d550 0x5617f112f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.701+0000 7f0f897fa640 10 client.25906 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.701+0000 7f0fa511a640 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5617f112d550 0x5617f112f970 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a180d3b59b95c5d1 server_cookie=4d072e8370e2121f in_seq=0 out_seq=0 2024-09-05T13:04:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.715+0000 7f0f897fa640 1 -- 172.21.15.73:0/1594203110 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f0f9c063070 con 0x5617f112d550 2024-09-05T13:04:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.715+0000 7f0f897fa640 10 client.25906 handle_command_reply: tid=0 2024-09-05T13:04:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.715+0000 7f0faa9ee740 1 client.25906 shutdown 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.715+0000 7f0faa9ee740 1 -- 172.21.15.73:0/1594203110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 msgr2=0x5617f10bb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.715+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10bb330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c004460 tx=0x7f0f9c009680 comp rx=0 tx=0).stop 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.716+0000 7f0faa9ee740 1 -- 172.21.15.73:0/1594203110 shutdown_connections 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.716+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5617f112d550 0x5617f112f970 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.716+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617f10b2370 0x5617f10bc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.716+0000 7f0f897fa640 0 client.25906 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.716+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617f10ad2e0 0x5617f10bb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.716+0000 7f0faa9ee740 1 --2- 172.21.15.73:0/1594203110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5617f10ac9a0 0x5617f10bb330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.716+0000 7f0faa9ee740 1 -- 172.21.15.73:0/1594203110 >> 172.21.15.73:0/1594203110 conn(0x5617f10a8010 msgr2=0x5617f10a69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.716+0000 7f0faa9ee740 1 -- 172.21.15.73:0/1594203110 shutdown_connections 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.716+0000 7f0faa9ee740 1 -- 172.21.15.73:0/1594203110 wait complete. 2024-09-05T13:04:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.716+0000 7f0faa9ee740 20 client.25906 trim_cache size 0 max 16384 2024-09-05T13:04:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:04:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:04:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:04:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:04:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/2517224 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0f8c0a2cb0 msgr2=0x7f0f8c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0f8c0a2cb0 0x7f0f8c0a5170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c02aa00 tx=0x7f0f9c0315b0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/2517224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa0102de0 msgr2=0x7f0fa0198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa0102de0 0x7f0fa0198340 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000e9f0 tx=0x7f0f9000edf0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/2517224 shutdown_connections 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0f8c0a2cb0 0x7f0f8c0a5170 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0fa01037a0 0x7f0fa019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa0102de0 0x7f0fa0198340 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 --2- 172.21.15.73:0/2517224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00ffe10 0x7f0fa0197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/2517224 >> 172.21.15.73:0/2517224 conn(0x7f0fa00fb930 msgr2=0x7f0fa01060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/2517224 shutdown_connections 2024-09-05T13:04:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:14.717+0000 7f0fa7b7f640 1 -- 172.21.15.73:0/2517224 wait complete. 2024-09-05T13:04:15.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:15 smithi073 ceph-mon[30883]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 3.33k op/s 2024-09-05T13:04:15.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:15 smithi162 ceph-mon[34220]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 3.33k op/s 2024-09-05T13:04:15.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:15 smithi169 ceph-mon[34823]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 3.33k op/s 2024-09-05T13:04:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:17 smithi073 ceph-mon[30883]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-09-05T13:04:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:17 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:04:17.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:17 smithi162 ceph-mon[34220]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-09-05T13:04:17.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:17 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:04:17.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:17 smithi169 ceph-mon[34823]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-09-05T13:04:17.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:17 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:04:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:04:18.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:04:18.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:04:18.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:04:18.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:04:18.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:04:18.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:04:18.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:04:18.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:04:18.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:04:19.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:19 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-05T13:04:19.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:19 smithi073 ceph-mon[30883]: Unable to set osd_memory_target on smithi073 to 184566681: error parsing value: Value '184566681' is below minimum 939524096 2024-09-05T13:04:19.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:19 smithi073 ceph-mon[30883]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 MiB/s wr, 1.01k op/s 2024-09-05T13:04:19.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:19 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-05T13:04:19.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:19 smithi162 ceph-mon[34220]: Unable to set osd_memory_target on smithi073 to 184566681: error parsing value: Value '184566681' is below minimum 939524096 2024-09-05T13:04:19.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:19 smithi162 ceph-mon[34220]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 MiB/s wr, 1.01k op/s 2024-09-05T13:04:19.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:19 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-05T13:04:19.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:19 smithi169 ceph-mon[34823]: Unable to set osd_memory_target on smithi073 to 184566681: error parsing value: Value '184566681' is below minimum 939524096 2024-09-05T13:04:19.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:19 smithi169 ceph-mon[34823]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 MiB/s wr, 1.01k op/s 2024-09-05T13:04:21.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:21 smithi073 ceph-mon[30883]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.0 MiB/s wr, 1.02k op/s 2024-09-05T13:04:21.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:21 smithi162 ceph-mon[34220]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.0 MiB/s wr, 1.02k op/s 2024-09-05T13:04:21.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:21 smithi169 ceph-mon[34823]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.0 MiB/s wr, 1.02k op/s 2024-09-05T13:04:23.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:23 smithi073 ceph-mon[30883]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.1 MiB/s wr, 804 op/s 2024-09-05T13:04:23.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:23 smithi162 ceph-mon[34220]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.1 MiB/s wr, 804 op/s 2024-09-05T13:04:23.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:23 smithi169 ceph-mon[34823]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.1 MiB/s wr, 804 op/s 2024-09-05T13:04:24.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:24 smithi073 ceph-mon[30883]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.3 MiB/s wr, 602 op/s 2024-09-05T13:04:24.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:24 smithi162 ceph-mon[34220]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.3 MiB/s wr, 602 op/s 2024-09-05T13:04:24.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:24 smithi169 ceph-mon[34823]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.3 MiB/s wr, 602 op/s 2024-09-05T13:04:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:27 smithi073 ceph-mon[30883]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.0 MiB/s wr, 530 op/s 2024-09-05T13:04:27.522 INFO:tasks.workunit.client.0.smithi073.stdout:Syncing()...1 sec 2024-09-05T13:04:27.522 INFO:tasks.workunit.client.0.smithi073.stdout:FFSB benchmark finished at: Thu Sep 5 13:04:27 2024 2024-09-05T13:04:27.522 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.522 INFO:tasks.workunit.client.0.smithi073.stdout:Results: 2024-09-05T13:04:27.522 INFO:tasks.workunit.client.0.smithi073.stdout:Benchmark took 328.51 sec 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout:Total Results 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout:=============== 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout: ======= ============ ========= ======= =========== ========== 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout: write : 4572160 13917.77 100.000% 100.000% 54.4MB/sec 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout:- 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout:13917.77 Transactions per Second 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout:Throughput Results 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout:=================== 2024-09-05T13:04:27.523 INFO:tasks.workunit.client.0.smithi073.stdout:Write Throughput: 54.4MB/sec 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout:System Call Latency statistics in millisecs 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout:===== 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout: Min Avg Max Total Calls 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout: ======== ======== ======== ============ 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout:[ open] 0.004000 38.975898 4864.287109 3572 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[1] 2000.000000 - 5000.000000 : 31 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[2] 1000.000000 - 2000.000000 : 6 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[3] 500.000000 - 1000.000000 : 16 2024-09-05T13:04:27.543 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[4] 200.000000 - 500.000000 : 12 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[6] 50.000000 - 100.000000 : 5 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[7] 20.000000 - 50.000000 : 26 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[8] 10.000000 - 20.000000 : 14 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[9] 5.000000 - 10.000000 : 23 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[10] 2.000000 - 5.000000 : 64 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[11] 1.000000 - 2.000000 : 110 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[12] 0.500000 - 1.000000 : 325 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[13] 0.200000 - 0.500000 : 4 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[14] 0.100000 - 0.200000 : 14 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[15] 0.050000 - 0.100000 : 119 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[16] 0.020000 - 0.050000 : 764 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[17] 0.010000 - 0.020000 : 1432 2024-09-05T13:04:27.544 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[18] 0.000000 - 0.010000 : 607 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout:[ write] 0.001000 2.154508 15769.792969 4572160 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[0] 5000.000000 - 10000.000000 : 48 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[1] 2000.000000 - 5000.000000 : 396 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[2] 1000.000000 - 2000.000000 : 596 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[3] 500.000000 - 1000.000000 : 543 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[4] 200.000000 - 500.000000 : 2515 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[5] 100.000000 - 200.000000 : 8546 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[6] 50.000000 - 100.000000 : 23712 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[7] 20.000000 - 50.000000 : 47507 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[8] 10.000000 - 20.000000 : 68697 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[9] 5.000000 - 10.000000 : 96379 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[10] 2.000000 - 5.000000 : 81765 2024-09-05T13:04:27.545 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[11] 1.000000 - 2.000000 : 713 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[12] 0.500000 - 1.000000 : 397 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[13] 0.200000 - 0.500000 : 336 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[14] 0.100000 - 0.200000 : 388 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[15] 0.050000 - 0.100000 : 1307 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[16] 0.020000 - 0.050000 : 6949 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[17] 0.010000 - 0.020000 : 13647 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[18] 0.000000 - 0.010000 : 4217706 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout:[ lseek] 0.000000 0.000767 51.598000 4572160 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-05T13:04:27.546 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[6] 50.000000 - 100.000000 : 1 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[7] 20.000000 - 50.000000 : 24 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[8] 10.000000 - 20.000000 : 35 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[9] 5.000000 - 10.000000 : 19 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[10] 2.000000 - 5.000000 : 27 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[11] 1.000000 - 2.000000 : 40 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[12] 0.500000 - 1.000000 : 48 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[13] 0.200000 - 0.500000 : 28 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[14] 0.100000 - 0.200000 : 39 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[15] 0.050000 - 0.100000 : 104 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[16] 0.020000 - 0.050000 : 546 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[17] 0.010000 - 0.020000 : 1641 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[18] 0.000000 - 0.010000 : 4569608 2024-09-05T13:04:27.547 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout:[ close] 0.001000 0.013902 24.011000 3572 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[7] 20.000000 - 50.000000 : 1 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[10] 2.000000 - 5.000000 : 0 2024-09-05T13:04:27.548 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[15] 0.050000 - 0.100000 : 1 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[16] 0.020000 - 0.050000 : 4 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[17] 0.010000 - 0.020000 : 32 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[18] 0.000000 - 0.010000 : 3533 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout:0.9% User Time 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout:16.4% System Time 2024-09-05T13:04:27.549 INFO:tasks.workunit.client.0.smithi073.stdout:17.2% CPU Utilization 2024-09-05T13:04:27.550 INFO:tasks.workunit.client.0.smithi073.stderr:+ cd .. 2024-09-05T13:04:27.550 INFO:tasks.workunit.client.0.smithi073.stderr:+ rm -r tmp ffsb 2024-09-05T13:04:27.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:27 smithi162 ceph-mon[34220]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.0 MiB/s wr, 530 op/s 2024-09-05T13:04:27.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:27 smithi169 ceph-mon[34823]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.0 MiB/s wr, 530 op/s 2024-09-05T13:04:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.813+0000 7f2ada7f6640 1 -- 172.21.15.73:0/3562449459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad41078a0 msgr2=0x7f2ad4109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.813+0000 7f2ada7f6640 1 --2- 172.21.15.73:0/3562449459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad41078a0 0x7f2ad4109c90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009ca0 tx=0x7f2acc02a8c0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 -- 172.21.15.73:0/3562449459 shutdown_connections 2024-09-05T13:04:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 --2- 172.21.15.73:0/3562449459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad41078a0 0x7f2ad4109c90 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 --2- 172.21.15.73:0/3562449459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ad4104f70 0x7f2ad4107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 --2- 172.21.15.73:0/3562449459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ad4102640 0x7f2ad4104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 -- 172.21.15.73:0/3562449459 >> 172.21.15.73:0/3562449459 conn(0x7f2ad40fc1e0 msgr2=0x7f2ad40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 -- 172.21.15.73:0/3562449459 shutdown_connections 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 -- 172.21.15.73:0/3562449459 wait complete. 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 Processor -- start 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 -- start start 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ad4102640 0x7f2ad4101fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.814+0000 7f2ada7f6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ad4104f70 0x7f2ad41005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ada7f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad41078a0 0x7f2ad4100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ada7f6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad410d7e0 con 0x7f2ad41078a0 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ada7f6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad410d660 con 0x7f2ad4104f70 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ada7f6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad410d960 con 0x7f2ad4102640 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad8d93640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad41078a0 0x7f2ad4100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad8d93640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad41078a0 0x7f2ad4100b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48734/0 (socket says 172.21.15.73:48734) 2024-09-05T13:04:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad8d93640 1 -- 172.21.15.73:0/2012486341 learned_addr learned my addr 172.21.15.73:0/2012486341 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ad4104f70 0x7f2ad41005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ad4102640 0x7f2ad4101fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad8d93640 1 -- 172.21.15.73:0/2012486341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ad4102640 msgr2=0x7f2ad4101fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad8d93640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ad4102640 0x7f2ad4101fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad8d93640 1 -- 172.21.15.73:0/2012486341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ad4104f70 msgr2=0x7f2ad41005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad8d93640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ad4104f70 0x7f2ad41005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad8d93640 1 -- 172.21.15.73:0/2012486341 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad41013c0 con 0x7f2ad41078a0 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad8d93640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad41078a0 0x7f2ad4100b30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2acc02f540 tx=0x7f2acc031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad17fa640 1 -- 172.21.15.73:0/2012486341 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc003b70 con 0x7f2ad41078a0 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad17fa640 1 -- 172.21.15.73:0/2012486341 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2acc003d10 con 0x7f2ad41078a0 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ada7f6640 1 -- 172.21.15.73:0/2012486341 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad41a1e20 con 0x7f2ad41078a0 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ad17fa640 1 -- 172.21.15.73:0/2012486341 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc02fc80 con 0x7f2ad41078a0 2024-09-05T13:04:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.815+0000 7f2ada7f6640 1 -- 172.21.15.73:0/2012486341 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad41a2280 con 0x7f2ad41078a0 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2ad17fa640 1 -- 172.21.15.73:0/2012486341 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2acc004050 con 0x7f2ad41078a0 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2add66b740 1 Processor -- start 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2add66b740 1 -- start start 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2add66b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a71960ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2add66b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a71960fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2add66b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a719610370 0x55a719612830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2add66b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a71956e2f0 con 0x55a71960a9a0 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2add66b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a719516270 con 0x55a71960b2e0 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2add66b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a71956a2b0 con 0x55a719610370 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2ad17fa640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2abc0a2c30 0x7f2abc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a71960ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a71960ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48742/0 (socket says 172.21.15.73:48742) 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2ad37fe640 1 -- 172.21.15.73:0/4198920495 learned_addr learned my addr 172.21.15.73:0/4198920495 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/4198920495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a71960fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2ad8d93640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2abc0a2c30 0x7f2abc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.818+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/4198920495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a719610370 0x55a719612830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2ad17fa640 1 -- 172.21.15.73:0/2012486341 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f2acc0f0160 con 0x7f2ad41078a0 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2ad3fff640 1 -- 172.21.15.73:0/4198920495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a719610370 msgr2=0x55a719612830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/4198920495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a719610370 0x55a719612830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2ad3fff640 1 -- 172.21.15.73:0/4198920495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 msgr2=0x55a71960ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/4198920495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a71960ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2ad3fff640 1 -- 172.21.15.73:0/4198920495 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a719515340 con 0x55a71960b2e0 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2ad8d93640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2abc0a2c30 0x7f2abc0a50f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0bc6f0 tx=0x7f2acc083040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/4198920495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a71960fda0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009b70 tx=0x7f2ac40117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe206ca00cf95eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2aba7fc640 1 -- 172.21.15.73:0/4198920495 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4009e60 con 0x55a71960b2e0 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2aba7fc640 1 -- 172.21.15.73:0/4198920495 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ac4012930 con 0x55a71960b2e0 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.819+0000 7f2aba7fc640 1 -- 172.21.15.73:0/4198920495 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac400fac0 con 0x55a71960b2e0 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 -- 172.21.15.73:0/4198920495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 msgr2=0x55a71960fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 --2- 172.21.15.73:0/4198920495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a71960fda0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009b70 tx=0x7f2ac40117b0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 -- 172.21.15.73:0/4198920495 shutdown_connections 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 --2- 172.21.15.73:0/4198920495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a719610370 0x55a719612830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 --2- 172.21.15.73:0/4198920495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a71960fda0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 --2- 172.21.15.73:0/4198920495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a71960ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 -- 172.21.15.73:0/4198920495 >> 172.21.15.73:0/4198920495 conn(0x55a719606010 msgr2=0x55a719606410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 -- 172.21.15.73:0/4198920495 shutdown_connections 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 -- 172.21.15.73:0/4198920495 wait complete. 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 -- start start 2024-09-05T13:04:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.820+0000 7f2add66b740 1 Processor -- start 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2add66b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960a9a0 0x55a719614bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2add66b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a719615110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2add66b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a719610370 0x55a71961c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2add66b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a719613340 con 0x55a719610370 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2add66b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a7194f7290 con 0x55a71960b2e0 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2add66b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a7196134c0 con 0x55a71960a9a0 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2add66b740 10 client.0 _ll_register_callbacks cb 0x55a719528140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a719610370 0x55a71961c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a719615110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a719615110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:53658/0 (socket says 172.21.15.73:53658) 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a719610370 0x55a71961c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48748/0 (socket says 172.21.15.73:48748) 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad3fff640 1 -- 172.21.15.73:0/872132310 learned_addr learned my addr 172.21.15.73:0/872132310 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960a9a0 0x55a719614bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad37fe640 1 -- 172.21.15.73:0/872132310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960a9a0 msgr2=0x55a719614bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960a9a0 0x55a719614bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad37fe640 1 -- 172.21.15.73:0/872132310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 msgr2=0x55a719615110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a719615110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad37fe640 1 -- 172.21.15.73:0/872132310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a719281210 con 0x55a719610370 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a719615110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a719610370 0x55a71961c150 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80058c0 tx=0x7f2ac800a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134c5e99a87c3a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ab37fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ab37fe640 1 -- 172.21.15.73:0/872132310 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80140d0 con 0x55a719610370 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2ab37fe640 1 -- 172.21.15.73:0/872132310 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f2ac8014270 con 0x55a719610370 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.821+0000 7f2add66b740 1 -- 172.21.15.73:0/872132310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ac4012930 con 0x55a719610370 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2ab37fe640 1 -- 172.21.15.73:0/872132310 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f2ac8005020 con 0x55a719610370 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2add66b740 10 client.16329 fetch_fsmap learned FSMap version 43 2024-09-05T13:04:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2add66b740 1 -- 172.21.15.73:0/872132310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55a71934d620 con 0x55a719610370 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2ab37fe640 1 -- 172.21.15.73:0/872132310 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ac4012930 con 0x55a719610370 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2ab37fe640 1 -- 172.21.15.73:0/872132310 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 43) ==== 8346+0+0 (secure 0 0 0) 0x7f2ac800e5c0 con 0x55a719610370 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2add66b740 10 client.16329 fetch_fsmap finished waiting for FSMap version 43 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2add66b740 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2add66b740 20 client.16329 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2add66b740 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a719620840 0x55a719622c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2add66b740 4 client.16329 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2add66b740 1 -- 172.21.15.73:0/872132310 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a71957ba20 con 0x55a719620840 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.822+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a719620840 0x55a719622c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.823+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a719620840 0x55a719622c50 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9162f151a818d6bb server_cookie=e9fa8c4f583cff9f in_seq=0 out_seq=0 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.823+0000 7f2ab37fe640 10 client.16329 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.823+0000 7f2ab37fe640 1 -- 172.21.15.73:0/872132310 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a71957ba20 con 0x55a719620840 2024-09-05T13:04:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.823+0000 7f2ab37fe640 10 client.16329 handle_command_reply: tid=0 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.823+0000 7f2add66b740 1 client.16329 shutdown 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 1 -- 172.21.15.73:0/872132310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a719610370 msgr2=0x55a71961c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a719610370 0x55a71961c150 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80058c0 tx=0x7f2ac800a2d0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 1 -- 172.21.15.73:0/872132310 shutdown_connections 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a719620840 0x55a719622c50 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a719610370 0x55a71961c150 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a71960b2e0 0x55a719615110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2ab37fe640 0 client.16329 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 1 --2- 172.21.15.73:0/872132310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960a9a0 0x55a719614bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 1 -- 172.21.15.73:0/872132310 >> 172.21.15.73:0/872132310 conn(0x55a719606010 msgr2=0x55a719607820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 1 -- 172.21.15.73:0/872132310 shutdown_connections 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 1 -- 172.21.15.73:0/872132310 wait complete. 2024-09-05T13:04:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.824+0000 7f2add66b740 20 client.16329 trim_cache size 0 max 16384 2024-09-05T13:04:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2add66b740 1 Processor -- start 2024-09-05T13:04:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2add66b740 1 -- start start 2024-09-05T13:04:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2add66b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a719622c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2add66b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960b2e0 0x55a71961c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2add66b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a719610370 0x55a7196063f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2add66b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad41ad870 con 0x55a71960a9a0 2024-09-05T13:04:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2add66b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad41ab140 con 0x55a719610370 2024-09-05T13:04:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2add66b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad41a8f90 con 0x55a71960b2e0 2024-09-05T13:04:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a719622c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a719622c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48758/0 (socket says 172.21.15.73:48758) 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2ad37fe640 1 -- 172.21.15.73:0/1155765781 learned_addr learned my addr 172.21.15.73:0/1155765781 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/1155765781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a719610370 0x55a7196063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2ad37fe640 1 -- 172.21.15.73:0/1155765781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960b2e0 msgr2=0x55a71961c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/1155765781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960b2e0 0x55a71961c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2ad37fe640 1 -- 172.21.15.73:0/1155765781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a719610370 msgr2=0x55a7196063f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.839+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/1155765781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a719610370 0x55a7196063f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2ad37fe640 1 -- 172.21.15.73:0/1155765781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a71960b7c0 con 0x55a71960a9a0 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/1155765781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a719622c30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8014830 tx=0x7f2ac8014c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00ec98af56c2b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2ab9ffb640 1 -- 172.21.15.73:0/1155765781 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800a630 con 0x55a71960a9a0 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2ab9ffb640 1 -- 172.21.15.73:0/1155765781 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ac800eb60 con 0x55a71960a9a0 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2ab9ffb640 1 -- 172.21.15.73:0/1155765781 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8004bc0 con 0x55a71960a9a0 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2add66b740 1 -- 172.21.15.73:0/1155765781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 msgr2=0x55a719622c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2add66b740 1 --2- 172.21.15.73:0/1155765781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a719622c30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8014830 tx=0x7f2ac8014c90 comp rx=0 tx=0).stop 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2add66b740 1 -- 172.21.15.73:0/1155765781 shutdown_connections 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2add66b740 1 --2- 172.21.15.73:0/1155765781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a719610370 0x55a7196063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2add66b740 1 --2- 172.21.15.73:0/1155765781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960b2e0 0x55a71961c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2add66b740 1 --2- 172.21.15.73:0/1155765781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960a9a0 0x55a719622c30 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.840+0000 7f2add66b740 1 -- 172.21.15.73:0/1155765781 >> 172.21.15.73:0/1155765781 conn(0x55a719606010 msgr2=0x55a719614bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 1 -- 172.21.15.73:0/1155765781 shutdown_connections 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 1 -- 172.21.15.73:0/1155765781 wait complete. 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 1 -- start start 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 1 Processor -- start 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960a9a0 0x55a71961c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960b2e0 0x55a719618b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a719610370 0x55a7196191b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad41a9600 con 0x55a71960b2e0 2024-09-05T13:04:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad41aaa70 con 0x55a719610370 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad41a9cd0 con 0x55a71960a9a0 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2add66b740 10 client.0 _ll_register_callbacks cb 0x7f2ac8014dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2ad3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960b2e0 0x55a719618b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2ad3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960b2e0 0x55a719618b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48764/0 (socket says 172.21.15.73:48764) 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2ad3fff640 1 -- 172.21.15.73:0/1956821048 learned_addr learned my addr 172.21.15.73:0/1956821048 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a719610370 0x55a7196191b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.841+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960a9a0 0x55a71961c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ad3fff640 1 -- 172.21.15.73:0/1956821048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960a9a0 msgr2=0x55a71961c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960a9a0 0x55a71961c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ad3fff640 1 -- 172.21.15.73:0/1956821048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a719610370 msgr2=0x55a7196191b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a719610370 0x55a7196191b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ad3fff640 1 -- 172.21.15.73:0/1956821048 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7196895a0 con 0x55a71960b2e0 2024-09-05T13:04:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ad3fff640 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960b2e0 0x55a719618b80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4000c00 tx=0x7f2ac40095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa25a50672808fd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ab37fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ab37fe640 1 -- 172.21.15.73:0/1956821048 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4012860 con 0x55a71960b2e0 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ab37fe640 1 -- 172.21.15.73:0/1956821048 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7f2ac4005040 con 0x55a71960b2e0 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2add66b740 1 -- 172.21.15.73:0/1956821048 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ac800eb60 con 0x55a71960b2e0 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ab37fe640 1 -- 172.21.15.73:0/1956821048 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f2ac4035050 con 0x55a71960b2e0 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2add66b740 10 client.16335 fetch_fsmap learned FSMap version 43 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2add66b740 1 -- 172.21.15.73:0/1956821048 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55a71968a940 con 0x55a71960b2e0 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.842+0000 7f2ab37fe640 1 -- 172.21.15.73:0/1956821048 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ac800eb60 con 0x55a71960b2e0 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.843+0000 7f2ab37fe640 1 -- 172.21.15.73:0/1956821048 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 43) ==== 8346+0+0 (secure 0 0 0) 0x7f2ac4003c90 con 0x55a71960b2e0 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.843+0000 7f2add66b740 10 client.16335 fetch_fsmap finished waiting for FSMap version 43 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.843+0000 7f2add66b740 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.843+0000 7f2add66b740 20 client.16335 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.843+0000 7f2add66b740 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a71968b190 0x55a71968d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.843+0000 7f2add66b740 4 client.16335 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T13:04:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.843+0000 7f2add66b740 1 -- 172.21.15.73:0/1956821048 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a719575d70 con 0x55a71968b190 2024-09-05T13:04:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.843+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a71968b190 0x55a71968d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.843+0000 7f2ab37fe640 10 client.16335 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.843+0000 7f2ad37fe640 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a71968b190 0x55a71968d5b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77083a9f9e8c615 server_cookie=d38b977594e1242 in_seq=0 out_seq=0 2024-09-05T13:04:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.899+0000 7f2ab37fe640 1 -- 172.21.15.73:0/1956821048 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a719575d70 con 0x55a71968b190 2024-09-05T13:04:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.899+0000 7f2ab37fe640 10 client.16335 handle_command_reply: tid=0 2024-09-05T13:04:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.899+0000 7f2add66b740 1 client.16335 shutdown 2024-09-05T13:04:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 1 -- 172.21.15.73:0/1956821048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960b2e0 msgr2=0x55a719618b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960b2e0 0x55a719618b80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4000c00 tx=0x7f2ac40095a0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 1 -- 172.21.15.73:0/1956821048 shutdown_connections 2024-09-05T13:04:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55a71968b190 0x55a71968d5b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a719610370 0x55a7196191b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2ab37fe640 0 client.16335 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a71960b2e0 0x55a719618b80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 1 --2- 172.21.15.73:0/1956821048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a71960a9a0 0x55a71961c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 1 -- 172.21.15.73:0/1956821048 >> 172.21.15.73:0/1956821048 conn(0x55a719606010 msgr2=0x55a7196049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 1 -- 172.21.15.73:0/1956821048 shutdown_connections 2024-09-05T13:04:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 1 -- 172.21.15.73:0/1956821048 wait complete. 2024-09-05T13:04:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.900+0000 7f2add66b740 20 client.16335 trim_cache size 0 max 16384 2024-09-05T13:04:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2024-09-05T13:04:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2024-09-05T13:04:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2024-09-05T13:04:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2024-09-05T13:04:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 -- 172.21.15.73:0/2012486341 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2abc0a2c30 msgr2=0x7f2abc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2abc0a2c30 0x7f2abc0a50f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0bc6f0 tx=0x7f2acc083040 comp rx=0 tx=0).stop 2024-09-05T13:04:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 -- 172.21.15.73:0/2012486341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad41078a0 msgr2=0x7f2ad4100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad41078a0 0x7f2ad4100b30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2acc02f540 tx=0x7f2acc031ee0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 -- 172.21.15.73:0/2012486341 shutdown_connections 2024-09-05T13:04:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2abc0a2c30 0x7f2abc0a50f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad41078a0 0x7f2ad4100b30 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ad4104f70 0x7f2ad41005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 --2- 172.21.15.73:0/2012486341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ad4102640 0x7f2ad4101fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 -- 172.21.15.73:0/2012486341 >> 172.21.15.73:0/2012486341 conn(0x7f2ad40fc1e0 msgr2=0x7f2ad4102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 -- 172.21.15.73:0/2012486341 shutdown_connections 2024-09-05T13:04:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2024-09-05T13:04:27.901+0000 7f2ada7f6640 1 -- 172.21.15.73:0/2012486341 wait complete. 2024-09-05T13:04:29.118 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:04:28 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: ignoring --setuser ceph since I am not root 2024-09-05T13:04:29.118 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:04:28 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: ignoring --setgroup ceph since I am not root 2024-09-05T13:04:29.118 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:04:28 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: starting mds.c at 2024-09-05T13:04:29.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:29 smithi073 ceph-mon[30883]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-09-05T13:04:29.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:29 smithi073 ceph-mon[30883]: daemon mds.c restarted 2024-09-05T13:04:29.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:29 smithi162 ceph-mon[34220]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-09-05T13:04:29.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:29 smithi162 ceph-mon[34220]: daemon mds.c restarted 2024-09-05T13:04:29.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:29 smithi169 ceph-mon[34823]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-09-05T13:04:29.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:29 smithi169 ceph-mon[34823]: daemon mds.c restarted 2024-09-05T13:04:30.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:30 smithi073 ceph-mon[30883]: osdmap e82: 12 total, 12 up, 12 in 2024-09-05T13:04:30.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:30 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.169:6836/2445546350,v1:172.21.15.169:6837/2445546350] up:boot 2024-09-05T13:04:30.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:30 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-09-05T13:04:30.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:30 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T13:04:30.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:30 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:30.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:30 smithi162 ceph-mon[34220]: osdmap e82: 12 total, 12 up, 12 in 2024-09-05T13:04:30.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:30 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.169:6836/2445546350,v1:172.21.15.169:6837/2445546350] up:boot 2024-09-05T13:04:30.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:30 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-09-05T13:04:30.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:30 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T13:04:30.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:30 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:30.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:30 smithi169 ceph-mon[34823]: osdmap e82: 12 total, 12 up, 12 in 2024-09-05T13:04:30.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:30 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.169:6836/2445546350,v1:172.21.15.169:6837/2445546350] up:boot 2024-09-05T13:04:30.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:30 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-09-05T13:04:30.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:30 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T13:04:30.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:30 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:31.090 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T13:04:31.090 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T13:04:31.195 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-05T13:04:31.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-05T13:04:31.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:31 smithi073 ceph-mon[30883]: pgmap v535: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 966 KiB/s wr, 262 op/s 2024-09-05T13:04:31.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:31 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:31.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:31 smithi162 ceph-mon[34220]: pgmap v535: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 966 KiB/s wr, 262 op/s 2024-09-05T13:04:31.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:31 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:31.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:31 smithi169 ceph-mon[34823]: pgmap v535: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 966 KiB/s wr, 262 op/s 2024-09-05T13:04:31.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:31 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:31.709 DEBUG:teuthology.parallel:result is None 2024-09-05T13:04:31.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T13:04:31.773 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T13:04:31.774 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-05T13:04:31.783 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi073.front.sepia.ceph.com 2024-09-05T13:04:31.793 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-05T13:04:31.802 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-05T13:04:33.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:33 smithi073 ceph-mon[30883]: pgmap v536: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 767 KiB/s wr, 229 op/s 2024-09-05T13:04:33.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:33 smithi162 ceph-mon[34220]: pgmap v536: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 767 KiB/s wr, 229 op/s 2024-09-05T13:04:33.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:33 smithi169 ceph-mon[34823]: pgmap v536: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 767 KiB/s wr, 229 op/s 2024-09-05T13:04:34.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:34 smithi073 ceph-mon[30883]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:34.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:34 smithi162 ceph-mon[34220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:34.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:34 smithi169 ceph-mon[34823]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-05T13:04:35.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T13:04:35.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:35 smithi073 ceph-mon[30883]: pgmap v537: 97 pgs: 97 active+clean; 9.0 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 639 KiB/s wr, 243 op/s 2024-09-05T13:04:35.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:35 smithi162 ceph-mon[34220]: pgmap v537: 97 pgs: 97 active+clean; 9.0 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 639 KiB/s wr, 243 op/s 2024-09-05T13:04:35.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:35 smithi169 ceph-mon[34823]: pgmap v537: 97 pgs: 97 active+clean; 9.0 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 639 KiB/s wr, 243 op/s 2024-09-05T13:04:35.855 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:04:36.458 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:36 smithi073 ceph-mon[30883]: pgmap v538: 97 pgs: 97 active+clean; 5.3 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 354 KiB/s wr, 262 op/s 2024-09-05T13:04:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.456+0000 7f2c0d568640 1 -- 172.21.15.73:0/3054527124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c08109450 msgr2=0x7f2c08109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.456+0000 7f2c0d568640 1 --2- 172.21.15.73:0/3054527124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c08109450 0x7f2c08109830 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800d960 tx=0x7f2bf802c2b0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.456+0000 7f2c0d568640 1 -- 172.21.15.73:0/3054527124 shutdown_connections 2024-09-05T13:04:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.456+0000 7f2c0d568640 1 --2- 172.21.15.73:0/3054527124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c08074920 0x7f2c0807b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.456+0000 7f2c0d568640 1 --2- 172.21.15.73:0/3054527124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c08109e00 0x7f2c080741e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.456+0000 7f2c0d568640 1 --2- 172.21.15.73:0/3054527124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c08109450 0x7f2c08109830 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.456+0000 7f2c0d568640 1 -- 172.21.15.73:0/3054527124 >> 172.21.15.73:0/3054527124 conn(0x7f2c0806e140 msgr2=0x7f2c0806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.461+0000 7f2c0d568640 1 -- 172.21.15.73:0/3054527124 shutdown_connections 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.462+0000 7f2c0d568640 1 -- 172.21.15.73:0/3054527124 wait complete. 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.462+0000 7f2c0d568640 1 Processor -- start 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.463+0000 7f2c0d568640 1 -- start start 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.463+0000 7f2c0d568640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c08074920 0x7f2c0807b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.463+0000 7f2c0d568640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c08109450 0x7f2c08076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.463+0000 7f2c0d568640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c08109e00 0x7f2c080766d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.463+0000 7f2c0d568640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2c08082bb0 con 0x7f2c08109e00 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.463+0000 7f2c0d568640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c08082a30 con 0x7f2c08109450 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.463+0000 7f2c0d568640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c08082d30 con 0x7f2c08074920 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.464+0000 7f2c06ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c08074920 0x7f2c0807b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.464+0000 7f2c067fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c08109450 0x7f2c08076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.464+0000 7f2c067fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c08109450 0x7f2c08076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:53354/0 (socket says 172.21.15.73:53354) 2024-09-05T13:04:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.464+0000 7f2c067fc640 1 -- 172.21.15.73:0/1274700860 learned_addr learned my addr 172.21.15.73:0/1274700860 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.465+0000 7f2c067fc640 1 -- 172.21.15.73:0/1274700860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c08074920 msgr2=0x7f2c0807b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.465+0000 7f2c067fc640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c08074920 0x7f2c0807b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.465+0000 7f2c067fc640 1 -- 172.21.15.73:0/1274700860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c08109e00 msgr2=0x7f2c080766d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.465+0000 7f2c067fc640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c08109e00 0x7f2c080766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.465+0000 7f2c067fc640 1 -- 172.21.15.73:0/1274700860 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c08076f90 con 0x7f2c08109450 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.466+0000 7f2c067fc640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c08109450 0x7f2c08076190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00e730 tx=0x7f2bfc00ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.466+0000 7f2beffff640 1 -- 172.21.15.73:0/1274700860 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc018030 con 0x7f2c08109450 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.466+0000 7f2c0d568640 1 -- 172.21.15.73:0/1274700860 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c08137350 con 0x7f2c08109450 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.466+0000 7f2beffff640 1 -- 172.21.15.73:0/1274700860 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bfc00ee40 con 0x7f2c08109450 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.466+0000 7f2beffff640 1 -- 172.21.15.73:0/1274700860 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc004a00 con 0x7f2c08109450 2024-09-05T13:04:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.466+0000 7f2c0d568640 1 -- 172.21.15.73:0/1274700860 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c081378e0 con 0x7f2c08109450 2024-09-05T13:04:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.475+0000 7f2c0f93e740 1 Processor -- start 2024-09-05T13:04:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.475+0000 7f2c0f93e740 1 -- start start 2024-09-05T13:04:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.476+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.476+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36bfdc0 0x5622f36ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.476+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36ca680 0x5622f36cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.476+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5622f36252e0 con 0x5622f36bf4a0 2024-09-05T13:04:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.476+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5622f35ccce0 con 0x5622f36ca680 2024-09-05T13:04:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.476+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5622f36212a0 con 0x5622f36bfdc0 2024-09-05T13:04:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.477+0000 7f2beffff640 1 -- 172.21.15.73:0/1274700860 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2bfc01b070 con 0x7f2c08109450 2024-09-05T13:04:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.477+0000 7f2c077fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.477+0000 7f2c077fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36bf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33642/0 (socket says 172.21.15.73:33642) 2024-09-05T13:04:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.477+0000 7f2c077fe640 1 -- 172.21.15.73:0/1798036402 learned_addr learned my addr 172.21.15.73:0/1798036402 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.477+0000 7f2c06ffd640 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36bfdc0 0x5622f36ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.477+0000 7f2c067fc640 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36ca680 0x5622f36cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2c077fe640 1 -- 172.21.15.73:0/1798036402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36bfdc0 msgr2=0x5622f36ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2c077fe640 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36bfdc0 0x5622f36ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2c077fe640 1 -- 172.21.15.73:0/1798036402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36ca680 msgr2=0x5622f36cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2c077fe640 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36ca680 0x5622f36cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2c077fe640 1 -- 172.21.15.73:0/1798036402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622f35b1440 con 0x5622f36bf4a0 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2c067fc640 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36ca680 0x5622f36cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2beffff640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2bf00a2c40 0x7f2bf00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2c077fe640 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36bf880 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2c00005f40 tx=0x7f2c0000ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c770ffa2797d698a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2beffff640 1 -- 172.21.15.73:0/1274700860 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f2bfc0cebf0 con 0x7f2c08109450 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2c06ffd640 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36bfdc0 0x5622f36ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.478+0000 7f2bed7fa640 1 -- 172.21.15.73:0/1798036402 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00004b20 con 0x5622f36bf4a0 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.479+0000 7f2bed7fa640 1 -- 172.21.15.73:0/1798036402 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c00004cc0 con 0x5622f36bf4a0 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.480+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1798036402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 msgr2=0x5622f36bf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.480+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36bf880 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2c00005f40 tx=0x7f2c0000ad90 comp rx=0 tx=0).stop 2024-09-05T13:04:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.480+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1798036402 shutdown_connections 2024-09-05T13:04:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.480+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36ca680 0x5622f36cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.480+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36bfdc0 0x5622f36ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.480+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/1798036402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36bf880 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.480+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1798036402 >> 172.21.15.73:0/1798036402 conn(0x5622f36bba30 msgr2=0x5622f36bbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.480+0000 7f2c06ffd640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2bf00a2c40 0x7f2bf00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.480+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1798036402 shutdown_connections 2024-09-05T13:04:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.482+0000 7f2c06ffd640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2bf00a2c40 0x7f2bf00a5100 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8000c00 tx=0x7f2bf800d590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.484+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1798036402 wait complete. 2024-09-05T13:04:36.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.484+0000 7f2c0f93e740 1 -- start start 2024-09-05T13:04:36.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.484+0000 7f2c0f93e740 1 Processor -- start 2024-09-05T13:04:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.485+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.485+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36bfdc0 0x5622f36c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.485+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36ca680 0x5622f36c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.485+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5622f36cd2f0 con 0x5622f36bf4a0 2024-09-05T13:04:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.485+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5622f35e0050 con 0x5622f36ca680 2024-09-05T13:04:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.485+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5622f36cd470 con 0x5622f36bfdc0 2024-09-05T13:04:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.486+0000 7f2c0f93e740 10 client.0 _ll_register_callbacks cb 0x5622f3620160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.486+0000 7f2c06ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.486+0000 7f2c06ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33648/0 (socket says 172.21.15.73:33648) 2024-09-05T13:04:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.486+0000 7f2c06ffd640 1 -- 172.21.15.73:0/1857898497 learned_addr learned my addr 172.21.15.73:0/1857898497 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.487+0000 7f2c06ffd640 1 -- 172.21.15.73:0/1857898497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36bfdc0 msgr2=0x5622f36c7100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.487+0000 7f2c06ffd640 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36bfdc0 0x5622f36c7100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.487+0000 7f2c06ffd640 1 -- 172.21.15.73:0/1857898497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36ca680 msgr2=0x5622f36c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.487+0000 7f2c06ffd640 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36ca680 0x5622f36c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.487+0000 7f2c06ffd640 1 -- 172.21.15.73:0/1857898497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622f33963c0 con 0x5622f36bf4a0 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.487+0000 7f2c06ffd640 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36c9e50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800d880 tx=0x7f2bf802c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb3215355d6b1e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.488+0000 7f2beaff5640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.488+0000 7f2beaff5640 1 -- 172.21.15.73:0/1857898497 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8039040 con 0x5622f36bf4a0 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.488+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1857898497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c00004cc0 con 0x5622f36bf4a0 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.488+0000 7f2beaff5640 1 -- 172.21.15.73:0/1857898497 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f2bf8005450 con 0x5622f36bf4a0 2024-09-05T13:04:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.489+0000 7f2beaff5640 1 -- 172.21.15.73:0/1857898497 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f2bf8005650 con 0x5622f36bf4a0 2024-09-05T13:04:36.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.490+0000 7f2c0f93e740 10 client.16347 fetch_fsmap learned FSMap version 47 2024-09-05T13:04:36.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.490+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1857898497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5622f36d8b30 con 0x5622f36bf4a0 2024-09-05T13:04:36.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.498+0000 7f2beaff5640 1 -- 172.21.15.73:0/1857898497 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c00004cc0 con 0x5622f36bf4a0 2024-09-05T13:04:36.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.499+0000 7f2beaff5640 1 -- 172.21.15.73:0/1857898497 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f2bf803e9a0 con 0x5622f36bf4a0 2024-09-05T13:04:36.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.499+0000 7f2c0f93e740 10 client.16347 fetch_fsmap finished waiting for FSMap version 47 2024-09-05T13:04:36.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.499+0000 7f2c0f93e740 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:36.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.499+0000 7f2c0f93e740 20 client.16347 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:36.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.499+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5622f36d9ff0 0x5622f36dc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.499+0000 7f2c0f93e740 4 client.16347 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:04:36.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.499+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1857898497 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622f3632850 con 0x5622f36d9ff0 2024-09-05T13:04:36.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.500+0000 7f2c067fc640 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5622f36d9ff0 0x5622f36dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.500+0000 7f2c067fc640 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5622f36d9ff0 0x5622f36dc460 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3e86f76b23d8741 server_cookie=70775ac295f37f54 in_seq=0 out_seq=0 2024-09-05T13:04:36.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.500+0000 7f2beaff5640 10 client.16347 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:36.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.502+0000 7f2beaff5640 1 -- 172.21.15.73:0/1857898497 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622f3632850 con 0x5622f36d9ff0 2024-09-05T13:04:36.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.502+0000 7f2beaff5640 10 client.16347 handle_command_reply: tid=0 2024-09-05T13:04:36.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.502+0000 7f2c0f93e740 1 client.16347 shutdown 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1857898497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 msgr2=0x5622f36c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36c9e50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800d880 tx=0x7f2bf802c2b0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1857898497 shutdown_connections 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5622f36d9ff0 0x5622f36dc460 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36ca680 0x5622f36c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36bfdc0 0x5622f36c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/1857898497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36c9e50 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1857898497 >> 172.21.15.73:0/1857898497 conn(0x5622f36bba30 msgr2=0x5622f36baab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2beaff5640 0 client.16347 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1857898497 shutdown_connections 2024-09-05T13:04:36.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.503+0000 7f2c0f93e740 1 -- 172.21.15.73:0/1857898497 wait complete. 2024-09-05T13:04:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.507+0000 7f2c0f93e740 20 client.16347 trim_cache size 0 max 16384 2024-09-05T13:04:36.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.540+0000 7f2c0f93e740 1 Processor -- start 2024-09-05T13:04:36.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c0f93e740 1 -- start start 2024-09-05T13:04:36.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36ba980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 0x5622f36baec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 0x5622f36e1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2c081d8670 con 0x5622f36bf4a0 2024-09-05T13:04:36.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c081d5f10 con 0x5622f36bfdc0 2024-09-05T13:04:36.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c081d3d60 con 0x5622f36ca680 2024-09-05T13:04:36.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c06ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36ba980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c077fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 0x5622f36e1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c077fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 0x5622f36e1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.73:59092/0 (socket says 172.21.15.73:59092) 2024-09-05T13:04:36.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c077fe640 1 -- 172.21.15.73:0/2534395878 learned_addr learned my addr 172.21.15.73:0/2534395878 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:36.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.541+0000 7f2c067fc640 1 --2- 172.21.15.73:0/2534395878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 0x5622f36baec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.542+0000 7f2c077fe640 1 -- 172.21.15.73:0/2534395878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 msgr2=0x5622f36baec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:36.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.542+0000 7f2c077fe640 1 --2- 172.21.15.73:0/2534395878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 0x5622f36baec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.542+0000 7f2c077fe640 1 -- 172.21.15.73:0/2534395878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 msgr2=0x5622f36ba980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:36.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.542+0000 7f2c077fe640 1 --2- 172.21.15.73:0/2534395878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36ba980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.542+0000 7f2c077fe640 1 -- 172.21.15.73:0/2534395878 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622f36dc7d0 con 0x5622f36ca680 2024-09-05T13:04:36.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.542+0000 7f2c077fe640 1 --2- 172.21.15.73:0/2534395878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 0x5622f36e1d30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000a380 tx=0x7f2c0000a4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8594c3f4bd4916bd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:36.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.542+0000 7f2becff9640 1 -- 172.21.15.73:0/2534395878 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00022020 con 0x5622f36ca680 2024-09-05T13:04:36.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.545+0000 7f2becff9640 1 -- 172.21.15.73:0/2534395878 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c0000d440 con 0x5622f36ca680 2024-09-05T13:04:36.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.545+0000 7f2becff9640 1 -- 172.21.15.73:0/2534395878 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0001ea80 con 0x5622f36ca680 2024-09-05T13:04:36.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.546+0000 7f2c0f93e740 1 -- 172.21.15.73:0/2534395878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 msgr2=0x5622f36e1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:36.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.546+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/2534395878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 0x5622f36e1d30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000a380 tx=0x7f2c0000a4b0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.548+0000 7f2c0f93e740 1 -- 172.21.15.73:0/2534395878 shutdown_connections 2024-09-05T13:04:36.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.548+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/2534395878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 0x5622f36e1d30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.548+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/2534395878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 0x5622f36baec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.548+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/2534395878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36ba980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.548+0000 7f2c0f93e740 1 -- 172.21.15.73:0/2534395878 >> 172.21.15.73:0/2534395878 conn(0x5622f36bba30 msgr2=0x5622f36ba270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:36.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.553+0000 7f2c0f93e740 1 -- 172.21.15.73:0/2534395878 shutdown_connections 2024-09-05T13:04:36.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.555+0000 7f2c0f93e740 1 -- 172.21.15.73:0/2534395878 wait complete. 2024-09-05T13:04:36.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.555+0000 7f2c0f93e740 1 -- start start 2024-09-05T13:04:36.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.556+0000 7f2c0f93e740 1 Processor -- start 2024-09-05T13:04:36.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.560+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.560+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 0x5622f36cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.560+0000 7f2c0f93e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 0x5622f3743d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.560+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2c081d43d0 con 0x5622f36bf4a0 2024-09-05T13:04:36.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.560+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c081d5840 con 0x5622f36bfdc0 2024-09-05T13:04:36.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.560+0000 7f2c0f93e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c081d4aa0 con 0x5622f36ca680 2024-09-05T13:04:36.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.560+0000 7f2c0f93e740 10 client.0 _ll_register_callbacks cb 0x7f2bfc005e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:36.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.560+0000 7f2c067fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 0x5622f36cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.561+0000 7f2c067fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 0x5622f36cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:53384/0 (socket says 172.21.15.73:53384) 2024-09-05T13:04:36.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.561+0000 7f2c067fc640 1 -- 172.21.15.73:0/943476550 learned_addr learned my addr 172.21.15.73:0/943476550 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:36.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.562+0000 7f2c06ffd640 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.562+0000 7f2c067fc640 1 -- 172.21.15.73:0/943476550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 msgr2=0x5622f3743d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T13:04:36.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.562+0000 7f2c067fc640 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 0x5622f3743d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.562+0000 7f2c067fc640 1 -- 172.21.15.73:0/943476550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 msgr2=0x5622f36ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:36.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.562+0000 7f2c067fc640 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.562+0000 7f2c067fc640 1 -- 172.21.15.73:0/943476550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622f3744240 con 0x5622f36bfdc0 2024-09-05T13:04:36.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.564+0000 7f2c067fc640 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 0x5622f36cee80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0cc720 tx=0x7f2bfc0d1100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc50d972cea88931 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:36.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.565+0000 7f2beaff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-05T13:04:36.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.566+0000 7f2beaff5640 1 -- 172.21.15.73:0/943476550 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc09f830 con 0x5622f36bfdc0 2024-09-05T13:04:36.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.566+0000 7f2c0f93e740 1 -- 172.21.15.73:0/943476550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5622f362cd60 con 0x5622f36bfdc0 2024-09-05T13:04:36.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.566+0000 7f2beaff5640 1 -- 172.21.15.73:0/943476550 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f2bfc099520 con 0x5622f36bfdc0 2024-09-05T13:04:36.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.567+0000 7f2beaff5640 1 -- 172.21.15.73:0/943476550 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f2bfc0a40f0 con 0x5622f36bfdc0 2024-09-05T13:04:36.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.568+0000 7f2c0f93e740 10 client.25829 fetch_fsmap learned FSMap version 47 2024-09-05T13:04:36.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.568+0000 7f2c0f93e740 1 -- 172.21.15.73:0/943476550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5622f3745430 con 0x5622f36bfdc0 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.572+0000 7f2beaff5640 1 -- 172.21.15.73:0/943476550 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5622f362cd60 con 0x5622f36bfdc0 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.572+0000 7f2beaff5640 1 -- 172.21.15.73:0/943476550 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f2bfc07b020 con 0x5622f36bfdc0 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.572+0000 7f2c0f93e740 10 client.25829 fetch_fsmap finished waiting for FSMap version 47 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.572+0000 7f2c0f93e740 10 client.25829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.572+0000 7f2c0f93e740 20 client.25829 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.572+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5622f3745b10 0x5622f3747f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.572+0000 7f2c0f93e740 4 client.25829 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.572+0000 7f2c0f93e740 1 -- 172.21.15.73:0/943476550 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5622f35a9210 con 0x5622f3745b10 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.573+0000 7f2c06ffd640 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5622f3745b10 0x5622f3747f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.574+0000 7f2c06ffd640 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5622f3745b10 0x5622f3747f30 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c4f9c24abead2dc server_cookie=ddf6338d258fc392 in_seq=0 out_seq=0 2024-09-05T13:04:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.574+0000 7f2beaff5640 10 client.25829 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:36.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.575+0000 7f2beaff5640 1 -- 172.21.15.73:0/943476550 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5622f35a9210 con 0x5622f3745b10 2024-09-05T13:04:36.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.575+0000 7f2beaff5640 10 client.25829 handle_command_reply: tid=0 2024-09-05T13:04:36.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.575+0000 7f2c0f93e740 1 client.25829 shutdown 2024-09-05T13:04:36.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.578+0000 7f2c0f93e740 1 -- 172.21.15.73:0/943476550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 msgr2=0x5622f36cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:36.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.578+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 0x5622f36cee80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0cc720 tx=0x7f2bfc0d1100 comp rx=0 tx=0).stop 2024-09-05T13:04:36.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.578+0000 7f2c0f93e740 1 -- 172.21.15.73:0/943476550 shutdown_connections 2024-09-05T13:04:36.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.578+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x5622f3745b10 0x5622f3747f30 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.578+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622f36ca680 0x5622f3743d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.578+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622f36bfdc0 0x5622f36cee80 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0cc720 tx=0x7f2bfc0d1100 comp rx=0 tx=0).stop 2024-09-05T13:04:36.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.578+0000 7f2c0f93e740 1 --2- 172.21.15.73:0/943476550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f36bf4a0 0x5622f36ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.578+0000 7f2beaff5640 0 client.25829 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:04:36.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.578+0000 7f2c0f93e740 1 -- 172.21.15.73:0/943476550 >> 172.21.15.73:0/943476550 conn(0x5622f36bba30 msgr2=0x5622f36c8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.583+0000 7f2c0f93e740 1 -- 172.21.15.73:0/943476550 shutdown_connections 2024-09-05T13:04:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.584+0000 7f2c0f93e740 1 -- 172.21.15.73:0/943476550 wait complete. 2024-09-05T13:04:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.584+0000 7f2c0f93e740 20 client.25829 trim_cache size 0 max 16384 2024-09-05T13:04:36.585 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:04:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2024-09-05T13:04:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2024-09-05T13:04:36.586 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:04:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.584+0000 7f2c0d568640 1 -- 172.21.15.73:0/1274700860 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2bf00a2c40 msgr2=0x7f2bf00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.584+0000 7f2c0d568640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2bf00a2c40 0x7f2bf00a5100 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8000c00 tx=0x7f2bf800d590 comp rx=0 tx=0).stop 2024-09-05T13:04:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.584+0000 7f2c0d568640 1 -- 172.21.15.73:0/1274700860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c08109450 msgr2=0x7f2c08076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.584+0000 7f2c0d568640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c08109450 0x7f2c08076190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00e730 tx=0x7f2bfc00ebf0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.585+0000 7f2c0d568640 1 -- 172.21.15.73:0/1274700860 shutdown_connections 2024-09-05T13:04:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.585+0000 7f2c0d568640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f2bf00a2c40 0x7f2bf00a5100 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.585+0000 7f2c0d568640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c08109e00 0x7f2c080766d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.585+0000 7f2c0d568640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c08109450 0x7f2c08076190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.585+0000 7f2c0d568640 1 --2- 172.21.15.73:0/1274700860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c08074920 0x7f2c0807b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.585+0000 7f2c0d568640 1 -- 172.21.15.73:0/1274700860 >> 172.21.15.73:0/1274700860 conn(0x7f2c0806e140 msgr2=0x7f2c08070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.588+0000 7f2c0d568640 1 -- 172.21.15.73:0/1274700860 shutdown_connections 2024-09-05T13:04:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:36.588+0000 7f2c0d568640 1 -- 172.21.15.73:0/1274700860 wait complete. 2024-09-05T13:04:36.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:36 smithi162 ceph-mon[34220]: pgmap v538: 97 pgs: 97 active+clean; 5.3 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 354 KiB/s wr, 262 op/s 2024-09-05T13:04:36.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:36 smithi169 ceph-mon[34823]: pgmap v538: 97 pgs: 97 active+clean; 5.3 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 354 KiB/s wr, 262 op/s 2024-09-05T13:04:38.546 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T13:04:38.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T13:04:38.922 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:04:39.354 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:39 smithi073 ceph-mon[30883]: pgmap v539: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 304 KiB/s wr, 262 op/s 2024-09-05T13:04:39.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.454+0000 7ffb83259640 1 -- 172.21.15.73:0/902928461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c106f20 msgr2=0x7ffb7c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:39.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.454+0000 7ffb83259640 1 --2- 172.21.15.73:0/902928461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c106f20 0x7ffb7c10eaa0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009ca0 tx=0x7ffb7402a8c0 comp rx=0 tx=0).stop 2024-09-05T13:04:39.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.455+0000 7ffb83259640 1 -- 172.21.15.73:0/902928461 shutdown_connections 2024-09-05T13:04:39.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.455+0000 7ffb83259640 1 --2- 172.21.15.73:0/902928461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c106f20 0x7ffb7c10eaa0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:39.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.455+0000 7ffb83259640 1 --2- 172.21.15.73:0/902928461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb7c1027a0 0x7ffb7c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:39.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.455+0000 7ffb83259640 1 --2- 172.21.15.73:0/902928461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb7c101df0 0x7ffb7c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:39.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.455+0000 7ffb83259640 1 -- 172.21.15.73:0/902928461 >> 172.21.15.73:0/902928461 conn(0x7ffb7c0fd8b0 msgr2=0x7ffb7c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:39.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.459+0000 7ffb83259640 1 -- 172.21.15.73:0/902928461 shutdown_connections 2024-09-05T13:04:39.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.462+0000 7ffb83259640 1 -- 172.21.15.73:0/902928461 wait complete. 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.462+0000 7ffb83259640 1 Processor -- start 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb83259640 1 -- start start 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb83259640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb7c101df0 0x7ffb7c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb83259640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c1027a0 0x7ffb7c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb83259640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb7c106f20 0x7ffb7c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb83259640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c111f80 con 0x7ffb7c1027a0 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb83259640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c111e00 con 0x7ffb7c106f20 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb83259640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c112100 con 0x7ffb7c101df0 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb80ff5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb7c101df0 0x7ffb7c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb817f6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb7c106f20 0x7ffb7c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb817f6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb7c106f20 0x7ffb7c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:53400/0 (socket says 172.21.15.73:53400) 2024-09-05T13:04:39.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.463+0000 7ffb817f6640 1 -- 172.21.15.73:0/2489660611 learned_addr learned my addr 172.21.15.73:0/2489660611 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.464+0000 7ffb7bfff640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c1027a0 0x7ffb7c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.464+0000 7ffb817f6640 1 -- 172.21.15.73:0/2489660611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb7c101df0 msgr2=0x7ffb7c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.464+0000 7ffb817f6640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb7c101df0 0x7ffb7c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.464+0000 7ffb817f6640 1 -- 172.21.15.73:0/2489660611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c1027a0 msgr2=0x7ffb7c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.464+0000 7ffb817f6640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c1027a0 0x7ffb7c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.464+0000 7ffb817f6640 1 -- 172.21.15.73:0/2489660611 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c19d3d0 con 0x7ffb7c106f20 2024-09-05T13:04:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.464+0000 7ffb817f6640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb7c106f20 0x7ffb7c19ccf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb74031a20 tx=0x7ffb74031a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.464+0000 7ffb80ff5640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb7c101df0 0x7ffb7c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:04:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.465+0000 7ffb79ffb640 1 -- 172.21.15.73:0/2489660611 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74003c30 con 0x7ffb7c106f20 2024-09-05T13:04:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.465+0000 7ffb79ffb640 1 -- 172.21.15.73:0/2489660611 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb74003dd0 con 0x7ffb7c106f20 2024-09-05T13:04:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.465+0000 7ffb83259640 1 -- 172.21.15.73:0/2489660611 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c19d660 con 0x7ffb7c106f20 2024-09-05T13:04:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.467+0000 7ffb79ffb640 1 -- 172.21.15.73:0/2489660611 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7402fc50 con 0x7ffb7c106f20 2024-09-05T13:04:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.467+0000 7ffb83259640 1 -- 172.21.15.73:0/2489660611 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c19dae0 con 0x7ffb7c106f20 2024-09-05T13:04:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.468+0000 7ffb83259640 1 -- 172.21.15.73:0/2489660611 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7c1032d0 con 0x7ffb7c106f20 2024-09-05T13:04:39.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.468+0000 7ffb79ffb640 1 -- 172.21.15.73:0/2489660611 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffb74004050 con 0x7ffb7c106f20 2024-09-05T13:04:39.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.469+0000 7ffb79ffb640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb6c0a2ba0 0x7ffb6c0a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:39.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.469+0000 7ffb79ffb640 1 -- 172.21.15.73:0/2489660611 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7ffb740f0060 con 0x7ffb7c106f20 2024-09-05T13:04:39.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.469+0000 7ffb80ff5640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb6c0a2ba0 0x7ffb6c0a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:39.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.470+0000 7ffb80ff5640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb6c0a2ba0 0x7ffb6c0a5060 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009fc0 tx=0x7ffb70005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:39.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.474+0000 7ffb79ffb640 1 -- 172.21.15.73:0/2489660611 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb740bd020 con 0x7ffb7c106f20 2024-09-05T13:04:39.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:39 smithi162 ceph-mon[34220]: pgmap v539: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 304 KiB/s wr, 262 op/s 2024-09-05T13:04:39.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:39 smithi169 ceph-mon[34823]: pgmap v539: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 304 KiB/s wr, 262 op/s 2024-09-05T13:04:39.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.846+0000 7ffb83259640 1 -- 172.21.15.73:0/2489660611 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb7c1997b0 con 0x7ffb7c106f20 2024-09-05T13:04:39.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.847+0000 7ffb79ffb640 1 -- 172.21.15.73:0/2489660611 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+11928 (secure 0 0 0) 0x7ffb7c1997b0 con 0x7ffb7c106f20 2024-09-05T13:04:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T13:04:39.849 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":47,"btime":"2024-09-05T13:04:33:189626+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T13:04:32.212887+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25924":{"gid":25924,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2445546350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2445546350},{"type":"v1","addr":"172.21.15.169:6837","nonce":2445546350}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T13:04:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 47 2024-09-05T13:04:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.850+0000 7ffb83259640 1 -- 172.21.15.73:0/2489660611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb6c0a2ba0 msgr2=0x7ffb6c0a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.850+0000 7ffb83259640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb6c0a2ba0 0x7ffb6c0a5060 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009fc0 tx=0x7ffb70005f90 comp rx=0 tx=0).stop 2024-09-05T13:04:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.850+0000 7ffb83259640 1 -- 172.21.15.73:0/2489660611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb7c106f20 msgr2=0x7ffb7c19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.850+0000 7ffb83259640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb7c106f20 0x7ffb7c19ccf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb74031a20 tx=0x7ffb74031a50 comp rx=0 tx=0).stop 2024-09-05T13:04:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.850+0000 7ffb83259640 1 -- 172.21.15.73:0/2489660611 shutdown_connections 2024-09-05T13:04:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.850+0000 7ffb83259640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7ffb6c0a2ba0 0x7ffb6c0a5060 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:39.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.850+0000 7ffb83259640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb7c106f20 0x7ffb7c19ccf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:39.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.850+0000 7ffb83259640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c1027a0 0x7ffb7c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:39.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.850+0000 7ffb83259640 1 --2- 172.21.15.73:0/2489660611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb7c101df0 0x7ffb7c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:39.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.850+0000 7ffb83259640 1 -- 172.21.15.73:0/2489660611 >> 172.21.15.73:0/2489660611 conn(0x7ffb7c0fd8b0 msgr2=0x7ffb7c0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:39.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.851+0000 7ffb83259640 1 -- 172.21.15.73:0/2489660611 shutdown_connections 2024-09-05T13:04:39.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:39.851+0000 7ffb83259640 1 -- 172.21.15.73:0/2489660611 wait complete. 2024-09-05T13:04:40.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:40 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2489660611' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:04:40.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:40 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2489660611' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:04:40.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:40 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2489660611' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:04:40.768 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T13:04:41.018 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:04:41.398 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:41 smithi073 ceph-mon[30883]: pgmap v540: 97 pgs: 97 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 230 KiB/s wr, 280 op/s 2024-09-05T13:04:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.477+0000 7fae1ca70640 1 -- 172.21.15.73:0/1505756875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae18100a80 msgr2=0x7fae18100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.477+0000 7fae1ca70640 1 --2- 172.21.15.73:0/1505756875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae18100a80 0x7fae18100ee0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009930 tx=0x7fae0c02a420 comp rx=0 tx=0).stop 2024-09-05T13:04:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.477+0000 7fae1ca70640 1 -- 172.21.15.73:0/1505756875 shutdown_connections 2024-09-05T13:04:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.477+0000 7fae1ca70640 1 --2- 172.21.15.73:0/1505756875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101420 0x7fae1810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.477+0000 7fae1ca70640 1 --2- 172.21.15.73:0/1505756875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae18100a80 0x7fae18100ee0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.477+0000 7fae1ca70640 1 --2- 172.21.15.73:0/1505756875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18106a80 0x7fae18106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.477+0000 7fae1ca70640 1 -- 172.21.15.73:0/1505756875 >> 172.21.15.73:0/1505756875 conn(0x7fae180fc7a0 msgr2=0x7fae180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.477+0000 7fae1ca70640 1 -- 172.21.15.73:0/1505756875 shutdown_connections 2024-09-05T13:04:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.477+0000 7fae1ca70640 1 -- 172.21.15.73:0/1505756875 wait complete. 2024-09-05T13:04:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1ca70640 1 Processor -- start 2024-09-05T13:04:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1ca70640 1 -- start start 2024-09-05T13:04:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1ca70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae18100a80 0x7fae18198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1ca70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101420 0x7fae181989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1ca70640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18106a80 0x7fae1819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1ca70640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae18111fa0 con 0x7fae18100a80 2024-09-05T13:04:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1ca70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae18111e20 con 0x7fae18101420 2024-09-05T13:04:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1ca70640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae18112120 con 0x7fae18106a80 2024-09-05T13:04:41.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae18100a80 0x7fae18198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae18100a80 0x7fae18198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33700/0 (socket says 172.21.15.73:33700) 2024-09-05T13:04:41.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.478+0000 7fae1659c640 1 -- 172.21.15.73:0/842939136 learned_addr learned my addr 172.21.15.73:0/842939136 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:41.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae15d9b640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101420 0x7fae181989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae16d9d640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18106a80 0x7fae1819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae1659c640 1 -- 172.21.15.73:0/842939136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18106a80 msgr2=0x7fae1819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae1659c640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18106a80 0x7fae1819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae1659c640 1 -- 172.21.15.73:0/842939136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101420 msgr2=0x7fae181989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae1659c640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101420 0x7fae181989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae1659c640 1 -- 172.21.15.73:0/842939136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1819d410 con 0x7fae18100a80 2024-09-05T13:04:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae16d9d640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18106a80 0x7fae1819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:04:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae1659c640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae18100a80 0x7fae18198460 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fae0800d770 tx=0x7fae0800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae077fe640 1 -- 172.21.15.73:0/842939136 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08017070 con 0x7fae18100a80 2024-09-05T13:04:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae077fe640 1 -- 172.21.15.73:0/842939136 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae08005500 con 0x7fae18100a80 2024-09-05T13:04:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae1ca70640 1 -- 172.21.15.73:0/842939136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1819d700 con 0x7fae18100a80 2024-09-05T13:04:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae077fe640 1 -- 172.21.15.73:0/842939136 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08004e00 con 0x7fae18100a80 2024-09-05T13:04:41.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.479+0000 7fae1ca70640 1 -- 172.21.15.73:0/842939136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae181a4fe0 con 0x7fae18100a80 2024-09-05T13:04:41.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.481+0000 7fae077fe640 1 -- 172.21.15.73:0/842939136 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fae08004fa0 con 0x7fae18100a80 2024-09-05T13:04:41.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae1ee46740 1 Processor -- start 2024-09-05T13:04:41.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae1ee46740 1 -- start start 2024-09-05T13:04:41.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae077fe640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2b80 0x7fae000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f978064b80 0x55f978063090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9780635d0 0x55f978063a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae1ee46740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f977fc92f0 con 0x55f97806e370 2024-09-05T13:04:41.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae1ee46740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f977f70cf0 con 0x55f978064b80 2024-09-05T13:04:41.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae1ee46740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f977fc52b0 con 0x55f9780635d0 2024-09-05T13:04:41.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae077fe640 1 -- 172.21.15.73:0/842939136 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fae080cea90 con 0x7fae18100a80 2024-09-05T13:04:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae16d9d640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2b80 0x7fae000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae16d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae16d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978070760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33712/0 (socket says 172.21.15.73:33712) 2024-09-05T13:04:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae16d9d640 1 -- 172.21.15.73:0/1711787348 learned_addr learned my addr 172.21.15.73:0/1711787348 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae1659c640 1 --2- 172.21.15.73:0/1711787348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f978064b80 0x55f978063090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.482+0000 7fae15d9b640 1 --2- 172.21.15.73:0/1711787348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9780635d0 0x55f978063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.483+0000 7fae16d9d640 1 -- 172.21.15.73:0/1711787348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9780635d0 msgr2=0x55f978063a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.483+0000 7fae16d9d640 1 --2- 172.21.15.73:0/1711787348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9780635d0 0x55f978063a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.483+0000 7fae16d9d640 1 -- 172.21.15.73:0/1711787348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f978064b80 msgr2=0x55f978063090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.483+0000 7fae16d9d640 1 --2- 172.21.15.73:0/1711787348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f978064b80 0x55f978063090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.483+0000 7fae16d9d640 1 -- 172.21.15.73:0/1711787348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f977f553a0 con 0x55f97806e370 2024-09-05T13:04:41.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.483+0000 7fae16d9d640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2b80 0x7fae000a5040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fae1000afd0 tx=0x7fae1000adc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:41.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.483+0000 7fae16d9d640 1 --2- 172.21.15.73:0/1711787348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978070760 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fae10012fd0 tx=0x7fae10019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3419d984c9c8a830 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:41.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.483+0000 7fae04ff9640 1 -- 172.21.15.73:0/1711787348 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10022070 con 0x55f97806e370 2024-09-05T13:04:41.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.483+0000 7fae04ff9640 1 -- 172.21.15.73:0/1711787348 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1000dde0 con 0x55f97806e370 2024-09-05T13:04:41.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.483+0000 7fae04ff9640 1 -- 172.21.15.73:0/1711787348 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae100105d0 con 0x55f97806e370 2024-09-05T13:04:41.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 -- 172.21.15.73:0/1711787348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 msgr2=0x55f978070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:41.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 --2- 172.21.15.73:0/1711787348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978070760 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fae10012fd0 tx=0x7fae10019000 comp rx=0 tx=0).stop 2024-09-05T13:04:41.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 -- 172.21.15.73:0/1711787348 shutdown_connections 2024-09-05T13:04:41.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 --2- 172.21.15.73:0/1711787348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978070760 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 --2- 172.21.15.73:0/1711787348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9780635d0 0x55f978063a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 --2- 172.21.15.73:0/1711787348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f978064b80 0x55f978063090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 -- 172.21.15.73:0/1711787348 >> 172.21.15.73:0/1711787348 conn(0x55f97802c310 msgr2=0x55f97805fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:41.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 -- 172.21.15.73:0/1711787348 shutdown_connections 2024-09-05T13:04:41.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 -- 172.21.15.73:0/1711787348 wait complete. 2024-09-05T13:04:41.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 -- start start 2024-09-05T13:04:41.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.484+0000 7fae1ee46740 1 Processor -- start 2024-09-05T13:04:41.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 0x55f97806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f97806afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 0x55f97806b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae1ee46740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f978071070 con 0x55f978064b80 2024-09-05T13:04:41.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae1ee46740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f977f84060 con 0x55f9780635d0 2024-09-05T13:04:41.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae1ee46740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f9780711f0 con 0x55f97806e370 2024-09-05T13:04:41.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae1ee46740 10 client.0 _ll_register_callbacks cb 0x55f977cd78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:41.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae15d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f97806afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae15d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f97806afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33724/0 (socket says 172.21.15.73:33724) 2024-09-05T13:04:41.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae15d9b640 1 -- 172.21.15.73:0/2322051602 learned_addr learned my addr 172.21.15.73:0/2322051602 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:41.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae1659c640 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 0x55f97806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae16d9d640 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 0x55f97806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae15d9b640 1 -- 172.21.15.73:0/2322051602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 msgr2=0x55f97806b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae15d9b640 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 0x55f97806b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae15d9b640 1 -- 172.21.15.73:0/2322051602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 msgr2=0x55f97806dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae15d9b640 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 0x55f97806dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae15d9b640 1 -- 172.21.15.73:0/2322051602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f977d3a3c0 con 0x55f978064b80 2024-09-05T13:04:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae15d9b640 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f97806afb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009930 tx=0x7fae0c0319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f97d31c72ec5673 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fadfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:04:41.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fadfdffb640 1 -- 172.21.15.73:0/2322051602 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c035040 con 0x55f978064b80 2024-09-05T13:04:41.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fadfdffb640 1 -- 172.21.15.73:0/2322051602 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fae0c004240 con 0x55f978064b80 2024-09-05T13:04:41.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.485+0000 7fae1ee46740 1 -- 172.21.15.73:0/2322051602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae1000dde0 con 0x55f978064b80 2024-09-05T13:04:41.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fadfdffb640 1 -- 172.21.15.73:0/2322051602 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fae0c04c070 con 0x55f978064b80 2024-09-05T13:04:41.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fae1ee46740 10 client.16368 fetch_fsmap learned FSMap version 47 2024-09-05T13:04:41.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fae1ee46740 1 -- 172.21.15.73:0/2322051602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55f97807caf0 con 0x55f978064b80 2024-09-05T13:04:41.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fadfdffb640 1 -- 172.21.15.73:0/2322051602 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1000dde0 con 0x55f978064b80 2024-09-05T13:04:41.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fadfdffb640 1 -- 172.21.15.73:0/2322051602 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7fae0c0049c0 con 0x55f978064b80 2024-09-05T13:04:41.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fae1ee46740 10 client.16368 fetch_fsmap finished waiting for FSMap version 47 2024-09-05T13:04:41.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fae1ee46740 10 client.16368 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T13:04:41.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fae1ee46740 20 client.16368 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:41.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55f97807e050 0x55f978080440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fae1ee46740 4 client.16368 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:04:41.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fae1ee46740 1 -- 172.21.15.73:0/2322051602 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f977fd6860 con 0x55f97807e050 2024-09-05T13:04:41.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.486+0000 7fae1659c640 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55f97807e050 0x55f978080440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.487+0000 7fadfdffb640 10 client.16368 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T13:04:41.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.487+0000 7fae1659c640 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55f97807e050 0x55f978080440 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9433f187eb9ecce0 server_cookie=81ffe0de040aeb10 in_seq=0 out_seq=0 2024-09-05T13:04:41.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.487+0000 7fadfdffb640 1 -- 172.21.15.73:0/2322051602 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f977fd6860 con 0x55f97807e050 2024-09-05T13:04:41.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.487+0000 7fadfdffb640 10 client.16368 handle_command_reply: tid=0 2024-09-05T13:04:41.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.487+0000 7fae1ee46740 1 client.16368 shutdown 2024-09-05T13:04:41.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 1 -- 172.21.15.73:0/2322051602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 msgr2=0x55f97806afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:41.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f97806afb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009930 tx=0x7fae0c0319b0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 1 -- 172.21.15.73:0/2322051602 shutdown_connections 2024-09-05T13:04:41.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55f97807e050 0x55f978080440 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 0x55f97806b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f97806afb0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2322051602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 0x55f97806dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 1 -- 172.21.15.73:0/2322051602 >> 172.21.15.73:0/2322051602 conn(0x55f97802c310 msgr2=0x55f9780659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:41.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fadfdffb640 0 client.16368 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T13:04:41.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 1 -- 172.21.15.73:0/2322051602 shutdown_connections 2024-09-05T13:04:41.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 1 -- 172.21.15.73:0/2322051602 wait complete. 2024-09-05T13:04:41.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.488+0000 7fae1ee46740 20 client.16368 trim_cache size 0 max 16384 2024-09-05T13:04:41.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.500+0000 7fae1ee46740 1 Processor -- start 2024-09-05T13:04:41.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae1ee46740 1 -- start start 2024-09-05T13:04:41.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9780635d0 0x55f97805ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f978064b80 0x55f97805f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978066160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae1ee46740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae181afd70 con 0x55f97806e370 2024-09-05T13:04:41.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae1ee46740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae181ad610 con 0x55f978064b80 2024-09-05T13:04:41.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae1ee46740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae181ab460 con 0x55f9780635d0 2024-09-05T13:04:41.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae16d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978066160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae16d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978066160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33732/0 (socket says 172.21.15.73:33732) 2024-09-05T13:04:41.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae16d9d640 1 -- 172.21.15.73:0/3373792413 learned_addr learned my addr 172.21.15.73:0/3373792413 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:41.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae1659c640 1 --2- 172.21.15.73:0/3373792413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9780635d0 0x55f97805ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae16d9d640 1 -- 172.21.15.73:0/3373792413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9780635d0 msgr2=0x55f97805ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:41.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae16d9d640 1 --2- 172.21.15.73:0/3373792413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9780635d0 0x55f97805ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae16d9d640 1 -- 172.21.15.73:0/3373792413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f978064b80 msgr2=0x55f97805f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:41.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae16d9d640 1 --2- 172.21.15.73:0/3373792413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f978064b80 0x55f97805f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae16d9d640 1 -- 172.21.15.73:0/3373792413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9780643d0 con 0x55f97806e370 2024-09-05T13:04:41.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fae16d9d640 1 --2- 172.21.15.73:0/3373792413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978066160 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55f978060d50 tx=0x7fae1001ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4349e285c24716b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:41.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fadfffff640 1 -- 172.21.15.73:0/3373792413 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10037070 con 0x55f97806e370 2024-09-05T13:04:41.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fadfffff640 1 -- 172.21.15.73:0/3373792413 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1000ddb0 con 0x55f97806e370 2024-09-05T13:04:41.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.501+0000 7fadfffff640 1 -- 172.21.15.73:0/3373792413 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10022040 con 0x55f97806e370 2024-09-05T13:04:41.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 -- 172.21.15.73:0/3373792413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 msgr2=0x55f978066160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:41.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 --2- 172.21.15.73:0/3373792413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978066160 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55f978060d50 tx=0x7fae1001ed60 comp rx=0 tx=0).stop 2024-09-05T13:04:41.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 -- 172.21.15.73:0/3373792413 shutdown_connections 2024-09-05T13:04:41.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 --2- 172.21.15.73:0/3373792413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f97806e370 0x55f978066160 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 --2- 172.21.15.73:0/3373792413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f978064b80 0x55f97805f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 --2- 172.21.15.73:0/3373792413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9780635d0 0x55f97805ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 -- 172.21.15.73:0/3373792413 >> 172.21.15.73:0/3373792413 conn(0x55f97802c310 msgr2=0x55f97805e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:41.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 -- 172.21.15.73:0/3373792413 shutdown_connections 2024-09-05T13:04:41.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 -- 172.21.15.73:0/3373792413 wait complete. 2024-09-05T13:04:41.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 -- start start 2024-09-05T13:04:41.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.502+0000 7fae1ee46740 1 Processor -- start 2024-09-05T13:04:41.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 0x55f978072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f978072780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1ee46740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 0x55f978072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1ee46740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae181abad0 con 0x55f978064b80 2024-09-05T13:04:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1ee46740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae181acf40 con 0x55f9780635d0 2024-09-05T13:04:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1ee46740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae181ac1a0 con 0x55f97806e370 2024-09-05T13:04:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1ee46740 10 client.0 _ll_register_callbacks cb 0x7fae0c0314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae15d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f978072780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae15d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f978072780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33740/0 (socket says 172.21.15.73:33740) 2024-09-05T13:04:41.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae15d9b640 1 -- 172.21.15.73:0/2098537440 learned_addr learned my addr 172.21.15.73:0/2098537440 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:41.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1659c640 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 0x55f978072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae16d9d640 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 0x55f978072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae15d9b640 1 -- 172.21.15.73:0/2098537440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 msgr2=0x55f978072cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:41.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae15d9b640 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 0x55f978072cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae15d9b640 1 -- 172.21.15.73:0/2098537440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 msgr2=0x55f978072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae15d9b640 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 0x55f978072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae15d9b640 1 -- 172.21.15.73:0/2098537440 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9780e7cd0 con 0x55f978064b80 2024-09-05T13:04:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae16d9d640 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 0x55f978072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:04:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1659c640 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 0x55f978072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:04:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae15d9b640 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f978072780 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fae0c005ec0 tx=0x7fae0c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678e863edde67c08 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fadfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:04:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fadfdffb640 1 -- 172.21.15.73:0/2098537440 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c035070 con 0x55f978064b80 2024-09-05T13:04:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fadfdffb640 1 -- 172.21.15.73:0/2098537440 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fae0c0048d0 con 0x55f978064b80 2024-09-05T13:04:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1ee46740 1 -- 172.21.15.73:0/2098537440 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae1000ddb0 con 0x55f978064b80 2024-09-05T13:04:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fadfdffb640 1 -- 172.21.15.73:0/2098537440 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fae0c009520 con 0x55f978064b80 2024-09-05T13:04:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1ee46740 10 client.16374 fetch_fsmap learned FSMap version 47 2024-09-05T13:04:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.503+0000 7fae1ee46740 1 -- 172.21.15.73:0/2098537440 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55f9780e8f80 con 0x55f978064b80 2024-09-05T13:04:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.504+0000 7fadfdffb640 1 -- 172.21.15.73:0/2098537440 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1000ddb0 con 0x55f978064b80 2024-09-05T13:04:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.504+0000 7fadfdffb640 1 -- 172.21.15.73:0/2098537440 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7fae0c005240 con 0x55f978064b80 2024-09-05T13:04:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.504+0000 7fae1ee46740 10 client.16374 fetch_fsmap finished waiting for FSMap version 47 2024-09-05T13:04:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.504+0000 7fae1ee46740 10 client.16374 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T13:04:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.504+0000 7fae1ee46740 20 client.16374 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.504+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55f9780e96d0 0x55f9780ebaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.504+0000 7fae1ee46740 4 client.16374 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:04:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.504+0000 7fae1ee46740 1 -- 172.21.15.73:0/2098537440 --> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f977fd0d70 con 0x55f9780e96d0 2024-09-05T13:04:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.504+0000 7fae1659c640 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55f9780e96d0 0x55f9780ebaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fadfdffb640 10 client.16374 ms_handle_connect on v2:172.21.15.162:6836/3027533309 2024-09-05T13:04:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1659c640 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55f9780e96d0 0x55f9780ebaf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fcb409fd2d2b7120 server_cookie=106a152e87813d6e in_seq=0 out_seq=0 2024-09-05T13:04:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fadfdffb640 1 -- 172.21.15.73:0/2098537440 <== mds.2 v2:172.21.15.162:6836/3027533309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f977fd0d70 con 0x55f9780e96d0 2024-09-05T13:04:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fadfdffb640 10 client.16374 handle_command_reply: tid=0 2024-09-05T13:04:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 client.16374 shutdown 2024-09-05T13:04:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 -- 172.21.15.73:0/2098537440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 msgr2=0x55f978072780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:41.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f978072780 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fae0c005ec0 tx=0x7fae0c0038a0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 -- 172.21.15.73:0/2098537440 shutdown_connections 2024-09-05T13:04:41.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.162:6836/3027533309,v1:172.21.15.162:6837/3027533309] conn(0x55f9780e96d0 0x55f9780ebaf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97806e370 0x55f978072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fadfdffb640 0 client.16374 ms_handle_reset on v2:172.21.15.162:6836/3027533309 2024-09-05T13:04:41.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f978064b80 0x55f978072780 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 --2- 172.21.15.73:0/2098537440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9780635d0 0x55f978072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 -- 172.21.15.73:0/2098537440 >> 172.21.15.73:0/2098537440 conn(0x55f97802c310 msgr2=0x55f97805ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:41.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 -- 172.21.15.73:0/2098537440 shutdown_connections 2024-09-05T13:04:41.554 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:04:41.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 1 -- 172.21.15.73:0/2098537440 wait complete. 2024-09-05T13:04:41.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.505+0000 7fae1ee46740 20 client.16374 trim_cache size 0 max 16384 2024-09-05T13:04:41.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 -- 172.21.15.73:0/842939136 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2b80 msgr2=0x7fae000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:41.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2b80 0x7fae000a5040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fae1000afd0 tx=0x7fae1000adc0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 -- 172.21.15.73:0/842939136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae18100a80 msgr2=0x7fae18198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:41.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae18100a80 0x7fae18198460 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fae0800d770 tx=0x7fae0800dc30 comp rx=0 tx=0).stop 2024-09-05T13:04:41.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 -- 172.21.15.73:0/842939136 shutdown_connections 2024-09-05T13:04:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fae000a2b80 0x7fae000a5040 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae18106a80 0x7fae1819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101420 0x7fae181989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 --2- 172.21.15.73:0/842939136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae18100a80 0x7fae18198460 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 -- 172.21.15.73:0/842939136 >> 172.21.15.73:0/842939136 conn(0x7fae180fc7a0 msgr2=0x7fae180fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 -- 172.21.15.73:0/842939136 shutdown_connections 2024-09-05T13:04:41.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:41.506+0000 7fae1ca70640 1 -- 172.21.15.73:0/842939136 wait complete. 2024-09-05T13:04:41.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:41 smithi162 ceph-mon[34220]: pgmap v540: 97 pgs: 97 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 230 KiB/s wr, 280 op/s 2024-09-05T13:04:41.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:41 smithi169 ceph-mon[34823]: pgmap v540: 97 pgs: 97 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 230 KiB/s wr, 280 op/s 2024-09-05T13:04:42.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T13:04:42.461 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:04:43.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:43 smithi073 ceph-mon[30883]: pgmap v541: 97 pgs: 97 active+clean; 674 MiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 182 KiB/s wr, 302 op/s 2024-09-05T13:04:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:43 smithi162 ceph-mon[34220]: pgmap v541: 97 pgs: 97 active+clean; 674 MiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 182 KiB/s wr, 302 op/s 2024-09-05T13:04:43.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:43 smithi169 ceph-mon[34823]: pgmap v541: 97 pgs: 97 active+clean; 674 MiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 182 KiB/s wr, 302 op/s 2024-09-05T13:04:45.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:45 smithi073 ceph-mon[30883]: pgmap v542: 97 pgs: 97 active+clean; 130 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 46 KiB/s wr, 265 op/s 2024-09-05T13:04:45.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:45 smithi162 ceph-mon[34220]: pgmap v542: 97 pgs: 97 active+clean; 130 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 46 KiB/s wr, 265 op/s 2024-09-05T13:04:45.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:45 smithi169 ceph-mon[34823]: pgmap v542: 97 pgs: 97 active+clean; 130 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 46 KiB/s wr, 265 op/s 2024-09-05T13:04:46.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:46 smithi073 ceph-mon[30883]: pgmap v543: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 25 KiB/s wr, 225 op/s 2024-09-05T13:04:46.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:46 smithi162 ceph-mon[34220]: pgmap v543: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 25 KiB/s wr, 225 op/s 2024-09-05T13:04:46.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:46 smithi169 ceph-mon[34823]: pgmap v543: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 25 KiB/s wr, 225 op/s 2024-09-05T13:04:46.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.511+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/2880609011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ff81082a0 msgr2=0x7f6ff810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:46.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.511+0000 7f6ffcf2f640 1 --2- 172.21.15.73:0/2880609011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ff81082a0 0x7f6ff810ec40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009cd0 tx=0x7f6ff002a8e0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.511+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/2880609011 shutdown_connections 2024-09-05T13:04:46.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.511+0000 7f6ffcf2f640 1 --2- 172.21.15.73:0/2880609011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ff81082a0 0x7f6ff810ec40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.511+0000 7f6ffcf2f640 1 --2- 172.21.15.73:0/2880609011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ff81036e0 0x7f6ff8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.511+0000 7f6ffcf2f640 1 --2- 172.21.15.73:0/2880609011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ff8102d30 0x7f6ff8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.511+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/2880609011 >> 172.21.15.73:0/2880609011 conn(0x7f6ff80fc7d0 msgr2=0x7f6ff80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.511+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/2880609011 shutdown_connections 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.511+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/2880609011 wait complete. 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.512+0000 7f6ffcf2f640 1 Processor -- start 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.512+0000 7f6ffcf2f640 1 -- start start 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.512+0000 7f6ffcf2f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ff8102d30 0x7f6ff8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ffcf2f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ff81036e0 0x7f6ff8198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ffcf2f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ff81082a0 0x7f6ff819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ffcf2f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81120a0 con 0x7f6ff81082a0 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ffcf2f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff8111f20 con 0x7f6ff8102d30 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ffcf2f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff8112220 con 0x7f6ff81036e0 2024-09-05T13:04:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ff81082a0 0x7f6ff819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ff81082a0 0x7f6ff819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44522/0 (socket says 172.21.15.73:44522) 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff6d9d640 1 -- 172.21.15.73:0/1685529560 learned_addr learned my addr 172.21.15.73:0/1685529560 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff659c640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ff8102d30 0x7f6ff8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ff81036e0 0x7f6ff8198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff6d9d640 1 -- 172.21.15.73:0/1685529560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ff81036e0 msgr2=0x7f6ff8198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ff81036e0 0x7f6ff8198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff6d9d640 1 -- 172.21.15.73:0/1685529560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ff8102d30 msgr2=0x7f6ff8198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ff8102d30 0x7f6ff8198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff6d9d640 1 -- 172.21.15.73:0/1685529560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff819d520 con 0x7f6ff81082a0 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ff81082a0 0x7f6ff819ce40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0005cc0 tx=0x7f6ff0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6fe77fe640 1 -- 172.21.15.73:0/1685529560 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0004040 con 0x7f6ff81082a0 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.513+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/1685529560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff819d7b0 con 0x7f6ff81082a0 2024-09-05T13:04:46.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.514+0000 7f6fe77fe640 1 -- 172.21.15.73:0/1685529560 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff00046c0 con 0x7f6ff81082a0 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.514+0000 7f6fe77fe640 1 -- 172.21.15.73:0/1685529560 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0046480 con 0x7f6ff81082a0 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.514+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/1685529560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff81a50f0 con 0x7f6ff81082a0 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.516+0000 7f6fe77fe640 1 -- 172.21.15.73:0/1685529560 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6ff00305a0 con 0x7f6ff81082a0 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.516+0000 7f6fff305740 1 Processor -- start 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6fff305740 1 -- start start 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6fe77fe640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fe00a2b80 0x7f6fe00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6fff305740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6fff305740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f15d0 0x55bfcf5f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6fff305740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 0x55bfcf5fe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6fff305740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bfcf5572f0 con 0x55bfcf5f15d0 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6fff305740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bfcf4fecf0 con 0x55bfcf5f2b80 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6fff305740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bfcf5532b0 con 0x55bfcf5fc370 2024-09-05T13:04:46.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6fe77fe640 1 -- 172.21.15.73:0/1685529560 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f6ff002e030 con 0x7f6ff81082a0 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f15d0 0x55bfcf5f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f15d0 0x55bfcf5f1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44530/0 (socket says 172.21.15.73:44530) 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2963952997 learned_addr learned my addr 172.21.15.73:0/2963952997 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff659c640 1 --2- 172.21.15.73:0/2963952997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fe00a2b80 0x7f6fe00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/2963952997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 0x55bfcf5fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2963952997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 msgr2=0x55bfcf5fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/2963952997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 0x55bfcf5fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2963952997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f2b80 msgr2=0x55bfcf5f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/2963952997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2963952997 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfcf4e33a0 con 0x55bfcf5f15d0 2024-09-05T13:04:46.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.517+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/2963952997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f15d0 0x55bfcf5f1a30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0129b0 tx=0x7f6fec012e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a31762f21c83dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fe00a2b80 0x7f6fe00a5040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0058a0 tx=0x7f6fec017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6fe4ff9640 1 -- 172.21.15.73:0/2963952997 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec012510 con 0x55bfcf5f15d0 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6fe4ff9640 1 -- 172.21.15.73:0/2963952997 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fec00b950 con 0x55bfcf5f15d0 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6fe4ff9640 1 -- 172.21.15.73:0/2963952997 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0035f0 con 0x55bfcf5f15d0 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6fff305740 1 -- 172.21.15.73:0/2963952997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f15d0 msgr2=0x55bfcf5f1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6fff305740 1 --2- 172.21.15.73:0/2963952997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f15d0 0x55bfcf5f1a30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0129b0 tx=0x7f6fec012e70 comp rx=0 tx=0).stop 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6fff305740 1 -- 172.21.15.73:0/2963952997 shutdown_connections 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6fff305740 1 --2- 172.21.15.73:0/2963952997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 0x55bfcf5fe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6fff305740 1 --2- 172.21.15.73:0/2963952997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f15d0 0x55bfcf5f1a30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6fff305740 1 --2- 172.21.15.73:0/2963952997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.518+0000 7f6fff305740 1 -- 172.21.15.73:0/2963952997 >> 172.21.15.73:0/2963952997 conn(0x55bfcf5ba310 msgr2=0x55bfcf5edc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 1 -- 172.21.15.73:0/2963952997 shutdown_connections 2024-09-05T13:04:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 1 -- 172.21.15.73:0/2963952997 wait complete. 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 1 -- start start 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 1 Processor -- start 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f15d0 0x55bfcf5fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 0x55bfcf5f9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bfcf5ff070 con 0x55bfcf5f2b80 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bfcf512060 con 0x55bfcf5f15d0 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bfcf5ff1f0 con 0x55bfcf5fc370 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6fff305740 10 client.0 _ll_register_callbacks cb 0x55bfcf2658c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6ff5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6ff5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44540/0 (socket says 172.21.15.73:44540) 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2795677600 learned_addr learned my addr 172.21.15.73:0/2795677600 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.519+0000 7f6ff659c640 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f15d0 0x55bfcf5fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 0x55bfcf5f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2795677600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 msgr2=0x55bfcf5f9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 0x55bfcf5f9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2795677600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f15d0 msgr2=0x55bfcf5fbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f15d0 0x55bfcf5fbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2795677600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfcf2c83c0 con 0x55bfcf5f2b80 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 0x55bfcf5f9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f9030 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00b6d0 tx=0x7f6fec00be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef7e4626d892ca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6fddffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6fddffb640 1 -- 172.21.15.73:0/2795677600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00d860 con 0x55bfcf5f2b80 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6fddffb640 1 -- 172.21.15.73:0/2795677600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f6fec005070 con 0x55bfcf5f2b80 2024-09-05T13:04:46.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6fff305740 1 -- 172.21.15.73:0/2795677600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fec00b950 con 0x55bfcf5f2b80 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6fddffb640 1 -- 172.21.15.73:0/2795677600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f6fec037020 con 0x55bfcf5f2b80 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6fff305740 10 client.16386 fetch_fsmap learned FSMap version 47 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.520+0000 7f6fff305740 1 -- 172.21.15.73:0/2795677600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55bfcf60ab40 con 0x55bfcf5f2b80 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.521+0000 7f6fddffb640 1 -- 172.21.15.73:0/2795677600 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fec00b950 con 0x55bfcf5f2b80 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.521+0000 7f6fddffb640 1 -- 172.21.15.73:0/2795677600 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f6fec0334e0 con 0x55bfcf5f2b80 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.521+0000 7f6fff305740 10 client.16386 fetch_fsmap finished waiting for FSMap version 47 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.521+0000 7f6fff305740 10 client.16386 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.521+0000 7f6fff305740 20 client.16386 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.521+0000 7f6fff305740 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55bfcf60bf50 0x55bfcf60e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.521+0000 7f6fff305740 4 client.16386 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.521+0000 7f6fff305740 1 -- 172.21.15.73:0/2795677600 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfcf564860 con 0x55bfcf60bf50 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.521+0000 7f6ff659c640 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55bfcf60bf50 0x55bfcf60e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6ff659c640 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55bfcf60bf50 0x55bfcf60e340 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=69d8bacd803edcb8 server_cookie=703981d45e110049 in_seq=0 out_seq=0 2024-09-05T13:04:46.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fddffb640 10 client.16386 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fddffb640 1 -- 172.21.15.73:0/2795677600 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bfcf564860 con 0x55bfcf60bf50 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fddffb640 10 client.16386 handle_command_reply: tid=0 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fff305740 1 client.16386 shutdown 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fff305740 1 -- 172.21.15.73:0/2795677600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 msgr2=0x55bfcf5f9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fff305740 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f9030 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00b6d0 tx=0x7f6fec00be40 comp rx=0 tx=0).stop 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fff305740 1 -- 172.21.15.73:0/2795677600 shutdown_connections 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fff305740 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55bfcf60bf50 0x55bfcf60e340 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fff305740 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5fc370 0x55bfcf5f9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fddffb640 0 client.16386 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fff305740 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f9030 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fff305740 1 --2- 172.21.15.73:0/2795677600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f15d0 0x55bfcf5fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.522+0000 7f6fff305740 1 -- 172.21.15.73:0/2795677600 >> 172.21.15.73:0/2795677600 conn(0x55bfcf5ba310 msgr2=0x55bfcf5f39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.523+0000 7f6fff305740 1 -- 172.21.15.73:0/2795677600 shutdown_connections 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.523+0000 7f6fff305740 1 -- 172.21.15.73:0/2795677600 wait complete. 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.523+0000 7f6fff305740 20 client.16386 trim_cache size 0 max 16384 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.535+0000 7f6fff305740 1 Processor -- start 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.535+0000 7f6fff305740 1 -- start start 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6fff305740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 0x55bfcf608310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6fff305740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6fff305740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5fc370 0x55bfcf6139d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6fff305740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81afd20 con 0x55bfcf5fc370 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6fff305740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81ad5c0 con 0x55bfcf5f2b80 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6fff305740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81ab430 con 0x55bfcf5f15d0 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5fc370 0x55bfcf6139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5fc370 0x55bfcf6139d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44556/0 (socket says 172.21.15.73:44556) 2024-09-05T13:04:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff6d9d640 1 -- 172.21.15.73:0/788894002 learned_addr learned my addr 172.21.15.73:0/788894002 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff659c640 1 --2- 172.21.15.73:0/788894002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 0x55bfcf608310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/788894002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff6d9d640 1 -- 172.21.15.73:0/788894002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 msgr2=0x55bfcf608310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/788894002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 0x55bfcf608310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff6d9d640 1 -- 172.21.15.73:0/788894002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f2b80 msgr2=0x55bfcf5f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/788894002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff6d9d640 1 -- 172.21.15.73:0/788894002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfcf5edde0 con 0x55bfcf5fc370 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/788894002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5fc370 0x55bfcf6139d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6ff00ee630 tx=0x7f6ff00ee190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a36c5999b0684c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6fdffff640 1 -- 172.21.15.73:0/788894002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00bc980 con 0x55bfcf5fc370 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6fdffff640 1 -- 172.21.15.73:0/788894002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff0036040 con 0x55bfcf5fc370 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.536+0000 7f6fdffff640 1 -- 172.21.15.73:0/788894002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00bb320 con 0x55bfcf5fc370 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 -- 172.21.15.73:0/788894002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5fc370 msgr2=0x55bfcf6139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 --2- 172.21.15.73:0/788894002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5fc370 0x55bfcf6139d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6ff00ee630 tx=0x7f6ff00ee190 comp rx=0 tx=0).stop 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 -- 172.21.15.73:0/788894002 shutdown_connections 2024-09-05T13:04:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 --2- 172.21.15.73:0/788894002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5fc370 0x55bfcf6139d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 --2- 172.21.15.73:0/788894002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5f2b80 0x55bfcf5f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 --2- 172.21.15.73:0/788894002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 0x55bfcf608310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 -- 172.21.15.73:0/788894002 >> 172.21.15.73:0/788894002 conn(0x55bfcf5ba310 msgr2=0x55bfcf5f7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 -- 172.21.15.73:0/788894002 shutdown_connections 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 -- 172.21.15.73:0/788894002 wait complete. 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 -- start start 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.537+0000 7f6fff305740 1 Processor -- start 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6fff305740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 0x55bfcf604660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6fff305740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf604ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6fff305740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5fc370 0x55bfcf5f5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6fff305740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81aba80 con 0x55bfcf5f2b80 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6fff305740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81acef0 con 0x55bfcf5fc370 2024-09-05T13:04:46.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6fff305740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81ac150 con 0x55bfcf5f15d0 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6fff305740 10 client.0 _ll_register_callbacks cb 0x7f6fe8004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf604ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf604ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44564/0 (socket says 172.21.15.73:44564) 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2678514790 learned_addr learned my addr 172.21.15.73:0/2678514790 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5fc370 0x55bfcf5f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff659c640 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 0x55bfcf604660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2678514790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 msgr2=0x55bfcf604660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 0x55bfcf604660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2678514790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5fc370 msgr2=0x55bfcf5f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5fc370 0x55bfcf5f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff5d9b640 1 -- 172.21.15.73:0/2678514790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfcf5f6070 con 0x55bfcf5f2b80 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff659c640 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 0x55bfcf604660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:04:46.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff6d9d640 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5fc370 0x55bfcf5f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6fddffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.538+0000 7f6ff5d9b640 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf604ba0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6fec033900 tx=0x7f6fec005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e051b48aa94b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fddffb640 1 -- 172.21.15.73:0/2678514790 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00d860 con 0x55bfcf5f2b80 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fddffb640 1 -- 172.21.15.73:0/2678514790 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f6fec00b950 con 0x55bfcf5f2b80 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fff305740 1 -- 172.21.15.73:0/2678514790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ff0036040 con 0x55bfcf5f2b80 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fddffb640 1 -- 172.21.15.73:0/2678514790 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f6fec042050 con 0x55bfcf5f2b80 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fff305740 10 client.16392 fetch_fsmap learned FSMap version 47 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fff305740 1 -- 172.21.15.73:0/2678514790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55bfcf6764a0 con 0x55bfcf5f2b80 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fddffb640 1 -- 172.21.15.73:0/2678514790 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff0036040 con 0x55bfcf5f2b80 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fddffb640 1 -- 172.21.15.73:0/2678514790 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f6fec033b20 con 0x55bfcf5f2b80 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fff305740 10 client.16392 fetch_fsmap finished waiting for FSMap version 47 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fff305740 10 client.16392 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fff305740 20 client.16392 populate_metadata read hostname 'smithi073' 2024-09-05T13:04:46.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fff305740 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55bfcf676bc0 0x55bfcf678fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fff305740 4 client.16392 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6fff305740 1 -- 172.21.15.73:0/2678514790 --> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bfcf55ed70 con 0x55bfcf676bc0 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.539+0000 7f6ff659c640 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55bfcf676bc0 0x55bfcf678fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6ff659c640 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55bfcf676bc0 0x55bfcf678fe0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6785ade2d4a0dd67 server_cookie=4af5c40dee5f2989 in_seq=0 out_seq=0 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fddffb640 10 client.16392 ms_handle_connect on v2:172.21.15.169:6838/3351085082 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fddffb640 1 -- 172.21.15.73:0/2678514790 <== mds.1 v2:172.21.15.169:6838/3351085082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bfcf55ed70 con 0x55bfcf676bc0 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fddffb640 10 client.16392 handle_command_reply: tid=0 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 client.16392 shutdown 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 -- 172.21.15.73:0/2678514790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 msgr2=0x55bfcf604ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf604ba0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6fec033900 tx=0x7f6fec005b90 comp rx=0 tx=0).stop 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 -- 172.21.15.73:0/2678514790 shutdown_connections 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.169:6838/3351085082,v1:172.21.15.169:6839/3351085082] conn(0x55bfcf676bc0 0x55bfcf678fe0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfcf5fc370 0x55bfcf5f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bfcf5f2b80 0x55bfcf604ba0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fddffb640 0 client.16392 ms_handle_reset on v2:172.21.15.169:6838/3351085082 2024-09-05T13:04:46.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 --2- 172.21.15.73:0/2678514790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bfcf5f15d0 0x55bfcf604660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 -- 172.21.15.73:0/2678514790 >> 172.21.15.73:0/2678514790 conn(0x55bfcf5ba310 msgr2=0x55bfcf5f8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:46.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 -- 172.21.15.73:0/2678514790 shutdown_connections 2024-09-05T13:04:46.978 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:04:46.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 1 -- 172.21.15.73:0/2678514790 wait complete. 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.540+0000 7f6fff305740 20 client.16392 trim_cache size 0 max 16384 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/1685529560 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fe00a2b80 msgr2=0x7f6fe00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fe00a2b80 0x7f6fe00a5040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0058a0 tx=0x7f6fec017000 comp rx=0 tx=0).stop 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/1685529560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ff81082a0 msgr2=0x7f6ff819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ff81082a0 0x7f6ff819ce40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0005cc0 tx=0x7f6ff0003970 comp rx=0 tx=0).stop 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/1685529560 shutdown_connections 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f6fe00a2b80 0x7f6fe00a5040 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ff81082a0 0x7f6ff819ce40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ff81036e0 0x7f6ff8198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 --2- 172.21.15.73:0/1685529560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ff8102d30 0x7f6ff8198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/1685529560 >> 172.21.15.73:0/1685529560 conn(0x7f6ff80fc7d0 msgr2=0x7f6ff8105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/1685529560 shutdown_connections 2024-09-05T13:04:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:04:45.541+0000 7f6ffcf2f640 1 -- 172.21.15.73:0/1685529560 wait complete. 2024-09-05T13:04:49.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:49 smithi073 ceph-mon[30883]: pgmap v544: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 142 op/s 2024-09-05T13:04:49.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:49 smithi162 ceph-mon[34220]: pgmap v544: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 142 op/s 2024-09-05T13:04:49.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:49 smithi169 ceph-mon[34823]: pgmap v544: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 142 op/s 2024-09-05T13:04:51.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:51 smithi073 ceph-mon[30883]: pgmap v545: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 132 op/s 2024-09-05T13:04:51.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:51 smithi162 ceph-mon[34220]: pgmap v545: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 132 op/s 2024-09-05T13:04:51.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:51 smithi169 ceph-mon[34823]: pgmap v545: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 132 op/s 2024-09-05T13:04:53.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:53 smithi073 ceph-mon[30883]: pgmap v546: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.4 KiB/s wr, 75 op/s 2024-09-05T13:04:53.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:53 smithi162 ceph-mon[34220]: pgmap v546: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.4 KiB/s wr, 75 op/s 2024-09-05T13:04:53.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:53 smithi169 ceph-mon[34823]: pgmap v546: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.4 KiB/s wr, 75 op/s 2024-09-05T13:04:55.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:55 smithi073 ceph-mon[30883]: pgmap v547: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 20 op/s 2024-09-05T13:04:55.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:55 smithi162 ceph-mon[34220]: pgmap v547: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 20 op/s 2024-09-05T13:04:55.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:55 smithi169 ceph-mon[34823]: pgmap v547: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 20 op/s 2024-09-05T13:04:57.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:57 smithi073 ceph-mon[30883]: pgmap v548: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-05T13:04:57.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:57 smithi162 ceph-mon[34220]: pgmap v548: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-05T13:04:57.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:57 smithi169 ceph-mon[34823]: pgmap v548: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-05T13:04:57.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T13:04:57.985 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:04:59.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:04:59 smithi073 ceph-mon[30883]: pgmap v549: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-05T13:04:59.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:04:59 smithi162 ceph-mon[34220]: pgmap v549: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-05T13:04:59.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:04:59 smithi169 ceph-mon[34823]: pgmap v549: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-05T13:05:01.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:01 smithi073 ceph-mon[30883]: pgmap v550: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-05T13:05:01.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:01 smithi162 ceph-mon[34220]: pgmap v550: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-05T13:05:01.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:01 smithi169 ceph-mon[34823]: pgmap v550: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-05T13:05:03.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.091+0000 7f8984b90640 1 -- 172.21.15.73:0/1923278493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f898010e440 msgr2=0x7f8980110830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.091+0000 7f8984b90640 1 --2- 172.21.15.73:0/1923278493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f898010e440 0x7f8980110830 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8978009ca0 tx=0x7f897802a950 comp rx=0 tx=0).stop 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.091+0000 7f8984b90640 1 -- 172.21.15.73:0/1923278493 shutdown_connections 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.091+0000 7f8984b90640 1 --2- 172.21.15.73:0/1923278493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f898010e440 0x7f8980110830 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.091+0000 7f8984b90640 1 --2- 172.21.15.73:0/1923278493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8980074e30 0x7f898010df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.091+0000 7f8984b90640 1 --2- 172.21.15.73:0/1923278493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8980074510 0x7f89800748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.091+0000 7f8984b90640 1 -- 172.21.15.73:0/1923278493 >> 172.21.15.73:0/1923278493 conn(0x7f89800fd8c0 msgr2=0x7f89800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.091+0000 7f8984b90640 1 -- 172.21.15.73:0/1923278493 shutdown_connections 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.091+0000 7f8984b90640 1 -- 172.21.15.73:0/1923278493 wait complete. 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f8984b90640 1 Processor -- start 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f8984b90640 1 -- start start 2024-09-05T13:05:03.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f8984b90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8980074510 0x7f898019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f8984b90640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8980074e30 0x7f898019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f8984b90640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898010e440 0x7f898019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f8984b90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8980114160 con 0x7f8980074510 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f8984b90640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8980113fe0 con 0x7f8980074e30 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f8984b90640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89801142e0 con 0x7f898010e440 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f897e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8980074510 0x7f898019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f897e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8980074510 0x7f898019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35018/0 (socket says 172.21.15.73:35018) 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.092+0000 7f897e59c640 1 -- 172.21.15.73:0/3855953891 learned_addr learned my addr 172.21.15.73:0/3855953891 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f897dd9b640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8980074e30 0x7f898019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f897ed9d640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898010e440 0x7f898019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f897e59c640 1 -- 172.21.15.73:0/3855953891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898010e440 msgr2=0x7f898019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:03.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f897e59c640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898010e440 0x7f898019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f897e59c640 1 -- 172.21.15.73:0/3855953891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8980074e30 msgr2=0x7f898019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f897e59c640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8980074e30 0x7f898019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f897e59c640 1 -- 172.21.15.73:0/3855953891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898019f5f0 con 0x7f8980074510 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f897ed9d640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898010e440 0x7f898019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f897e59c640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8980074510 0x7f898019a640 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f897000d770 tx=0x7f897000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f89777fe640 1 -- 172.21.15.73:0/3855953891 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970017070 con 0x7f8980074510 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f89777fe640 1 -- 172.21.15.73:0/3855953891 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8970005500 con 0x7f8980074510 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f89777fe640 1 -- 172.21.15.73:0/3855953891 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970004e00 con 0x7f8980074510 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f8984b90640 1 -- 172.21.15.73:0/3855953891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898019f8e0 con 0x7f8980074510 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.093+0000 7f8984b90640 1 -- 172.21.15.73:0/3855953891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89801a71c0 con 0x7f8980074510 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.096+0000 7f89777fe640 1 -- 172.21.15.73:0/3855953891 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8970004fa0 con 0x7f8980074510 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.096+0000 7f8986f66740 1 Processor -- start 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.096+0000 7f8986f66740 1 -- start start 2024-09-05T13:05:03.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f89777fe640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f896c0a2b80 0x7f896c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f8986f66740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f592b80 0x55d04f591090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f8986f66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f5915d0 0x55d04f591a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f8986f66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f59c370 0x55d04f59e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f8986f66740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d04f4f72f0 con 0x55d04f592b80 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f8986f66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d04f49ecf0 con 0x55d04f5915d0 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f8986f66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d04f4f32b0 con 0x55d04f59c370 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f592b80 0x55d04f591090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897ed9d640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f896c0a2b80 0x7f896c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f592b80 0x55d04f591090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35026/0 (socket says 172.21.15.73:35026) 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897e59c640 1 -- 172.21.15.73:0/2129678284 learned_addr learned my addr 172.21.15.73:0/2129678284 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f89777fe640 1 -- 172.21.15.73:0/3855953891 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f89700ceb40 con 0x7f8980074510 2024-09-05T13:05:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897dd9b640 1 --2- 172.21.15.73:0/2129678284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f5915d0 0x55d04f591a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897e59c640 1 -- 172.21.15.73:0/2129678284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f59c370 msgr2=0x55d04f59e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897e59c640 1 --2- 172.21.15.73:0/2129678284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f59c370 0x55d04f59e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897e59c640 1 -- 172.21.15.73:0/2129678284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f5915d0 msgr2=0x55d04f591a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897e59c640 1 --2- 172.21.15.73:0/2129678284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f5915d0 0x55d04f591a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897e59c640 1 -- 172.21.15.73:0/2129678284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d04f4833a0 con 0x55d04f592b80 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897ed9d640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f896c0a2b80 0x7f896c0a5040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8978005e30 tx=0x7f89780098e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.097+0000 7f897e59c640 1 --2- 172.21.15.73:0/2129678284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f592b80 0x55d04f591090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f89700cc670 tx=0x7f8970016500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390b8700e36b471a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.098+0000 7f8974ff9640 1 -- 172.21.15.73:0/2129678284 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700a0910 con 0x55d04f592b80 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.098+0000 7f8974ff9640 1 -- 172.21.15.73:0/2129678284 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89700046c0 con 0x55d04f592b80 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.098+0000 7f8974ff9640 1 -- 172.21.15.73:0/2129678284 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700a0c90 con 0x55d04f592b80 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.098+0000 7f8986f66740 1 -- 172.21.15.73:0/2129678284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f592b80 msgr2=0x55d04f591090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.098+0000 7f8986f66740 1 --2- 172.21.15.73:0/2129678284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f592b80 0x55d04f591090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f89700cc670 tx=0x7f8970016500 comp rx=0 tx=0).stop 2024-09-05T13:05:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.098+0000 7f8986f66740 1 -- 172.21.15.73:0/2129678284 shutdown_connections 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.098+0000 7f8986f66740 1 --2- 172.21.15.73:0/2129678284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f59c370 0x55d04f59e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.098+0000 7f8986f66740 1 --2- 172.21.15.73:0/2129678284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f5915d0 0x55d04f591a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.098+0000 7f8986f66740 1 --2- 172.21.15.73:0/2129678284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f592b80 0x55d04f591090 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.098+0000 7f8986f66740 1 -- 172.21.15.73:0/2129678284 >> 172.21.15.73:0/2129678284 conn(0x55d04f55a310 msgr2=0x55d04f58dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 1 -- 172.21.15.73:0/2129678284 shutdown_connections 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 1 -- 172.21.15.73:0/2129678284 wait complete. 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 1 -- start start 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 1 Processor -- start 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f59bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f599050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f59c370 0x55d04f5997e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d04f59f0d0 con 0x55d04f5915d0 2024-09-05T13:05:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d04f4b2060 con 0x55d04f59c370 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d04f59f250 con 0x55d04f592b80 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f8986f66740 10 client.0 _ll_register_callbacks cb 0x55d04f2058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f897e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f59bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f897e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f59bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35028/0 (socket says 172.21.15.73:35028) 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f897e59c640 1 -- 172.21.15.73:0/3477861898 learned_addr learned my addr 172.21.15.73:0/3477861898 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.099+0000 7f897ed9d640 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f59c370 0x55d04f5997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f897e59c640 1 -- 172.21.15.73:0/3477861898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 msgr2=0x55d04f599050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f897dd9b640 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f599050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f897e59c640 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f599050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f897e59c640 1 -- 172.21.15.73:0/3477861898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f59c370 msgr2=0x55d04f5997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f897e59c640 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f59c370 0x55d04f5997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f897e59c640 1 -- 172.21.15.73:0/3477861898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d04f2683c0 con 0x55d04f5915d0 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f897ed9d640 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f59c370 0x55d04f5997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f897e59c640 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f59bda0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f89700970b0 tx=0x7f89700a0910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d082c11d2ea10fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8965ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8965ffb640 1 -- 172.21.15.73:0/3477861898 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897009bad0 con 0x55d04f5915d0 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8965ffb640 1 -- 172.21.15.73:0/3477861898 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f897009f520 con 0x55d04f5915d0 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8986f66740 1 -- 172.21.15.73:0/3477861898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d04f504860 con 0x55d04f5915d0 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8965ffb640 1 -- 172.21.15.73:0/3477861898 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f89700a4040 con 0x55d04f5915d0 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8986f66740 10 client.16404 fetch_fsmap learned FSMap version 47 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8986f66740 1 -- 172.21.15.73:0/3477861898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55d04f5aabb0 con 0x55d04f5915d0 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8965ffb640 1 -- 172.21.15.73:0/3477861898 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d04f504860 con 0x55d04f5915d0 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8965ffb640 1 -- 172.21.15.73:0/3477861898 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f89700a0b50 con 0x55d04f5915d0 2024-09-05T13:05:03.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8986f66740 10 client.16404 fetch_fsmap finished waiting for FSMap version 47 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.100+0000 7f8986f66740 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.101+0000 7f8986f66740 20 client.16404 populate_metadata read hostname 'smithi073' 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.101+0000 7f8986f66740 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d04f5abf00 0x55d04f5ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.101+0000 7f8986f66740 4 client.16404 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.101+0000 7f8986f66740 1 -- 172.21.15.73:0/3477861898 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d04f4fed70 con 0x55d04f5abf00 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.101+0000 7f897dd9b640 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d04f5abf00 0x55d04f5ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.101+0000 7f897dd9b640 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d04f5abf00 0x55d04f5ae2f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=888f1ad6b41bdd1f server_cookie=85c8cd91ed3f76fa in_seq=0 out_seq=0 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.101+0000 7f8965ffb640 10 client.16404 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8965ffb640 1 -- 172.21.15.73:0/3477861898 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d04f4fed70 con 0x55d04f5abf00 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8965ffb640 10 client.16404 handle_command_reply: tid=0 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 client.16404 shutdown 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 -- 172.21.15.73:0/3477861898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 msgr2=0x55d04f59bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f59bda0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f89700970b0 tx=0x7f89700a0910 comp rx=0 tx=0).stop 2024-09-05T13:05:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 -- 172.21.15.73:0/3477861898 shutdown_connections 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d04f5abf00 0x55d04f5ae2f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f59c370 0x55d04f5997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f599050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 --2- 172.21.15.73:0/3477861898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f59bda0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8965ffb640 0 client.16404 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 -- 172.21.15.73:0/3477861898 >> 172.21.15.73:0/3477861898 conn(0x55d04f55a310 msgr2=0x55d04f593970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 -- 172.21.15.73:0/3477861898 shutdown_connections 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 1 -- 172.21.15.73:0/3477861898 wait complete. 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.102+0000 7f8986f66740 20 client.16404 trim_cache size 0 max 16384 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.115+0000 7f8986f66740 1 Processor -- start 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.115+0000 7f8986f66740 1 -- start start 2024-09-05T13:05:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f8986f66740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f5a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f8986f66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f594160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f8986f66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f59c370 0x55d04f5946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f8986f66740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f89801b2000 con 0x55d04f5915d0 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f8986f66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89801af8a0 con 0x55d04f59c370 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f8986f66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89801ad6f0 con 0x55d04f592b80 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f897e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f5a7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f897e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f5a7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35036/0 (socket says 172.21.15.73:35036) 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f897e59c640 1 -- 172.21.15.73:0/4125006690 learned_addr learned my addr 172.21.15.73:0/4125006690 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f897dd9b640 1 --2- 172.21.15.73:0/4125006690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f594160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f897e59c640 1 -- 172.21.15.73:0/4125006690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 msgr2=0x55d04f594160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f897e59c640 1 --2- 172.21.15.73:0/4125006690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f594160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f897e59c640 1 -- 172.21.15.73:0/4125006690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f59c370 msgr2=0x55d04f5946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:05:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f897e59c640 1 --2- 172.21.15.73:0/4125006690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f59c370 0x55d04f5946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f897e59c640 1 -- 172.21.15.73:0/4125006690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d04f58d510 con 0x55d04f5915d0 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f897e59c640 1 --2- 172.21.15.73:0/4125006690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f5a7bf0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8970009610 tx=0x7f8970009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b119b53f59391c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f8967fff640 1 -- 172.21.15.73:0/4125006690 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970097be0 con 0x55d04f5915d0 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f8967fff640 1 -- 172.21.15.73:0/4125006690 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f897009bad0 con 0x55d04f5915d0 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.116+0000 7f8967fff640 1 -- 172.21.15.73:0/4125006690 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700a0b00 con 0x55d04f5915d0 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 -- 172.21.15.73:0/4125006690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 msgr2=0x55d04f5a7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 --2- 172.21.15.73:0/4125006690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f5a7bf0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8970009610 tx=0x7f8970009c30 comp rx=0 tx=0).stop 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 -- 172.21.15.73:0/4125006690 shutdown_connections 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 --2- 172.21.15.73:0/4125006690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f59c370 0x55d04f5946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 --2- 172.21.15.73:0/4125006690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f594160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 --2- 172.21.15.73:0/4125006690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f5915d0 0x55d04f5a7bf0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 -- 172.21.15.73:0/4125006690 >> 172.21.15.73:0/4125006690 conn(0x55d04f55a310 msgr2=0x55d04f5a74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:03.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 -- 172.21.15.73:0/4125006690 shutdown_connections 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 -- 172.21.15.73:0/4125006690 wait complete. 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 -- start start 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.117+0000 7f8986f66740 1 Processor -- start 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8986f66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f5915d0 0x55d04f5b1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8986f66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f5aed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8986f66740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f59c370 0x55d04f5af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8986f66740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f89801add60 con 0x55d04f59c370 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8986f66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89801af1d0 con 0x55d04f5915d0 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8986f66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89801ae430 con 0x55d04f592b80 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8986f66740 10 client.0 _ll_register_callbacks cb 0x7f896800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f59c370 0x55d04f5af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f59c370 0x55d04f5af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35042/0 (socket says 172.21.15.73:35042) 2024-09-05T13:05:03.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897ed9d640 1 -- 172.21.15.73:0/3693752879 learned_addr learned my addr 172.21.15.73:0/3693752879 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897dd9b640 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f5aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897ed9d640 1 -- 172.21.15.73:0/3693752879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 msgr2=0x55d04f5aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897ed9d640 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f5aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897e59c640 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f5915d0 0x55d04f5b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897ed9d640 1 -- 172.21.15.73:0/3693752879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f5915d0 msgr2=0x55d04f5b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897ed9d640 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f5915d0 0x55d04f5b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897ed9d640 1 -- 172.21.15.73:0/3693752879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d04f5afa80 con 0x55d04f59c370 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897dd9b640 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f5aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f897ed9d640 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f59c370 0x55d04f5af250 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f89780098b0 tx=0x7f89780095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a166000ddad968 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8965ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8965ffb640 1 -- 172.21.15.73:0/3693752879 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978034050 con 0x55d04f59c370 2024-09-05T13:05:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8965ffb640 1 -- 172.21.15.73:0/3693752879 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f8978004040 con 0x55d04f59c370 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8986f66740 1 -- 172.21.15.73:0/3693752879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f897009bad0 con 0x55d04f59c370 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8965ffb640 1 -- 172.21.15.73:0/3693752879 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f8978058050 con 0x55d04f59c370 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8986f66740 10 client.16410 fetch_fsmap learned FSMap version 47 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.118+0000 7f8986f66740 1 -- 172.21.15.73:0/3693752879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55d04f616740 con 0x55d04f59c370 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.119+0000 7f8965ffb640 1 -- 172.21.15.73:0/3693752879 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f897009bad0 con 0x55d04f59c370 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.119+0000 7f8965ffb640 1 -- 172.21.15.73:0/3693752879 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f8978046050 con 0x55d04f59c370 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.119+0000 7f8986f66740 10 client.16410 fetch_fsmap finished waiting for FSMap version 47 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.119+0000 7f8986f66740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.119+0000 7f8986f66740 20 client.16410 populate_metadata read hostname 'smithi073' 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.119+0000 7f8986f66740 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d04f616f10 0x55d04f619330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.119+0000 7f8986f66740 4 client.16410 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.119+0000 7f8986f66740 1 -- 172.21.15.73:0/3693752879 --> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d04f47b170 con 0x55d04f616f10 2024-09-05T13:05:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.119+0000 7f897e59c640 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d04f616f10 0x55d04f619330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f897e59c640 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d04f616f10 0x55d04f619330 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b31b928ce20e4fe server_cookie=51d2684bd232647f in_seq=0 out_seq=0 2024-09-05T13:05:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8965ffb640 10 client.16410 ms_handle_connect on v2:172.21.15.162:6838/3413521160 2024-09-05T13:05:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8965ffb640 1 -- 172.21.15.73:0/3693752879 <== mds.0 v2:172.21.15.162:6838/3413521160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d04f47b170 con 0x55d04f616f10 2024-09-05T13:05:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8965ffb640 10 client.16410 handle_command_reply: tid=0 2024-09-05T13:05:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 client.16410 shutdown 2024-09-05T13:05:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 -- 172.21.15.73:0/3693752879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f59c370 msgr2=0x55d04f5af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f59c370 0x55d04f5af250 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f89780098b0 tx=0x7f89780095c0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.082 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 -- 172.21.15.73:0/3693752879 shutdown_connections 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.162:6838/3413521160,v1:172.21.15.162:6839/3413521160] conn(0x55d04f616f10 0x55d04f619330 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d04f59c370 0x55d04f5af250 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8965ffb640 0 client.16410 ms_handle_reset on v2:172.21.15.162:6838/3413521160 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d04f592b80 0x55d04f5aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 --2- 172.21.15.73:0/3693752879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d04f5915d0 0x55d04f5b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 -- 172.21.15.73:0/3693752879 >> 172.21.15.73:0/3693752879 conn(0x55d04f55a310 msgr2=0x55d04f58c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 -- 172.21.15.73:0/3693752879 shutdown_connections 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 1 -- 172.21.15.73:0/3693752879 wait complete. 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.120+0000 7f8986f66740 20 client.16410 trim_cache size 0 max 16384 2024-09-05T13:05:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 -- 172.21.15.73:0/3855953891 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f896c0a2b80 msgr2=0x7f896c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f896c0a2b80 0x7f896c0a5040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8978005e30 tx=0x7f89780098e0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 -- 172.21.15.73:0/3855953891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8980074510 msgr2=0x7f898019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8980074510 0x7f898019a640 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f897000d770 tx=0x7f897000dc30 comp rx=0 tx=0).stop 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 -- 172.21.15.73:0/3855953891 shutdown_connections 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f896c0a2b80 0x7f896c0a5040 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898010e440 0x7f898019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8980074e30 0x7f898019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 --2- 172.21.15.73:0/3855953891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8980074510 0x7f898019a640 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 -- 172.21.15.73:0/3855953891 >> 172.21.15.73:0/3855953891 conn(0x7f89800fd8c0 msgr2=0x7f89800fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 -- 172.21.15.73:0/3855953891 shutdown_connections 2024-09-05T13:05:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:02.121+0000 7f8984b90640 1 -- 172.21.15.73:0/3855953891 wait complete. 2024-09-05T13:05:03.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:03 smithi073 ceph-mon[30883]: pgmap v551: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-05T13:05:03.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:03 smithi162 ceph-mon[34220]: pgmap v551: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-05T13:05:03.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:03 smithi169 ceph-mon[34823]: pgmap v551: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-05T13:05:05.263 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:05 smithi073 ceph-mon[30883]: pgmap v552: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:05.482 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_e856d6b2462509a377ef39149a05475ed006ebac/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_e856d6b2462509a377ef39149a05475ed006ebac/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_e856d6b2462509a377ef39149a05475ed006ebac/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-05T13:05:05.482 INFO:tasks.fwd_scrub:done joining 2024-09-05T13:05:05.483 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-05T13:05:05.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T13:05:05.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:05 smithi162 ceph-mon[34220]: pgmap v552: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:05.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.610+0000 7fd5a6239640 1 -- 172.21.15.73:0/748427633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5a01025c0 msgr2=0x7fd5a0108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:05.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.610+0000 7fd5a6239640 1 --2- 172.21.15.73:0/748427633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5a01025c0 0x7fd5a0108e50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd598009ca0 tx=0x7fd59802a8c0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.610+0000 7fd5a6239640 1 -- 172.21.15.73:0/748427633 shutdown_connections 2024-09-05T13:05:05.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.610+0000 7fd5a6239640 1 --2- 172.21.15.73:0/748427633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5a01025c0 0x7fd5a0108e50 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.610+0000 7fd5a6239640 1 --2- 172.21.15.73:0/748427633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5a0101c00 0x7fd5a0102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.610+0000 7fd5a6239640 1 --2- 172.21.15.73:0/748427633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5a0100a10 0x7fd5a0100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.610+0000 7fd5a6239640 1 -- 172.21.15.73:0/748427633 >> 172.21.15.73:0/748427633 conn(0x7fd5a00fc170 msgr2=0x7fd5a00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:05.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.610+0000 7fd5a6239640 1 -- 172.21.15.73:0/748427633 shutdown_connections 2024-09-05T13:05:05.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.610+0000 7fd5a6239640 1 -- 172.21.15.73:0/748427633 wait complete. 2024-09-05T13:05:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd5a6239640 1 Processor -- start 2024-09-05T13:05:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd5a6239640 1 -- start start 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd5a6239640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5a0100a10 0x7fd5a01049a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd5a6239640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5a0101c00 0x7fd5a0102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd5a6239640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5a01025c0 0x7fd5a0103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd5a6239640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a010c690 con 0x7fd5a0101c00 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd5a6239640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a010c510 con 0x7fd5a0100a10 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd5a6239640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a010c810 con 0x7fd5a01025c0 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd59effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5a0101c00 0x7fd5a0102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd59effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5a0101c00 0x7fd5a0102fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36728/0 (socket says 172.21.15.73:36728) 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd59effd640 1 -- 172.21.15.73:0/2184046196 learned_addr learned my addr 172.21.15.73:0/2184046196 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd59f7fe640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5a0100a10 0x7fd5a01049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd59ffff640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5a01025c0 0x7fd5a0103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd59effd640 1 -- 172.21.15.73:0/2184046196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5a01025c0 msgr2=0x7fd5a0103520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd59effd640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5a01025c0 0x7fd5a0103520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd59effd640 1 -- 172.21.15.73:0/2184046196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5a0100a10 msgr2=0x7fd5a01049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.611+0000 7fd59effd640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5a0100a10 0x7fd5a01049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.612+0000 7fd59effd640 1 -- 172.21.15.73:0/2184046196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a0103db0 con 0x7fd5a0101c00 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.612+0000 7fd59ffff640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5a01025c0 0x7fd5a0103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.612+0000 7fd59effd640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5a0101c00 0x7fd5a0102fe0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd59000e9f0 tx=0x7fd59000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.612+0000 7fd59cff9640 1 -- 172.21.15.73:0/2184046196 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59000cd80 con 0x7fd5a0101c00 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.612+0000 7fd59cff9640 1 -- 172.21.15.73:0/2184046196 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd590005500 con 0x7fd5a0101c00 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.612+0000 7fd5a6239640 1 -- 172.21.15.73:0/2184046196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a01a1f20 con 0x7fd5a0101c00 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.612+0000 7fd59cff9640 1 -- 172.21.15.73:0/2184046196 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590010690 con 0x7fd5a0101c00 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.612+0000 7fd5a6239640 1 -- 172.21.15.73:0/2184046196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a01a2380 con 0x7fd5a0101c00 2024-09-05T13:05:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.613+0000 7fd5a6239640 1 -- 172.21.15.73:0/2184046196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a01a2670 con 0x7fd5a0101c00 2024-09-05T13:05:05.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.615+0000 7fd59cff9640 1 -- 172.21.15.73:0/2184046196 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd5900046c0 con 0x7fd5a0101c00 2024-09-05T13:05:05.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.616+0000 7fd59cff9640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd58c0a2c10 0x7fd58c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.616+0000 7fd59f7fe640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd58c0a2c10 0x7fd58c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.616+0000 7fd59cff9640 1 -- 172.21.15.73:0/2184046196 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fd5900cf690 con 0x7fd5a0101c00 2024-09-05T13:05:05.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:05 smithi169 ceph-mon[34823]: pgmap v552: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.617+0000 7fd59f7fe640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd58c0a2c10 0x7fd58c0a50d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0101a60 tx=0x7fd588005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:05.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.619+0000 7fd59cff9640 1 -- 172.21.15.73:0/2184046196 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5900541b0 con 0x7fd5a0101c00 2024-09-05T13:05:05.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.794+0000 7fd5a6239640 1 -- 172.21.15.73:0/2184046196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5a01a29c0 con 0x7fd5a0101c00 2024-09-05T13:05:05.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.796+0000 7fd59cff9640 1 -- 172.21.15.73:0/2184046196 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22645 (secure 0 0 0) 0x7fd5a01a29c0 con 0x7fd5a0101c00 2024-09-05T13:05:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T13:05:05.798 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":82,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T13:04:28.701104+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T13:05:05.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 -- 172.21.15.73:0/2184046196 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd58c0a2c10 msgr2=0x7fd58c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:05.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd58c0a2c10 0x7fd58c0a50d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0101a60 tx=0x7fd588005f90 comp rx=0 tx=0).stop 2024-09-05T13:05:05.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 -- 172.21.15.73:0/2184046196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5a0101c00 msgr2=0x7fd5a0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:05.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5a0101c00 0x7fd5a0102fe0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd59000e9f0 tx=0x7fd59000edf0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 -- 172.21.15.73:0/2184046196 shutdown_connections 2024-09-05T13:05:05.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fd58c0a2c10 0x7fd58c0a50d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5a01025c0 0x7fd5a0103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5a0101c00 0x7fd5a0102fe0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 --2- 172.21.15.73:0/2184046196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5a0100a10 0x7fd5a01049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 -- 172.21.15.73:0/2184046196 >> 172.21.15.73:0/2184046196 conn(0x7fd5a00fc170 msgr2=0x7fd5a00fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:05.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 -- 172.21.15.73:0/2184046196 shutdown_connections 2024-09-05T13:05:05.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.798+0000 7fd5a6239640 1 -- 172.21.15.73:0/2184046196 wait complete. 2024-09-05T13:05:05.811 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T12:51:12.204701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-05T12:55:42.305439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-05T12:55:44.548796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-05T13:05:05.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-05T13:05:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.916+0000 7f441c6d0640 1 -- 172.21.15.73:0/2557312211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44141025b0 msgr2=0x7f4414108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.916+0000 7f441c6d0640 1 --2- 172.21.15.73:0/2557312211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44141025b0 0x7f4414108e40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f440c009ca0 tx=0x7f440c02a8c0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.916+0000 7f441c6d0640 1 -- 172.21.15.73:0/2557312211 shutdown_connections 2024-09-05T13:05:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.916+0000 7f441c6d0640 1 --2- 172.21.15.73:0/2557312211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44141025b0 0x7f4414108e40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.916+0000 7f441c6d0640 1 --2- 172.21.15.73:0/2557312211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4414101bf0 0x7f4414102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.916+0000 7f441c6d0640 1 --2- 172.21.15.73:0/2557312211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4414100a00 0x7f4414100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.916+0000 7f441c6d0640 1 -- 172.21.15.73:0/2557312211 >> 172.21.15.73:0/2557312211 conn(0x7f44140fc140 msgr2=0x7f44140fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.916+0000 7f441c6d0640 1 -- 172.21.15.73:0/2557312211 shutdown_connections 2024-09-05T13:05:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.916+0000 7f441c6d0640 1 -- 172.21.15.73:0/2557312211 wait complete. 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441c6d0640 1 Processor -- start 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441c6d0640 1 -- start start 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441c6d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4414100a00 0x7f4414197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441c6d0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4414101bf0 0x7f4414198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441c6d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44141025b0 0x7f441419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441c6d0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f441410c680 con 0x7f4414100a00 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441c6d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f441410c500 con 0x7f44141025b0 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441c6d0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f441410c800 con 0x7f4414101bf0 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441a46c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4414100a00 0x7f4414197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441a46c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4414100a00 0x7f4414197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36750/0 (socket says 172.21.15.73:36750) 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441a46c640 1 -- 172.21.15.73:0/1218639613 learned_addr learned my addr 172.21.15.73:0/1218639613 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441ac6d640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44141025b0 0x7f441419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f4419c6b640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4414101bf0 0x7f4414198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441a46c640 1 -- 172.21.15.73:0/1218639613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4414101bf0 msgr2=0x7f4414198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.917+0000 7f441a46c640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4414101bf0 0x7f4414198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.918+0000 7f441a46c640 1 -- 172.21.15.73:0/1218639613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44141025b0 msgr2=0x7f441419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.918+0000 7f441a46c640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44141025b0 0x7f441419f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.918+0000 7f441a46c640 1 -- 172.21.15.73:0/1218639613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441419fa40 con 0x7f4414100a00 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.918+0000 7f4419c6b640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4414101bf0 0x7f4414198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.918+0000 7f441a46c640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4414100a00 0x7f4414197e20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f441000e9c0 tx=0x7f441000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.918+0000 7f440b7fe640 1 -- 172.21.15.73:0/1218639613 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441000cd80 con 0x7f4414100a00 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.918+0000 7f441c6d0640 1 -- 172.21.15.73:0/1218639613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441419fd30 con 0x7f4414100a00 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.918+0000 7f440b7fe640 1 -- 172.21.15.73:0/1218639613 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44100035f0 con 0x7f4414100a00 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.918+0000 7f440b7fe640 1 -- 172.21.15.73:0/1218639613 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410010690 con 0x7f4414100a00 2024-09-05T13:05:05.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.918+0000 7f441c6d0640 1 -- 172.21.15.73:0/1218639613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44141a0210 con 0x7f4414100a00 2024-09-05T13:05:05.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.919+0000 7f441c6d0640 1 -- 172.21.15.73:0/1218639613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44141a04d0 con 0x7f4414100a00 2024-09-05T13:05:05.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.920+0000 7f440b7fe640 1 -- 172.21.15.73:0/1218639613 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f44100037a0 con 0x7f4414100a00 2024-09-05T13:05:05.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.921+0000 7f440b7fe640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f44000a2b90 0x7f44000a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:05.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.921+0000 7f4419c6b640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f44000a2b90 0x7f44000a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:05.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.921+0000 7f440b7fe640 1 -- 172.21.15.73:0/1218639613 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f44100cf490 con 0x7f4414100a00 2024-09-05T13:05:05.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.921+0000 7f4419c6b640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f44000a2b90 0x7f44000a5050 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4414199330 tx=0x7f4404005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:05.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:05.925+0000 7f440b7fe640 1 -- 172.21.15.73:0/1218639613 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f441009c420 con 0x7f4414100a00 2024-09-05T13:05:06.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.098+0000 7f441c6d0640 1 -- 172.21.15.73:0/1218639613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f44141a06a0 con 0x7f4414100a00 2024-09-05T13:05:06.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.099+0000 7f440b7fe640 1 -- 172.21.15.73:0/1218639613 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f441009bd20 con 0x7f4414100a00 2024-09-05T13:05:06.100 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-05T13:05:06.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 -- 172.21.15.73:0/1218639613 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f44000a2b90 msgr2=0x7f44000a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f44000a2b90 0x7f44000a5050 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4414199330 tx=0x7f4404005f90 comp rx=0 tx=0).stop 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 -- 172.21.15.73:0/1218639613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4414100a00 msgr2=0x7f4414197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4414100a00 0x7f4414197e20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f441000e9c0 tx=0x7f441000ee80 comp rx=0 tx=0).stop 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 -- 172.21.15.73:0/1218639613 shutdown_connections 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f44000a2b90 0x7f44000a5050 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44141025b0 0x7f441419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4414101bf0 0x7f4414198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 --2- 172.21.15.73:0/1218639613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4414100a00 0x7f4414197e20 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 -- 172.21.15.73:0/1218639613 >> 172.21.15.73:0/1218639613 conn(0x7f44140fc140 msgr2=0x7f44140fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 -- 172.21.15.73:0/1218639613 shutdown_connections 2024-09-05T13:05:06.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.101+0000 7f441c6d0640 1 -- 172.21.15.73:0/1218639613 wait complete. 2024-09-05T13:05:06.114 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-05T13:05:06.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.218+0000 7fe8aff03640 1 -- 172.21.15.73:0/2908629628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a8101bf0 msgr2=0x7fe8a8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.218+0000 7fe8aff03640 1 --2- 172.21.15.73:0/2908629628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a8101bf0 0x7fe8a8102070 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe898009900 tx=0x7fe89802a410 comp rx=0 tx=0).stop 2024-09-05T13:05:06.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.218+0000 7fe8aff03640 1 -- 172.21.15.73:0/2908629628 shutdown_connections 2024-09-05T13:05:06.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.218+0000 7fe8aff03640 1 --2- 172.21.15.73:0/2908629628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8a81025b0 0x7fe8a8108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.218+0000 7fe8aff03640 1 --2- 172.21.15.73:0/2908629628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a8101bf0 0x7fe8a8102070 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.218+0000 7fe8aff03640 1 --2- 172.21.15.73:0/2908629628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a8100a00 0x7fe8a8100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.218+0000 7fe8aff03640 1 -- 172.21.15.73:0/2908629628 >> 172.21.15.73:0/2908629628 conn(0x7fe8a80fc140 msgr2=0x7fe8a80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:06.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.218+0000 7fe8aff03640 1 -- 172.21.15.73:0/2908629628 shutdown_connections 2024-09-05T13:05:06.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.218+0000 7fe8aff03640 1 -- 172.21.15.73:0/2908629628 wait complete. 2024-09-05T13:05:06.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8aff03640 1 Processor -- start 2024-09-05T13:05:06.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8aff03640 1 -- start start 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8aff03640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a8100a00 0x7fe8a8104990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8aff03640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8a8101bf0 0x7fe8a8102fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8aff03640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a81025b0 0x7fe8a8103510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8aff03640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a810c680 con 0x7fe8a81025b0 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8aff03640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a810c500 con 0x7fe8a8100a00 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8aff03640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a810c800 con 0x7fe8a8101bf0 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8ae4a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a81025b0 0x7fe8a8103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8ae4a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a81025b0 0x7fe8a8103510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36764/0 (socket says 172.21.15.73:36764) 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8ae4a0640 1 -- 172.21.15.73:0/3219531049 learned_addr learned my addr 172.21.15.73:0/3219531049 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8ad49e640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8a8101bf0 0x7fe8a8102fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8adc9f640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a8100a00 0x7fe8a8104990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8ae4a0640 1 -- 172.21.15.73:0/3219531049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8a8101bf0 msgr2=0x7fe8a8102fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8ae4a0640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8a8101bf0 0x7fe8a8102fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8ae4a0640 1 -- 172.21.15.73:0/3219531049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a8100a00 msgr2=0x7fe8a8104990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8ae4a0640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a8100a00 0x7fe8a8104990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.219+0000 7fe8ae4a0640 1 -- 172.21.15.73:0/3219531049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a8103da0 con 0x7fe8a81025b0 2024-09-05T13:05:06.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.220+0000 7fe8ae4a0640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a81025b0 0x7fe8a8103510 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000eb10 tx=0x7fe8a000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.221+0000 7fe89effd640 1 -- 172.21.15.73:0/3219531049 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0004b20 con 0x7fe8a81025b0 2024-09-05T13:05:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.222+0000 7fe89effd640 1 -- 172.21.15.73:0/3219531049 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8a0004cc0 con 0x7fe8a81025b0 2024-09-05T13:05:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.222+0000 7fe8aff03640 1 -- 172.21.15.73:0/3219531049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a81a1f70 con 0x7fe8a81025b0 2024-09-05T13:05:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.222+0000 7fe89effd640 1 -- 172.21.15.73:0/3219531049 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0010760 con 0x7fe8a81025b0 2024-09-05T13:05:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.222+0000 7fe8aff03640 1 -- 172.21.15.73:0/3219531049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a81a2430 con 0x7fe8a81025b0 2024-09-05T13:05:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.223+0000 7fe8aff03640 1 -- 172.21.15.73:0/3219531049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a81a2720 con 0x7fe8a81025b0 2024-09-05T13:05:06.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.224+0000 7fe89effd640 1 -- 172.21.15.73:0/3219531049 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe8a0005000 con 0x7fe8a81025b0 2024-09-05T13:05:06.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.225+0000 7fe89effd640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8940a2c10 0x7fe8940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.225+0000 7fe8adc9f640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8940a2c10 0x7fe8940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.225+0000 7fe89effd640 1 -- 172.21.15.73:0/3219531049 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fe8a00cfc40 con 0x7fe8a81025b0 2024-09-05T13:05:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.225+0000 7fe8adc9f640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8940a2c10 0x7fe8940a50d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8101a50 tx=0x7fe8a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:06.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.228+0000 7fe89effd640 1 -- 172.21.15.73:0/3219531049 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8a009cbd0 con 0x7fe8a81025b0 2024-09-05T13:05:06.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.399+0000 7fe8aff03640 1 -- 172.21.15.73:0/3219531049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe8a81a2ab0 con 0x7fe8a81025b0 2024-09-05T13:05:06.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.399+0000 7fe89effd640 1 -- 172.21.15.73:0/3219531049 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7fe8a009c4d0 con 0x7fe8a81025b0 2024-09-05T13:05:06.401 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-09-05T13:05:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 -- 172.21.15.73:0/3219531049 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8940a2c10 msgr2=0x7fe8940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8940a2c10 0x7fe8940a50d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8101a50 tx=0x7fe8a4005f90 comp rx=0 tx=0).stop 2024-09-05T13:05:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 -- 172.21.15.73:0/3219531049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a81025b0 msgr2=0x7fe8a8103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a81025b0 0x7fe8a8103510 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000eb10 tx=0x7fe8a000c2d0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 -- 172.21.15.73:0/3219531049 shutdown_connections 2024-09-05T13:05:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fe8940a2c10 0x7fe8940a50d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a81025b0 0x7fe8a8103510 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8a8101bf0 0x7fe8a8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 --2- 172.21.15.73:0/3219531049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a8100a00 0x7fe8a8104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 -- 172.21.15.73:0/3219531049 >> 172.21.15.73:0/3219531049 conn(0x7fe8a80fc140 msgr2=0x7fe8a8069330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:06.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 -- 172.21.15.73:0/3219531049 shutdown_connections 2024-09-05T13:05:06.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.401+0000 7fe8aff03640 1 -- 172.21.15.73:0/3219531049 wait complete. 2024-09-05T13:05:06.412 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:06 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2184046196' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T13:05:06.413 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:06 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1218639613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T13:05:06.413 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:06 smithi073 ceph-mon[30883]: pgmap v553: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:06.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-05T13:05:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.516+0000 7feac821e640 1 -- 172.21.15.73:0/716707377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac0101bf0 msgr2=0x7feac0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.516+0000 7feac821e640 1 --2- 172.21.15.73:0/716707377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac0101bf0 0x7feac0102070 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7feab0009900 tx=0x7feab002a410 comp rx=0 tx=0).stop 2024-09-05T13:05:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.516+0000 7feac821e640 1 -- 172.21.15.73:0/716707377 shutdown_connections 2024-09-05T13:05:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.516+0000 7feac821e640 1 --2- 172.21.15.73:0/716707377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac01025b0 0x7feac0108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.516+0000 7feac821e640 1 --2- 172.21.15.73:0/716707377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac0101bf0 0x7feac0102070 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.516+0000 7feac821e640 1 --2- 172.21.15.73:0/716707377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feac0100a00 0x7feac0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.516+0000 7feac821e640 1 -- 172.21.15.73:0/716707377 >> 172.21.15.73:0/716707377 conn(0x7feac00fc140 msgr2=0x7feac00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.516+0000 7feac821e640 1 -- 172.21.15.73:0/716707377 shutdown_connections 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.516+0000 7feac821e640 1 -- 172.21.15.73:0/716707377 wait complete. 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac821e640 1 Processor -- start 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac821e640 1 -- start start 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac821e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac0100a00 0x7feac019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac821e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0101bf0 0x7feac019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac821e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feac01025b0 0x7feac01a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac821e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feac010d7d0 con 0x7feac0100a00 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac821e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feac010d650 con 0x7feac0101bf0 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac821e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feac010d950 con 0x7feac01025b0 2024-09-05T13:05:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac5fba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac0100a00 0x7feac019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac5fba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac0100a00 0x7feac019a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36780/0 (socket says 172.21.15.73:36780) 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac5fba640 1 -- 172.21.15.73:0/3687646576 learned_addr learned my addr 172.21.15.73:0/3687646576 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac67bb640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feac01025b0 0x7feac01a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.517+0000 7feac57b9640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0101bf0 0x7feac019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feac5fba640 1 -- 172.21.15.73:0/3687646576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feac01025b0 msgr2=0x7feac01a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feac5fba640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feac01025b0 0x7feac01a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feac5fba640 1 -- 172.21.15.73:0/3687646576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0101bf0 msgr2=0x7feac019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feac5fba640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0101bf0 0x7feac019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feac5fba640 1 -- 172.21.15.73:0/3687646576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac01a1cb0 con 0x7feac0100a00 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feac57b9640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0101bf0 0x7feac019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:05:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feac5fba640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac0100a00 0x7feac019a090 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7feabc00e9c0 tx=0x7feabc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feab6ffd640 1 -- 172.21.15.73:0/3687646576 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc00cd80 con 0x7feac0100a00 2024-09-05T13:05:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feab6ffd640 1 -- 172.21.15.73:0/3687646576 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feabc0035f0 con 0x7feac0100a00 2024-09-05T13:05:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feac821e640 1 -- 172.21.15.73:0/3687646576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac01a1fa0 con 0x7feac0100a00 2024-09-05T13:05:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feab6ffd640 1 -- 172.21.15.73:0/3687646576 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc010690 con 0x7feac0100a00 2024-09-05T13:05:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.518+0000 7feac821e640 1 -- 172.21.15.73:0/3687646576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac01a23b0 con 0x7feac0100a00 2024-09-05T13:05:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.519+0000 7feac821e640 1 -- 172.21.15.73:0/3687646576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac01a2640 con 0x7feac0100a00 2024-09-05T13:05:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.520+0000 7feab6ffd640 1 -- 172.21.15.73:0/3687646576 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7feabc0037a0 con 0x7feac0100a00 2024-09-05T13:05:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.521+0000 7feab6ffd640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feaac0a2b90 0x7feaac0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.521+0000 7feac57b9640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feaac0a2b90 0x7feaac0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.521+0000 7feab6ffd640 1 -- 172.21.15.73:0/3687646576 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7feabc0cf4b0 con 0x7feac0100a00 2024-09-05T13:05:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.522+0000 7feac57b9640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feaac0a2b90 0x7feaac0a5050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feab0000c00 tx=0x7feab00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.525+0000 7feab6ffd640 1 -- 172.21.15.73:0/3687646576 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feabc09c440 con 0x7feac0100a00 2024-09-05T13:05:06.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:06 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2184046196' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T13:05:06.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:06 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1218639613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T13:05:06.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:06 smithi162 ceph-mon[34220]: pgmap v553: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:06.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:06 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2184046196' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T13:05:06.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:06 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1218639613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T13:05:06.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:06 smithi169 ceph-mon[34823]: pgmap v553: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:06.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.697+0000 7feac821e640 1 -- 172.21.15.73:0/3687646576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feac01a2810 con 0x7feac0100a00 2024-09-05T13:05:06.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.698+0000 7feab6ffd640 1 -- 172.21.15.73:0/3687646576 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7feabc09bd40 con 0x7feac0100a00 2024-09-05T13:05:06.699 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-09-05T13:05:06.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 -- 172.21.15.73:0/3687646576 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feaac0a2b90 msgr2=0x7feaac0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feaac0a2b90 0x7feaac0a5050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feab0000c00 tx=0x7feab00095f0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 -- 172.21.15.73:0/3687646576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac0100a00 msgr2=0x7feac019a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac0100a00 0x7feac019a090 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7feabc00e9c0 tx=0x7feabc00ee80 comp rx=0 tx=0).stop 2024-09-05T13:05:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 -- 172.21.15.73:0/3687646576 shutdown_connections 2024-09-05T13:05:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7feaac0a2b90 0x7feaac0a5050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feac01025b0 0x7feac01a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0101bf0 0x7feac019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 --2- 172.21.15.73:0/3687646576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac0100a00 0x7feac019a090 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 -- 172.21.15.73:0/3687646576 >> 172.21.15.73:0/3687646576 conn(0x7feac00fc140 msgr2=0x7feac0107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 -- 172.21.15.73:0/3687646576 shutdown_connections 2024-09-05T13:05:06.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.700+0000 7feac821e640 1 -- 172.21.15.73:0/3687646576 wait complete. 2024-09-05T13:05:06.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-05T13:05:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.811+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3925176161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a6c100a30 msgr2=0x7f7a6c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.811+0000 7f7a73ddd640 1 --2- 172.21.15.73:0/3925176161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a6c100a30 0x7f7a6c100e30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009ca0 tx=0x7f7a5c02a8c0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3925176161 shutdown_connections 2024-09-05T13:05:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 --2- 172.21.15.73:0/3925176161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a6c1025e0 0x7f7a6c108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 --2- 172.21.15.73:0/3925176161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a6c101c20 0x7f7a6c1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 --2- 172.21.15.73:0/3925176161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a6c100a30 0x7f7a6c100e30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3925176161 >> 172.21.15.73:0/3925176161 conn(0x7f7a6c0fc190 msgr2=0x7f7a6c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3925176161 shutdown_connections 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3925176161 wait complete. 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 Processor -- start 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 -- start start 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a6c100a30 0x7f7a6c197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a6c101c20 0x7f7a6c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a6c1025e0 0x7f7a6c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c10d800 con 0x7f7a6c101c20 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c10d680 con 0x7f7a6c100a30 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a73ddd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c10d980 con 0x7f7a6c1025e0 2024-09-05T13:05:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.812+0000 7f7a71378640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a6c101c20 0x7f7a6c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a71378640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a6c101c20 0x7f7a6c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36800/0 (socket says 172.21.15.73:36800) 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a71378640 1 -- 172.21.15.73:0/3254364068 learned_addr learned my addr 172.21.15.73:0/3254364068 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a7237a640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a6c1025e0 0x7f7a6c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a71b79640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a6c100a30 0x7f7a6c197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a71378640 1 -- 172.21.15.73:0/3254364068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a6c1025e0 msgr2=0x7f7a6c19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a71378640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a6c1025e0 0x7f7a6c19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a71378640 1 -- 172.21.15.73:0/3254364068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a6c100a30 msgr2=0x7f7a6c197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a71378640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a6c100a30 0x7f7a6c197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a71378640 1 -- 172.21.15.73:0/3254364068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c19fad0 con 0x7f7a6c101c20 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a71b79640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a6c100a30 0x7f7a6c197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a71378640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a6c101c20 0x7f7a6c1983f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000d770 tx=0x7f7a6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a6affd640 1 -- 172.21.15.73:0/3254364068 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60017070 con 0x7f7a6c101c20 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a6affd640 1 -- 172.21.15.73:0/3254364068 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a60005500 con 0x7f7a6c101c20 2024-09-05T13:05:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a6affd640 1 -- 172.21.15.73:0/3254364068 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60004e00 con 0x7f7a6c101c20 2024-09-05T13:05:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3254364068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6c19fdc0 con 0x7f7a6c101c20 2024-09-05T13:05:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.813+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3254364068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6c1a0230 con 0x7f7a6c101c20 2024-09-05T13:05:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.814+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3254364068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6c107e70 con 0x7f7a6c101c20 2024-09-05T13:05:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.815+0000 7f7a6affd640 1 -- 172.21.15.73:0/3254364068 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7a60004fa0 con 0x7f7a6c101c20 2024-09-05T13:05:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.816+0000 7f7a6affd640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7a540a2b90 0x7f7a540a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.817+0000 7f7a71b79640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7a540a2b90 0x7f7a540a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.817+0000 7f7a6affd640 1 -- 172.21.15.73:0/3254364068 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f7a600cef50 con 0x7f7a6c101c20 2024-09-05T13:05:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.817+0000 7f7a71b79640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7a540a2b90 0x7f7a540a5050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c006010 tx=0x7f7a5c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:06.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:06.820+0000 7f7a6affd640 1 -- 172.21.15.73:0/3254364068 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a6009be80 con 0x7f7a6c101c20 2024-09-05T13:05:07.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.033+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3254364068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f7a6c062e90 con 0x7f7a6c101c20 2024-09-05T13:05:07.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.041+0000 7f7a6affd640 1 -- 172.21.15.73:0/3254364068 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740370 (secure 0 0 0) 0x7f7a6009b780 con 0x7f7a6c101c20 2024-09-05T13:05:07.052 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T13:05:07.052 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 18, 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: "active_gid": 14150, 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: "active_name": "x", 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: "active_addrs": { 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6800", 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3294068694 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6801", 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3294068694 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: "active_addr": "172.21.15.73:6801/3294068694", 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: "active_change": "2024-09-05T12:49:03.895149+0000", 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: "active_mgr_features": 4540701547738038271, 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: "available": true, 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: "standbys": [ 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: "gid": 24112, 2024-09-05T13:05:07.054 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "z", 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_features": 4540701547738038271, 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.055 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.056 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.057 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.059 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2024-09-05T13:05:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2024-09-05T13:05:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-05T13:05:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2024-09-05T13:05:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2024-09-05T13:05:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T13:05:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T13:05:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2024-09-05T13:05:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "read", 2024-09-05T13:05:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap", 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap-read" 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2024-09-05T13:05:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2024-09-05T13:05:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm_log_destination": { 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm_log_destination", 2024-09-05T13:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "file", 2024-09-05T13:05:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "file,syslog", 2024-09-05T13:05:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "syslog" 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2024-09-05T13:05:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2024-09-05T13:05:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2024-09-05T13:05:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2024-09-05T13:05:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-05T13:05:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2024-09-05T13:05:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_nvmeof": { 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_nvmeof", 2024-09-05T13:05:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Nvme-of container image", 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2024-09-05T13:05:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_samba": { 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_samba", 2024-09-05T13:05:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Samba/SMB container image", 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-05T13:05:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-05T13:05:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2024-09-05T13:05:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2024-09-05T13:05:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "grafana_dashboards_path": { 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "grafana_dashboards_path", 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "hw_monitoring": { 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hw_monitoring", 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "inventory_list_all": { 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "inventory_list_all", 2024-09-05T13:05:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "oob_default_addr": { 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "oob_default_addr", 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "169.254.1.1", 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-05T13:05:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-05T13:05:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.183 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.184 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-05T13:05:07.185 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2024-09-05T13:05:07.186 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-05T13:05:07.187 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-05T13:05:07.188 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.189 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.190 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.191 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.192 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.194 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.196 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.198 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.199 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.201 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.202 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.203 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.204 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-05T13:05:07.205 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-05T13:05:07.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2024-09-05T13:05:07.207 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.208 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.211 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2024-09-05T13:05:07.211 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-05T13:05:07.211 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.211 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.211 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.211 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.211 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.211 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.211 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.211 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.212 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.213 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.214 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.215 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.216 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.217 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.219 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.220 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.221 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.223 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.224 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.226 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.227 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.228 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.230 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2024-09-05T13:05:07.231 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.232 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.233 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.234 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.236 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.238 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.240 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.241 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2024-09-05T13:05:07.242 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2024-09-05T13:05:07.243 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2024-09-05T13:05:07.244 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-05T13:05:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.246 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.247 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.248 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.249 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.250 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.251 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.253 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.254 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.255 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.256 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.257 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2024-09-05T13:05:07.258 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.259 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.261 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-05T13:05:07.262 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.263 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.264 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.266 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.267 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2024-09-05T13:05:07.268 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2024-09-05T13:05:07.269 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T13:05:07.270 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-05T13:05:07.271 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.273 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.274 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.275 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.276 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.279 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.281 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.282 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.284 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "k8sevents", 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.285 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_event_retention_days": { 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ceph_event_retention_days", 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7", 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.286 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "config_check_secs": { 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_check_secs", 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "10", 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-05T13:05:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.288 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.289 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.289 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.289 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.289 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.292 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.292 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.292 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.292 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.292 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.293 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.294 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.295 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.296 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.297 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.298 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.299 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.300 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.302 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-05T13:05:07.303 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.304 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.305 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.306 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2024-09-05T13:05:07.307 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mds_autoscaler", 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.308 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.309 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.311 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.311 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.311 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.311 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.311 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.311 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.311 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.311 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.313 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2024-09-05T13:05:07.314 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.315 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.316 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.319 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.321 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.322 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.323 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.324 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.325 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.326 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.327 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.328 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.328 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.328 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.328 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.328 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.328 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.328 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.328 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.328 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.329 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.330 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.332 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.334 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.335 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.336 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.337 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.338 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.339 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.340 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.341 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.349 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.351 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.352 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.353 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.354 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.355 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.356 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.358 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.359 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.360 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.361 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.362 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.363 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.364 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.365 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.366 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.367 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.369 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.370 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.371 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.373 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.374 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.375 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.376 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.377 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.379 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.381 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.382 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.384 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.385 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.386 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2024-09-05T13:05:07.387 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.389 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.390 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.391 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.391 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.391 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.391 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.391 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.391 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.391 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.391 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.392 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.393 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.394 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.395 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.396 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.397 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rgw", 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.398 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.399 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.400 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.401 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.402 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.403 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rook", 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.404 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.406 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.407 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.409 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "storage_class": { 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "storage_class", 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "local", 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.410 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.411 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.412 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.413 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.414 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.417 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.418 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.419 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.420 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.422 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.423 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.424 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.425 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.426 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2024-09-05T13:05:07.427 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.428 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.429 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.430 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.431 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.432 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.433 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.435 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.436 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2024-09-05T13:05:07.437 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.438 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.440 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.443 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.444 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.445 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.446 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.448 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-05T13:05:07.449 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2024-09-05T13:05:07.450 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.451 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.452 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.453 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.454 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.455 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.457 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.458 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.459 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.460 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.462 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.463 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.464 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.465 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2024-09-05T13:05:07.466 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.467 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.468 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.469 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.470 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.472 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.473 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.474 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.475 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.476 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.477 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.478 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.479 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.480 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.481 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.482 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.483 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.484 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.485 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.486 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.487 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.489 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.490 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "periodic_async_work": { 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "periodic_async_work", 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Periodically check for async work", 2024-09-05T13:05:07.491 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.492 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_no_wait": { 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_no_wait", 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.496 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.496 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-05T13:05:07.496 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2024-09-05T13:05:07.497 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2024-09-05T13:05:07.498 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.499 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.500 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.501 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.502 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.503 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.504 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2024-09-05T13:05:07.505 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2024-09-05T13:05:07.506 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: "gid": 24116, 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "y", 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_features": 4540701547738038271, 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2024-09-05T13:05:07.509 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2024-09-05T13:05:07.510 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.511 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.512 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.512 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.512 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.512 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.512 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.512 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.512 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.512 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.512 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.512 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.513 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.514 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.515 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.516 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2024-09-05T13:05:07.517 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2024-09-05T13:05:07.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2024-09-05T13:05:07.519 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2024-09-05T13:05:07.520 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2024-09-05T13:05:07.521 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2024-09-05T13:05:07.522 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2024-09-05T13:05:07.523 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.526 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-05T13:05:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:07.528 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.529 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2024-09-05T13:05:07.530 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.531 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.532 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.533 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.536 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.537 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.538 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.539 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "read", 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap", 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap-read" 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.540 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-05T13:05:07.541 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.542 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-05T13:05:07.543 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.544 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.546 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.547 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2024-09-05T13:05:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.549 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm_log_destination": { 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm_log_destination", 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "file", 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "file,syslog", 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: "syslog" 2024-09-05T13:05:07.552 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.553 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.555 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-05T13:05:07.556 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-05T13:05:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.558 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-05T13:05:07.559 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.560 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.561 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.562 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.563 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.564 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2024-09-05T13:05:07.565 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.566 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_nvmeof": { 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_nvmeof", 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.567 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Nvme-of container image", 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.568 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.569 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_samba": { 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_samba", 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.570 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Samba/SMB container image", 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.571 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2024-09-05T13:05:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2024-09-05T13:05:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2024-09-05T13:05:07.574 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2024-09-05T13:05:07.575 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.576 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.577 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.578 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "grafana_dashboards_path": { 2024-09-05T13:05:07.579 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "grafana_dashboards_path", 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.580 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.581 INFO:teuthology.orchestra.run.smithi073.stdout: "hw_monitoring": { 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hw_monitoring", 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.582 INFO:teuthology.orchestra.run.smithi073.stdout: "inventory_list_all": { 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "inventory_list_all", 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.583 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.584 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.585 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.586 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.587 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.588 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.589 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.590 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.591 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.592 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.593 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.594 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.595 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "oob_default_addr": { 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "oob_default_addr", 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "169.254.1.1", 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.596 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.597 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.598 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.599 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.600 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.601 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.602 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.603 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.604 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.605 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.606 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.607 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.608 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.609 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.612 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.613 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.614 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.615 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.616 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2024-09-05T13:05:07.618 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.620 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.621 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.622 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.623 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.624 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.625 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.626 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.627 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.629 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.630 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.631 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.632 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.633 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.634 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.635 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.636 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.637 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.638 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.639 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.640 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.641 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.642 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.643 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.644 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.645 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.646 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.648 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.649 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.650 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.651 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.652 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.653 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.654 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.655 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.656 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.658 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.659 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.660 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.661 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.663 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2024-09-05T13:05:07.665 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-05T13:05:07.666 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.667 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.668 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.669 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.670 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.671 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2024-09-05T13:05:07.672 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.673 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.678 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2024-09-05T13:05:07.679 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-05T13:05:07.680 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.681 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.682 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.684 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.685 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.688 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.689 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.690 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.691 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.692 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.693 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.694 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.695 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.696 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.697 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.697 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.697 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.697 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.697 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.697 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.697 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.697 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.700 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.700 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.700 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.700 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.700 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.702 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.703 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.704 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.705 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.706 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.707 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.708 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2024-09-05T13:05:07.709 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.710 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.712 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.714 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.715 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.716 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.717 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.718 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.719 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.720 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.721 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.722 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.723 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.724 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.726 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.727 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.728 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.730 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.731 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.733 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.734 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "k8sevents", 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_event_retention_days": { 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ceph_event_retention_days", 2024-09-05T13:05:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7", 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "config_check_secs": { 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_check_secs", 2024-09-05T13:05:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "10", 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.751 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.752 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.752 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2024-09-05T13:05:07.752 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.752 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.752 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.752 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2024-09-05T13:05:07.752 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.752 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.752 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.753 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-05T13:05:07.754 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mds_autoscaler", 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.755 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.756 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.757 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.759 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.761 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.762 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.763 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.764 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.765 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.766 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.767 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.768 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.769 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.770 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.771 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.772 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.773 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.776 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.777 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.778 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.780 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.781 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.782 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.783 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.784 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.785 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.786 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.787 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.789 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.790 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.791 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.792 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.793 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.794 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.795 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.796 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.797 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.799 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.800 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.801 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.803 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.804 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.805 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2024-09-05T13:05:07.807 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2024-09-05T13:05:07.808 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2024-09-05T13:05:07.809 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.810 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.811 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.813 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.814 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.817 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-05T13:05:07.818 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-05T13:05:07.819 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2024-09-05T13:05:07.820 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-05T13:05:07.821 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.822 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.824 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.826 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.827 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.828 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.829 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.830 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.831 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.832 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.833 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.834 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.835 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.836 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.837 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.838 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.839 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.840 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.841 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rgw", 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.843 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rook", 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.851 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.852 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "storage_class": { 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "storage_class", 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "local", 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.855 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.856 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.857 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.858 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.859 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.860 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.861 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.862 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.863 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.864 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.865 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.866 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2024-09-05T13:05:07.868 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.869 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.870 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.871 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.873 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.875 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.876 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.877 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.878 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.879 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.880 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.882 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.883 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.884 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.885 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.887 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.888 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.890 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.891 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.892 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-05T13:05:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2024-09-05T13:05:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "periodic_async_work": { 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "periodic_async_work", 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Periodically check for async work", 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_no_wait": { 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_no_wait", 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-05T13:05:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.943 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.945 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.946 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.947 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.948 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.949 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: "modules": [ 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: "dashboard", 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: "iostat", 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: "nfs", 2024-09-05T13:05:07.950 INFO:teuthology.orchestra.run.smithi073.stdout: "restful" 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.951 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2024-09-05T13:05:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T13:05:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-05T13:05:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2024-09-05T13:05:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "read", 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap", 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap-read" 2024-09-05T13:05:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-05T13:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-05T13:05:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-05T13:05:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-05T13:05:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2024-09-05T13:05:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2024-09-05T13:05:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm_log_destination": { 2024-09-05T13:05:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm_log_destination", 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "file", 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "file,syslog", 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "syslog" 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2024-09-05T13:05:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_nvmeof": { 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_nvmeof", 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Nvme-of container image", 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-05T13:05:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-05T13:05:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_samba": { 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_samba", 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Samba/SMB container image", 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2024-09-05T13:05:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2024-09-05T13:05:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2024-09-05T13:05:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2024-09-05T13:05:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2024-09-05T13:05:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "grafana_dashboards_path": { 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "grafana_dashboards_path", 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "hw_monitoring": { 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hw_monitoring", 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "inventory_list_all": { 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "inventory_list_all", 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2024-09-05T13:05:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2024-09-05T13:05:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "oob_default_addr": { 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "oob_default_addr", 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "169.254.1.1", 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2024-09-05T13:05:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2024-09-05T13:05:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2024-09-05T13:05:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2024-09-05T13:05:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2024-09-05T13:05:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2024-09-05T13:05:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-05T13:05:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-05T13:05:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2024-09-05T13:05:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-05T13:05:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2024-09-05T13:05:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2024-09-05T13:05:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2024-09-05T13:05:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2024-09-05T13:05:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.111 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.112 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.113 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.115 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.116 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.117 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.118 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.119 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.120 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.121 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.122 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.124 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.125 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.126 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.127 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.128 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.129 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.130 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.131 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.132 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-05T13:05:08.133 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.134 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.135 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.136 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.137 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.138 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.139 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.141 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.142 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.143 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.144 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.145 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.146 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2024-09-05T13:05:08.147 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.149 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.150 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.153 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.154 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.155 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.156 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.158 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.159 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.160 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.161 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.162 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.163 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.164 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.165 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.166 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.167 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.168 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.169 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.171 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.173 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.174 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "k8sevents", 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_event_retention_days": { 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ceph_event_retention_days", 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7", 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.175 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "config_check_secs": { 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_check_secs", 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "10", 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.176 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.178 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.179 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.180 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.181 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2024-09-05T13:05:08.182 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.183 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.184 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.185 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.186 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.187 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.188 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.189 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.190 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.191 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.192 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.193 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mds_autoscaler", 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.194 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.195 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.200 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.201 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.202 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.203 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.204 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.205 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.207 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.208 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.209 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.210 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.211 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.212 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.213 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.214 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.215 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.216 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.218 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.220 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.221 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.222 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.223 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.225 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.226 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.227 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.228 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.229 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.230 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.231 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.232 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.233 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2024-09-05T13:05:08.236 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.237 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.238 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.239 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.240 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.241 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.242 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.243 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.244 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.246 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2024-09-05T13:05:08.247 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.248 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.249 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.250 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.251 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.253 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.255 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.256 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.257 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-05T13:05:08.258 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-05T13:05:08.259 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.260 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.261 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.262 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.263 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.264 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.265 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.266 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.267 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.268 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.269 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.270 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.271 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.272 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-05T13:05:08.273 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.274 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.275 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.276 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.277 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.278 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.279 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rgw", 2024-09-05T13:05:08.281 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.282 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.283 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.284 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.285 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.286 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rook", 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.287 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.288 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.289 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.290 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.291 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.292 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "storage_class": { 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "storage_class", 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "local", 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.293 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.294 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.295 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.296 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.297 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.298 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2024-09-05T13:05:08.299 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2024-09-05T13:05:08.300 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.303 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.304 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.305 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.306 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.307 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.308 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.309 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.309 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.309 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2024-09-05T13:05:08.309 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2024-09-05T13:05:08.309 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.309 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.309 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.309 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.312 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.312 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.312 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.312 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.312 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.314 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2024-09-05T13:05:08.315 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2024-09-05T13:05:08.316 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.318 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.319 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.320 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.321 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.322 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.326 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.327 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.330 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.331 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.332 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.333 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.336 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.337 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.338 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.339 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.341 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.342 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.343 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-05T13:05:08.344 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.345 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.346 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.347 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.348 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.350 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.351 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.352 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.353 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.354 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.355 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.359 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.360 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.361 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.362 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-05T13:05:08.363 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.364 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.365 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.366 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.367 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.368 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.369 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.371 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.372 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.373 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.374 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.375 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.376 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "periodic_async_work": { 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "periodic_async_work", 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Periodically check for async work", 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.377 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.378 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_no_wait": { 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_no_wait", 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-05T13:05:08.379 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2024-09-05T13:05:08.380 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2024-09-05T13:05:08.381 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-05T13:05:08.382 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-05T13:05:08.383 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.384 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.385 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.386 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.387 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.388 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.390 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-05T13:05:08.391 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: "services": { 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: "dashboard": "https://172.21.15.73:8443/" 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: "always_on_modules": { 2024-09-05T13:05:08.392 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus": [ 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific": [ 2024-09-05T13:05:08.393 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy": [ 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2024-09-05T13:05:08.394 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "reef": [ 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2024-09-05T13:05:08.395 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "squid": [ 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2024-09-05T13:05:08.396 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: "last_failure_osd_epoch": 3, 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: "active_clients": [ 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.397 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1429723404 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "libcephsqlite", 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 559438885 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.398 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 4016443502 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.399 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2024-09-05T13:05:08.400 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-05T13:05:08.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-05T13:05:08.400 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-05T13:05:08.400 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2024-09-05T13:05:08.400 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3964851659 2024-09-05T13:05:08.400 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.400 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-05T13:05:08.400 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:08.400 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-05T13:05:08.400 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:05:08.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:07 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3219531049' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T13:05:08.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:07 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3687646576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T13:05:08.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:07 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3254364068' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-05T13:05:08.402 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:07 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3219531049' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T13:05:08.402 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:07 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3687646576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T13:05:08.402 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:07 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3254364068' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-05T13:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.046+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3254364068 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7a540a2b90 msgr2=0x7f7a540a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.046+0000 7f7a73ddd640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7a540a2b90 0x7f7a540a5050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c006010 tx=0x7f7a5c000f40 comp rx=0 tx=0).stop 2024-09-05T13:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.046+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3254364068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a6c101c20 msgr2=0x7f7a6c1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.046+0000 7f7a73ddd640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a6c101c20 0x7f7a6c1983f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000d770 tx=0x7f7a6000dc30 comp rx=0 tx=0).stop 2024-09-05T13:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.046+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3254364068 shutdown_connections 2024-09-05T13:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.046+0000 7f7a73ddd640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f7a540a2b90 0x7f7a540a5050 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.046+0000 7f7a73ddd640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a6c1025e0 0x7f7a6c19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.046+0000 7f7a73ddd640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a6c101c20 0x7f7a6c1983f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.046+0000 7f7a73ddd640 1 --2- 172.21.15.73:0/3254364068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a6c100a30 0x7f7a6c197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.046+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3254364068 >> 172.21.15.73:0/3254364068 conn(0x7f7a6c0fc190 msgr2=0x7f7a6c105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.047+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3254364068 shutdown_connections 2024-09-05T13:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:07.047+0000 7f7a73ddd640 1 -- 172.21.15.73:0/3254364068 wait complete. 2024-09-05T13:05:08.463 DEBUG:tasks.check_counter:Getting stats from a 2024-09-05T13:05:08.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-05T13:05:08.464 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:07 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3219531049' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T13:05:08.464 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:07 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3687646576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T13:05:08.464 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:07 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3254364068' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-05T13:05:08.490 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:08 smithi073 ceph-mon[30883]: pgmap v554: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T13:05:08.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:08 smithi162 ceph-mon[34220]: pgmap v554: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T13:05:08.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:08 smithi169 ceph-mon[34823]: pgmap v554: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T13:05:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:09.283 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:05:09.283 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:09.283 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 161, 2024-09-05T13:05:09.283 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 158, 2024-09-05T13:05:09.283 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 461808, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 96208, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 0, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.025110062, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.010253092, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.016670762, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 157, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.008215010, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000052324 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.284 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 461808, 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 96208 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 5, 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 121, 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 3184, 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 99920, 2024-09-05T13:05:09.285 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 3, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 2, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.011001974, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.006616217, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.003149046, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 120, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.010525742, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000087714 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:09.286 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 99920 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 0, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 2, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 0, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 0, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 2, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.000302585, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.000000000, 2024-09-05T13:05:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.000230142, 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:09.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 0, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:09.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:09.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:09.291 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 148967, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 29, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:09.292 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 928, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 2, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 162, 2024-09-05T13:05:09.293 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 439090, 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 162, 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 162, 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 439090, 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:09.294 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:05:10.000 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-05T13:05:10.000 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-05T13:05:10.000 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-05T13:05:10.000 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-05T13:05:10.000 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-05T13:05:10.000 DEBUG:tasks.check_counter:Getting stats from d 2024-09-05T13:05:10.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-05T13:05:10.290 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:10.770 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:05:10.770 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:10.770 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 170, 2024-09-05T13:05:10.770 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 165, 2024-09-05T13:05:10.770 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 466192, 2024-09-05T13:05:10.770 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 99856, 2024-09-05T13:05:10.770 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:10.770 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 0, 2024-09-05T13:05:10.770 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.027739081, 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.010905103, 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.019519956, 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 165, 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.014605659, 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000088519 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:10.771 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 466192, 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 99856 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1, 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 123, 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 160, 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 100176, 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 3, 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 2, 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.009199957, 2024-09-05T13:05:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.006498832, 2024-09-05T13:05:10.773 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.001326416, 2024-09-05T13:05:10.773 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:10.773 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:10.773 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 121, 2024-09-05T13:05:10.773 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.005774601, 2024-09-05T13:05:10.773 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000047723 2024-09-05T13:05:10.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 100176 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 0, 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 2, 2024-09-05T13:05:10.777 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 0, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 0, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 2, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.000394398, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.000000000, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.000318803, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:10.778 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 0, 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:10.779 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:10.780 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:10.781 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 148967, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 29, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-05T13:05:10.782 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 928, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 2, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-05T13:05:10.783 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 167, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 439740, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 167, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-05T13:05:10.784 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 167, 2024-09-05T13:05:10.785 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 439740, 2024-09-05T13:05:10.785 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-05T13:05:10.785 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:10.785 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:10.785 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:10.785 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:10.785 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:10.785 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:05:11.449 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:11 smithi073 ceph-mon[30883]: pgmap v555: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:11.478 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-05T13:05:11.479 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-05T13:05:11.479 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-05T13:05:11.479 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-05T13:05:11.479 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-05T13:05:11.479 DEBUG:tasks.check_counter:Getting stats from g 2024-09-05T13:05:11.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-05T13:05:11.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:11 smithi162 ceph-mon[34220]: pgmap v555: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:11.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:11 smithi169 ceph-mon[34823]: pgmap v555: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:11.726 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:12.257 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:05:12.257 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:12.257 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 0, 2024-09-05T13:05:12.257 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 2, 2024-09-05T13:05:12.257 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 0, 2024-09-05T13:05:12.257 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 0, 2024-09-05T13:05:12.257 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:12.257 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 0, 2024-09-05T13:05:12.257 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.001144350, 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.000000000, 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.000211167, 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 5, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 122, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 3184, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 100096, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 3, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 2, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.010681825, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.006403249, 2024-09-05T13:05:12.259 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.003144876, 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 121, 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.013823666, 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000114245 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-05T13:05:12.260 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 100096 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 162, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 159, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 462080, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 96848, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 2, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.024907317, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.010306765, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.018240906, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:12.261 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 158, 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.012476868, 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000078967 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 462080, 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 96848 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 0, 2024-09-05T13:05:12.262 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:12.263 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:12.264 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 149007, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 30, 2024-09-05T13:05:12.265 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-05T13:05:12.266 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 928, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 2, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 163, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 439220, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:12.267 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 163, 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 163, 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 439220, 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:12.268 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:05:12.946 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-05T13:05:12.946 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-05T13:05:12.946 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-05T13:05:12.946 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-05T13:05:12.946 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-05T13:05:12.946 DEBUG:tasks.check_counter:Getting stats from j 2024-09-05T13:05:12.946 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-05T13:05:13.193 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:13.469 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:13 smithi073 ceph-mon[30883]: pgmap v556: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:13.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:13 smithi162 ceph-mon[34220]: pgmap v556: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:13.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:13 smithi169 ceph-mon[34823]: pgmap v556: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:13.705 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-05T13:05:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 171, 2024-09-05T13:05:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 166, 2024-09-05T13:05:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 466464, 2024-09-05T13:05:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 100496, 2024-09-05T13:05:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 0, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.028306150, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.010114017, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.021685988, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 166, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.021812159, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000131398 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 466464, 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 100496 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1, 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 124, 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 160, 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 100352, 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 3, 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 2, 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.009076093, 2024-09-05T13:05:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.006883236, 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.001032326, 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 122, 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.005474025, 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000044869 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T13:05:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 100352 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 0, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 2, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 0, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 0, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 2, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.000235091, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.000000000, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.000169245, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 0, 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 148967, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 29, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 928, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 2, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 168, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 439870, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 168, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 168, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 439870, 2024-09-05T13:05:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-05T13:05:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-05T13:05:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-05T13:05:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-05T13:05:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-05T13:05:13.716 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-05T13:05:14.439 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-05T13:05:14.439 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-05T13:05:14.439 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-05T13:05:14.439 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-05T13:05:14.440 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-05T13:05:14.440 DEBUG:tasks.check_counter:Getting stats from b 2024-09-05T13:05:14.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-05T13:05:14.765 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T13:05:15.403 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 6617, 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 7478, 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 2013457, 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 14327165, 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 10, 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 5, 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.619460312, 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.309928107, 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.216346048, 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.086556589, 2024-09-05T13:05:15.404 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 7476, 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.560461169, 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000208729 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 6897, 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001921845, 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000278 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.405 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 4243, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 4280, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1421829, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 15746973, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 129, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 7, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.436291250, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.139238101, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.125017564, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.134243064, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4278, 2024-09-05T13:05:15.406 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.813985563, 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000424026 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 323, 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000049029, 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000151 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 60976, 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 324800 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 20640, 2024-09-05T13:05:15.407 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 28102, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 7808642, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 17493435, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 11, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 6, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 1.418779779, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.538397841, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 1.241310573, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.133041703, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 28102, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 5.293508038, 2024-09-05T13:05:15.408 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000188367 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 35967, 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.008294316, 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000230 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 605392, 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 114208 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-05T13:05:15.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 8732, 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 7.190912446, 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000823512 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2110, 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.133146494, 2024-09-05T13:05:15.410 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000063102 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 2822, 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 2816, 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2816, 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 147.707075344, 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.052452796 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 6, 2024-09-05T13:05:15.411 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 4, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 1, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 396, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 1, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 82, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 17, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 50, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 15, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 57, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 592, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 1, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 1, 2024-09-05T13:05:15.412 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 4, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 4035, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 3762, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 6, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 46, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 6, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 7, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 541, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 7, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 444, 2024-09-05T13:05:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 1864, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 4, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 234, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 1864, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 552, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 8, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 544, 2024-09-05T13:05:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 1312, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 4, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 458, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 6008, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 6, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 11736, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 10511, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 109, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 1271 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 173, 2024-09-05T13:05:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 334, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 9, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 837, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 767, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 61, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-05T13:05:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 8, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 7, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 1, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-05T13:05:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 14007, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 13268, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 13268, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 739, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 65, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 45, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 44, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 44, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 1, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 1, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-05T13:05:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 2, 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 33648660, 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 35056966, 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 0, 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4541, 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 75.470282473, 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.016619749 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 0 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 36, 2024-09-05T13:05:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 1186, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 1150, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 31, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 207, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 176, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 82, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 1991, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 1909, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 1, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 1234, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 1233, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 72700, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 231712 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 3880, 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 101, 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 2822, 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 20, 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 241, 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 765, 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.053292707, 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001376853 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 149, 2024-09-05T13:05:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.027941643, 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000187527 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 61, 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.044496833, 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000729456 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 534, 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 131.713062185, 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.246653674 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 105, 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.099987166, 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000952258 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 81, 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.070470737, 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000870009 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 173, 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.975091634, 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.005636367 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 113, 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 9.919510391, 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.087783277 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-05T13:05:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 99, 2024-09-05T13:05:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2.578497647, 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.026045430 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 7, 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.028432288, 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.004061755 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4, 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001237734, 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000309433 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 7, 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.019261423, 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002751631 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 13, 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.008378360, 2024-09-05T13:05:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000644489 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 705, 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.167414596, 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001655907 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-05T13:05:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-05T13:05:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 2, 2024-09-05T13:05:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-09-05T13:05:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-05T13:05:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-05T13:05:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 545, 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 545, 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 461, 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-05T13:05:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 306481, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 131, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7400, 2024-09-05T13:05:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 187611, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2326, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-05T13:05:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 9929, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 32275658, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 32, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 9929, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 9929, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 237.132185008, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.023882786 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 9929, 2024-09-05T13:05:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 12182 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 9929, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 1909, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 8020, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 287, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 637, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 32, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 4565, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 115, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-05T13:05:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 1, 2024-09-05T13:05:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 2045, 2024-09-05T13:05:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-05T13:05:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-05T13:05:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-05T13:05:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 1877, 2024-09-05T13:05:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 1274, 2024-09-05T13:05:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-05T13:05:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-05T13:05:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-05T13:05:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 6, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-05T13:05:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 82, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 4, 2024-09-05T13:05:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 12, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 12, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 1162, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 10, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 171 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 1, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 26, 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 10, 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 1519, 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 767, 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 31496, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 8387231, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 31496, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 31496, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 8387231, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-05T13:05:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-05T13:05:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-05T13:05:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-05T13:05:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 9929, 2024-09-05T13:05:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 32353065, 2024-09-05T13:05:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 9929, 2024-09-05T13:05:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 32353065, 2024-09-05T13:05:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-05T13:05:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-05T13:05:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 9929, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 9929, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 9929, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 9929, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 767, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 77475, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 767, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 24, 2024-09-05T13:05:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 77475, 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55c77fffe960": { 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 14007, 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 30862662, 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 14007, 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 4541, 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 30862662, 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:15.455 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-05T13:05:15.455 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:15 smithi162 ceph-mon[34220]: pgmap v557: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:15.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:15 smithi073 ceph-mon[30883]: pgmap v557: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:15.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:15 smithi169 ceph-mon[34823]: pgmap v557: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:16.451 INFO:tasks.check_counter:Daemon mds.b mds.exported=7 2024-09-05T13:05:16.451 INFO:tasks.check_counter:Daemon mds.b mds.imported=7 2024-09-05T13:05:16.451 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=173 2024-09-05T13:05:16.451 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-05T13:05:16.451 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=1 2024-09-05T13:05:16.452 DEBUG:tasks.check_counter:Getting stats from e 2024-09-05T13:05:16.452 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-05T13:05:16.707 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T13:05:17.258 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 678, 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 680, 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 4269358, 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 215668, 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.060015914, 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.020003332, 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.017425942, 2024-09-05T13:05:17.259 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.017028955, 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 678, 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.030449509, 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000044910 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:17.260 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 568, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 541, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 672262, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 218613, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.057871234, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.018787301, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.027846501, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.013681817, 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:17.261 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 540, 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.033605391, 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000062232 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 581712, 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 101584 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:17.262 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 526, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 647, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 178240, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 458366, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.065774556, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.022186285, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.018130812, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.019558340, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 646, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.046414826, 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000071849 2024-09-05T13:05:17.263 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 292688 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-05T13:05:17.264 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-05T13:05:17.265 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-05T13:05:17.265 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2729, 2024-09-05T13:05:17.265 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.070733101, 2024-09-05T13:05:17.265 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000025919 2024-09-05T13:05:17.265 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:17.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.265 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-05T13:05:17.265 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-05T13:05:17.265 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.266 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 52, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 52, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 52, 2024-09-05T13:05:17.267 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 1, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 1, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-05T13:05:17.268 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-05T13:05:17.269 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-05T13:05:17.270 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-05T13:05:17.271 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-05T13:05:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 3395, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-05T13:05:17.273 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 5, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 8287851, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 8286200, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 3395 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.274 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 4, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 77, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 73, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 2, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 16, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 14, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 52, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 125, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 73, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 51000, 2024-09-05T13:05:17.275 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 215328 2024-09-05T13:05:17.276 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.276 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-05T13:05:17.276 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-05T13:05:17.276 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-05T13:05:17.276 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-05T13:05:17.276 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-05T13:05:17.276 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.277 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-05T13:05:17.278 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.279 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.280 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-05T13:05:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.283 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-05T13:05:17.284 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-05T13:05:17.286 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.287 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.287 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.287 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-05T13:05:17.287 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.287 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.287 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.287 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-05T13:05:17.287 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-05T13:05:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 1, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 0, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 1490, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:17.289 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:17.290 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:17.291 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 190167, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 52, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-05T13:05:17.292 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7400, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 48656, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 236, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:17.293 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 1567, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 21, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 3, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 1567, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1567, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 41.188159370, 2024-09-05T13:05:17.294 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.026284721 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1567, 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1568 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 1567, 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 1567, 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-05T13:05:17.295 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 887, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 678, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-05T13:05:17.296 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 1, 2024-09-05T13:05:17.297 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-05T13:05:17.297 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-05T13:05:17.297 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-05T13:05:17.297 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-05T13:05:17.297 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-05T13:05:17.297 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-05T13:05:17.297 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-05T13:05:17.297 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-05T13:05:17.298 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 82, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 4, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 5, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 5, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-05T13:05:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-05T13:05:17.300 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 1768, 2024-09-05T13:05:17.301 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 4947549, 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 1768, 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1768, 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 4947549, 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-05T13:05:17.302 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 1567, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 4093552, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1567, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 4093552, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.303 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 1567, 2024-09-05T13:05:17.304 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 1567, 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1567, 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1567, 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:17.305 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:17.306 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55afaf800b40": { 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:17.307 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:17.308 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:17.308 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:17.308 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:17.308 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-05T13:05:17.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:17 smithi162 ceph-mon[34220]: pgmap v558: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:17.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:17 smithi073 ceph-mon[30883]: pgmap v558: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:17.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:17 smithi169 ceph-mon[34823]: pgmap v558: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:18.275 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-05T13:05:18.275 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-05T13:05:18.275 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-05T13:05:18.275 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-05T13:05:18.275 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-05T13:05:18.275 DEBUG:tasks.check_counter:Getting stats from h 2024-09-05T13:05:18.275 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-05T13:05:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:05:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:18 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.537 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T13:05:18.550 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:05:18.550 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:18 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T13:05:18.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:18.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:18 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.024 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-05T13:05:19.024 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:19.024 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 5189, 2024-09-05T13:05:19.024 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 4303, 2024-09-05T13:05:19.024 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 2252598, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 5514113, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 18, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 7, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.380065078, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.156801302, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.221864104, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.037948424, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4305, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.243375435, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000056533 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 7098, 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001309012, 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000184 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 596064, 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 111216 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 826, 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 940, 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 312588, 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 656394, 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 8, 2024-09-05T13:05:19.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 5, 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.076079049, 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.021946981, 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.024078159, 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.024903887, 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 940, 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.081917532, 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000087146 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 104, 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000021461, 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000206 2024-09-05T13:05:19.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 292144 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 4608, 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 5158, 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1550537, 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 2086587, 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 20, 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 8, 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.345086097, 2024-09-05T13:05:19.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.107864986, 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.315703497, 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.023274836, 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 5152, 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.868327728, 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000168541 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 7101, 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001591846, 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000224 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:19.029 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1181, 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.828236003, 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000701300 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:19.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.031 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-05T13:05:19.031 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-05T13:05:19.031 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-05T13:05:19.031 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1447, 2024-09-05T13:05:19.031 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.049023248, 2024-09-05T13:05:19.031 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000033879 2024-09-05T13:05:19.031 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:19.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.031 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-05T13:05:19.031 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 344, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 327, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 327, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 7.149592184, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.021864196 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 17, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 11, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-05T13:05:19.032 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 19, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 2, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 7, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 10, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 13, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 186, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 3, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 823, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 630, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 17, 2024-09-05T13:05:19.033 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 94, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 4, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 12, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 4, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 63, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 241, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 325, 2024-09-05T13:05:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 13424230409, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 241, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 241, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 26, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 225, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 742, 2024-09-05T13:05:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 3380, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 2855, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 34, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 90 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 269, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 181, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 170, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-05T13:05:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 51, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 51, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-05T13:05:19.037 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 4, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 3395, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 3395, 2024-09-05T13:05:19.038 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 5, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 5, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 8287851, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 0, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 417, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 7.743369244, 2024-09-05T13:05:19.039 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.018569230 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 0 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 23, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 173, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 150, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 22, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 117, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 95, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 19, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 307, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 288, 2024-09-05T13:05:19.040 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 107, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 107, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 55704, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 223520 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 579, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 14, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 344, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 8, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 83, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.041 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 93, 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 6.543767064, 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.070363086 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-05T13:05:19.042 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 124, 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.402102075, 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.003242758 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.043 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.044 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.045 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-05T13:05:19.045 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.045 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.045 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.045 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-05T13:05:19.045 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.045 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.046 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.046 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-05T13:05:19.046 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.046 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.046 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.046 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-05T13:05:19.046 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.046 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 53, 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.113654258, 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002144419 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-05T13:05:19.047 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 6, 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.003510996, 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000585166 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.048 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.049 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-05T13:05:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.051 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 51, 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.086557791, 2024-09-05T13:05:19.052 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001697211 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 1, 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 0, 2024-09-05T13:05:19.053 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 140, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 140, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 403, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:19.054 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:19.055 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:19.056 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 283271, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 115, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7400, 2024-09-05T13:05:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 93789, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 377, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-05T13:05:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 2222, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 4138343, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 32, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 2222, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2222, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 104.720891059, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.047129113 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2222, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2405 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 2222, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 243, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 1979, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 0, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 10, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 2, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 419, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 29, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-05T13:05:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 1365, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 241, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 20, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T13:05:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-05T13:05:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 82, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 4, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 12, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 12, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 253, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 0, 2024-09-05T13:05:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 66 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 1, 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 51, 2024-09-05T13:05:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 1, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 1353, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 51, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 10619, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 3144982, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 10619, 2024-09-05T13:05:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 10619, 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 3144982, 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2222, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 4143494, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2222, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 4143494, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2222, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 2222, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2222, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 2222, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 51, 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 5151, 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 51, 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-05T13:05:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2, 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 5151, 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x564651e80960": { 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 3395, 2024-09-05T13:05:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 4093547, 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 3395, 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 417, 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 4093547, 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:19.071 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-05T13:05:19.481 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:19 smithi162 ceph-mon[34220]: pgmap v559: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T13:05:19.481 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:19 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-05T13:05:19.481 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:19 smithi162 ceph-mon[34220]: Unable to set osd_memory_target on smithi169 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-05T13:05:19.481 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:19 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.481 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:19 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.481 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:19 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.481 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:19 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.481 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:19 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:05:19.481 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:19 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:05:19.481 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:19 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:05:19.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:19 smithi073 ceph-mon[30883]: pgmap v559: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T13:05:19.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:19 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-05T13:05:19.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:19 smithi073 ceph-mon[30883]: Unable to set osd_memory_target on smithi169 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-05T13:05:19.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:19 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:19 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:19 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:19 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:19 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:05:19.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:19 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:05:19.514 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:19 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:05:19.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:19 smithi169 ceph-mon[34823]: pgmap v559: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T13:05:19.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:19 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-05T13:05:19.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:19 smithi169 ceph-mon[34823]: Unable to set osd_memory_target on smithi169 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-05T13:05:19.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:19 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:19 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:19 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:19 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T13:05:19.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:19 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T13:05:19.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:19 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T13:05:19.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:19 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' 2024-09-05T13:05:19.767 INFO:tasks.check_counter:Daemon mds.h mds.exported=4 2024-09-05T13:05:19.768 INFO:tasks.check_counter:Daemon mds.h mds.imported=4 2024-09-05T13:05:19.768 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-05T13:05:19.768 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=269 2024-09-05T13:05:19.768 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-05T13:05:19.768 DEBUG:tasks.check_counter:Getting stats from k 2024-09-05T13:05:19.768 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-05T13:05:20.019 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T13:05:20.426 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:20 smithi162 ceph-mon[34220]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-05T13:05:20.426 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:20 smithi162 ceph-mon[34220]: Unable to set osd_memory_target on smithi162 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-05T13:05:20.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:20 smithi073 ceph-mon[30883]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-05T13:05:20.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:20 smithi073 ceph-mon[30883]: Unable to set osd_memory_target on smithi162 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-05T13:05:20.528 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 0, 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 2, 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 0, 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 0, 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.001160990, 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000000000, 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000320545, 2024-09-05T13:05:20.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.530 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 126, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 160, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 100704, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.007198589, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.004997634, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000822513, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 124, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.008188453, 2024-09-05T13:05:20.531 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000066035 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 100704 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 174, 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 169, 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 467280, 2024-09-05T13:05:20.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 102416, 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.029334012, 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.012472836, 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.020940160, 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 169, 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.017607382, 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000104185 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:20.533 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 467280, 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 102416 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:20.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:20.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 149007, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 30, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:20.537 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-05T13:05:20.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 171, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 440260, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 171, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 171, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 440260, 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-05T13:05:20.539 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-05T13:05:20.540 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-05T13:05:20.540 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-05T13:05:20.540 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:20.540 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-05T13:05:20.540 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-05T13:05:20.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:20 smithi169 ceph-mon[34823]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-05T13:05:20.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:20 smithi169 ceph-mon[34823]: Unable to set osd_memory_target on smithi162 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-05T13:05:21.220 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-05T13:05:21.220 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-05T13:05:21.220 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-05T13:05:21.220 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-05T13:05:21.221 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-05T13:05:21.221 DEBUG:tasks.check_counter:Getting stats from c 2024-09-05T13:05:21.221 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-05T13:05:21.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:21 smithi073 ceph-mon[30883]: pgmap v560: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:21.538 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T13:05:21.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:21 smithi162 ceph-mon[34220]: pgmap v560: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:21.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:21 smithi169 ceph-mon[34823]: pgmap v560: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:22.177 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-05T13:05:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 56, 2024-09-05T13:05:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 58, 2024-09-05T13:05:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 19167, 2024-09-05T13:05:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 17818, 2024-09-05T13:05:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 6, 2024-09-05T13:05:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 2, 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.011594973, 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.002046220, 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.002958997, 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.002484919, 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 56, 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.036408697, 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000650155 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 145, 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 142, 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1606622, 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 48513, 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-05T13:05:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.024132315, 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.011676084, 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.013080227, 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.002974796, 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 141, 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.015939210, 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000113044 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 168144, 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 11568 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 8, 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 19, 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 4579, 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 109460, 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 4, 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.005799384, 2024-09-05T13:05:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.000792247, 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.004849465, 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000118932, 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 18, 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.033743503, 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001874639 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-05T13:05:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 108496 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 281, 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.008768900, 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000031206 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-05T13:05:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 398, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 0, 2024-09-05T13:05:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 398, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 398, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 2, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-05T13:05:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 4, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 234, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-05T13:05:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T13:05:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-05T13:05:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-05T13:05:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-05T13:05:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 739, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 1, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 1, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 33648660, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 35056966, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 35054133, 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-05T13:05:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 739 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 19, 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 285, 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 266, 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 18, 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 94, 2024-09-05T13:05:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 76, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 398, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 589, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 191, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 48384, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 215328 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-05T13:05:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-05T13:05:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-05T13:05:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-05T13:05:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 1, 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 0, 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 0, 2024-09-05T13:05:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 1501, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 196798, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 57, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 7400, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 152, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 348446, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 2681, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 175, 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 26, 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 4, 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 175, 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 175, 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.236995037, 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001354257 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-05T13:05:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 175, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 176 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 175, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 175, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 106, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 66, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-05T13:05:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 2, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-05T13:05:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-05T13:05:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 0, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 6, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 6, 2024-09-05T13:05:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 205, 2024-09-05T13:05:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1607434, 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 205, 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 205, 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1607434, 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 175, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 1408316, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 175, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1408316, 2024-09-05T13:05:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 175, 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 175, 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 175, 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 175, 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-05T13:05:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x5578e9ffe6e0": { 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:22.226 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-05T13:05:22.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:22 smithi073 ceph-mon[30883]: pgmap v561: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:22.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:22 smithi162 ceph-mon[34220]: pgmap v561: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:22.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:22 smithi169 ceph-mon[34823]: pgmap v561: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:23.278 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-05T13:05:23.278 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-05T13:05:23.278 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-05T13:05:23.278 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-05T13:05:23.278 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-05T13:05:23.278 DEBUG:tasks.check_counter:Getting stats from f 2024-09-05T13:05:23.279 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-05T13:05:23.536 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T13:05:24.093 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-05T13:05:24.093 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:24.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 759, 2024-09-05T13:05:24.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 730, 2024-09-05T13:05:24.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 771152, 2024-09-05T13:05:24.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 278844, 2024-09-05T13:05:24.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 1, 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.087271628, 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.028564289, 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.038862089, 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.020306265, 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 730, 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.050003822, 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000068498 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.094 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 585008, 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 102672 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 3, 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 126, 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 716, 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 292938, 2024-09-05T13:05:24.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.007953042, 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.005131386, 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.001742913, 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000056063, 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 124, 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.006605114, 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000053267 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:24.096 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 292240 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1184, 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1186, 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 4460286, 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 376519, 2024-09-05T13:05:24.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:24.098 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-05T13:05:24.098 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.086392401, 2024-09-05T13:05:24.098 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.025267638, 2024-09-05T13:05:24.098 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.024338766, 2024-09-05T13:05:24.098 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.031454359, 2024-09-05T13:05:24.098 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:24.098 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1184, 2024-09-05T13:05:24.098 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.061271631, 2024-09-05T13:05:24.098 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000051749 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-05T13:05:24.099 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-05T13:05:24.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.100 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-05T13:05:24.100 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-05T13:05:24.100 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-05T13:05:24.100 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2920, 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.072206168, 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000024728 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:24.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-05T13:05:24.102 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 47, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 0, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 47, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 47, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 1, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-05T13:05:24.103 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-05T13:05:24.104 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-05T13:05:24.105 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-05T13:05:24.106 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-05T13:05:24.107 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-05T13:05:24.108 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 3291, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 5, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 2, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-05T13:05:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4194304, 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 8353817, 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 8352166, 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 3291 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 4, 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 331, 2024-09-05T13:05:24.110 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 327, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 2, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 92, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 90, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 47, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 536, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 489, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 50532, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 215328 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-05T13:05:24.111 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.112 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.114 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-05T13:05:24.115 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.117 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-05T13:05:24.117 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.117 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.117 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.117 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-05T13:05:24.117 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.117 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.117 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-05T13:05:24.120 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.121 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.122 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.123 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.123 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-05T13:05:24.123 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.123 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.123 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.123 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-05T13:05:24.123 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.123 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.124 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 2, 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 1, 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 1, 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 1501, 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.125 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:24.127 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:24.128 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:24.128 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:24.128 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:24.128 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:24.128 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:24.128 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:24.128 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-05T13:05:24.129 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:24.129 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:24.129 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:24.129 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:24.129 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 181303, 2024-09-05T13:05:24.129 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 46, 2024-09-05T13:05:24.129 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:24.129 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:24.129 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-05T13:05:24.130 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-05T13:05:24.130 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:24.130 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:24.130 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:24.130 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:24.130 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 7400, 2024-09-05T13:05:24.130 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 152, 2024-09-05T13:05:24.130 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:24.131 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:24.131 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:24.131 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-05T13:05:24.131 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 45136, 2024-09-05T13:05:24.131 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 216, 2024-09-05T13:05:24.131 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:24.131 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-05T13:05:24.131 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:24.131 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 1740, 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 21, 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 3, 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 1740, 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1740, 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 26.225438226, 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.015072090 2024-09-05T13:05:24.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1740, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1741 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 1740, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 1740, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 1010, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-05T13:05:24.133 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 728, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 1, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-05T13:05:24.134 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-05T13:05:24.135 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-05T13:05:24.135 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-05T13:05:24.135 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-05T13:05:24.135 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-05T13:05:24.135 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-05T13:05:24.135 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T13:05:24.135 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-05T13:05:24.135 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-05T13:05:24.136 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 82, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 4, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 4, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 4, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-05T13:05:24.137 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-05T13:05:24.138 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 1942, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 5044131, 2024-09-05T13:05:24.139 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:24.140 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 1942, 2024-09-05T13:05:24.140 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-05T13:05:24.140 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-05T13:05:24.140 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 1942, 2024-09-05T13:05:24.140 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 5044131, 2024-09-05T13:05:24.140 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:24.140 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.140 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.140 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 1740, 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 4159518, 2024-09-05T13:05:24.141 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 1740, 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 4159518, 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-05T13:05:24.142 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 1740, 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 1740, 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 1740, 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1740, 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-05T13:05:24.143 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:24.144 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x563fef00ab40": { 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-05T13:05:24.145 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:24.147 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-05T13:05:25.296 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-05T13:05:25.296 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-05T13:05:25.296 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-05T13:05:25.296 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-05T13:05:25.296 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-05T13:05:25.297 DEBUG:tasks.check_counter:Getting stats from i 2024-09-05T13:05:25.297 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-05T13:05:25.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:25 smithi073 ceph-mon[30883]: pgmap v562: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:25.559 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T13:05:25.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:25 smithi162 ceph-mon[34220]: pgmap v562: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:25.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:25 smithi169 ceph-mon[34823]: pgmap v562: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:26.131 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-05T13:05:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 4202, 2024-09-05T13:05:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 3654, 2024-09-05T13:05:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1669571, 2024-09-05T13:05:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 5651217, 2024-09-05T13:05:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 20, 2024-09-05T13:05:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 7, 2024-09-05T13:05:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.329521534, 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.106881625, 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.177749019, 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.055181036, 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3652, 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.274203249, 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000075083 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 5363, 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.001260131, 2024-09-05T13:05:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000234 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 4715, 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 5487, 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 2110281, 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 2233760, 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 14, 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 6, 2024-09-05T13:05:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.371872450, 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.121760198, 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.425175198, 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.026545981, 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 5487, 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.666082216, 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000121392 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 7254, 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.001634748, 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000225 2024-09-05T13:05:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 601248, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 112656 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 405, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 531, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 183816, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 543716, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 12, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 6, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.044938380, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.014740013, 2024-09-05T13:05:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.015350133, 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.011243904, 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 529, 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.050063075, 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000094637 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 108, 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000020391, 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000188 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 293936 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1144, 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.831930622, 2024-09-05T13:05:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000727212 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1341, 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.048956267, 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000036507 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 362, 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 347, 2024-09-05T13:05:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 347, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 3.309859569, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.009538500 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 15, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 11, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 15, 2024-09-05T13:05:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 0, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 5, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 10, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 13, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 466, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 2, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 2, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 3, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 856, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 675, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 14, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 99, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-05T13:05:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 1000, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 1, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 3, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 432, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 3, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 478, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 230, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 325, 2024-09-05T13:05:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 13424230409, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 230, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 230, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 44, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 342, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 514, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T13:05:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T13:05:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T13:05:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 3366, 2024-09-05T13:05:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 2781, 2024-09-05T13:05:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 39, 2024-09-05T13:05:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 75 2024-09-05T13:05:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-05T13:05:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 2, 2024-09-05T13:05:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 267, 2024-09-05T13:05:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 180, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 166, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 2, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 46, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 46, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-05T13:05:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 3, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-05T13:05:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 3291, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 3291, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 5, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 5, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 2, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-05T13:05:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4194304, 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 8353817, 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 0, 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 414, 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 12.574426143, 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.030373010 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 0 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 19, 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 354, 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 335, 2024-09-05T13:05:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 18, 2024-09-05T13:05:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 123, 2024-09-05T13:05:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 105, 2024-09-05T13:05:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 15, 2024-09-05T13:05:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 573, 2024-09-05T13:05:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 558, 2024-09-05T13:05:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 2, 2024-09-05T13:05:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 349, 2024-09-05T13:05:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 347, 2024-09-05T13:05:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 60684, 2024-09-05T13:05:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 223520 2024-09-05T13:05:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 603, 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 23, 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 362, 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 12, 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 92, 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-05T13:05:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 132, 2024-09-05T13:05:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2.930301679, 2024-09-05T13:05:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.022199255 2024-09-05T13:05:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-05T13:05:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-05T13:05:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 113, 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.219795700, 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001945094 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-05T13:05:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2, 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000183376, 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000091688 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 50, 2024-09-05T13:05:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.038535848, 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000770716 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 4, 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.002812835, 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000703208 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-05T13:05:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 46, 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.118230131, 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.002570220 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 2, 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 1, 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 1, 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 137, 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 137, 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 464, 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-05T13:05:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 291838, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 122, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 7400, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 152, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 77853, 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 341, 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 2093, 2024-09-05T13:05:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 4219172, 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 28, 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 2093, 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2093, 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 120.955448322, 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.057790467 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2093, 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2250 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 2093, 2024-09-05T13:05:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 233, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 1860, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 0, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 10, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 3, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 417, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 30, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 1266, 2024-09-05T13:05:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 230, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 20, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-05T13:05:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-05T13:05:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 82, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 4, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 12, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 12, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 217, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 0, 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 57 2024-09-05T13:05:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 1, 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 51, 2024-09-05T13:05:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 1, 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 1254, 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 46, 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 9318, 2024-09-05T13:05:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 3109800, 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 9318, 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 9318, 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 3109800, 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-05T13:05:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-05T13:05:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-05T13:05:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-05T13:05:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2093, 2024-09-05T13:05:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 4223818, 2024-09-05T13:05:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2093, 2024-09-05T13:05:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 4223818, 2024-09-05T13:05:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2093, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 2093, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2093, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 2093, 2024-09-05T13:05:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-05T13:05:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-05T13:05:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 46, 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 4646, 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 46, 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3, 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 4646, 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x5623e5d54960": { 2024-09-05T13:05:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-05T13:05:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 3291, 2024-09-05T13:05:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 4159513, 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 3291, 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 414, 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 4159513, 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:26.184 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-05T13:05:27.057 INFO:tasks.check_counter:Daemon mds.i mds.exported=3 2024-09-05T13:05:27.057 INFO:tasks.check_counter:Daemon mds.i mds.imported=3 2024-09-05T13:05:27.057 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=2 2024-09-05T13:05:27.057 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=267 2024-09-05T13:05:27.057 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-05T13:05:27.057 DEBUG:tasks.check_counter:Getting stats from l 2024-09-05T13:05:27.057 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-05T13:05:27.305 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T13:05:27.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:27 smithi169 ceph-mon[34823]: pgmap v563: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:27.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:27 smithi073 ceph-mon[30883]: pgmap v563: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:27.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:27 smithi162 ceph-mon[34220]: pgmap v563: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-05T13:05:27.817 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-05T13:05:27.817 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T13:05:27.817 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 0, 2024-09-05T13:05:27.817 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 2, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 0, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 0, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 0, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.001080457, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.000000000, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.000211073, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 172, 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 169, 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 464800, 2024-09-05T13:05:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 103248, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 2, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 1, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.025979808, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.011016597, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.019951955, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 168, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.011241799, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000066915 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 464800, 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 103248 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 5, 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 130, 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 3184, 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 101504, 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 3, 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 2, 2024-09-05T13:05:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.009592608, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.005641741, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.002764711, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 129, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.009970545, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000077291 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-05T13:05:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 101504 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 0, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T13:05:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T13:05:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-05T13:05:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 148984, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 30, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-05T13:05:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 928, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 2, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 173, 2024-09-05T13:05:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 440520, 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 173, 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 173, 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 440520, 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-05T13:05:27.828 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-05T13:05:28.602 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-05T13:05:28.602 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-05T13:05:28.602 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-05T13:05:28.602 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-05T13:05:28.602 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-05T13:05:28.603 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-05T13:05:28.613 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-05T13:05:28.613 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T13:05:28.613 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T13:05:28.642 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-05T13:05:28.642 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T13:05:28.702 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd blocklist ls 2024-09-05T13:05:29.009 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:29.399 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:29 smithi073 ceph-mon[30883]: pgmap v564: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T13:05:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.479+0000 7f0b40fb2640 1 -- 172.21.15.73:0/1992621163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b3c100a70 msgr2=0x7f0b3c10ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.479+0000 7f0b40fb2640 1 --2- 172.21.15.73:0/1992621163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b3c100a70 0x7f0b3c10ea60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009900 tx=0x7f0b2c02a410 comp rx=0 tx=0).stop 2024-09-05T13:05:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.480+0000 7f0b40fb2640 1 -- 172.21.15.73:0/1992621163 shutdown_connections 2024-09-05T13:05:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.480+0000 7f0b40fb2640 1 --2- 172.21.15.73:0/1992621163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b3c100a70 0x7f0b3c10ea60 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.480+0000 7f0b40fb2640 1 --2- 172.21.15.73:0/1992621163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b3c1000d0 0x7f0b3c100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.480+0000 7f0b40fb2640 1 --2- 172.21.15.73:0/1992621163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b3c106ba0 0x7f0b3c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.480+0000 7f0b40fb2640 1 -- 172.21.15.73:0/1992621163 >> 172.21.15.73:0/1992621163 conn(0x7f0b3c077210 msgr2=0x7f0b3c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.480+0000 7f0b40fb2640 1 -- 172.21.15.73:0/1992621163 shutdown_connections 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.480+0000 7f0b40fb2640 1 -- 172.21.15.73:0/1992621163 wait complete. 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.480+0000 7f0b40fb2640 1 Processor -- start 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.480+0000 7f0b40fb2640 1 -- start start 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b40fb2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b3c1000d0 0x7f0b3c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b40fb2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b3c100a70 0x7f0b3c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b40fb2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b3c106ba0 0x7f0b3c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b40fb2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c112130 con 0x7f0b3c106ba0 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b40fb2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c111fb0 con 0x7f0b3c100a70 2024-09-05T13:05:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b40fb2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c1122b0 con 0x7f0b3c1000d0 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b3ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b3c106ba0 0x7f0b3c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b3ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b3c106ba0 0x7f0b3c19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44554/0 (socket says 172.21.15.73:44554) 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b3ad9d640 1 -- 172.21.15.73:0/746518769 learned_addr learned my addr 172.21.15.73:0/746518769 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b39d9b640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b3c100a70 0x7f0b3c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b3a59c640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b3c1000d0 0x7f0b3c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b3ad9d640 1 -- 172.21.15.73:0/746518769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b3c1000d0 msgr2=0x7f0b3c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b3ad9d640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b3c1000d0 0x7f0b3c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b3ad9d640 1 -- 172.21.15.73:0/746518769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b3c100a70 msgr2=0x7f0b3c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b3ad9d640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b3c100a70 0x7f0b3c198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b3ad9d640 1 -- 172.21.15.73:0/746518769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c19d560 con 0x7f0b3c106ba0 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b39d9b640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b3c100a70 0x7f0b3c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:05:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.481+0000 7f0b3ad9d640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b3c106ba0 0x7f0b3c19ce80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c005ab0 tx=0x7f0b2c003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.482+0000 7f0b2b7fe640 1 -- 172.21.15.73:0/746518769 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c03f070 con 0x7f0b3c106ba0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.482+0000 7f0b2b7fe640 1 -- 172.21.15.73:0/746518769 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b2c031e30 con 0x7f0b3c106ba0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.482+0000 7f0b2b7fe640 1 -- 172.21.15.73:0/746518769 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c035030 con 0x7f0b3c106ba0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.482+0000 7f0b40fb2640 1 -- 172.21.15.73:0/746518769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3c19d7f0 con 0x7f0b3c106ba0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.482+0000 7f0b40fb2640 1 -- 172.21.15.73:0/746518769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3c1a5130 con 0x7f0b3c106ba0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.483+0000 7f0b40fb2640 1 -- 172.21.15.73:0/746518769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b3c100530 con 0x7f0b3c106ba0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.484+0000 7f0b2b7fe640 1 -- 172.21.15.73:0/746518769 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0b2c042070 con 0x7f0b3c106ba0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.484+0000 7f0b2b7fe640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0b240a2c00 0x7f0b240a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.484+0000 7f0b3a59c640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0b240a2c00 0x7f0b240a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.484+0000 7f0b2b7fe640 1 -- 172.21.15.73:0/746518769 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f0b2c0ef920 con 0x7f0b3c106ba0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.485+0000 7f0b3a59c640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0b240a2c00 0x7f0b240a50c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009f20 tx=0x7f0b340094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.489+0000 7f0b2b7fe640 1 -- 172.21.15.73:0/746518769 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b2c003e20 con 0x7f0b3c106ba0 2024-09-05T13:05:29.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:29 smithi162 ceph-mon[34220]: pgmap v564: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T13:05:29.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:29 smithi169 ceph-mon[34823]: pgmap v564: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-05T13:05:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.668+0000 7f0b40fb2640 1 -- 172.21.15.73:0/746518769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0b3c10a090 con 0x7f0b3c106ba0 2024-09-05T13:05:29.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.669+0000 7f0b2b7fe640 1 -- 172.21.15.73:0/746518769 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v82) ==== 81+0+590 (secure 0 0 0) 0x7f0b2c0bc8b0 con 0x7f0b3c106ba0 2024-09-05T13:05:29.670 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/164449765 2024-09-06T12:49:03.895045+0000 2024-09-05T13:05:29.670 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3258347917 2024-09-06T12:49:03.895045+0000 2024-09-05T13:05:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1727245409 2024-09-06T12:49:03.895045+0000 2024-09-05T13:05:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/2037973546 2024-09-06T12:49:03.895045+0000 2024-09-05T13:05:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/4065677028 2024-09-06T12:48:40.645773+0000 2024-09-05T13:05:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/3437397159 2024-09-06T12:48:40.645773+0000 2024-09-05T13:05:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/3437397159 2024-09-06T12:48:40.645773+0000 2024-09-05T13:05:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/2037973546 2024-09-06T12:49:03.895045+0000 2024-09-05T13:05:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1582140576 2024-09-06T12:48:40.645773+0000 2024-09-05T13:05:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/636038208 2024-09-06T12:48:40.645773+0000 2024-09-05T13:05:29.671 INFO:teuthology.orchestra.run.smithi073.stderr:listed 10 entries 2024-09-05T13:05:29.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 -- 172.21.15.73:0/746518769 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0b240a2c00 msgr2=0x7f0b240a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:29.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0b240a2c00 0x7f0b240a50c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009f20 tx=0x7f0b340094f0 comp rx=0 tx=0).stop 2024-09-05T13:05:29.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 -- 172.21.15.73:0/746518769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b3c106ba0 msgr2=0x7f0b3c19ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b3c106ba0 0x7f0b3c19ce80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c005ab0 tx=0x7f0b2c003c30 comp rx=0 tx=0).stop 2024-09-05T13:05:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 -- 172.21.15.73:0/746518769 shutdown_connections 2024-09-05T13:05:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f0b240a2c00 0x7f0b240a50c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b3c106ba0 0x7f0b3c19ce80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b3c100a70 0x7f0b3c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 --2- 172.21.15.73:0/746518769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b3c1000d0 0x7f0b3c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 -- 172.21.15.73:0/746518769 >> 172.21.15.73:0/746518769 conn(0x7f0b3c077210 msgr2=0x7f0b3c104c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 -- 172.21.15.73:0/746518769 shutdown_connections 2024-09-05T13:05:29.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:29.672+0000 7f0b40fb2640 1 -- 172.21.15.73:0/746518769 wait complete. 2024-09-05T13:05:30.455 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:30 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/746518769' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-05T13:05:30.483 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-05T13:05:30.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T13:05:30.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-05T13:05:30.526 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-05T13:05:30.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T13:05:30.526 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-05T13:05:30.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:30 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/746518769' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-05T13:05:30.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:30 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/746518769' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-05T13:05:30.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T13:05:30.630 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-05T13:05:30.696 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-05T13:05:30.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T13:05:30.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T13:05:30.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T13:05:30.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-09-05T13:05:30.815 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-05T13:05:30.825 INFO:tasks.cephadm:Teardown begin 2024-09-05T13:05:30.825 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-05T13:05:30.826 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T13:05:31.079 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:31.477 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:31 smithi073 ceph-mon[30883]: pgmap v565: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:31.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.555+0000 7f57558b2640 1 -- 172.21.15.73:0/1358060794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5750102570 msgr2=0x7f57501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:31.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.555+0000 7f57558b2640 1 --2- 172.21.15.73:0/1358060794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5750102570 0x7f57501029b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5738009900 tx=0x7f573802a480 comp rx=0 tx=0).stop 2024-09-05T13:05:31.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.555+0000 7f57558b2640 1 -- 172.21.15.73:0/1358060794 shutdown_connections 2024-09-05T13:05:31.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.555+0000 7f57558b2640 1 --2- 172.21.15.73:0/1358060794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750102ef0 0x7f575010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:31.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.555+0000 7f57558b2640 1 --2- 172.21.15.73:0/1358060794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5750102570 0x7f57501029b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:31.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.555+0000 7f57558b2640 1 --2- 172.21.15.73:0/1358060794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5750100e20 0x7f5750101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:31.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.555+0000 7f57558b2640 1 -- 172.21.15.73:0/1358060794 >> 172.21.15.73:0/1358060794 conn(0x7f57500fc7d0 msgr2=0x7f57500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:31.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.555+0000 7f57558b2640 1 -- 172.21.15.73:0/1358060794 shutdown_connections 2024-09-05T13:05:31.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.555+0000 7f57558b2640 1 -- 172.21.15.73:0/1358060794 wait complete. 2024-09-05T13:05:31.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.555+0000 7f57558b2640 1 Processor -- start 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f57558b2640 1 -- start start 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f57558b2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750100e20 0x7f57501973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f57558b2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5750102570 0x7f57501978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f57558b2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5750102ef0 0x7f575019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f57558b2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5750110f80 con 0x7f5750102570 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f57558b2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5750110e00 con 0x7f5750102ef0 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f57558b2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5750111100 con 0x7f5750100e20 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5750102570 0x7f57501978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5750102570 0x7f57501978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44580/0 (socket says 172.21.15.73:44580) 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574e7fc640 1 -- 172.21.15.73:0/2742724700 learned_addr learned my addr 172.21.15.73:0/2742724700 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574f7fe640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5750102ef0 0x7f575019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574effd640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750100e20 0x7f57501973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574e7fc640 1 -- 172.21.15.73:0/2742724700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750100e20 msgr2=0x7f57501973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574e7fc640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750100e20 0x7f57501973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574e7fc640 1 -- 172.21.15.73:0/2742724700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5750102ef0 msgr2=0x7f575019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574e7fc640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5750102ef0 0x7f575019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574e7fc640 1 -- 172.21.15.73:0/2742724700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575019c350 con 0x7f5750102570 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574effd640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750100e20 0x7f57501973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.556+0000 7f574f7fe640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5750102ef0 0x7f575019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.557+0000 7f574e7fc640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5750102570 0x7f57501978e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5738006010 tx=0x7f5738003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.557+0000 7f57548b0640 1 -- 172.21.15.73:0/2742724700 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738035070 con 0x7f5750102570 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.557+0000 7f57548b0640 1 -- 172.21.15.73:0/2742724700 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5738031a20 con 0x7f5750102570 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.557+0000 7f57548b0640 1 -- 172.21.15.73:0/2742724700 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738038b10 con 0x7f5750102570 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.557+0000 7f57558b2640 1 -- 172.21.15.73:0/2742724700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575019c5e0 con 0x7f5750102570 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.557+0000 7f57558b2640 1 -- 172.21.15.73:0/2742724700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5750069f70 con 0x7f5750102570 2024-09-05T13:05:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.558+0000 7f57558b2640 1 -- 172.21.15.73:0/2742724700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57501021b0 con 0x7f5750102570 2024-09-05T13:05:31.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.559+0000 7f57548b0640 1 -- 172.21.15.73:0/2742724700 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5738038cb0 con 0x7f5750102570 2024-09-05T13:05:31.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.560+0000 7f57548b0640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f573c0a2b80 0x7f573c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:31.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.560+0000 7f574effd640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f573c0a2b80 0x7f573c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:31.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.560+0000 7f57548b0640 1 -- 172.21.15.73:0/2742724700 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f57380f13c0 con 0x7f5750102570 2024-09-05T13:05:31.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.560+0000 7f574effd640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f573c0a2b80 0x7f573c0a5040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5740005fd0 tx=0x7f5740009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:31.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.563+0000 7f57548b0640 1 -- 172.21.15.73:0/2742724700 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57380be350 con 0x7f5750102570 2024-09-05T13:05:31.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:31 smithi162 ceph-mon[34220]: pgmap v565: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:31.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:31 smithi169 ceph-mon[34823]: pgmap v565: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-05T13:05:31.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.763+0000 7f57558b2640 1 -- 172.21.15.73:0/2742724700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5750101200 con 0x7f5750102570 2024-09-05T13:05:31.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.763+0000 7f57548b0640 1 -- 172.21.15.73:0/2742724700 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+11928 (secure 0 0 0) 0x7f5750101200 con 0x7f5750102570 2024-09-05T13:05:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T13:05:31.766 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":47,"btime":"2024-09-05T13:04:33:189626+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T13:04:32.212887+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25924":{"gid":25924,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2445546350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2445546350},{"type":"v1","addr":"172.21.15.169:6837","nonce":2445546350}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T13:05:31.767 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 47 2024-09-05T13:05:31.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 -- 172.21.15.73:0/2742724700 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f573c0a2b80 msgr2=0x7f573c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:31.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f573c0a2b80 0x7f573c0a5040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5740005fd0 tx=0x7f5740009500 comp rx=0 tx=0).stop 2024-09-05T13:05:31.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 -- 172.21.15.73:0/2742724700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5750102570 msgr2=0x7f57501978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:31.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5750102570 0x7f57501978e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5738006010 tx=0x7f5738003b90 comp rx=0 tx=0).stop 2024-09-05T13:05:31.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 -- 172.21.15.73:0/2742724700 shutdown_connections 2024-09-05T13:05:31.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f573c0a2b80 0x7f573c0a5040 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:31.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5750102ef0 0x7f575019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:31.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5750102570 0x7f57501978e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:31.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 --2- 172.21.15.73:0/2742724700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750100e20 0x7f57501973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:31.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 -- 172.21.15.73:0/2742724700 >> 172.21.15.73:0/2742724700 conn(0x7f57500fc7d0 msgr2=0x7f57500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:31.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 -- 172.21.15.73:0/2742724700 shutdown_connections 2024-09-05T13:05:31.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:31.766+0000 7f57558b2640 1 -- 172.21.15.73:0/2742724700 wait complete. 2024-09-05T13:05:32.500 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:32 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2742724700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:05:32.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T13:05:32.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:32 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2742724700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:05:32.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:32 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2742724700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:05:32.784 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.224+0000 7fc6c1b47640 1 -- 172.21.15.73:0/2451883827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6bc102dd0 msgr2=0x7fc6bc1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.224+0000 7fc6c1b47640 1 --2- 172.21.15.73:0/2451883827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6bc102dd0 0x7fc6bc1031b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009930 tx=0x7fc6ac02a420 comp rx=0 tx=0).stop 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.224+0000 7fc6c1b47640 1 -- 172.21.15.73:0/2451883827 shutdown_connections 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.224+0000 7fc6c1b47640 1 --2- 172.21.15.73:0/2451883827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6bc108300 0x7fc6bc10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.224+0000 7fc6c1b47640 1 --2- 172.21.15.73:0/2451883827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6bc103780 0x7fc6bc107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.224+0000 7fc6c1b47640 1 --2- 172.21.15.73:0/2451883827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6bc102dd0 0x7fc6bc1031b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.224+0000 7fc6c1b47640 1 -- 172.21.15.73:0/2451883827 >> 172.21.15.73:0/2451883827 conn(0x7fc6bc0fc7d0 msgr2=0x7fc6bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.224+0000 7fc6c1b47640 1 -- 172.21.15.73:0/2451883827 shutdown_connections 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.224+0000 7fc6c1b47640 1 -- 172.21.15.73:0/2451883827 wait complete. 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6c1b47640 1 Processor -- start 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6c1b47640 1 -- start start 2024-09-05T13:05:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6c1b47640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6bc102dd0 0x7fc6bc198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6c1b47640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6bc103780 0x7fc6bc198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6c1b47640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6bc108300 0x7fc6bc19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6c1b47640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc1120b0 con 0x7fc6bc108300 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6c1b47640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc111f30 con 0x7fc6bc102dd0 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6c1b47640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc112230 con 0x7fc6bc103780 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6bbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6bc108300 0x7fc6bc19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6bbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6bc108300 0x7fc6bc19cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44590/0 (socket says 172.21.15.73:44590) 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6bbfff640 1 -- 172.21.15.73:0/4161933375 learned_addr learned my addr 172.21.15.73:0/4161933375 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6bb7fe640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6bc102dd0 0x7fc6bc198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.225+0000 7fc6baffd640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6bc103780 0x7fc6bc198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6bbfff640 1 -- 172.21.15.73:0/4161933375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6bc103780 msgr2=0x7fc6bc198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6bbfff640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6bc103780 0x7fc6bc198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6bbfff640 1 -- 172.21.15.73:0/4161933375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6bc102dd0 msgr2=0x7fc6bc198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6bbfff640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6bc102dd0 0x7fc6bc198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6bbfff640 1 -- 172.21.15.73:0/4161933375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc19d620 con 0x7fc6bc108300 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6bbfff640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6bc108300 0x7fc6bc19cf40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400eaa0 tx=0x7fc6b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6b8ff9640 1 -- 172.21.15.73:0/4161933375 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b400cdb0 con 0x7fc6bc108300 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6c1b47640 1 -- 172.21.15.73:0/4161933375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6bc19d910 con 0x7fc6bc108300 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6b8ff9640 1 -- 172.21.15.73:0/4161933375 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6b4005020 con 0x7fc6bc108300 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6b8ff9640 1 -- 172.21.15.73:0/4161933375 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40116d0 con 0x7fc6bc108300 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.226+0000 7fc6c1b47640 1 -- 172.21.15.73:0/4161933375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6bc1a51f0 con 0x7fc6bc108300 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.227+0000 7fc6c1b47640 1 -- 172.21.15.73:0/4161933375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6bc06a7b0 con 0x7fc6bc108300 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.228+0000 7fc6b8ff9640 1 -- 172.21.15.73:0/4161933375 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc6b40054d0 con 0x7fc6bc108300 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.229+0000 7fc6b8ff9640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a40a2b80 0x7fc6a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.229+0000 7fc6bb7fe640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a40a2b80 0x7fc6a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.229+0000 7fc6b8ff9640 1 -- 172.21.15.73:0/4161933375 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fc6b40cf160 con 0x7fc6bc108300 2024-09-05T13:05:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.229+0000 7fc6bb7fe640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a40a2b80 0x7fc6a40a5040 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009900 tx=0x7fc6ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.233+0000 7fc6b8ff9640 1 -- 172.21.15.73:0/4161933375 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6b4016030 con 0x7fc6bc108300 2024-09-05T13:05:33.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.434+0000 7fc6c1b47640 1 -- 172.21.15.73:0/4161933375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6bc10a290 con 0x7fc6bc108300 2024-09-05T13:05:33.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.435+0000 7fc6b8ff9640 1 -- 172.21.15.73:0/4161933375 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+11928 (secure 0 0 0) 0x7fc6b409baa0 con 0x7fc6bc108300 2024-09-05T13:05:33.437 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T13:05:33.438 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":47,"btime":"2024-09-05T13:04:33:189626+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3381594379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3381594379},{"type":"v1","addr":"172.21.15.73:6835","nonce":3381594379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3164965523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3164965523},{"type":"v1","addr":"172.21.15.73:6837","nonce":3164965523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3218139737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3218139737},{"type":"v1","addr":"172.21.15.73:6839","nonce":3218139737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/2107729050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":2107729050},{"type":"v1","addr":"172.21.15.73:6841","nonce":2107729050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1135530165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1135530165},{"type":"v1","addr":"172.21.15.162:6833","nonce":1135530165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1381090054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1381090054},{"type":"v1","addr":"172.21.15.169:6833","nonce":1381090054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T12:55:46.371642+0000","modified":"2024-09-05T13:04:32.212887+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24482,"mds_1":24466,"mds_2":24452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/3122717185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3122717185},{"type":"v1","addr":"172.21.15.162:6835","nonce":3122717185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/4085562536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":4085562536},{"type":"v1","addr":"172.21.15.169:6835","nonce":4085562536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/3027533309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3027533309},{"type":"v1","addr":"172.21.15.162:6837","nonce":3027533309}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3351085082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3351085082},{"type":"v1","addr":"172.21.15.169:6839","nonce":3351085082}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/3413521160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3413521160},{"type":"v1","addr":"172.21.15.162:6839","nonce":3413521160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25924":{"gid":25924,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2445546350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2445546350},{"type":"v1","addr":"172.21.15.169:6837","nonce":2445546350}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482,24466,24452]},"id":1}]} 2024-09-05T13:05:33.438 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 47 2024-09-05T13:05:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 -- 172.21.15.73:0/4161933375 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a40a2b80 msgr2=0x7fc6a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a40a2b80 0x7fc6a40a5040 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009900 tx=0x7fc6ac0058d0 comp rx=0 tx=0).stop 2024-09-05T13:05:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 -- 172.21.15.73:0/4161933375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6bc108300 msgr2=0x7fc6bc19cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6bc108300 0x7fc6bc19cf40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400eaa0 tx=0x7fc6b400ef60 comp rx=0 tx=0).stop 2024-09-05T13:05:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 -- 172.21.15.73:0/4161933375 shutdown_connections 2024-09-05T13:05:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc6a40a2b80 0x7fc6a40a5040 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6bc108300 0x7fc6bc19cf40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6bc103780 0x7fc6bc198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 --2- 172.21.15.73:0/4161933375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6bc102dd0 0x7fc6bc198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 -- 172.21.15.73:0/4161933375 >> 172.21.15.73:0/4161933375 conn(0x7fc6bc0fc7d0 msgr2=0x7fc6bc105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 -- 172.21.15.73:0/4161933375 shutdown_connections 2024-09-05T13:05:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:33.437+0000 7fc6c1b47640 1 -- 172.21.15.73:0/4161933375 wait complete. 2024-09-05T13:05:33.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:33 smithi073 ceph-mon[30883]: pgmap v566: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-05T13:05:33.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:33 smithi162 ceph-mon[34220]: pgmap v566: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-05T13:05:33.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:33 smithi169 ceph-mon[34823]: pgmap v566: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-05T13:05:34.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T13:05:34.403 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:34.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:34 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/4161933375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:05:34.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:34 smithi073 ceph-mon[30883]: pgmap v567: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-05T13:05:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:34 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/4161933375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:05:34.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:34 smithi162 ceph-mon[34220]: pgmap v567: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-05T13:05:34.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:34 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/4161933375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T13:05:34.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:34 smithi169 ceph-mon[34823]: pgmap v567: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-05T13:05:34.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.848+0000 7f14681cb640 1 -- 172.21.15.73:0/1341494651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1460102ef0 msgr2=0x7f146010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.848+0000 7f14681cb640 1 --2- 172.21.15.73:0/1341494651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1460102ef0 0x7f146010da40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1458009ca0 tx=0x7f145802a950 comp rx=0 tx=0).stop 2024-09-05T13:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.848+0000 7f14681cb640 1 -- 172.21.15.73:0/1341494651 shutdown_connections 2024-09-05T13:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.848+0000 7f14681cb640 1 --2- 172.21.15.73:0/1341494651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1460102ef0 0x7f146010da40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.848+0000 7f14681cb640 1 --2- 172.21.15.73:0/1341494651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1460102570 0x7f14601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.848+0000 7f14681cb640 1 --2- 172.21.15.73:0/1341494651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1460100e20 0x7f1460101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.848+0000 7f14681cb640 1 -- 172.21.15.73:0/1341494651 >> 172.21.15.73:0/1341494651 conn(0x7f14600fc7d0 msgr2=0x7f14600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.849+0000 7f14681cb640 1 -- 172.21.15.73:0/1341494651 shutdown_connections 2024-09-05T13:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.849+0000 7f14681cb640 1 -- 172.21.15.73:0/1341494651 wait complete. 2024-09-05T13:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.849+0000 7f14681cb640 1 Processor -- start 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.849+0000 7f14681cb640 1 -- start start 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.849+0000 7f14681cb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1460100e20 0x7f14600fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.849+0000 7f14681cb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1460102570 0x7f14600fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.849+0000 7f14681cb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1460102ef0 0x7f14600fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.849+0000 7f14681cb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1460111020 con 0x7f1460100e20 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.849+0000 7f14681cb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1460110ea0 con 0x7f1460102570 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.849+0000 7f14681cb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f14601111a0 con 0x7f1460102ef0 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465f67640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1460100e20 0x7f14600fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465f67640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1460100e20 0x7f14600fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56898/0 (socket says 172.21.15.73:56898) 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465f67640 1 -- 172.21.15.73:0/3131324764 learned_addr learned my addr 172.21.15.73:0/3131324764 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465766640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1460102570 0x7f14600fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1466768640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1460102ef0 0x7f14600fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465f67640 1 -- 172.21.15.73:0/3131324764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1460102ef0 msgr2=0x7f14600fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465f67640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1460102ef0 0x7f14600fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465f67640 1 -- 172.21.15.73:0/3131324764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1460102570 msgr2=0x7f14600fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465f67640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1460102570 0x7f14600fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465f67640 1 -- 172.21.15.73:0/3131324764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14601a6aa0 con 0x7f1460100e20 2024-09-05T13:05:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465766640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1460102570 0x7f14600fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:05:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1466768640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1460102ef0 0x7f14600fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:05:34.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1465f67640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1460100e20 0x7f14600fcc80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f145c00b4a0 tx=0x7f145c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:34.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1456ffd640 1 -- 172.21.15.73:0/3131324764 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c014070 con 0x7f1460100e20 2024-09-05T13:05:34.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f14681cb640 1 -- 172.21.15.73:0/3131324764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14601a6d90 con 0x7f1460100e20 2024-09-05T13:05:34.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1456ffd640 1 -- 172.21.15.73:0/3131324764 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f145c010af0 con 0x7f1460100e20 2024-09-05T13:05:34.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f1456ffd640 1 -- 172.21.15.73:0/3131324764 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c017d10 con 0x7f1460100e20 2024-09-05T13:05:34.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.850+0000 7f14681cb640 1 -- 172.21.15.73:0/3131324764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14601a7220 con 0x7f1460100e20 2024-09-05T13:05:34.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.851+0000 7f14681cb640 1 -- 172.21.15.73:0/3131324764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1460101280 con 0x7f1460100e20 2024-09-05T13:05:34.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.852+0000 7f1456ffd640 1 -- 172.21.15.73:0/3131324764 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f145c017070 con 0x7f1460100e20 2024-09-05T13:05:34.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.853+0000 7f1456ffd640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f144c0a2b80 0x7f144c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:34.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.853+0000 7f1465766640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f144c0a2b80 0x7f144c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:34.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.853+0000 7f1456ffd640 1 -- 172.21.15.73:0/3131324764 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f145c0ce830 con 0x7f1460100e20 2024-09-05T13:05:34.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.853+0000 7f1465766640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f144c0a2b80 0x7f144c0a5040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f14600fe710 tx=0x7f1450008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:34.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:34.856+0000 7f1456ffd640 1 -- 172.21.15.73:0/3131324764 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f145c09b7c0 con 0x7f1460100e20 2024-09-05T13:05:35.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.025+0000 7f14681cb640 1 -- 172.21.15.73:0/3131324764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14600fe1b0 con 0x7f1460100e20 2024-09-05T13:05:35.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.026+0000 7f1456ffd640 1 -- 172.21.15.73:0/3131324764 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22645 (secure 0 0 0) 0x7f14600fe1b0 con 0x7f1460100e20 2024-09-05T13:05:35.029 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-05T13:05:35.029 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":82,"fsid":"febf1dd4-6b84-11ef-bcd6-c7b262605968","created":"2024-09-05T12:48:11.856424+0000","modified":"2024-09-05T13:04:28.701104+0000","last_up_change":"2024-09-05T12:54:54.096066+0000","last_in_change":"2024-09-05T12:54:30.520785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T12:51:12.204701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T12:55:42.305439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T12:55:44.548796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f66519cc-c789-455a-bb2a-a7872eeb6102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6803","nonce":1199952118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6805","nonce":1199952118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6809","nonce":1199952118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1199952118},{"type":"v1","addr":"172.21.15.73:6807","nonce":1199952118}]},"public_addr":"172.21.15.73:6803/1199952118","cluster_addr":"172.21.15.73:6805/1199952118","heartbeat_back_addr":"172.21.15.73:6809/1199952118","heartbeat_front_addr":"172.21.15.73:6807/1199952118","state":["exists","up"]},{"osd":1,"uuid":"0f31a701-6a71-46f4-b80e-0b3da55579f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6801","nonce":1849982968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6803","nonce":1849982968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6807","nonce":1849982968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1849982968},{"type":"v1","addr":"172.21.15.162:6805","nonce":1849982968}]},"public_addr":"172.21.15.162:6801/1849982968","cluster_addr":"172.21.15.162:6803/1849982968","heartbeat_back_addr":"172.21.15.162:6807/1849982968","heartbeat_front_addr":"172.21.15.162:6805/1849982968","state":["exists","up"]},{"osd":2,"uuid":"4ca9a85b-64f2-42c6-89d8-5acf031950ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6801","nonce":2183957699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6803","nonce":2183957699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6807","nonce":2183957699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2183957699},{"type":"v1","addr":"172.21.15.169:6805","nonce":2183957699}]},"public_addr":"172.21.15.169:6801/2183957699","cluster_addr":"172.21.15.169:6803/2183957699","heartbeat_back_addr":"172.21.15.169:6807/2183957699","heartbeat_front_addr":"172.21.15.169:6805/2183957699","state":["exists","up"]},{"osd":3,"uuid":"872dac25-184d-4a09-8f6f-05ed823cac56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6811","nonce":3192613076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6813","nonce":3192613076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6817","nonce":3192613076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3192613076},{"type":"v1","addr":"172.21.15.73:6815","nonce":3192613076}]},"public_addr":"172.21.15.73:6811/3192613076","cluster_addr":"172.21.15.73:6813/3192613076","heartbeat_back_addr":"172.21.15.73:6817/3192613076","heartbeat_front_addr":"172.21.15.73:6815/3192613076","state":["exists","up"]},{"osd":4,"uuid":"80300180-a992-4ec2-b072-5d87d9df1e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6809","nonce":2879857832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6811","nonce":2879857832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6815","nonce":2879857832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2879857832},{"type":"v1","addr":"172.21.15.162:6813","nonce":2879857832}]},"public_addr":"172.21.15.162:6809/2879857832","cluster_addr":"172.21.15.162:6811/2879857832","heartbeat_back_addr":"172.21.15.162:6815/2879857832","heartbeat_front_addr":"172.21.15.162:6813/2879857832","state":["exists","up"]},{"osd":5,"uuid":"dbfe5aa2-e557-4217-9a26-1bfb6c75e659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6809","nonce":324340736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6811","nonce":324340736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6815","nonce":324340736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":324340736},{"type":"v1","addr":"172.21.15.169:6813","nonce":324340736}]},"public_addr":"172.21.15.169:6809/324340736","cluster_addr":"172.21.15.169:6811/324340736","heartbeat_back_addr":"172.21.15.169:6815/324340736","heartbeat_front_addr":"172.21.15.169:6813/324340736","state":["exists","up"]},{"osd":6,"uuid":"873c54c3-a55e-4994-b850-56c22cb1d92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6819","nonce":1759972661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6821","nonce":1759972661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6825","nonce":1759972661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1759972661},{"type":"v1","addr":"172.21.15.73:6823","nonce":1759972661}]},"public_addr":"172.21.15.73:6819/1759972661","cluster_addr":"172.21.15.73:6821/1759972661","heartbeat_back_addr":"172.21.15.73:6825/1759972661","heartbeat_front_addr":"172.21.15.73:6823/1759972661","state":["exists","up"]},{"osd":7,"uuid":"ec604cbe-a213-4979-99bb-959531e665d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6817","nonce":1574930675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6819","nonce":1574930675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6823","nonce":1574930675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1574930675},{"type":"v1","addr":"172.21.15.162:6821","nonce":1574930675}]},"public_addr":"172.21.15.162:6817/1574930675","cluster_addr":"172.21.15.162:6819/1574930675","heartbeat_back_addr":"172.21.15.162:6823/1574930675","heartbeat_front_addr":"172.21.15.162:6821/1574930675","state":["exists","up"]},{"osd":8,"uuid":"1b840a9a-9ed0-497a-a83a-43fc27f0323f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6817","nonce":3235960631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6819","nonce":3235960631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6823","nonce":3235960631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3235960631},{"type":"v1","addr":"172.21.15.169:6821","nonce":3235960631}]},"public_addr":"172.21.15.169:6817/3235960631","cluster_addr":"172.21.15.169:6819/3235960631","heartbeat_back_addr":"172.21.15.169:6823/3235960631","heartbeat_front_addr":"172.21.15.169:6821/3235960631","state":["exists","up"]},{"osd":9,"uuid":"249077c2-cf03-4aa8-83fd-0325ca397e07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6827","nonce":3048419338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6829","nonce":3048419338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6833","nonce":3048419338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3048419338},{"type":"v1","addr":"172.21.15.73:6831","nonce":3048419338}]},"public_addr":"172.21.15.73:6827/3048419338","cluster_addr":"172.21.15.73:6829/3048419338","heartbeat_back_addr":"172.21.15.73:6833/3048419338","heartbeat_front_addr":"172.21.15.73:6831/3048419338","state":["exists","up"]},{"osd":10,"uuid":"f745b0aa-839f-430b-a4af-a0f05f393cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6825","nonce":3623867420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6827","nonce":3623867420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6831","nonce":3623867420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3623867420},{"type":"v1","addr":"172.21.15.162:6829","nonce":3623867420}]},"public_addr":"172.21.15.162:6825/3623867420","cluster_addr":"172.21.15.162:6827/3623867420","heartbeat_back_addr":"172.21.15.162:6831/3623867420","heartbeat_front_addr":"172.21.15.162:6829/3623867420","state":["exists","up"]},{"osd":11,"uuid":"4f508768-c586-4e4d-8ac6-0c2ffccd05a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6825","nonce":1127339864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6827","nonce":1127339864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6831","nonce":1127339864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1127339864},{"type":"v1","addr":"172.21.15.169:6829","nonce":1127339864}]},"public_addr":"172.21.15.169:6825/1127339864","cluster_addr":"172.21.15.169:6827/1127339864","heartbeat_back_addr":"172.21.15.169:6831/1127339864","heartbeat_front_addr":"172.21.15.169:6829/1127339864","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:23.156418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:50:46.763920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:10.292412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:33.997701+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:51:58.158562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:23.144173+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:52:47.539926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:12.520206+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:53:36.227656+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:02.143294+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:26.874743+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T12:54:52.545391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/164449765":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/3258347917":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1727245409":"2024-09-06T12:49:03.895045+0000","172.21.15.73:6801/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/4065677028":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6801/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/3437397159":"2024-09-06T12:48:40.645773+0000","172.21.15.73:6800/2037973546":"2024-09-06T12:49:03.895045+0000","172.21.15.73:0/1582140576":"2024-09-06T12:48:40.645773+0000","172.21.15.73:0/636038208":"2024-09-06T12:48:40.645773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T13:05:35.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 -- 172.21.15.73:0/3131324764 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f144c0a2b80 msgr2=0x7f144c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:35.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f144c0a2b80 0x7f144c0a5040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f14600fe710 tx=0x7f1450008040 comp rx=0 tx=0).stop 2024-09-05T13:05:35.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 -- 172.21.15.73:0/3131324764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1460100e20 msgr2=0x7f14600fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:35.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1460100e20 0x7f14600fcc80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f145c00b4a0 tx=0x7f145c00b960 comp rx=0 tx=0).stop 2024-09-05T13:05:35.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 -- 172.21.15.73:0/3131324764 shutdown_connections 2024-09-05T13:05:35.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f144c0a2b80 0x7f144c0a5040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:35.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1460102ef0 0x7f14600fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:35.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1460102570 0x7f14600fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:35.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 --2- 172.21.15.73:0/3131324764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1460100e20 0x7f14600fcc80 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:35.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 -- 172.21.15.73:0/3131324764 >> 172.21.15.73:0/3131324764 conn(0x7f14600fc7d0 msgr2=0x7f146006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:35.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 -- 172.21.15.73:0/3131324764 shutdown_connections 2024-09-05T13:05:35.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:35.029+0000 7f14681cb640 1 -- 172.21.15.73:0/3131324764 wait complete. 2024-09-05T13:05:35.296 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:35 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/3131324764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T13:05:35.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:35 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/3131324764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T13:05:35.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:35 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/3131324764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T13:05:35.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs fail cephfs 2024-09-05T13:05:35.985 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:36.391 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:36 smithi073 ceph-mon[30883]: pgmap v568: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-05T13:05:36.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 -- 172.21.15.73:0/496787438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3858100a80 msgr2=0x7f3858100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:36.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 --2- 172.21.15.73:0/496787438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3858100a80 0x7f3858100ee0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3840009930 tx=0x7f384002a420 comp rx=0 tx=0).stop 2024-09-05T13:05:36.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 -- 172.21.15.73:0/496787438 shutdown_connections 2024-09-05T13:05:36.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 --2- 172.21.15.73:0/496787438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858101420 0x7f385810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:36.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 --2- 172.21.15.73:0/496787438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3858100a80 0x7f3858100ee0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 --2- 172.21.15.73:0/496787438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3858106a80 0x7f3858106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 -- 172.21.15.73:0/496787438 >> 172.21.15.73:0/496787438 conn(0x7f38580fc7a0 msgr2=0x7f38580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 -- 172.21.15.73:0/496787438 shutdown_connections 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 -- 172.21.15.73:0/496787438 wait complete. 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 Processor -- start 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.470+0000 7f385e7dd640 1 -- start start 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f385e7dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3858100a80 0x7f38581992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f385e7dd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3858101420 0x7f3858199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f385e7dd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858106a80 0x7f38581a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f385e7dd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3858110ec0 con 0x7f3858101420 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f385e7dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3858110d40 con 0x7f3858100a80 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f385e7dd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3858111040 con 0x7f3858106a80 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f38577fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3858101420 0x7f3858199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f38577fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3858101420 0x7f3858199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56920/0 (socket says 172.21.15.73:56920) 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f38577fe640 1 -- 172.21.15.73:0/852185450 learned_addr learned my addr 172.21.15.73:0/852185450 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f385cd7a640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858106a80 0x7f38581a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f3857fff640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3858100a80 0x7f38581992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f38577fe640 1 -- 172.21.15.73:0/852185450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858106a80 msgr2=0x7f38581a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f38577fe640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858106a80 0x7f38581a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f38577fe640 1 -- 172.21.15.73:0/852185450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3858100a80 msgr2=0x7f38581992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f38577fe640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3858100a80 0x7f38581992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f38577fe640 1 -- 172.21.15.73:0/852185450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38581a48b0 con 0x7f3858101420 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.471+0000 7f38577fe640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3858101420 0x7f3858199830 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3840009230 tx=0x7f3840004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.472+0000 7f38557fa640 1 -- 172.21.15.73:0/852185450 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384003f030 con 0x7f3858101420 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.472+0000 7f38557fa640 1 -- 172.21.15.73:0/852185450 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3840003ad0 con 0x7f3858101420 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.472+0000 7f385e7dd640 1 -- 172.21.15.73:0/852185450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38581a4a80 con 0x7f3858101420 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.472+0000 7f38557fa640 1 -- 172.21.15.73:0/852185450 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840035070 con 0x7f3858101420 2024-09-05T13:05:36.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.472+0000 7f385e7dd640 1 -- 172.21.15.73:0/852185450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38581a4f90 con 0x7f3858101420 2024-09-05T13:05:36.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.473+0000 7f385e7dd640 1 -- 172.21.15.73:0/852185450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3858100ee0 con 0x7f3858101420 2024-09-05T13:05:36.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.474+0000 7f38557fa640 1 -- 172.21.15.73:0/852185450 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3840042030 con 0x7f3858101420 2024-09-05T13:05:36.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.475+0000 7f38557fa640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38440a2b80 0x7f38440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:36.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.475+0000 7f3857fff640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38440a2b80 0x7f38440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:36.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.475+0000 7f38557fa640 1 -- 172.21.15.73:0/852185450 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f38400ef820 con 0x7f3858101420 2024-09-05T13:05:36.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.475+0000 7f3857fff640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38440a2b80 0x7f38440a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3848009990 tx=0x7f3848009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:36.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.478+0000 7f38557fa640 1 -- 172.21.15.73:0/852185450 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38400bc7b0 con 0x7f3858101420 2024-09-05T13:05:36.610 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-mon[34220]: pgmap v568: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-05T13:05:36.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-mon[34823]: pgmap v568: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-05T13:05:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.678+0000 7f385e7dd640 1 -- 172.21.15.73:0/852185450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3858109010 con 0x7f3858101420 2024-09-05T13:05:36.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.680+0000 7f38557fa640 1 -- 172.21.15.73:0/852185450 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) ==== 161+0+0 (secure 0 0 0) 0x7f38400bc0b0 con 0x7f3858101420 2024-09-05T13:05:36.683 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-05T13:05:36.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.682+0000 7f385e7dd640 1 -- 172.21.15.73:0/852185450 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38440a2b80 msgr2=0x7f38440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:36.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.682+0000 7f385e7dd640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38440a2b80 0x7f38440a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3848009990 tx=0x7f3848009110 comp rx=0 tx=0).stop 2024-09-05T13:05:36.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.683+0000 7f385e7dd640 1 -- 172.21.15.73:0/852185450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3858101420 msgr2=0x7f3858199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:36.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.683+0000 7f385e7dd640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3858101420 0x7f3858199830 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3840009230 tx=0x7f3840004270 comp rx=0 tx=0).stop 2024-09-05T13:05:36.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.683+0000 7f385e7dd640 1 -- 172.21.15.73:0/852185450 shutdown_connections 2024-09-05T13:05:36.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.683+0000 7f385e7dd640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7f38440a2b80 0x7f38440a5040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:36.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.683+0000 7f385e7dd640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858106a80 0x7f38581a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:36.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.683+0000 7f385e7dd640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3858101420 0x7f3858199830 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:36.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.683+0000 7f385e7dd640 1 --2- 172.21.15.73:0/852185450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3858100a80 0x7f38581992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:36.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.683+0000 7f385e7dd640 1 -- 172.21.15.73:0/852185450 >> 172.21.15.73:0/852185450 conn(0x7f38580fc7a0 msgr2=0x7f38580fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:36.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.683+0000 7f385e7dd640 1 -- 172.21.15.73:0/852185450 shutdown_connections 2024-09-05T13:05:36.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:36.683+0000 7f385e7dd640 1 -- 172.21.15.73:0/852185450 wait complete. 2024-09-05T13:05:37.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:36 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a[30879]: 2024-09-05T13:05:36.679+0000 7f8d6cac7640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T13:05:37.111 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h[64504]: ignoring --setuser ceph since I am not root 2024-09-05T13:05:37.111 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h[64504]: ignoring --setgroup ceph since I am not root 2024-09-05T13:05:37.111 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-mds[64508]: -- 172.21.15.162:0/571412355 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d1fa685c20 con 0x55d1fa663400 2024-09-05T13:05:37.111 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h[64504]: starting mds.h at 2024-09-05T13:05:37.112 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e[64203]: ignoring --setuser ceph since I am not root 2024-09-05T13:05:37.112 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e[64203]: ignoring --setgroup ceph since I am not root 2024-09-05T13:05:37.112 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-mds[64207]: -- 172.21.15.162:0/2539962374 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590e71b5860 con 0x5590e7192800 2024-09-05T13:05:37.112 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e[64203]: starting mds.e at 2024-09-05T13:05:37.112 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b[64807]: ignoring --setuser ceph since I am not root 2024-09-05T13:05:37.112 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b[64807]: ignoring --setgroup ceph since I am not root 2024-09-05T13:05:37.112 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-mds[64811]: -- 172.21.15.162:0/1423419463 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56168ef33860 con 0x56168ef11000 2024-09-05T13:05:37.112 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 13:05:36 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b[64807]: starting mds.b at 2024-09-05T13:05:37.118 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: ignoring --setuser ceph since I am not root 2024-09-05T13:05:37.118 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: ignoring --setgroup ceph since I am not root 2024-09-05T13:05:37.118 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-mds[65207]: -- 172.21.15.169:0/496172821 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56534c48f860 con 0x56534c46d000 2024-09-05T13:05:37.118 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: starting mds.c at 2024-09-05T13:05:37.118 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i[65508]: ignoring --setuser ceph since I am not root 2024-09-05T13:05:37.118 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i[65508]: ignoring --setgroup ceph since I am not root 2024-09-05T13:05:37.118 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-mds[65512]: -- 172.21.15.169:0/2442032667 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5575b8767c20 con 0x5575b8745400 2024-09-05T13:05:37.118 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i[65508]: starting mds.i at 2024-09-05T13:05:37.119 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f[64905]: ignoring --setuser ceph since I am not root 2024-09-05T13:05:37.119 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f[64905]: ignoring --setgroup ceph since I am not root 2024-09-05T13:05:37.119 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-mds[64909]: -- 172.21.15.169:0/825669481 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56307fe33860 con 0x56307fe10800 2024-09-05T13:05:37.119 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 13:05:36 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f[64905]: starting mds.f at 2024-09-05T13:05:37.413 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:37 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/852185450' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T13:05:37.413 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:37 smithi073 ceph-mon[30883]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-05T13:05:37.413 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:37 smithi073 ceph-mon[30883]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T13:05:37.413 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:37 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/852185450' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-05T13:05:37.413 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:37 smithi073 ceph-mon[30883]: osdmap e83: 12 total, 12 up, 12 in 2024-09-05T13:05:37.413 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:37 smithi073 ceph-mon[30883]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-05T13:05:37.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-05T13:05:37.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:37 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/852185450' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T13:05:37.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:37 smithi162 ceph-mon[34220]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-05T13:05:37.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:37 smithi162 ceph-mon[34220]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T13:05:37.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:37 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/852185450' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-05T13:05:37.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:37 smithi162 ceph-mon[34220]: osdmap e83: 12 total, 12 up, 12 in 2024-09-05T13:05:37.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:37 smithi162 ceph-mon[34220]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-05T13:05:37.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:37 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/852185450' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T13:05:37.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:37 smithi169 ceph-mon[34823]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-05T13:05:37.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:37 smithi169 ceph-mon[34823]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T13:05:37.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:37 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/852185450' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-05T13:05:37.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:37 smithi169 ceph-mon[34823]: osdmap e83: 12 total, 12 up, 12 in 2024-09-05T13:05:37.618 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:37 smithi169 ceph-mon[34823]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-05T13:05:37.691 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.197+0000 7fa2ac780640 1 -- 172.21.15.73:0/3717758565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a410c170 msgr2=0x7fa2a410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.197+0000 7fa2ac780640 1 --2- 172.21.15.73:0/3717758565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a410c170 0x7fa2a410e610 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009ca0 tx=0x7fa29c02a950 comp rx=0 tx=0).stop 2024-09-05T13:05:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.197+0000 7fa2ac780640 1 -- 172.21.15.73:0/3717758565 shutdown_connections 2024-09-05T13:05:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.197+0000 7fa2ac780640 1 --2- 172.21.15.73:0/3717758565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a410c170 0x7fa2a410e610 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.197+0000 7fa2ac780640 1 --2- 172.21.15.73:0/3717758565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2a4103660 0x7fa2a410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.197+0000 7fa2ac780640 1 --2- 172.21.15.73:0/3717758565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a4102d40 0x7fa2a4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.197+0000 7fa2ac780640 1 -- 172.21.15.73:0/3717758565 >> 172.21.15.73:0/3717758565 conn(0x7fa2a40fc7a0 msgr2=0x7fa2a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.197+0000 7fa2ac780640 1 -- 172.21.15.73:0/3717758565 shutdown_connections 2024-09-05T13:05:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.197+0000 7fa2ac780640 1 -- 172.21.15.73:0/3717758565 wait complete. 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2ac780640 1 Processor -- start 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2ac780640 1 -- start start 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2ac780640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4102d40 0x7fa2a41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2ac780640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a4103660 0x7fa2a4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2ac780640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2a410c170 0x7fa2a4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2ac780640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4111f70 con 0x7fa2a4102d40 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2ac780640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4111df0 con 0x7fa2a410c170 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2ac780640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a41120f0 con 0x7fa2a4103660 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2aa51c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4102d40 0x7fa2a41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2aa51c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4102d40 0x7fa2a41009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56944/0 (socket says 172.21.15.73:56944) 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2aa51c640 1 -- 172.21.15.73:0/1801650177 learned_addr learned my addr 172.21.15.73:0/1801650177 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2aad1d640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2a410c170 0x7fa2a4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.198+0000 7fa2a9d1b640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a4103660 0x7fa2a4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa2aa51c640 1 -- 172.21.15.73:0/1801650177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a4103660 msgr2=0x7fa2a4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa2aa51c640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a4103660 0x7fa2a4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa2aa51c640 1 -- 172.21.15.73:0/1801650177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2a410c170 msgr2=0x7fa2a4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa2aa51c640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2a410c170 0x7fa2a4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa2aa51c640 1 -- 172.21.15.73:0/1801650177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a41a68b0 con 0x7fa2a4102d40 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa2a9d1b640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a4103660 0x7fa2a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa2aad1d640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2a410c170 0x7fa2a4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa2aa51c640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4102d40 0x7fa2a41009a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000d770 tx=0x7fa2a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1801650177 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0017070 con 0x7fa2a4102d40 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa2ac780640 1 -- 172.21.15.73:0/1801650177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a41a6ba0 con 0x7fa2a4102d40 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1801650177 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2a0005500 con 0x7fa2a4102d40 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1801650177 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0004e00 con 0x7fa2a4102d40 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.199+0000 7fa2ac780640 1 -- 172.21.15.73:0/1801650177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a41a7090 con 0x7fa2a4102d40 2024-09-05T13:05:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.200+0000 7fa2ac780640 1 -- 172.21.15.73:0/1801650177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a4103120 con 0x7fa2a4102d40 2024-09-05T13:05:38.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.201+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1801650177 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa2a0004fa0 con 0x7fa2a4102d40 2024-09-05T13:05:38.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.202+0000 7fa29b7fe640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2900a2b80 0x7fa2900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:38.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.202+0000 7fa2a9d1b640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2900a2b80 0x7fa2900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:38.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.202+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1801650177 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa2a00ceca0 con 0x7fa2a4102d40 2024-09-05T13:05:38.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.202+0000 7fa2a9d1b640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2900a2b80 0x7fa2900a5040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4102430 tx=0x7fa294005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:38.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.206+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1801650177 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2a009bad0 con 0x7fa2a4102d40 2024-09-05T13:05:38.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.406+0000 7fa2ac780640 1 -- 172.21.15.73:0/1801650177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa2a402d7c0 con 0x7fa2a4102d40 2024-09-05T13:05:38.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.688+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1801650177 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) ==== 104+0+0 (secure 0 0 0) 0x7fa2a009b3d0 con 0x7fa2a4102d40 2024-09-05T13:05:38.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 -- 172.21.15.73:0/1801650177 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2900a2b80 msgr2=0x7fa2900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:38.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2900a2b80 0x7fa2900a5040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4102430 tx=0x7fa294005d50 comp rx=0 tx=0).stop 2024-09-05T13:05:38.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 -- 172.21.15.73:0/1801650177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4102d40 msgr2=0x7fa2a41009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:38.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4102d40 0x7fa2a41009a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000d770 tx=0x7fa2a000dc30 comp rx=0 tx=0).stop 2024-09-05T13:05:38.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 -- 172.21.15.73:0/1801650177 shutdown_connections 2024-09-05T13:05:38.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fa2900a2b80 0x7fa2900a5040 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:38.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2a410c170 0x7fa2a4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:38.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a4103660 0x7fa2a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:38.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 --2- 172.21.15.73:0/1801650177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4102d40 0x7fa2a41009a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:38.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 -- 172.21.15.73:0/1801650177 >> 172.21.15.73:0/1801650177 conn(0x7fa2a40fc7a0 msgr2=0x7fa2a40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:38.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 -- 172.21.15.73:0/1801650177 shutdown_connections 2024-09-05T13:05:38.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:38.692+0000 7fa2ac780640 1 -- 172.21.15.73:0/1801650177 wait complete. 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.162:6834/143445983,v1:172.21.15.162:6835/143445983] up:boot 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.169:6834/1993667148,v1:172.21.15.169:6835/1993667148] up:boot 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.162:6836/839788466,v1:172.21.15.162:6838/839788466] up:boot 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.162:6837/2875870896,v1:172.21.15.162:6839/2875870896] up:boot 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.169:6836/1772214006,v1:172.21.15.169:6837/1772214006] up:boot 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: mds.? [v2:172.21.15.169:6838/3790121608,v1:172.21.15.169:6839/3790121608] up:boot 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T13:05:39.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T13:05:39.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T13:05:39.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: pgmap v570: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-05T13:05:39.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:38 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1801650177' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T13:05:39.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.162:6834/143445983,v1:172.21.15.162:6835/143445983] up:boot 2024-09-05T13:05:39.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.169:6834/1993667148,v1:172.21.15.169:6835/1993667148] up:boot 2024-09-05T13:05:39.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.162:6836/839788466,v1:172.21.15.162:6838/839788466] up:boot 2024-09-05T13:05:39.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.162:6837/2875870896,v1:172.21.15.162:6839/2875870896] up:boot 2024-09-05T13:05:39.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.169:6836/1772214006,v1:172.21.15.169:6837/1772214006] up:boot 2024-09-05T13:05:39.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: mds.? [v2:172.21.15.169:6838/3790121608,v1:172.21.15.169:6839/3790121608] up:boot 2024-09-05T13:05:39.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-05T13:05:39.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T13:05:39.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T13:05:39.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T13:05:39.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T13:05:39.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T13:05:39.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T13:05:39.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: pgmap v570: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-05T13:05:39.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:38 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1801650177' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T13:05:39.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.162:6834/143445983,v1:172.21.15.162:6835/143445983] up:boot 2024-09-05T13:05:39.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.169:6834/1993667148,v1:172.21.15.169:6835/1993667148] up:boot 2024-09-05T13:05:39.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.162:6836/839788466,v1:172.21.15.162:6838/839788466] up:boot 2024-09-05T13:05:39.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.162:6837/2875870896,v1:172.21.15.162:6839/2875870896] up:boot 2024-09-05T13:05:39.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.169:6836/1772214006,v1:172.21.15.169:6837/1772214006] up:boot 2024-09-05T13:05:39.119 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: mds.? [v2:172.21.15.169:6838/3790121608,v1:172.21.15.169:6839/3790121608] up:boot 2024-09-05T13:05:39.119 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-05T13:05:39.119 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T13:05:39.119 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T13:05:39.119 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T13:05:39.119 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T13:05:39.120 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T13:05:39.120 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: from='mgr.14150 172.21.15.73:0/2018578090' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T13:05:39.120 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: pgmap v570: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-05T13:05:39.120 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:38 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1801650177' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T13:05:39.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-05T13:05:39.684 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:39.997 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:39 smithi073 ceph-mon[30883]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-05T13:05:39.998 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:39 smithi073 ceph-mon[30883]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-05T13:05:39.998 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:39 smithi073 ceph-mon[30883]: Cluster is now healthy 2024-09-05T13:05:39.998 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:39 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/1801650177' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-05T13:05:39.998 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:39 smithi073 ceph-mon[30883]: fsmap 12 up:standby 2024-09-05T13:05:40.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:39 smithi162 ceph-mon[34220]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-05T13:05:40.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:39 smithi162 ceph-mon[34220]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-05T13:05:40.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:39 smithi162 ceph-mon[34220]: Cluster is now healthy 2024-09-05T13:05:40.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:39 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/1801650177' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-05T13:05:40.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:39 smithi162 ceph-mon[34220]: fsmap 12 up:standby 2024-09-05T13:05:40.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:39 smithi169 ceph-mon[34823]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-05T13:05:40.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:39 smithi169 ceph-mon[34823]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-05T13:05:40.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:39 smithi169 ceph-mon[34823]: Cluster is now healthy 2024-09-05T13:05:40.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:39 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/1801650177' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-05T13:05:40.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:39 smithi169 ceph-mon[34823]: fsmap 12 up:standby 2024-09-05T13:05:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.208+0000 7eff29a42640 1 -- 172.21.15.73:0/2233935462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff24103ff0 msgr2=0x7eff241043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.208+0000 7eff29a42640 1 --2- 172.21.15.73:0/2233935462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff24103ff0 0x7eff241043d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7eff14009900 tx=0x7eff1402a410 comp rx=0 tx=0).stop 2024-09-05T13:05:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.208+0000 7eff29a42640 1 -- 172.21.15.73:0/2233935462 shutdown_connections 2024-09-05T13:05:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.208+0000 7eff29a42640 1 --2- 172.21.15.73:0/2233935462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff24109120 0x7eff24110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.208+0000 7eff29a42640 1 --2- 172.21.15.73:0/2233935462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff241049a0 0x7eff241089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.208+0000 7eff29a42640 1 --2- 172.21.15.73:0/2233935462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff24103ff0 0x7eff241043d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.208+0000 7eff29a42640 1 -- 172.21.15.73:0/2233935462 >> 172.21.15.73:0/2233935462 conn(0x7eff240ffa90 msgr2=0x7eff24101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.208+0000 7eff29a42640 1 -- 172.21.15.73:0/2233935462 shutdown_connections 2024-09-05T13:05:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.208+0000 7eff29a42640 1 -- 172.21.15.73:0/2233935462 wait complete. 2024-09-05T13:05:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff29a42640 1 Processor -- start 2024-09-05T13:05:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff29a42640 1 -- start start 2024-09-05T13:05:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff29a42640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff24103ff0 0x7eff2419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff29a42640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff241049a0 0x7eff2419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff29a42640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff24109120 0x7eff2419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff29a42640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7eff24114120 con 0x7eff24109120 2024-09-05T13:05:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff29a42640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff24113fa0 con 0x7eff241049a0 2024-09-05T13:05:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff29a42640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7eff241142a0 con 0x7eff24103ff0 2024-09-05T13:05:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff24109120 0x7eff2419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff24109120 0x7eff2419ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56956/0 (socket says 172.21.15.73:56956) 2024-09-05T13:05:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff237fe640 1 -- 172.21.15.73:0/2658978075 learned_addr learned my addr 172.21.15.73:0/2658978075 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.209+0000 7eff22ffd640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff24103ff0 0x7eff2419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff227fc640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff241049a0 0x7eff2419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff237fe640 1 -- 172.21.15.73:0/2658978075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff24103ff0 msgr2=0x7eff2419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff237fe640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff24103ff0 0x7eff2419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff237fe640 1 -- 172.21.15.73:0/2658978075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff241049a0 msgr2=0x7eff2419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff237fe640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff241049a0 0x7eff2419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff237fe640 1 -- 172.21.15.73:0/2658978075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2419f570 con 0x7eff24109120 2024-09-05T13:05:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff22ffd640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff24103ff0 0x7eff2419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T13:05:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff237fe640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff24109120 0x7eff2419ee90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00cad0 tx=0x7eff1c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff28a40640 1 -- 172.21.15.73:0/2658978075 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00ae20 con 0x7eff24109120 2024-09-05T13:05:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff29a42640 1 -- 172.21.15.73:0/2658978075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2419f860 con 0x7eff24109120 2024-09-05T13:05:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff28a40640 1 -- 172.21.15.73:0/2658978075 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff1c005020 con 0x7eff24109120 2024-09-05T13:05:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff28a40640 1 -- 172.21.15.73:0/2658978075 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00f6f0 con 0x7eff24109120 2024-09-05T13:05:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.210+0000 7eff29a42640 1 -- 172.21.15.73:0/2658978075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff241a7140 con 0x7eff24109120 2024-09-05T13:05:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.211+0000 7eff29a42640 1 -- 172.21.15.73:0/2658978075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff241043d0 con 0x7eff24109120 2024-09-05T13:05:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.212+0000 7eff28a40640 1 -- 172.21.15.73:0/2658978075 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7eff1c0051d0 con 0x7eff24109120 2024-09-05T13:05:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.213+0000 7eff28a40640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7eff0c0a2c00 0x7eff0c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.213+0000 7eff22ffd640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7eff0c0a2c00 0x7eff0c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.213+0000 7eff28a40640 1 -- 172.21.15.73:0/2658978075 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7eff1c0cf0a0 con 0x7eff24109120 2024-09-05T13:05:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.213+0000 7eff22ffd640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7eff0c0a2c00 0x7eff0c0a50c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7eff14005ab0 tx=0x7eff14005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.217+0000 7eff28a40640 1 -- 172.21.15.73:0/2658978075 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff1c014030 con 0x7eff24109120 2024-09-05T13:05:40.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.388+0000 7eff29a42640 1 -- 172.21.15.73:0/2658978075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7eff2402d7c0 con 0x7eff24109120 2024-09-05T13:05:40.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.695+0000 7eff28a40640 1 -- 172.21.15.73:0/2658978075 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7eff1c09bfd0 con 0x7eff24109120 2024-09-05T13:05:40.698 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-09-05T13:05:40.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.698+0000 7eff29a42640 1 -- 172.21.15.73:0/2658978075 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7eff0c0a2c00 msgr2=0x7eff0c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:40.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.698+0000 7eff29a42640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7eff0c0a2c00 0x7eff0c0a50c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7eff14005ab0 tx=0x7eff14005a20 comp rx=0 tx=0).stop 2024-09-05T13:05:40.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.699+0000 7eff29a42640 1 -- 172.21.15.73:0/2658978075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff24109120 msgr2=0x7eff2419ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:40.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.699+0000 7eff29a42640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff24109120 0x7eff2419ee90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00cad0 tx=0x7eff1c00cf90 comp rx=0 tx=0).stop 2024-09-05T13:05:40.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.699+0000 7eff29a42640 1 -- 172.21.15.73:0/2658978075 shutdown_connections 2024-09-05T13:05:40.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.699+0000 7eff29a42640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7eff0c0a2c00 0x7eff0c0a50c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:40.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.699+0000 7eff29a42640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff24109120 0x7eff2419ee90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:40.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.699+0000 7eff29a42640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff241049a0 0x7eff2419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:40.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.699+0000 7eff29a42640 1 --2- 172.21.15.73:0/2658978075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff24103ff0 0x7eff2419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:40.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.699+0000 7eff29a42640 1 -- 172.21.15.73:0/2658978075 >> 172.21.15.73:0/2658978075 conn(0x7eff240ffa90 msgr2=0x7eff24100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:40.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.699+0000 7eff29a42640 1 -- 172.21.15.73:0/2658978075 shutdown_connections 2024-09-05T13:05:40.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:40.699+0000 7eff29a42640 1 -- 172.21.15.73:0/2658978075 wait complete. 2024-09-05T13:05:40.993 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:40 smithi073 ceph-mon[30883]: pgmap v571: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 716 B/s wr, 6 op/s 2024-09-05T13:05:40.993 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:40 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2658978075' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T13:05:41.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:40 smithi162 ceph-mon[34220]: pgmap v571: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 716 B/s wr, 6 op/s 2024-09-05T13:05:41.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:40 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2658978075' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T13:05:41.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:40 smithi169 ceph-mon[34823]: pgmap v571: 97 pgs: 97 active+clean; 10 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 716 B/s wr, 6 op/s 2024-09-05T13:05:41.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:40 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2658978075' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T13:05:41.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac shell --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-05T13:05:41.672 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T13:05:41.965 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:41 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2658978075' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T13:05:41.965 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:41 smithi073 ceph-mon[30883]: osdmap e84: 12 total, 12 up, 12 in 2024-09-05T13:05:42.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:41 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2658978075' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T13:05:42.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:41 smithi162 ceph-mon[34220]: osdmap e84: 12 total, 12 up, 12 in 2024-09-05T13:05:42.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:41 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2658978075' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T13:05:42.118 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:41 smithi169 ceph-mon[34823]: osdmap e84: 12 total, 12 up, 12 in 2024-09-05T13:05:42.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.143+0000 7fc1cac67640 1 -- 172.21.15.73:0/1865731584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1c4101de0 msgr2=0x7fc1c41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:42.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.144+0000 7fc1cac67640 1 --2- 172.21.15.73:0/1865731584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1c4101de0 0x7fc1c41021c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009900 tx=0x7fc1c002a410 comp rx=0 tx=0).stop 2024-09-05T13:05:42.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.144+0000 7fc1cac67640 1 -- 172.21.15.73:0/1865731584 shutdown_connections 2024-09-05T13:05:42.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.144+0000 7fc1cac67640 1 --2- 172.21.15.73:0/1865731584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c4106f10 0x7fc1c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.144+0000 7fc1cac67640 1 --2- 172.21.15.73:0/1865731584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4102790 0x7fc1c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.144+0000 7fc1cac67640 1 --2- 172.21.15.73:0/1865731584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1c4101de0 0x7fc1c41021c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.144+0000 7fc1cac67640 1 -- 172.21.15.73:0/1865731584 >> 172.21.15.73:0/1865731584 conn(0x7fc1c40fd8c0 msgr2=0x7fc1c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.144+0000 7fc1cac67640 1 -- 172.21.15.73:0/1865731584 shutdown_connections 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.144+0000 7fc1cac67640 1 -- 172.21.15.73:0/1865731584 wait complete. 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.144+0000 7fc1cac67640 1 Processor -- start 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.144+0000 7fc1cac67640 1 -- start start 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1cac67640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 0x7fc1c41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1cac67640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1c4102790 0x7fc1c41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1cac67640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c4106f10 0x7fc1c419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1cac67640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c4111f70 con 0x7fc1c4102790 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1cac67640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c4111df0 con 0x7fc1c4106f10 2024-09-05T13:05:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1cac67640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41120f0 con 0x7fc1c4101de0 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1bbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1c4102790 0x7fc1c41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1bbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1c4102790 0x7fc1c41989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56972/0 (socket says 172.21.15.73:56972) 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1bbfff640 1 -- 172.21.15.73:0/2365918131 learned_addr learned my addr 172.21.15.73:0/2365918131 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1c8a03640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 0x7fc1c41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1c9204640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c4106f10 0x7fc1c419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1bbfff640 1 -- 172.21.15.73:0/2365918131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 msgr2=0x7fc1c41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1bbfff640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 0x7fc1c41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1bbfff640 1 -- 172.21.15.73:0/2365918131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c4106f10 msgr2=0x7fc1c419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1bbfff640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c4106f10 0x7fc1c419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1bbfff640 1 -- 172.21.15.73:0/2365918131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c419d460 con 0x7fc1c4102790 2024-09-05T13:05:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1c8a03640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 0x7fc1c41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1bbfff640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1c4102790 0x7fc1c41989f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400e9f0 tx=0x7fc1b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.145+0000 7fc1b9ffb640 1 -- 172.21.15.73:0/2365918131 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400cd80 con 0x7fc1c4102790 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.146+0000 7fc1b9ffb640 1 -- 172.21.15.73:0/2365918131 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b4005500 con 0x7fc1c4102790 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.146+0000 7fc1cac67640 1 -- 172.21.15.73:0/2365918131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c419d750 con 0x7fc1c4102790 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.146+0000 7fc1b9ffb640 1 -- 172.21.15.73:0/2365918131 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4010690 con 0x7fc1c4102790 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.146+0000 7fc1cac67640 1 -- 172.21.15.73:0/2365918131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c41a5030 con 0x7fc1c4102790 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.147+0000 7fc1cac67640 1 -- 172.21.15.73:0/2365918131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c41021c0 con 0x7fc1c4102790 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.148+0000 7fc1b9ffb640 1 -- 172.21.15.73:0/2365918131 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc1b40046c0 con 0x7fc1c4102790 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.148+0000 7fc1b9ffb640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc1ac0a2b80 0x7fc1ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.148+0000 7fc1b9ffb640 1 -- 172.21.15.73:0/2365918131 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7944+0+0 (secure 0 0 0) 0x7fc1b40cf2b0 con 0x7fc1c4102790 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.148+0000 7fc1c8a03640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc1ac0a2b80 0x7fc1ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T13:05:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.149+0000 7fc1c8a03640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc1ac0a2b80 0x7fc1ac0a5040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009230 tx=0x7fc1c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T13:05:42.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.153+0000 7fc1b9ffb640 1 -- 172.21.15.73:0/2365918131 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1b409c380 con 0x7fc1c4102790 2024-09-05T13:05:42.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.318+0000 7fc1cac67640 1 -- 172.21.15.73:0/2365918131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc1c4109b60 con 0x7fc1c4102790 2024-09-05T13:05:42.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.702+0000 7fc1b9ffb640 1 -- 172.21.15.73:0/2365918131 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7fc1b409bc80 con 0x7fc1c4102790 2024-09-05T13:05:42.705 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-09-05T13:05:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.706+0000 7fc1cac67640 1 -- 172.21.15.73:0/2365918131 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc1ac0a2b80 msgr2=0x7fc1ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.706+0000 7fc1cac67640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc1ac0a2b80 0x7fc1ac0a5040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009230 tx=0x7fc1c00058d0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.706+0000 7fc1cac67640 1 -- 172.21.15.73:0/2365918131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1c4102790 msgr2=0x7fc1c41989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T13:05:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.706+0000 7fc1cac67640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1c4102790 0x7fc1c41989f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400e9f0 tx=0x7fc1b400edf0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.706+0000 7fc1cac67640 1 -- 172.21.15.73:0/2365918131 shutdown_connections 2024-09-05T13:05:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.706+0000 7fc1cac67640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.73:6800/3294068694,v1:172.21.15.73:6801/3294068694] conn(0x7fc1ac0a2b80 0x7fc1ac0a5040 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.706+0000 7fc1cac67640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c4106f10 0x7fc1c419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.706+0000 7fc1cac67640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1c4102790 0x7fc1c41989f0 secure :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400e9f0 tx=0x7fc1b400edf0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.706+0000 7fc1cac67640 1 --2- 172.21.15.73:0/2365918131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 0x7fc1c41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T13:05:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.706+0000 7fc1cac67640 1 -- 172.21.15.73:0/2365918131 >> 172.21.15.73:0/2365918131 conn(0x7fc1c40fd8c0 msgr2=0x7fc1c40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T13:05:42.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.708+0000 7fc1cac67640 1 -- 172.21.15.73:0/2365918131 shutdown_connections 2024-09-05T13:05:42.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-05T13:05:42.708+0000 7fc1cac67640 1 -- 172.21.15.73:0/2365918131 wait complete. 2024-09-05T13:05:43.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:42 smithi073 ceph-mon[30883]: pgmap v573: 65 pgs: 65 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T13:05:43.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:42 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2365918131' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T13:05:43.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:42 smithi162 ceph-mon[34220]: pgmap v573: 65 pgs: 65 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T13:05:43.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:42 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2365918131' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T13:05:43.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:42 smithi169 ceph-mon[34823]: pgmap v573: 65 pgs: 65 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T13:05:43.117 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:42 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2365918131' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T13:05:43.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T13:05:43.439 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T13:05:43.474 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T13:05:43.501 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-05T13:05:43.502 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-05T13:05:43.523 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-05T13:05:43.539 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-05T13:05:43.559 INFO:tasks.cephadm:Stopping all daemons... 2024-09-05T13:05:43.559 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-05T13:05:43.559 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.a 2024-09-05T13:05:43.706 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:43 smithi073 systemd[1]: Stopping Ceph mon.a for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:05:43.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:43 smithi162 ceph-mon[34220]: from='client.? 172.21.15.73:0/2365918131' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T13:05:43.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:43 smithi162 ceph-mon[34220]: osdmap e85: 12 total, 12 up, 12 in 2024-09-05T13:05:43.867 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:43 smithi169 ceph-mon[34823]: from='client.? 172.21.15.73:0/2365918131' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T13:05:43.868 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:43 smithi169 ceph-mon[34823]: osdmap e85: 12 total, 12 up, 12 in 2024-09-05T13:05:44.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:43 smithi073 ceph-mon[30883]: from='client.? 172.21.15.73:0/2365918131' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T13:05:44.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:43 smithi073 ceph-mon[30883]: osdmap e85: 12 total, 12 up, 12 in 2024-09-05T13:05:44.014 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:43 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a[30879]: 2024-09-05T13:05:43.895+0000 7f8d722d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:05:44.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:43 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a[30879]: 2024-09-05T13:05:43.895+0000 7f8d722d2640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-05T13:05:44.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:43 smithi073 podman[97037]: 2024-09-05 13:05:43.937889961 +0000 UTC m=+0.158382263 container died d41793c84463611329966ce36eba00866afd4a712939ae45769b6d041aad4bfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-09-05T13:05:44.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:44 smithi073 podman[97037]: 2024-09-05 13:05:44.347075975 +0000 UTC m=+0.567568269 container cleanup d41793c84463611329966ce36eba00866afd4a712939ae45769b6d041aad4bfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-05T13:05:44.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 05 13:05:44 smithi073 bash[97037]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-a 2024-09-05T13:05:44.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.a.service' 2024-09-05T13:05:44.792 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:05:44.792 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-05T13:05:44.792 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-05T13:05:44.793 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.b 2024-09-05T13:05:45.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:44 smithi162 systemd[1]: Stopping Ceph mon.b for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:05:45.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:45 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-b[34216]: 2024-09-05T13:05:45.108+0000 7f658a8a0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:05:45.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:45 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-b[34216]: 2024-09-05T13:05:45.108+0000 7f658a8a0640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-05T13:05:45.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:45 smithi162 podman[68412]: 2024-09-05 13:05:45.293397964 +0000 UTC m=+0.286123006 container died af79306ec132869658a37b5954efa133432ea169a3e6210e8cf383432bb9a53f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-b, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-05T13:05:45.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:45 smithi162 podman[68412]: 2024-09-05 13:05:45.718993632 +0000 UTC m=+0.711718666 container cleanup af79306ec132869658a37b5954efa133432ea169a3e6210e8cf383432bb9a53f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-05T13:05:45.781 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:45 smithi162 bash[68412]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-b 2024-09-05T13:05:46.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 05 13:05:45 smithi162 podman[68424]: 2024-09-05 13:05:45.979086485 +0000 UTC m=+0.678547616 container remove af79306ec132869658a37b5954efa133432ea169a3e6210e8cf383432bb9a53f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-b, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True) 2024-09-05T13:05:46.210 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.b.service' 2024-09-05T13:05:46.258 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:05:46.259 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-05T13:05:46.259 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-05T13:05:46.259 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.c 2024-09-05T13:05:46.571 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:46 smithi169 systemd[1]: Stopping Ceph mon.c for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:05:46.847 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:46 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-c[34819]: 2024-09-05T13:05:46.618+0000 7f1b29adc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:05:46.848 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:46 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-c[34819]: 2024-09-05T13:05:46.618+0000 7f1b29adc640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-05T13:05:46.848 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:46 smithi169 podman[69401]: 2024-09-05 13:05:46.638403045 +0000 UTC m=+0.141973143 container died 8912ea49fbb900570b41f501a8530482911a55d95beadcd5d3a2baaf46b87e03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-c, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-05T13:05:47.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:47 smithi169 podman[69401]: 2024-09-05 13:05:47.110774802 +0000 UTC m=+0.614344902 container cleanup 8912ea49fbb900570b41f501a8530482911a55d95beadcd5d3a2baaf46b87e03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-05T13:05:47.368 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 05 13:05:47 smithi169 bash[69401]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mon-c 2024-09-05T13:05:47.560 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mon.c.service' 2024-09-05T13:05:47.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:05:47.608 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-05T13:05:47.608 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-05T13:05:47.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.x 2024-09-05T13:05:47.937 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 13:05:47 smithi073 systemd[1]: Stopping Ceph mgr.x for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:05:48.263 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 13:05:47 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x[31109]: 2024-09-05T13:05:47.935+0000 7f33f9858640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:05:48.263 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 13:05:47 smithi073 podman[97160]: 2024-09-05 13:05:47.966949775 +0000 UTC m=+0.154217905 container died f384e21e7493e107091640cb28203b93603712bf2c26622e61fc46c91dbf8179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-05T13:05:48.763 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 13:05:48 smithi073 podman[97160]: 2024-09-05 13:05:48.471071722 +0000 UTC m=+0.658339896 container cleanup f384e21e7493e107091640cb28203b93603712bf2c26622e61fc46c91dbf8179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e856d6b2462509a377ef39149a05475ed006ebac, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-05T13:05:48.763 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 05 13:05:48 smithi073 bash[97160]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-x 2024-09-05T13:05:49.019 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.x.service' 2024-09-05T13:05:49.053 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:05:49.054 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-05T13:05:49.054 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-05T13:05:49.054 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.y 2024-09-05T13:05:49.361 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 13:05:49 smithi162 systemd[1]: Stopping Ceph mgr.y for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:05:49.709 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 13:05:49 smithi162 podman[68547]: 2024-09-05 13:05:49.386759005 +0000 UTC m=+0.136093522 container died ced4666a5ca30880ce76fa4fdf948c433c1efca844546ab59cfa0f419de5606d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-05T13:05:50.069 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 13:05:49 smithi162 podman[68547]: 2024-09-05 13:05:49.799922901 +0000 UTC m=+0.549257417 container cleanup ced4666a5ca30880ce76fa4fdf948c433c1efca844546ab59cfa0f419de5606d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y, ceph=True, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T13:05:50.069 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 05 13:05:49 smithi162 bash[68547]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-y 2024-09-05T13:05:50.229 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.y.service' 2024-09-05T13:05:50.266 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:05:50.266 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-05T13:05:50.266 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-05T13:05:50.266 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.z 2024-09-05T13:05:50.605 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 13:05:50 smithi169 systemd[1]: Stopping Ceph mgr.z for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:05:50.868 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 13:05:50 smithi169 podman[69536]: 2024-09-05 13:05:50.604049209 +0000 UTC m=+0.141801953 container died 87f7f5ba38acc4685ab3ec4f976a6ef8606fc14977c15d168bab645890794f11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-05T13:05:51.269 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 13:05:50 smithi169 podman[69536]: 2024-09-05 13:05:50.967062524 +0000 UTC m=+0.504815260 container cleanup 87f7f5ba38acc4685ab3ec4f976a6ef8606fc14977c15d168bab645890794f11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T13:05:51.270 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 05 13:05:50 smithi169 bash[69536]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mgr-z 2024-09-05T13:05:51.442 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mgr.z.service' 2024-09-05T13:05:51.478 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:05:51.478 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-05T13:05:51.478 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-05T13:05:51.478 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.0 2024-09-05T13:05:51.763 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:51 smithi073 systemd[1]: Stopping Ceph osd.0 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:05:52.263 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:51 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0[44413]: 2024-09-05T13:05:51.810+0000 7fa16c2b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:05:52.263 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:51 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0[44413]: 2024-09-05T13:05:51.810+0000 7fa16c2b8640 -1 osd.0 85 *** Got signal Terminated *** 2024-09-05T13:05:52.263 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:51 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0[44413]: 2024-09-05T13:05:51.810+0000 7fa16c2b8640 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:05:57.704 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:57 smithi073 podman[97283]: 2024-09-05 13:05:57.394708403 +0000 UTC m=+5.722332427 container died 93c416a9ff5f84b20f44103b13d2bb2af1d1eb446f1e9db614b14fe371faedaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-05T13:05:58.013 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:57 smithi073 podman[97283]: 2024-09-05 13:05:57.885714887 +0000 UTC m=+6.213338908 container cleanup 93c416a9ff5f84b20f44103b13d2bb2af1d1eb446f1e9db614b14fe371faedaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-05T13:05:58.013 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:57 smithi073 bash[97283]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0 2024-09-05T13:05:58.498 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:58 smithi073 podman[97300]: 2024-09-05 13:05:58.187861089 +0000 UTC m=+0.777968765 container remove 93c416a9ff5f84b20f44103b13d2bb2af1d1eb446f1e9db614b14fe371faedaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T13:05:58.763 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:58 smithi073 podman[97384]: 2024-09-05 13:05:58.399809494 +0000 UTC m=+0.015806429 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:05:58.764 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:58 smithi073 podman[97384]: 2024-09-05 13:05:58.530612882 +0000 UTC m=+0.146609849 container create ecce6d451251cda2653a5d1d8b592ddfbe14b751574ac7b1d9f503b7f67953c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-05T13:05:59.184 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:58 smithi073 podman[97384]: 2024-09-05 13:05:58.790605927 +0000 UTC m=+0.406602852 container init ecce6d451251cda2653a5d1d8b592ddfbe14b751574ac7b1d9f503b7f67953c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-05T13:05:59.185 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:58 smithi073 podman[97384]: 2024-09-05 13:05:58.793922985 +0000 UTC m=+0.409919913 container start ecce6d451251cda2653a5d1d8b592ddfbe14b751574ac7b1d9f503b7f67953c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-05T13:05:59.185 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:58 smithi073 podman[97384]: 2024-09-05 13:05:58.919432744 +0000 UTC m=+0.535429735 container attach ecce6d451251cda2653a5d1d8b592ddfbe14b751574ac7b1d9f503b7f67953c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T13:05:59.513 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 05 13:05:59 smithi073 podman[97407]: 2024-09-05 13:05:59.20728741 +0000 UTC m=+0.016297375 container died ecce6d451251cda2653a5d1d8b592ddfbe14b751574ac7b1d9f503b7f67953c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-05T13:05:59.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.0.service' 2024-09-05T13:05:59.878 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:05:59.878 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-05T13:05:59.878 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-05T13:05:59.878 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.1 2024-09-05T13:06:00.201 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:05:59 smithi162 systemd[1]: Stopping Ceph osd.1 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:06:00.611 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:00 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1[38558]: 2024-09-05T13:06:00.199+0000 7fbf0d9b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:06:00.611 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:00 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1[38558]: 2024-09-05T13:06:00.199+0000 7fbf0d9b8640 -1 osd.1 85 *** Got signal Terminated *** 2024-09-05T13:06:00.611 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:00 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1[38558]: 2024-09-05T13:06:00.199+0000 7fbf0d9b8640 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:06:06.048 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:05 smithi162 podman[68673]: 2024-09-05 13:06:05.713259994 +0000 UTC m=+5.634627509 container died ef733c411d6a8fbd41f1737623bc5b4e457cb23f026dc2f8246b534a4ffdebff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1, maintainer=Guillaume Abrioux , RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T13:06:06.361 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:06 smithi162 podman[68673]: 2024-09-05 13:06:06.145292202 +0000 UTC m=+6.066659711 container cleanup ef733c411d6a8fbd41f1737623bc5b4e457cb23f026dc2f8246b534a4ffdebff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T13:06:06.361 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:06 smithi162 bash[68673]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1 2024-09-05T13:06:06.806 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:06 smithi162 podman[68691]: 2024-09-05 13:06:06.382741241 +0000 UTC m=+0.672134959 container remove ef733c411d6a8fbd41f1737623bc5b4e457cb23f026dc2f8246b534a4ffdebff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T13:06:07.111 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:06 smithi162 podman[68780]: 2024-09-05 13:06:06.708627901 +0000 UTC m=+0.015983408 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:06:07.111 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:06 smithi162 podman[68780]: 2024-09-05 13:06:06.831723765 +0000 UTC m=+0.139079271 container create 17f2d40d8ba685b78fd42aa2806e2b33662e0e7aeb8824d7d8f7b45df9283723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-05T13:06:07.111 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:07 smithi162 podman[68780]: 2024-09-05 13:06:07.050886745 +0000 UTC m=+0.358242255 container init 17f2d40d8ba685b78fd42aa2806e2b33662e0e7aeb8824d7d8f7b45df9283723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2) 2024-09-05T13:06:07.111 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:07 smithi162 podman[68780]: 2024-09-05 13:06:07.054177498 +0000 UTC m=+0.361533006 container start 17f2d40d8ba685b78fd42aa2806e2b33662e0e7aeb8824d7d8f7b45df9283723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T13:06:07.570 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:07 smithi162 podman[68780]: 2024-09-05 13:06:07.151032614 +0000 UTC m=+0.458388139 container attach 17f2d40d8ba685b78fd42aa2806e2b33662e0e7aeb8824d7d8f7b45df9283723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-05T13:06:07.570 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 05 13:06:07 smithi162 podman[68780]: 2024-09-05 13:06:07.295861307 +0000 UTC m=+0.603216822 container died 17f2d40d8ba685b78fd42aa2806e2b33662e0e7aeb8824d7d8f7b45df9283723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-05T13:06:07.995 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.1.service' 2024-09-05T13:06:08.035 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:06:08.035 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-05T13:06:08.035 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-05T13:06:08.035 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.2 2024-09-05T13:06:08.356 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:08 smithi169 systemd[1]: Stopping Ceph osd.2 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:06:08.618 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:08 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2[39767]: 2024-09-05T13:06:08.354+0000 7f4530ac1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:06:08.618 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:08 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2[39767]: 2024-09-05T13:06:08.354+0000 7f4530ac1640 -1 osd.2 85 *** Got signal Terminated *** 2024-09-05T13:06:08.618 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:08 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2[39767]: 2024-09-05T13:06:08.354+0000 7f4530ac1640 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:06:14.282 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:13 smithi169 podman[69662]: 2024-09-05 13:06:13.968911996 +0000 UTC m=+5.740748135 container died 9ffe46af19ab9b1d5f37a2f089ba049745cb77df6036c2b4d58314bf121a89bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-05T13:06:14.616 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:14 smithi169 podman[69662]: 2024-09-05 13:06:14.371966078 +0000 UTC m=+6.143802218 container cleanup 9ffe46af19ab9b1d5f37a2f089ba049745cb77df6036c2b4d58314bf121a89bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-05T13:06:14.616 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:14 smithi169 bash[69662]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2 2024-09-05T13:06:14.867 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:14 smithi169 podman[69677]: 2024-09-05 13:06:14.615139441 +0000 UTC m=+0.647898531 container remove 9ffe46af19ab9b1d5f37a2f089ba049745cb77df6036c2b4d58314bf121a89bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T13:06:15.220 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:14 smithi169 podman[69768]: 2024-09-05 13:06:14.834747334 +0000 UTC m=+0.016228309 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:06:15.221 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:14 smithi169 podman[69768]: 2024-09-05 13:06:14.949386013 +0000 UTC m=+0.130866974 container create 1f91ed92db69d3e5034a07f952410f9c1a42b60e2f33689a07a04f9baca75c4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-05T13:06:15.618 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:15 smithi169 podman[69768]: 2024-09-05 13:06:15.219697863 +0000 UTC m=+0.401178850 container init 1f91ed92db69d3e5034a07f952410f9c1a42b60e2f33689a07a04f9baca75c4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-05T13:06:15.618 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:15 smithi169 podman[69768]: 2024-09-05 13:06:15.223665586 +0000 UTC m=+0.405146552 container start 1f91ed92db69d3e5034a07f952410f9c1a42b60e2f33689a07a04f9baca75c4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-05T13:06:15.618 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:15 smithi169 podman[69768]: 2024-09-05 13:06:15.33643162 +0000 UTC m=+0.517912586 container attach 1f91ed92db69d3e5034a07f952410f9c1a42b60e2f33689a07a04f9baca75c4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-05T13:06:15.618 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 05 13:06:15 smithi169 podman[69768]: 2024-09-05 13:06:15.43846903 +0000 UTC m=+0.619950006 container died 1f91ed92db69d3e5034a07f952410f9c1a42b60e2f33689a07a04f9baca75c4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-05T13:06:16.102 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.2.service' 2024-09-05T13:06:16.142 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:06:16.142 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-05T13:06:16.143 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-05T13:06:16.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.3 2024-09-05T13:06:16.469 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:16 smithi073 systemd[1]: Stopping Ceph osd.3 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:06:16.720 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:16 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3[51160]: 2024-09-05T13:06:16.468+0000 7f0d30cf8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:06:16.720 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:16 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3[51160]: 2024-09-05T13:06:16.468+0000 7f0d30cf8640 -1 osd.3 85 *** Got signal Terminated *** 2024-09-05T13:06:16.720 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:16 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3[51160]: 2024-09-05T13:06:16.468+0000 7f0d30cf8640 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:06:22.237 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:21 smithi073 podman[97487]: 2024-09-05 13:06:21.92817112 +0000 UTC m=+5.581057589 container died 42152ed417401d7e6fde63ea6309ef76c4c16b05099a4f143a03911ac23a18d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T13:06:22.513 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:22 smithi073 podman[97487]: 2024-09-05 13:06:22.444055332 +0000 UTC m=+6.096941844 container cleanup 42152ed417401d7e6fde63ea6309ef76c4c16b05099a4f143a03911ac23a18d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-05T13:06:22.513 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:22 smithi073 bash[97487]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3 2024-09-05T13:06:23.013 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:22 smithi073 podman[97513]: 2024-09-05 13:06:22.696181057 +0000 UTC m=+0.767231996 container remove 42152ed417401d7e6fde63ea6309ef76c4c16b05099a4f143a03911ac23a18d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-05T13:06:23.409 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:23 smithi073 podman[97602]: 2024-09-05 13:06:22.999154851 +0000 UTC m=+0.015701626 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:06:23.409 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:23 smithi073 podman[97602]: 2024-09-05 13:06:23.105850579 +0000 UTC m=+0.122397353 container create baffb218a4ed93d56871367c706b21b972b1c370cc73a14fc30e7397c9a28b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-05T13:06:23.409 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:23 smithi073 podman[97602]: 2024-09-05 13:06:23.408547254 +0000 UTC m=+0.425094041 container init baffb218a4ed93d56871367c706b21b972b1c370cc73a14fc30e7397c9a28b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3-deactivate, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-05T13:06:23.764 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:23 smithi073 podman[97602]: 2024-09-05 13:06:23.411894716 +0000 UTC m=+0.428441491 container start baffb218a4ed93d56871367c706b21b972b1c370cc73a14fc30e7397c9a28b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0) 2024-09-05T13:06:23.764 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:23 smithi073 podman[97602]: 2024-09-05 13:06:23.508686712 +0000 UTC m=+0.525233501 container attach baffb218a4ed93d56871367c706b21b972b1c370cc73a14fc30e7397c9a28b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-05T13:06:23.764 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 05 13:06:23 smithi073 podman[97602]: 2024-09-05 13:06:23.60205754 +0000 UTC m=+0.618604318 container died baffb218a4ed93d56871367c706b21b972b1c370cc73a14fc30e7397c9a28b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-05T13:06:24.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.3.service' 2024-09-05T13:06:24.329 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:06:24.329 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-05T13:06:24.329 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-05T13:06:24.329 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.4 2024-09-05T13:06:24.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:24 smithi162 systemd[1]: Stopping Ceph osd.4 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:06:25.111 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:24 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4[45430]: 2024-09-05T13:06:24.656+0000 7f054bc18640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:06:25.111 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:24 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4[45430]: 2024-09-05T13:06:24.656+0000 7f054bc18640 -1 osd.4 85 *** Got signal Terminated *** 2024-09-05T13:06:25.111 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:24 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4[45430]: 2024-09-05T13:06:24.656+0000 7f054bc18640 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:06:30.361 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:30 smithi162 podman[68909]: 2024-09-05 13:06:30.10700057 +0000 UTC m=+5.575000640 container died ebe273ed684292faa7b52486e394c619cbaf16d69750bb6ede8d5fb4e2ea24d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T13:06:30.861 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:30 smithi162 podman[68909]: 2024-09-05 13:06:30.465128394 +0000 UTC m=+5.933128454 container cleanup ebe273ed684292faa7b52486e394c619cbaf16d69750bb6ede8d5fb4e2ea24d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T13:06:30.864 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:30 smithi162 bash[68909]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4 2024-09-05T13:06:30.864 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:30 smithi162 podman[68925]: 2024-09-05 13:06:30.641370155 +0000 UTC m=+0.517709866 container remove ebe273ed684292faa7b52486e394c619cbaf16d69750bb6ede8d5fb4e2ea24d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-05T13:06:31.328 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:31 smithi162 podman[69013]: 2024-09-05 13:06:30.975790326 +0000 UTC m=+0.017123766 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:06:31.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:31 smithi162 podman[69013]: 2024-09-05 13:06:31.092563571 +0000 UTC m=+0.133897004 container create c987e0a16d92fa7d203c51da232fa54acc1385118c7d6d838eafa371408eed48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4-deactivate, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-05T13:06:31.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:31 smithi162 podman[69013]: 2024-09-05 13:06:31.328225718 +0000 UTC m=+0.369559151 container init c987e0a16d92fa7d203c51da232fa54acc1385118c7d6d838eafa371408eed48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-05T13:06:31.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:31 smithi162 podman[69013]: 2024-09-05 13:06:31.331625469 +0000 UTC m=+0.372958910 container start c987e0a16d92fa7d203c51da232fa54acc1385118c7d6d838eafa371408eed48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-05T13:06:31.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:31 smithi162 podman[69013]: 2024-09-05 13:06:31.45813101 +0000 UTC m=+0.499464444 container attach c987e0a16d92fa7d203c51da232fa54acc1385118c7d6d838eafa371408eed48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-05T13:06:31.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 05 13:06:31 smithi162 podman[69013]: 2024-09-05 13:06:31.524150284 +0000 UTC m=+0.565483726 container died c987e0a16d92fa7d203c51da232fa54acc1385118c7d6d838eafa371408eed48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T13:06:32.224 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.4.service' 2024-09-05T13:06:32.264 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:06:32.264 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-05T13:06:32.264 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-05T13:06:32.264 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.5 2024-09-05T13:06:32.602 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:32 smithi169 systemd[1]: Stopping Ceph osd.5 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:06:32.868 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:32 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5[46645]: 2024-09-05T13:06:32.601+0000 7f1125463640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:06:32.868 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:32 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5[46645]: 2024-09-05T13:06:32.601+0000 7f1125463640 -1 osd.5 85 *** Got signal Terminated *** 2024-09-05T13:06:32.868 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:32 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5[46645]: 2024-09-05T13:06:32.601+0000 7f1125463640 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:06:38.578 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:38 smithi169 podman[69883]: 2024-09-05 13:06:38.271024046 +0000 UTC m=+5.799912487 container died 9d87c2c309569430e94a7072b14878dd233a8cb2d0900b6a15e70876c175bbe0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-05T13:06:38.867 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:38 smithi169 podman[69883]: 2024-09-05 13:06:38.685016988 +0000 UTC m=+6.213905427 container cleanup 9d87c2c309569430e94a7072b14878dd233a8cb2d0900b6a15e70876c175bbe0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-05T13:06:38.868 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:38 smithi169 bash[69883]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5 2024-09-05T13:06:39.295 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:38 smithi169 podman[69899]: 2024-09-05 13:06:38.886336826 +0000 UTC m=+0.611085117 container remove 9d87c2c309569430e94a7072b14878dd233a8cb2d0900b6a15e70876c175bbe0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-05T13:06:39.574 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:39 smithi169 podman[69985]: 2024-09-05 13:06:39.196709951 +0000 UTC m=+0.016026855 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:06:39.574 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:39 smithi169 podman[69985]: 2024-09-05 13:06:39.320653691 +0000 UTC m=+0.139970574 container create 4c6c07d1e6b9bf1df0e2697ed82e9240209306e9b7b689e5523df305882834e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-05T13:06:39.574 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:39 smithi169 podman[69985]: 2024-09-05 13:06:39.573359104 +0000 UTC m=+0.392675990 container init 4c6c07d1e6b9bf1df0e2697ed82e9240209306e9b7b689e5523df305882834e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-05T13:06:39.868 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:39 smithi169 podman[69985]: 2024-09-05 13:06:39.576833591 +0000 UTC m=+0.396150479 container start 4c6c07d1e6b9bf1df0e2697ed82e9240209306e9b7b689e5523df305882834e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-05T13:06:39.868 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:39 smithi169 podman[69985]: 2024-09-05 13:06:39.673485183 +0000 UTC m=+0.492802064 container attach 4c6c07d1e6b9bf1df0e2697ed82e9240209306e9b7b689e5523df305882834e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-05T13:06:39.868 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 05 13:06:39 smithi169 podman[69985]: 2024-09-05 13:06:39.773858716 +0000 UTC m=+0.593175598 container died 4c6c07d1e6b9bf1df0e2697ed82e9240209306e9b7b689e5523df305882834e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-05T13:06:40.454 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.5.service' 2024-09-05T13:06:40.493 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:06:40.494 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-05T13:06:40.494 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-05T13:06:40.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.6 2024-09-05T13:06:40.817 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:40 smithi073 systemd[1]: Stopping Ceph osd.6 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:06:41.263 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:40 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6[57642]: 2024-09-05T13:06:40.815+0000 7fcc86609640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:06:41.263 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:40 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6[57642]: 2024-09-05T13:06:40.815+0000 7fcc86609640 -1 osd.6 85 *** Got signal Terminated *** 2024-09-05T13:06:41.264 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:40 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6[57642]: 2024-09-05T13:06:40.815+0000 7fcc86609640 -1 osd.6 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:06:46.669 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:46 smithi073 podman[97704]: 2024-09-05 13:06:46.412965321 +0000 UTC m=+5.721837898 container died c842e325f259240fb4f20c009aa09a69d6db6ed76a79ee257b7e7e5fb593de79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-05T13:06:46.930 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:46 smithi073 podman[97704]: 2024-09-05 13:06:46.915870749 +0000 UTC m=+6.224743364 container cleanup c842e325f259240fb4f20c009aa09a69d6db6ed76a79ee257b7e7e5fb593de79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-05T13:06:46.930 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:46 smithi073 bash[97704]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6 2024-09-05T13:06:47.496 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:47 smithi073 podman[97719]: 2024-09-05 13:06:47.184149598 +0000 UTC m=+0.767355642 container remove c842e325f259240fb4f20c009aa09a69d6db6ed76a79ee257b7e7e5fb593de79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-05T13:06:47.763 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:47 smithi073 podman[97807]: 2024-09-05 13:06:47.398710512 +0000 UTC m=+0.015992926 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:06:47.763 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:47 smithi073 podman[97807]: 2024-09-05 13:06:47.529534512 +0000 UTC m=+0.146816953 container create 5ef032c04d563d1e89d5d77119b47a267ebb1741b2980cc40af0c084532227bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-05T13:06:48.264 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:47 smithi073 podman[97807]: 2024-09-05 13:06:47.788119692 +0000 UTC m=+0.405402094 container init 5ef032c04d563d1e89d5d77119b47a267ebb1741b2980cc40af0c084532227bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T13:06:48.264 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:47 smithi073 podman[97807]: 2024-09-05 13:06:47.791446261 +0000 UTC m=+0.408728660 container start 5ef032c04d563d1e89d5d77119b47a267ebb1741b2980cc40af0c084532227bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD) 2024-09-05T13:06:48.264 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:47 smithi073 podman[97807]: 2024-09-05 13:06:47.863048695 +0000 UTC m=+0.480331097 container attach 5ef032c04d563d1e89d5d77119b47a267ebb1741b2980cc40af0c084532227bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T13:06:48.264 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 05 13:06:47 smithi073 podman[97807]: 2024-09-05 13:06:47.979485086 +0000 UTC m=+0.596767487 container died 5ef032c04d563d1e89d5d77119b47a267ebb1741b2980cc40af0c084532227bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T13:06:48.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.6.service' 2024-09-05T13:06:48.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:06:48.757 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-05T13:06:48.757 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-05T13:06:48.757 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.7 2024-09-05T13:06:49.093 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:48 smithi162 systemd[1]: Stopping Ceph osd.7 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:06:49.361 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:49 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7[52339]: 2024-09-05T13:06:49.091+0000 7f20e6182640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:06:49.361 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:49 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7[52339]: 2024-09-05T13:06:49.091+0000 7f20e6182640 -1 osd.7 85 *** Got signal Terminated *** 2024-09-05T13:06:49.361 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:49 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7[52339]: 2024-09-05T13:06:49.091+0000 7f20e6182640 -1 osd.7 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:06:54.953 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:54 smithi162 podman[69115]: 2024-09-05 13:06:54.639920894 +0000 UTC m=+5.684686363 container died c060ab3758a1728200d242e5460c2c5b785269ba4d356385a384724e9fb8ddaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T13:06:55.276 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:55 smithi162 podman[69115]: 2024-09-05 13:06:55.057443314 +0000 UTC m=+6.102208783 container cleanup c060ab3758a1728200d242e5460c2c5b785269ba4d356385a384724e9fb8ddaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T13:06:55.276 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:55 smithi162 bash[69115]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7 2024-09-05T13:06:55.610 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:55 smithi162 podman[69141]: 2024-09-05 13:06:55.275591868 +0000 UTC m=+0.637612405 container remove c060ab3758a1728200d242e5460c2c5b785269ba4d356385a384724e9fb8ddaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-05T13:06:56.013 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:55 smithi162 podman[69232]: 2024-09-05 13:06:55.667946508 +0000 UTC m=+0.112374412 container create a7ee6fab8ca64d421ef70a845d4a097db0cee661fa5fa0966920a2aca23c1f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-05T13:06:56.013 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:55 smithi162 podman[69232]: 2024-09-05 13:06:55.571786046 +0000 UTC m=+0.016213966 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:06:56.013 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:55 smithi162 podman[69232]: 2024-09-05 13:06:55.912137825 +0000 UTC m=+0.356565728 container init a7ee6fab8ca64d421ef70a845d4a097db0cee661fa5fa0966920a2aca23c1f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-09-05T13:06:56.013 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:55 smithi162 podman[69232]: 2024-09-05 13:06:55.915382887 +0000 UTC m=+0.359810794 container start a7ee6fab8ca64d421ef70a845d4a097db0cee661fa5fa0966920a2aca23c1f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-05T13:06:56.013 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:56 smithi162 podman[69232]: 2024-09-05 13:06:56.012271782 +0000 UTC m=+0.456699711 container attach a7ee6fab8ca64d421ef70a845d4a097db0cee661fa5fa0966920a2aca23c1f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-05T13:06:56.361 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 05 13:06:56 smithi162 podman[69232]: 2024-09-05 13:06:56.102609602 +0000 UTC m=+0.547037515 container died a7ee6fab8ca64d421ef70a845d4a097db0cee661fa5fa0966920a2aca23c1f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-05T13:06:56.740 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.7.service' 2024-09-05T13:06:56.780 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:06:56.780 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-05T13:06:56.780 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-05T13:06:56.780 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.8 2024-09-05T13:06:57.080 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:06:56 smithi169 systemd[1]: Stopping Ceph osd.8 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:06:57.367 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:06:57 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8[53392]: 2024-09-05T13:06:57.079+0000 7f1cfcc36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:06:57.368 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:06:57 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8[53392]: 2024-09-05T13:06:57.079+0000 7f1cfcc36640 -1 osd.8 85 *** Got signal Terminated *** 2024-09-05T13:06:57.368 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:06:57 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8[53392]: 2024-09-05T13:06:57.079+0000 7f1cfcc36640 -1 osd.8 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:06:58.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:06:58 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:06:58.171+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:06:59.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:06:59 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:06:59.200+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:00.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:00 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:00.201+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:01.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:01 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:01.193+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:02.111 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:01 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:01.624+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:02.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:01 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:01.627+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:02.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:02 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:02.166+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:02.831 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:02 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:02.627+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:02.831 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:07:02 smithi169 podman[70088]: 2024-09-05 13:07:02.562407929 +0000 UTC m=+5.584219288 container died fff78702a26084726cc934ad69722423852f5dd93d0d6cba857a991181830294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-05T13:07:03.111 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:02 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:02.625+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:03.117 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:07:02 smithi169 podman[70088]: 2024-09-05 13:07:02.929633928 +0000 UTC m=+5.951445284 container cleanup fff78702a26084726cc934ad69722423852f5dd93d0d6cba857a991181830294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-05T13:07:03.117 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:07:02 smithi169 bash[70088]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8 2024-09-05T13:07:03.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:03 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:03.185+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:03.537 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:07:03 smithi169 podman[70116]: 2024-09-05 13:07:03.189428536 +0000 UTC m=+0.629419740 container remove fff78702a26084726cc934ad69722423852f5dd93d0d6cba857a991181830294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T13:07:03.788 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:03 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:03.597+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:03.788 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:07:03 smithi169 podman[70205]: 2024-09-05 13:07:03.438886024 +0000 UTC m=+0.015993966 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:07:03.788 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:07:03 smithi169 podman[70205]: 2024-09-05 13:07:03.540164904 +0000 UTC m=+0.117272879 container create da41768c898d56c14c78575d909e021f0c7987364aeec0727ef8d0272e8b2fe9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-05T13:07:03.789 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:07:03 smithi169 podman[70205]: 2024-09-05 13:07:03.784361386 +0000 UTC m=+0.361469316 container init da41768c898d56c14c78575d909e021f0c7987364aeec0727ef8d0272e8b2fe9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-05T13:07:03.789 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:07:03 smithi169 podman[70205]: 2024-09-05 13:07:03.787618077 +0000 UTC m=+0.364726013 container start da41768c898d56c14c78575d909e021f0c7987364aeec0727ef8d0272e8b2fe9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-05T13:07:04.110 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:03 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:03.648+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:04.118 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:07:03 smithi169 podman[70205]: 2024-09-05 13:07:03.89298024 +0000 UTC m=+0.470088182 container attach da41768c898d56c14c78575d909e021f0c7987364aeec0727ef8d0272e8b2fe9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-05T13:07:04.118 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 05 13:07:03 smithi169 podman[70205]: 2024-09-05 13:07:03.97537105 +0000 UTC m=+0.552478982 container died da41768c898d56c14c78575d909e021f0c7987364aeec0727ef8d0272e8b2fe9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T13:07:04.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:04 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:04.220+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:04.617 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:04 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:04.590+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:04.696 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.8.service' 2024-09-05T13:07:04.739 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:04.739 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-05T13:07:04.739 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-05T13:07:04.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.9 2024-09-05T13:07:05.111 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:04 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:04.646+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:05.211 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:04 smithi073 systemd[1]: Stopping Ceph osd.9 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:05.211 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:05.010+0000 7fc6f7364640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:05.211 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:05.010+0000 7fc6f7364640 -1 osd.9 85 *** Got signal Terminated *** 2024-09-05T13:07:05.212 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:05.010+0000 7fc6f7364640 -1 osd.9 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:07:05.212 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:05 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:05.210+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:05.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:05 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:05.579+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:06.111 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:05 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:05.683+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:06.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:06 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:06.213+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:06.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:06 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:06.213+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.638459+0000 front 2024-09-05T13:06:02.638560+0000 (oldest deadline 2024-09-05T13:07:06.138278+0000) 2024-09-05T13:07:06.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:06 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:06.593+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:07.110 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:06 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:06.642+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:07.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:07 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:07.251+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:07.513 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:07 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:07.251+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.638459+0000 front 2024-09-05T13:06:02.638560+0000 (oldest deadline 2024-09-05T13:07:06.138278+0000) 2024-09-05T13:07:07.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:07 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:07.596+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:07.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:07 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:07.582+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:08.763 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:08 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:08.275+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:08.763 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:08 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:08.275+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.638459+0000 front 2024-09-05T13:06:02.638560+0000 (oldest deadline 2024-09-05T13:07:06.138278+0000) 2024-09-05T13:07:08.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:08 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:08.609+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:08.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:08 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:08.609+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:09.111 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:08 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:08.617+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:09.763 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:09 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:09.279+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.235948+0000 front 2024-09-05T13:05:55.235919+0000 (oldest deadline 2024-09-05T13:06:58.136088+0000) 2024-09-05T13:07:09.763 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:09 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9[64159]: 2024-09-05T13:07:09.279+0000 7fc6ef972640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.638459+0000 front 2024-09-05T13:06:02.638560+0000 (oldest deadline 2024-09-05T13:07:06.138278+0000) 2024-09-05T13:07:10.110 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:09 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:09.635+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:10.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:09 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:09.652+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:10.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:09 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:09.652+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:10.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:10 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:10.606+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:10.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:10 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:10.606+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:05.144083+0000 front 2024-09-05T13:06:05.144015+0000 (oldest deadline 2024-09-05T13:07:10.444120+0000) 2024-09-05T13:07:10.937 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:10 smithi073 podman[97909]: 2024-09-05 13:07:10.659340394 +0000 UTC m=+5.727242756 container died 059a449132c44fbc848834eba5c0ee579e47c636c7a6a28175401b7ef0b3eb0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T13:07:11.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:10 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:10.679+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:11.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:10 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:10.679+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:11.263 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:11 smithi073 podman[97909]: 2024-09-05 13:07:11.094340498 +0000 UTC m=+6.162242902 container cleanup 059a449132c44fbc848834eba5c0ee579e47c636c7a6a28175401b7ef0b3eb0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-05T13:07:11.263 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:11 smithi073 bash[97909]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9 2024-09-05T13:07:11.692 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:11 smithi073 podman[97924]: 2024-09-05 13:07:11.287482837 +0000 UTC m=+0.621692062 container remove 059a449132c44fbc848834eba5c0ee579e47c636c7a6a28175401b7ef0b3eb0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-05T13:07:11.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:11 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:11.580+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:11.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:11 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:11.580+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:05.144083+0000 front 2024-09-05T13:06:05.144015+0000 (oldest deadline 2024-09-05T13:07:10.444120+0000) 2024-09-05T13:07:11.999 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:11 smithi073 podman[98013]: 2024-09-05 13:07:11.59445813 +0000 UTC m=+0.015889571 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:07:12.000 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:11 smithi073 podman[98013]: 2024-09-05 13:07:11.696512078 +0000 UTC m=+0.117943507 container create 4d71082dca61a7b683b72bbe7b311540e76a3612f9ad3c0481e65aac8c5e671e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-05T13:07:12.000 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:11 smithi073 podman[98013]: 2024-09-05 13:07:11.924338452 +0000 UTC m=+0.345769882 container init 4d71082dca61a7b683b72bbe7b311540e76a3612f9ad3c0481e65aac8c5e671e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T13:07:12.000 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:11 smithi073 podman[98013]: 2024-09-05 13:07:11.92750153 +0000 UTC m=+0.348932960 container start 4d71082dca61a7b683b72bbe7b311540e76a3612f9ad3c0481e65aac8c5e671e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-05T13:07:12.000 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:11 smithi073 podman[98013]: 2024-09-05 13:07:11.999125505 +0000 UTC m=+0.420556932 container attach 4d71082dca61a7b683b72bbe7b311540e76a3612f9ad3c0481e65aac8c5e671e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T13:07:12.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:11 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:11.635+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:12.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:11 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:11.635+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:12.263 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 05 13:07:12 smithi073 podman[98036]: 2024-09-05 13:07:12.137993778 +0000 UTC m=+0.016988566 container died 4d71082dca61a7b683b72bbe7b311540e76a3612f9ad3c0481e65aac8c5e671e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-05T13:07:12.717 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.9.service' 2024-09-05T13:07:12.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:12.758 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-05T13:07:12.758 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-05T13:07:12.758 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.10 2024-09-05T13:07:12.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:12 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:12.579+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:12.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:12 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:12.579+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:05.144083+0000 front 2024-09-05T13:06:05.144015+0000 (oldest deadline 2024-09-05T13:07:10.444120+0000) 2024-09-05T13:07:12.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:12 smithi162 systemd[1]: Stopping Ceph osd.10 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:12.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:12 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:12.604+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:12.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:12 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:12.604+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:13.361 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:13 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:13.075+0000 7f6d36a7d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:13.361 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:13 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:13.075+0000 7f6d36a7d640 -1 osd.10 85 *** Got signal Terminated *** 2024-09-05T13:07:13.361 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:13 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:13.075+0000 7f6d36a7d640 -1 osd.10 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:07:13.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:13 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:13.591+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:13.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:13 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:13.591+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:05.144083+0000 front 2024-09-05T13:06:05.144015+0000 (oldest deadline 2024-09-05T13:07:10.444120+0000) 2024-09-05T13:07:14.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:13 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:13.646+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:14.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:13 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:13.646+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:14.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:14 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:14.547+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:14.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:14 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:14.547+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:05.144083+0000 front 2024-09-05T13:06:05.144015+0000 (oldest deadline 2024-09-05T13:07:10.444120+0000) 2024-09-05T13:07:15.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:14 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:14.637+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:15.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:14 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:14.637+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:15.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:15 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:15.571+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:15.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:15 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:15.571+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:05.144083+0000 front 2024-09-05T13:06:05.144015+0000 (oldest deadline 2024-09-05T13:07:10.444120+0000) 2024-09-05T13:07:15.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:15 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:15.609+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:15.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:15 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:15.609+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:16.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:16 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:16.550+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:16.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:16 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:16.550+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:05.144083+0000 front 2024-09-05T13:06:05.144015+0000 (oldest deadline 2024-09-05T13:07:10.444120+0000) 2024-09-05T13:07:16.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:16 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:16.550+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:13.245513+0000 front 2024-09-05T13:06:13.245490+0000 (oldest deadline 2024-09-05T13:07:16.145259+0000) 2024-09-05T13:07:17.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:16 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:16.646+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:17.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:16 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:16.646+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:17.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:17 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:17.554+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:56.343167+0000 front 2024-09-05T13:05:56.343325+0000 (oldest deadline 2024-09-05T13:07:01.043031+0000) 2024-09-05T13:07:17.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:17 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:17.554+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:05.144083+0000 front 2024-09-05T13:06:05.144015+0000 (oldest deadline 2024-09-05T13:07:10.444120+0000) 2024-09-05T13:07:17.861 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:17 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10[59303]: 2024-09-05T13:07:17.554+0000 7f6d2f08b640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:13.245513+0000 front 2024-09-05T13:06:13.245490+0000 (oldest deadline 2024-09-05T13:07:16.145259+0000) 2024-09-05T13:07:18.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:17 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:17.632+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:18.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:17 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:17.632+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:18.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:17 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:17.632+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:11.169371+0000 front 2024-09-05T13:06:11.169296+0000 (oldest deadline 2024-09-05T13:07:17.069403+0000) 2024-09-05T13:07:18.831 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:18 smithi162 podman[69334]: 2024-09-05 13:07:18.540725457 +0000 UTC m=+5.591186249 container died b3a0725099b618d68b5228e8704dbfd623a1c7849d5301a97d7fe4cd275a2ef1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-05T13:07:19.111 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:18 smithi162 podman[69334]: 2024-09-05 13:07:18.933475631 +0000 UTC m=+5.983936421 container cleanup b3a0725099b618d68b5228e8704dbfd623a1c7849d5301a97d7fe4cd275a2ef1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-05T13:07:19.111 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:18 smithi162 bash[69334]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10 2024-09-05T13:07:19.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:18 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:18.632+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:19.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:18 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:18.632+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:19.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:18 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:18.632+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:11.169371+0000 front 2024-09-05T13:06:11.169296+0000 (oldest deadline 2024-09-05T13:07:17.069403+0000) 2024-09-05T13:07:19.478 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:19 smithi162 podman[69351]: 2024-09-05 13:07:19.159853536 +0000 UTC m=+0.620996641 container remove b3a0725099b618d68b5228e8704dbfd623a1c7849d5301a97d7fe4cd275a2ef1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-05T13:07:19.772 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:19 smithi162 podman[69443]: 2024-09-05 13:07:19.47722369 +0000 UTC m=+0.102775086 container create f8e641205a284f3fcd3a3c9f5225c34995533dd934368f3f292bb82de7a64b69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True) 2024-09-05T13:07:19.772 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:19 smithi162 podman[69443]: 2024-09-05 13:07:19.390575778 +0000 UTC m=+0.016127182 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:07:19.772 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:19 smithi162 podman[69443]: 2024-09-05 13:07:19.71300016 +0000 UTC m=+0.338551557 container init f8e641205a284f3fcd3a3c9f5225c34995533dd934368f3f292bb82de7a64b69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-05T13:07:19.772 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:19 smithi162 podman[69443]: 2024-09-05 13:07:19.716203456 +0000 UTC m=+0.341754855 container start f8e641205a284f3fcd3a3c9f5225c34995533dd934368f3f292bb82de7a64b69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, org.label-schema.build-date=20240731) 2024-09-05T13:07:19.772 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:19 smithi162 podman[69443]: 2024-09-05 13:07:19.77117462 +0000 UTC m=+0.396726024 container attach f8e641205a284f3fcd3a3c9f5225c34995533dd934368f3f292bb82de7a64b69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10-deactivate, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-05T13:07:20.111 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 05 13:07:19 smithi162 podman[69443]: 2024-09-05 13:07:19.904460835 +0000 UTC m=+0.530012240 container died f8e641205a284f3fcd3a3c9f5225c34995533dd934368f3f292bb82de7a64b69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-10-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-05T13:07:20.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:19 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:19.670+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:20.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:19 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:19.670+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:20.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:19 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:19.670+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:11.169371+0000 front 2024-09-05T13:06:11.169296+0000 (oldest deadline 2024-09-05T13:07:17.069403+0000) 2024-09-05T13:07:20.500 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.10.service' 2024-09-05T13:07:20.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:20.539 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-05T13:07:20.539 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-05T13:07:20.539 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.11 2024-09-05T13:07:20.842 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:20 smithi169 systemd[1]: Stopping Ceph osd.11 for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:20.842 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:20 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:20.648+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:20.842 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:20 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:20.648+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:20.842 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:20 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:20.648+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:11.169371+0000 front 2024-09-05T13:06:11.169296+0000 (oldest deadline 2024-09-05T13:07:17.069403+0000) 2024-09-05T13:07:21.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:20 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:20.840+0000 7f846e3d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:21.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:20 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:20.840+0000 7f846e3d0640 -1 osd.11 85 *** Got signal Terminated *** 2024-09-05T13:07:21.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:20 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:20.840+0000 7f846e3d0640 -1 osd.11 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T13:07:22.117 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:21 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:21.623+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:22.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:21 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:21.623+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:22.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:21 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:21.623+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:11.169371+0000 front 2024-09-05T13:06:11.169296+0000 (oldest deadline 2024-09-05T13:07:17.069403+0000) 2024-09-05T13:07:22.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:22 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:22.593+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:22.868 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:22 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:22.593+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:22.868 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:22 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:22.593+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:11.169371+0000 front 2024-09-05T13:06:11.169296+0000 (oldest deadline 2024-09-05T13:07:17.069403+0000) 2024-09-05T13:07:24.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:23 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:23.628+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:24.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:23 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:23.628+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:24.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:23 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:23.628+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:11.169371+0000 front 2024-09-05T13:06:11.169296+0000 (oldest deadline 2024-09-05T13:07:17.069403+0000) 2024-09-05T13:07:24.118 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:23 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:23.628+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-05T13:06:20.570609+0000 front 2024-09-05T13:06:20.570675+0000 (oldest deadline 2024-09-05T13:07:22.870441+0000) 2024-09-05T13:07:24.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:24 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:24.600+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:24.868 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:24 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:24.600+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:24.868 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:24 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:24.600+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:11.169371+0000 front 2024-09-05T13:06:11.169296+0000 (oldest deadline 2024-09-05T13:07:17.069403+0000) 2024-09-05T13:07:24.868 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:24 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:24.600+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-05T13:06:20.570609+0000 front 2024-09-05T13:06:20.570675+0000 (oldest deadline 2024-09-05T13:07:22.870441+0000) 2024-09-05T13:07:25.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:25 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:25.595+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-05T13:05:55.467181+0000 front 2024-09-05T13:05:55.467316+0000 (oldest deadline 2024-09-05T13:07:00.767095+0000) 2024-09-05T13:07:25.868 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:25 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:25.595+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-05T13:06:02.468195+0000 front 2024-09-05T13:06:02.468065+0000 (oldest deadline 2024-09-05T13:07:07.768093+0000) 2024-09-05T13:07:25.868 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:25 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:25.595+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-05T13:06:11.169371+0000 front 2024-09-05T13:06:11.169296+0000 (oldest deadline 2024-09-05T13:07:17.069403+0000) 2024-09-05T13:07:25.868 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:25 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11[60354]: 2024-09-05T13:07:25.595+0000 7f846a9e6640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-05T13:06:20.570609+0000 front 2024-09-05T13:06:20.570675+0000 (oldest deadline 2024-09-05T13:07:22.870441+0000) 2024-09-05T13:07:26.600 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:26 smithi169 podman[70308]: 2024-09-05 13:07:26.340813568 +0000 UTC m=+5.604911332 container died 0e84e10a755c4183f1e1f1cfe51306e3e33fc62b78bc5c40b3d822c637f01134 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-05T13:07:26.867 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:26 smithi169 podman[70308]: 2024-09-05 13:07:26.681718811 +0000 UTC m=+5.945816572 container cleanup 0e84e10a755c4183f1e1f1cfe51306e3e33fc62b78bc5c40b3d822c637f01134 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-05T13:07:26.868 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:26 smithi169 bash[70308]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11 2024-09-05T13:07:27.336 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:26 smithi169 podman[70324]: 2024-09-05 13:07:26.97463165 +0000 UTC m=+0.637270184 container remove 0e84e10a755c4183f1e1f1cfe51306e3e33fc62b78bc5c40b3d822c637f01134 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-05T13:07:27.618 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:27 smithi169 podman[70413]: 2024-09-05 13:07:27.238444675 +0000 UTC m=+0.015942162 image pull 1d96423d1332efb9e5f8063bc531a59b7531a45a24fb75f81483029528a85232 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945 2024-09-05T13:07:27.618 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:27 smithi169 podman[70413]: 2024-09-05 13:07:27.342282792 +0000 UTC m=+0.119780279 container create e623ddd172432cad8fbd0a6bdc2f7c695af33d88105ddab96bce59da17591cac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-05T13:07:27.618 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:27 smithi169 podman[70413]: 2024-09-05 13:07:27.553478212 +0000 UTC m=+0.330975704 container init e623ddd172432cad8fbd0a6bdc2f7c695af33d88105ddab96bce59da17591cac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T13:07:27.618 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:27 smithi169 podman[70413]: 2024-09-05 13:07:27.556636806 +0000 UTC m=+0.334134311 container start e623ddd172432cad8fbd0a6bdc2f7c695af33d88105ddab96bce59da17591cac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T13:07:28.040 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:27 smithi169 podman[70413]: 2024-09-05 13:07:27.636705205 +0000 UTC m=+0.414202708 container attach e623ddd172432cad8fbd0a6bdc2f7c695af33d88105ddab96bce59da17591cac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T13:07:28.040 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 05 13:07:27 smithi169 podman[70413]: 2024-09-05 13:07:27.745402278 +0000 UTC m=+0.522899768 container died e623ddd172432cad8fbd0a6bdc2f7c695af33d88105ddab96bce59da17591cac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-osd-11-deactivate, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-05T13:07:28.322 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@osd.11.service' 2024-09-05T13:07:28.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:28.361 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-05T13:07:28.362 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-05T13:07:28.362 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.a 2024-09-05T13:07:28.648 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 13:07:28 smithi073 systemd[1]: Stopping Ceph mds.a for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:29.013 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 13:07:28 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-a[71467]: 2024-09-05T13:07:28.646+0000 7f56146e8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:29.013 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 13:07:28 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-a[71467]: 2024-09-05T13:07:28.646+0000 7f56146e8640 -1 mds.a *** got signal Terminated *** 2024-09-05T13:07:32.940 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 13:07:32 smithi073 podman[98127]: 2024-09-05 13:07:32.685173626 +0000 UTC m=+4.133163843 container died ccc4588bae307720ba56be6bf4cfa9b3129f6009cfbde6e78f8dd2f7887eed10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-a, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-05T13:07:33.263 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 13:07:33 smithi073 podman[98127]: 2024-09-05 13:07:33.105349113 +0000 UTC m=+4.553339314 container cleanup ccc4588bae307720ba56be6bf4cfa9b3129f6009cfbde6e78f8dd2f7887eed10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-05T13:07:33.263 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 13:07:33 smithi073 bash[98127]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-a 2024-09-05T13:07:33.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.a.service' 2024-09-05T13:07:33.553 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 13:07:33 smithi073 podman[98139]: 2024-09-05 13:07:33.29847681 +0000 UTC m=+0.606521725 container remove ccc4588bae307720ba56be6bf4cfa9b3129f6009cfbde6e78f8dd2f7887eed10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-a, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-05T13:07:33.553 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 13:07:33 smithi073 systemd[1]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-05T13:07:33.553 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 05 13:07:33 smithi073 systemd[1]: Stopped Ceph mds.a for febf1dd4-6b84-11ef-bcd6-c7b262605968. 2024-09-05T13:07:33.567 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:33.567 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-05T13:07:33.567 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-05T13:07:33.567 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.d 2024-09-05T13:07:33.894 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 13:07:33 smithi073 systemd[1]: Stopping Ceph mds.d for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:34.263 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 13:07:33 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-d[70275]: 2024-09-05T13:07:33.892+0000 7f1d93a33640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:34.263 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 13:07:33 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-d[70275]: 2024-09-05T13:07:33.892+0000 7f1d93a33640 -1 mds.d *** got signal Terminated *** 2024-09-05T13:07:38.218 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 13:07:37 smithi073 podman[98246]: 2024-09-05 13:07:37.90681157 +0000 UTC m=+4.118608206 container died 3e778f6db72d7972ed823deb9b1a0a3e5815f53918cb3e99c0d28a3a20db1d38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-d, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-05T13:07:38.478 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 13:07:38 smithi073 podman[98246]: 2024-09-05 13:07:38.309317927 +0000 UTC m=+4.521114562 container cleanup 3e778f6db72d7972ed823deb9b1a0a3e5815f53918cb3e99c0d28a3a20db1d38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True) 2024-09-05T13:07:38.478 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 05 13:07:38 smithi073 bash[98246]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-d 2024-09-05T13:07:38.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.d.service' 2024-09-05T13:07:38.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:38.718 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-05T13:07:38.718 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-05T13:07:38.718 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.g 2024-09-05T13:07:39.047 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 13:07:38 smithi073 systemd[1]: Stopping Ceph mds.g for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:39.513 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 13:07:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-g[71157]: 2024-09-05T13:07:39.046+0000 7f3922f70640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:39.513 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 13:07:39 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-g[71157]: 2024-09-05T13:07:39.046+0000 7f3922f70640 -1 mds.g *** got signal Terminated *** 2024-09-05T13:07:42.847 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 13:07:42 smithi073 podman[98367]: 2024-09-05 13:07:42.550302829 +0000 UTC m=+3.614068150 container died 71933dfc691fdb58522cac8af8da53443c5443d1499a137a46a7d315c1daf9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-05T13:07:42.847 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 13:07:42 smithi073 podman[98367]: 2024-09-05 13:07:42.846787349 +0000 UTC m=+3.910552660 container cleanup 71933dfc691fdb58522cac8af8da53443c5443d1499a137a46a7d315c1daf9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-g, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-05T13:07:43.254 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 13:07:42 smithi073 bash[98367]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-g 2024-09-05T13:07:43.254 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 05 13:07:43 smithi073 podman[98382]: 2024-09-05 13:07:43.02323957 +0000 UTC m=+0.468996804 container remove 71933dfc691fdb58522cac8af8da53443c5443d1499a137a46a7d315c1daf9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T13:07:43.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.g.service' 2024-09-05T13:07:43.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:43.300 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-05T13:07:43.300 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-05T13:07:43.300 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.j 2024-09-05T13:07:43.618 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 13:07:43 smithi073 systemd[1]: Stopping Ceph mds.j for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:44.013 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 13:07:43 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-j[69874]: 2024-09-05T13:07:43.617+0000 7f08b0f05640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:44.013 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 13:07:43 smithi073 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-j[69874]: 2024-09-05T13:07:43.617+0000 7f08b0f05640 -1 mds.j *** got signal Terminated *** 2024-09-05T13:07:46.604 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 13:07:46 smithi073 podman[98490]: 2024-09-05 13:07:46.302491805 +0000 UTC m=+2.781521804 container died eb660a2617c2afe72e777d5d421e5f70268fb34daeee17b8f6ab275149550a7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-j, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-05T13:07:46.961 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 13:07:46 smithi073 podman[98490]: 2024-09-05 13:07:46.730860173 +0000 UTC m=+3.209890102 container cleanup eb660a2617c2afe72e777d5d421e5f70268fb34daeee17b8f6ab275149550a7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T13:07:46.961 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 05 13:07:46 smithi073 bash[98490]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-j 2024-09-05T13:07:47.086 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.j.service' 2024-09-05T13:07:47.118 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:47.118 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-05T13:07:47.118 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-05T13:07:47.118 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.b 2024-09-05T13:07:47.407 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 13:07:47 smithi162 systemd[1]: Stopping Ceph mds.b for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:47.860 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 13:07:47 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b[64807]: 2024-09-05T13:07:47.405+0000 7f543d2d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:47.861 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 13:07:47 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b[64807]: 2024-09-05T13:07:47.405+0000 7f543d2d0640 -1 mds.b *** got signal Terminated *** 2024-09-05T13:07:49.029 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 13:07:48 smithi162 podman[69546]: 2024-09-05 13:07:48.746006162 +0000 UTC m=+1.431185856 container died 68348360e9b946ffc236b6344bf32001651b85152cce7c7a888f71cb3ccd200a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-05T13:07:49.361 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 13:07:49 smithi162 podman[69546]: 2024-09-05 13:07:49.138982222 +0000 UTC m=+1.824161906 container cleanup 68348360e9b946ffc236b6344bf32001651b85152cce7c7a888f71cb3ccd200a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-05T13:07:49.361 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 05 13:07:49 smithi162 bash[69546]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-b 2024-09-05T13:07:49.580 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.b.service' 2024-09-05T13:07:49.616 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:49.616 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-05T13:07:49.616 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-05T13:07:49.617 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.e 2024-09-05T13:07:49.952 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 13:07:49 smithi162 systemd[1]: Stopping Ceph mds.e for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:50.361 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 13:07:49 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e[64203]: 2024-09-05T13:07:49.950+0000 7f1a2d065640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:50.361 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 13:07:49 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e[64203]: 2024-09-05T13:07:49.950+0000 7f1a2d065640 -1 mds.e *** got signal Terminated *** 2024-09-05T13:07:53.111 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 13:07:52 smithi162 podman[69678]: 2024-09-05 13:07:52.755109791 +0000 UTC m=+2.904167408 container died b83cd90ef665b87376fbf2bdae0f43a64ae24033a372dcdaaee5b359e3884e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.build-date=20240731) 2024-09-05T13:07:53.495 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 13:07:53 smithi162 podman[69678]: 2024-09-05 13:07:53.243037516 +0000 UTC m=+3.392095165 container cleanup b83cd90ef665b87376fbf2bdae0f43a64ae24033a372dcdaaee5b359e3884e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-05T13:07:53.495 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 05 13:07:53 smithi162 bash[69678]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-e 2024-09-05T13:07:53.623 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.e.service' 2024-09-05T13:07:53.657 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:53.658 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-05T13:07:53.658 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-05T13:07:53.658 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.h 2024-09-05T13:07:53.861 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 13:07:53 smithi162 systemd[1]: Stopping Ceph mds.h for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:54.361 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 13:07:53 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h[64504]: 2024-09-05T13:07:53.971+0000 7fc4112f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:54.361 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 13:07:53 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h[64504]: 2024-09-05T13:07:53.971+0000 7fc4112f8640 -1 mds.h *** got signal Terminated *** 2024-09-05T13:07:57.032 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 13:07:56 smithi162 podman[69802]: 2024-09-05 13:07:56.753117732 +0000 UTC m=+2.875464675 container died 23d08294772488295c3aad377042e2423be6ef0977a2e4dd39442e9dae4757db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-05T13:07:57.360 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 13:07:57 smithi162 podman[69802]: 2024-09-05 13:07:57.112853276 +0000 UTC m=+3.235200225 container cleanup 23d08294772488295c3aad377042e2423be6ef0977a2e4dd39442e9dae4757db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-05T13:07:57.361 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 05 13:07:57 smithi162 bash[69802]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-h 2024-09-05T13:07:57.555 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.h.service' 2024-09-05T13:07:57.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:07:57.589 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-05T13:07:57.589 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-05T13:07:57.589 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.k 2024-09-05T13:07:57.917 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 13:07:57 smithi162 systemd[1]: Stopping Ceph mds.k for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:07:58.361 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 13:07:57 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-k[63887]: 2024-09-05T13:07:57.916+0000 7fe3ee975640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:07:58.361 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 13:07:57 smithi162 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-k[63887]: 2024-09-05T13:07:57.916+0000 7fe3ee975640 -1 mds.k *** got signal Terminated *** 2024-09-05T13:07:59.792 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 13:07:59 smithi162 podman[69924]: 2024-09-05 13:07:59.484241281 +0000 UTC m=+1.673675958 container died d3470ab6bf8e9a61e8ab2de77c023345f2a1ad059444fec629a6459256359f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-05T13:07:59.792 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 13:07:59 smithi162 podman[69924]: 2024-09-05 13:07:59.791634792 +0000 UTC m=+1.981069454 container cleanup d3470ab6bf8e9a61e8ab2de77c023345f2a1ad059444fec629a6459256359f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-05T13:08:00.109 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 13:07:59 smithi162 bash[69924]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-k 2024-09-05T13:08:00.109 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 05 13:08:00 smithi162 podman[69936]: 2024-09-05 13:08:00.017753259 +0000 UTC m=+0.536109051 container remove d3470ab6bf8e9a61e8ab2de77c023345f2a1ad059444fec629a6459256359f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-k, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-05T13:08:00.151 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.k.service' 2024-09-05T13:08:00.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:08:00.184 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-05T13:08:00.184 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-05T13:08:00.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.c 2024-09-05T13:08:00.483 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:08:00 smithi169 systemd[1]: Stopping Ceph mds.c for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:08:00.747 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:08:00 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: 2024-09-05T13:08:00.480+0000 7f7987aad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:08:00.747 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:08:00 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c[65203]: 2024-09-05T13:08:00.480+0000 7f7987aad640 -1 mds.c *** got signal Terminated *** 2024-09-05T13:08:04.740 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:08:04 smithi169 podman[70516]: 2024-09-05 13:08:04.487871914 +0000 UTC m=+4.109556488 container died 7a9c6082eb02037fdd4caabaceabc58506b8d45fa8c8478a447a5cf3f2b02c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-05T13:08:05.008 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:08:04 smithi169 podman[70516]: 2024-09-05 13:08:04.830722312 +0000 UTC m=+4.452406871 container cleanup 7a9c6082eb02037fdd4caabaceabc58506b8d45fa8c8478a447a5cf3f2b02c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-05T13:08:05.008 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:08:04 smithi169 bash[70516]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c 2024-09-05T13:08:05.265 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 05 13:08:05 smithi169 podman[70539]: 2024-09-05 13:08:05.006762783 +0000 UTC m=+0.512772038 container remove 7a9c6082eb02037fdd4caabaceabc58506b8d45fa8c8478a447a5cf3f2b02c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T13:08:05.270 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.c.service' 2024-09-05T13:08:05.307 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:08:05.307 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-05T13:08:05.307 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-05T13:08:05.307 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.f 2024-09-05T13:08:05.617 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 13:08:05 smithi169 systemd[1]: Stopping Ceph mds.f for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:08:06.120 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 13:08:05 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f[64905]: 2024-09-05T13:08:05.658+0000 7f32e82d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:08:06.120 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 13:08:05 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f[64905]: 2024-09-05T13:08:05.658+0000 7f32e82d3640 -1 mds.f *** got signal Terminated *** 2024-09-05T13:08:09.028 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 13:08:08 smithi169 podman[70649]: 2024-09-05 13:08:08.753524151 +0000 UTC m=+3.229280091 container died 35c37a324c2d3708b1fda85462781f161cfb78f17283a6bb5cebbc5a48c09992 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T13:08:09.367 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 13:08:09 smithi169 podman[70649]: 2024-09-05 13:08:09.100915953 +0000 UTC m=+3.576671896 container cleanup 35c37a324c2d3708b1fda85462781f161cfb78f17283a6bb5cebbc5a48c09992 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-05T13:08:09.368 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 05 13:08:09 smithi169 bash[70649]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-f 2024-09-05T13:08:09.531 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.f.service' 2024-09-05T13:08:09.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:08:09.565 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-05T13:08:09.565 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-05T13:08:09.565 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.i 2024-09-05T13:08:09.881 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 13:08:09 smithi169 systemd[1]: Stopping Ceph mds.i for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:08:10.367 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 13:08:09 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i[65508]: 2024-09-05T13:08:09.878+0000 7f9069eb4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:08:10.367 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 13:08:09 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i[65508]: 2024-09-05T13:08:09.878+0000 7f9069eb4640 -1 mds.i *** got signal Terminated *** 2024-09-05T13:08:13.023 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 13:08:12 smithi169 podman[70768]: 2024-09-05 13:08:12.762117781 +0000 UTC m=+2.979905037 container died e155dbb3f4bb03cc3ee355a8baa073c07e71678726fb35aaa5f7d957ddb4d69d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T13:08:13.306 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 13:08:13 smithi169 podman[70768]: 2024-09-05 13:08:13.096386409 +0000 UTC m=+3.314173706 container cleanup e155dbb3f4bb03cc3ee355a8baa073c07e71678726fb35aaa5f7d957ddb4d69d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b) 2024-09-05T13:08:13.307 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 05 13:08:13 smithi169 bash[70768]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-i 2024-09-05T13:08:13.522 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.i.service' 2024-09-05T13:08:13.556 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:08:13.557 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-05T13:08:13.557 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-05T13:08:13.557 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.l 2024-09-05T13:08:13.876 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 13:08:13 smithi169 systemd[1]: Stopping Ceph mds.l for febf1dd4-6b84-11ef-bcd6-c7b262605968... 2024-09-05T13:08:14.368 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 13:08:13 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-l[64588]: 2024-09-05T13:08:13.875+0000 7fb465819640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T13:08:14.368 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 13:08:13 smithi169 ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-l[64588]: 2024-09-05T13:08:13.875+0000 7fb465819640 -1 mds.l *** got signal Terminated *** 2024-09-05T13:08:16.918 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 13:08:16 smithi169 podman[70887]: 2024-09-05 13:08:16.650112132 +0000 UTC m=+2.884282975 container died 285eb183f55aac5d10404de3ee7e7a046703f4427ca06427a2cb040e43a8ce81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-l, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T13:08:17.260 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 13:08:17 smithi169 podman[70887]: 2024-09-05 13:08:17.008436685 +0000 UTC m=+3.242607525 container cleanup 285eb183f55aac5d10404de3ee7e7a046703f4427ca06427a2cb040e43a8ce81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a8d119a7bc9b781809e472dee68e518e59e6f64fda4c70bd4af602122e8dd945, name=ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath6-testing-2024-09-05-1413-squid-e856d6b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-05T13:08:17.260 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 05 13:08:17 smithi169 bash[70887]: ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968-mds-l 2024-09-05T13:08:17.387 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-febf1dd4-6b84-11ef-bcd6-c7b262605968@mds.l.service' 2024-09-05T13:08:17.419 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T13:08:17.419 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-05T13:08:17.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-05T13:08:17.621 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T13:08:20.182 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-05T13:08:20.387 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T13:08:22.938 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-05T13:08:23.141 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T13:08:25.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T13:08:25.631 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T13:08:25.665 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T13:08:25.692 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-05T13:08:25.694 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462/remote/smithi073/crash 2024-09-05T13:08:25.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/crash -- . 2024-09-05T13:08:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:tar: /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-05T13:08:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:tar: Error is not recoverable: exiting now 2024-09-05T13:08:25.739 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462/remote/smithi162/crash 2024-09-05T13:08:25.740 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/crash -- . 2024-09-05T13:08:25.784 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-05T13:08:25.784 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-09-05T13:08:25.786 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462/remote/smithi169/crash 2024-09-05T13:08:25.787 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/crash -- . 2024-09-05T13:08:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:tar: /var/lib/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-05T13:08:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:tar: Error is not recoverable: exiting now 2024-09-05T13:08:25.822 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-05T13:08:25.823 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-05T13:08:25.893 INFO:tasks.cephadm:Compressing logs... 2024-09-05T13:08:25.893 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T13:08:25.896 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T13:08:25.898 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T13:08:25.928 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-05T13:08:25.929 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.10.log 2024-09-05T13:08:25.930 INFO:teuthology.orchestra.run.smithi073.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-05T13:08:25.934 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.1.log 2024-09-05T13:08:25.934 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.7.log 2024-09-05T13:08:25.934 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-05T13:08:25.934 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.b.log 2024-09-05T13:08:25.934 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.k.log 2024-09-05T13:08:25.934 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.4.log 2024-09-05T13:08:25.934 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-05T13:08:25.934 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-05T13:08:25.934 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mgr.y.log 2024-09-05T13:08:25.934 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.log 2024-09-05T13:08:25.935 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.h.log 2024-09-05T13:08:25.935 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mon.b.log 2024-09-05T13:08:25.935 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.e.log 2024-09-05T13:08:25.935 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-05T13:08:25.935 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 94.7% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.k.log.gz 2024-09-05T13:08:25.936 INFO:teuthology.orchestra.run.smithi162.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-05T13:08:25.943 INFO:teuthology.orchestra.run.smithi169.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-05T13:08:25.943 INFO:teuthology.orchestra.run.smithi169.stderr:: No such file or directory 2024-09-05T13:08:25.943 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-05T13:08:25.943 INFO:teuthology.orchestra.run.smithi169.stderr:gzip/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.i.log 2024-09-05T13:08:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mon.c.log 2024-09-05T13:08:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-05T13:08:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.11.log 2024-09-05T13:08:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:gzip/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.cephadm.log: -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.2.log 2024-09-05T13:08:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.5.log 2024-09-05T13:08:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.log 2024-09-05T13:08:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.l.log 2024-09-05T13:08:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.8.log 2024-09-05T13:08:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mgr.z.log 2024-09-05T13:08:25.945 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.c.log 2024-09-05T13:08:25.945 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.f.log 2024-09-05T13:08:25.945 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-05T13:08:25.945 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 94.7% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.l.log.gz 2024-09-05T13:08:25.946 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.0.log 2024-09-05T13:08:25.947 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.9.log 2024-09-05T13:08:25.947 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-05T13:08:25.947 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-05T13:08:25.947 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.a.log 2024-09-05T13:08:25.947 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-05T13:08:25.948 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mon.a.log 2024-09-05T13:08:25.948 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.g.log 2024-09-05T13:08:25.948 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.6.log 2024-09-05T13:08:25.948 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.log 2024-09-05T13:08:25.948 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.d.log 2024-09-05T13:08:25.948 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mgr.x.log 2024-09-05T13:08:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.j.log 2024-09-05T13:08:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.3.log 2024-09-05T13:08:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-05T13:08:25.949 INFO:teuthology.orchestra.run.smithi073.stderr: 94.7% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.a.log.gz 2024-09-05T13:08:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 86.6% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.log.gz 2024-09-05T13:08:25.949 INFO:teuthology.orchestra.run.smithi073.stderr: 94.7% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.g.log.gz 2024-09-05T13:08:25.950 INFO:teuthology.orchestra.run.smithi073.stderr: 94.7% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.d.log.gz 2024-09-05T13:08:25.950 INFO:teuthology.orchestra.run.smithi073.stderr: 94.8% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.j.log.gz 2024-09-05T13:08:25.955 INFO:teuthology.orchestra.run.smithi169.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-05T13:08:25.997 INFO:teuthology.orchestra.run.smithi162.stderr: 92.5% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mgr.y.log.gz 2024-09-05T13:08:26.018 INFO:teuthology.orchestra.run.smithi169.stderr: 92.7% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mgr.z.log.gz 2024-09-05T13:08:26.020 INFO:teuthology.orchestra.run.smithi169.stderr: 82.7% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-05T13:08:26.064 INFO:teuthology.orchestra.run.smithi169.stderr: 90.8% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-05T13:08:26.071 INFO:teuthology.orchestra.run.smithi162.stderr: 82.7% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-05T13:08:26.074 INFO:teuthology.orchestra.run.smithi162.stderr: 86.6% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.log.gz 2024-09-05T13:08:26.101 INFO:teuthology.orchestra.run.smithi162.stderr: 90.5% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-05T13:08:26.123 INFO:teuthology.orchestra.run.smithi162.stderr: 90.8% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-05T13:08:26.128 INFO:teuthology.orchestra.run.smithi073.stderr: 82.6% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-05T13:08:26.129 INFO:teuthology.orchestra.run.smithi073.stderr: 90.3% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-05T13:08:26.181 INFO:teuthology.orchestra.run.smithi073.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-05T13:08:26.205 INFO:teuthology.orchestra.run.smithi073.stderr: 90.9% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-05T13:08:26.206 INFO:teuthology.orchestra.run.smithi169.stderr: 86.6% 90.5% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.log.gz -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-05T13:08:26.206 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-05T13:08:26.593 INFO:teuthology.orchestra.run.smithi169.stderr: 95.6% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.c.log.gz 2024-09-05T13:08:27.021 INFO:teuthology.orchestra.run.smithi169.stderr: 95.0% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.i.log.gz 2024-09-05T13:08:27.210 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mon.c.log.gz 2024-09-05T13:08:27.307 INFO:teuthology.orchestra.run.smithi169.stderr: 95.1% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.f.log.gz 2024-09-05T13:08:27.321 INFO:teuthology.orchestra.run.smithi073.stderr: 90.3% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mgr.x.log.gz 2024-09-05T13:08:27.907 INFO:teuthology.orchestra.run.smithi162.stderr: 91.7% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mon.b.log.gz 2024-09-05T13:08:28.040 INFO:teuthology.orchestra.run.smithi162.stderr: 95.2% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.e.log.gz 2024-09-05T13:08:29.496 INFO:teuthology.orchestra.run.smithi073.stderr: 90.3% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mon.a.log.gz 2024-09-05T13:08:36.115 INFO:teuthology.orchestra.run.smithi162.stderr: 94.9% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.h.log.gz 2024-09-05T13:09:14.890 INFO:teuthology.orchestra.run.smithi162.stderr: 94.3% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-mds.b.log.gz 2024-09-05T13:09:54.126 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.8.log.gz 2024-09-05T13:10:49.261 INFO:teuthology.orchestra.run.smithi073.stderr: 91.5% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.9.log.gz 2024-09-05T13:11:06.780 INFO:teuthology.orchestra.run.smithi073.stderr: 91.4% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.0.log.gz 2024-09-05T13:11:21.671 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.5.log.gz 2024-09-05T13:11:41.700 INFO:teuthology.orchestra.run.smithi073.stderr: 91.5% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.6.log.gz 2024-09-05T13:12:13.688 INFO:teuthology.orchestra.run.smithi073.stderr: 91.4% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.3.log.gz 2024-09-05T13:12:13.688 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-05T13:12:13.688 INFO:teuthology.orchestra.run.smithi073.stderr:real 3m47.779s 2024-09-05T13:12:13.688 INFO:teuthology.orchestra.run.smithi073.stderr:user 4m55.150s 2024-09-05T13:12:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m10.483s 2024-09-05T13:12:24.214 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.2.log.gz 2024-09-05T13:12:28.499 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.11.log.gz 2024-09-05T13:12:28.503 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-05T13:12:28.503 INFO:teuthology.orchestra.run.smithi169.stderr:real 4m2.590s 2024-09-05T13:12:28.503 INFO:teuthology.orchestra.run.smithi169.stderr:user 5m6.450s 2024-09-05T13:12:28.503 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m11.423s 2024-09-05T13:16:33.344 INFO:teuthology.orchestra.run.smithi162.stderr: 91.4% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.7.log.gz 2024-09-05T13:16:41.836 INFO:teuthology.orchestra.run.smithi162.stderr: 91.6% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.10.log.gz 2024-09-05T13:17:45.829 INFO:teuthology.orchestra.run.smithi162.stderr: 91.7% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.4.log.gz 2024-09-05T13:17:48.587 INFO:teuthology.orchestra.run.smithi162.stderr: 91.4% -- replaced with /var/log/ceph/febf1dd4-6b84-11ef-bcd6-c7b262605968/ceph-osd.1.log.gz 2024-09-05T13:17:48.589 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-05T13:17:48.589 INFO:teuthology.orchestra.run.smithi162.stderr:real 9m22.675s 2024-09-05T13:17:48.589 INFO:teuthology.orchestra.run.smithi162.stderr:user 5m20.032s 2024-09-05T13:17:48.589 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m13.926s 2024-09-05T13:17:48.590 INFO:tasks.cephadm:Archiving logs... 2024-09-05T13:17:48.590 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462/remote/smithi073/log 2024-09-05T13:17:48.591 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T13:18:41.026 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462/remote/smithi162/log 2024-09-05T13:18:41.027 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T13:19:35.631 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462/remote/smithi169/log 2024-09-05T13:19:35.632 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T13:20:30.204 INFO:tasks.cephadm:Removing cluster... 2024-09-05T13:20:30.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 --force 2024-09-05T13:20:30.495 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T13:20:31.170 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 --force 2024-09-05T13:20:31.474 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T13:20:32.148 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid febf1dd4-6b84-11ef-bcd6-c7b262605968 --force 2024-09-05T13:20:32.355 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: febf1dd4-6b84-11ef-bcd6-c7b262605968 2024-09-05T13:20:32.985 INFO:tasks.cephadm:Removing cephadm ... 2024-09-05T13:20:32.985 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-05T13:20:33.006 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-05T13:20:33.025 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-05T13:20:33.042 INFO:tasks.cephadm:Teardown complete 2024-09-05T13:20:33.042 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-05T13:20:33.353 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-05T13:20:33.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T13:20:33.357 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T13:20:33.361 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T13:20:33.537 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-05T13:20:33.548 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-05T13:20:33.548 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T13:20:33.551 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T13:20:33.554 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T13:20:33.566 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-05T13:20:33.568 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-05T13:20:33.583 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T13:20:33.583 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-05T13:20:33.583 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 +381us[ +424us] +/- 49ms 2024-09-05T13:20:33.583 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -393us[ -351us] +/- 64ms 2024-09-05T13:20:33.583 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -38us[ -38us] +/- 71ms 2024-09-05T13:20:33.583 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T13:20:33.585 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-05T13:20:33.592 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T13:20:33.592 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-05T13:20:33.592 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +383us[ +398us] +/- 49ms 2024-09-05T13:20:33.592 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -399us[ -385us] +/- 64ms 2024-09-05T13:20:33.592 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -86us[ -72us] +/- 71ms 2024-09-05T13:20:33.592 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T13:20:33.598 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T13:20:33.599 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-05T13:20:33.599 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 +362us[ +363us] +/- 49ms 2024-09-05T13:20:33.599 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -400us[ -399us] +/- 64ms 2024-09-05T13:20:33.599 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -87us[ -86us] +/- 71ms 2024-09-05T13:20:33.599 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T13:20:33.600 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-05T13:20:33.609 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-05T13:20:33.610 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-05T13:20:33.653 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T13:20:33.788 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T13:20:33.905 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T13:20:34.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T13:20:34.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T13:20:34.048 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T13:20:34.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T13:20:34.082 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T13:20:34.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T13:20:34.111 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-05T13:20:34.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-05T13:20:34.152 INFO:teuthology.task.internal:Duration was 2328.098319 seconds 2024-09-05T13:20:34.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-05T13:20:34.183 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-05T13:20:34.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T13:20:34.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T13:20:34.191 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T13:20:34.255 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T13:20:34.258 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T13:20:34.272 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T13:20:34.657 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-05T13:20:34.657 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-05T13:20:34.657 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T13:20:34.692 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-05T13:20:34.692 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T13:20:34.725 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-09-05T13:20:34.725 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T13:20:34.759 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-05T13:20:34.759 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T13:20:34.766 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T13:20:34.768 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T13:20:34.827 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-05T13:20:34.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T13:20:34.840 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T13:20:34.842 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T13:20:35.571 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-05T13:20:35.584 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-05T13:20:35.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T13:20:35.629 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T13:20:35.676 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T13:20:35.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-05T13:20:35.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T13:20:35.733 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T13:20:35.736 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T13:20:35.764 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-05T13:20:35.772 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-05T13:20:35.789 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-09-05T13:20:35.820 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T13:20:35.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T13:20:35.841 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T13:20:35.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T13:20:35.857 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T13:20:35.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T13:20:35.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-05T13:20:35.886 INFO:teuthology.task.internal:Transferring archived files... 2024-09-05T13:20:35.887 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462/remote/smithi073 2024-09-05T13:20:35.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T13:20:35.936 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462/remote/smithi162 2024-09-05T13:20:35.937 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T13:20:35.975 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-05_11:20:21-fs:workload-wip-bharath6-testing-2024-09-05-1413-squid-testing-default-smithi/7890462/remote/smithi169 2024-09-05T13:20:35.976 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T13:20:36.017 INFO:teuthology.task.internal:Removing archive directory... 2024-09-05T13:20:36.017 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T13:20:36.020 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T13:20:36.022 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T13:20:36.068 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-05T13:20:36.086 INFO:teuthology.task.internal:Not uploading archives. 2024-09-05T13:20:36.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-05T13:20:36.098 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-05T13:20:36.098 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T13:20:36.101 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T13:20:36.103 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T13:20:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 13:20 /home/ubuntu/cephtest 2024-09-05T13:20:36.117 INFO:teuthology.orchestra.run.smithi162.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 13:20 /home/ubuntu/cephtest 2024-09-05T13:20:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 13:20 /home/ubuntu/cephtest 2024-09-05T13:20:36.132 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-05T13:20:36.146 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-05T13:20:36.220 INFO:teuthology.run:Summary data: description: fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} duration: 2328.0983188152313 flavor: default owner: scheduled_hyelloji@teuthology success: true 2024-09-05T13:20:36.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T13:20:36.308 INFO:teuthology.run:pass